Tracking mouse from incomplete body-part observations and deep-learned deformable-mouse model motion-track constraint for behavior analysis:
the only thing about me is the way I walk (2024)
Königsweg 67
14163 Berlin
+49 30 838 61146
tierschutz@vetmed.fu-berlin.de
Abstract / Zusammenfassung
Tracking mouse body parts in video is often incomplete due to occlusions such that - e.g. - subsequent action and behavior analysis is impeded. In this conceptual work, videos from several perspectives are integrated via global exterior camera orientation; body part positions are estimated by 3D triangulation and bundle adjustment. Consistency of overall 3D track reconstruction is achieved by introduction of a 3D mouse model, deep-learned body part movements, and global motion-track smoothness constraint.
The resulting 3D body and body part track estimates are substantially more complete than the original single-frame-based body part detection, therefore, allowing improved animal behavior analysis.