Ego-Centric Body Motion Capture System

DFKI's Ego-Centric Body Motion Capture System demonstrates how full-body human movements can be captured from a first-person view, such as with a head-worn camera or VR headset. Unlike traditional motion capture systems that use many external cameras and markers, this method relies on compact, wearable sensors and smart algorithms to reconstruct body posture. 

In the demonstration, visitors see an interactive setup: they wear a headset or lightweight camera glasses and move through the room while a virtual avatar mirrors their body movements in real time. The system calculates joint positions and movement sequences from the camera's egocentric field of view, compensates for occlusions, and combines image data with additional sensor data (such as inertial sensors to ensure stable tracking. 

The Ego-Centric Body Motion Capture System tackles key challenges for future XR applications: natural interaction without full-body suits, portability outside labs, and efficient motion data for training, help, and remote presence. Developed with RICOH, this technology offers new possibilities for industry, rehab, sports, and teamwork in virtual environments.