The aim of MediHopps is the development of an intelligent full body holoportation for self-sufficient XR glasses. These record body postures and poses precisely and transfer them to digital avatars in the virtual world.
Medihopps
1
2
The intelligent assistance system classifies the detected movements and recognizes incorrectly performed exercises.
3
In this way, MediHopps creates an easily accessible, supervised, qualitatively controlled and location-independent rehabilitation sports training including positive group dynamic effects.
Principal Investigator
Dr. Dirk Werth
managing director and
scientific director
Short & to the point
What?
The MediHopps project is the first to implement full body holoportation for XR glasses, which enables precise tracking of the entire body in XR without the need for expensive external hardware. Wearing the multi-sensory glasses enables precise recording of body postures and movements and the transfer of these to digital avatars. An XR platform supports the collaborative execution of rehabilitation sports units through the qualitative support of a trainer. In combination with an AI-supported rehabilitation sports assistance system, rehabilitation exercises are classified with regard to correct exercise. The assessment is returned to users and trainers as real-time feedback. The aim of the development is to create a sensor-reduced modular XR group collaboration room for medically precise telerehabilitation. Due to their effectiveness, the project initially focuses on dynamic rehabilitation sports exercises in the fields of "mobilization" and "strengthening". However, the solution can be used for all exercises without equipment, e.g. also in stretching or balance exercises.
How?
The execution of rehabilitation sports units with appropriate XR sensors (integrated cameras, IMU sensors) collects training data for the implementation of the project and processes it. Existing XR glasses have several integrated, cleverly placed cameras that capture the entire front of the wearer's body in the field of view. Thus they are very well suited for the realization of a full body holoportation system. This data, consisting of movements and body poses, is used to train an artificial intelligence.
The evaluation of visual information (viewing angle, visible body parts), IMU information (acceleration, speed and angle information) and a time series analysis (change over defined time axes) enables body posture and movement to be derived. Based on the latest approaches of the 3D human body model, MediHopps is developing an essential innovation module of the holoportation system for anatomically correct and precise transfer of body postures and movements to 3D avatars. This innovation module enables a collaborative, virtual and controlled rehabilitation sport in XR training rooms. As a value-added service, a rapid content creation module offers the low-threshold creation of new virtual rehabilitation exercises by the trainer in the system.
Initial Situation
More and more people are suffering from chronic degenerative diseases and are dependent on continuous care. The supply bottlenecks in rural regions pose a particular challenge.
Due to demographic change, the need for medical rehabilitation sports is increasing both in aftercare and in prevention. People with restricted mobility often do not have the opportunity to take part in suitable offers, especially in peripheral areas.
Telemedicine Solutions
against supply bottlenecks
Sense of community
in the virtual training room
The August Wilhelm Scheer Institute is developing the following components:
Thanks to our expertise in the areas of artificial intelligence and multi-sensor technology, we take over Conception and development of artificial intelligence for full body holoportation as well as the classification and recognition of rehabilitation sports exercises. In addition, we define Requirements for the job to the necessary training data collected in the data collection and support the Organization and implementation of data collection.
PROMOTION NOTICE
The MediHopps project is funded by the Federal Ministry of Education and Research.
Funding code: 16SV9058
Running time: 01.08.2022 – 31.07.2025