Metropolia UAS

GameRAT

Gamified Joint Rehabilitation, Analysis and Training

Helsinki XR Center

Helsinki XR Center is a developer center for extended reality and adjacent technologies. We conduct research nationally and internationally, support early-stage startup teams and showcase the Finnish and European ecosystem around these technologies. We operate under Metropolia’s research, development and innovation services and have extensive experience on researching and developing solutions with XR technologies. We are also part of FAIR European Digital Innovation Hub.

Project Objective

GameRAT aims to create new services for rehabilitation, for both professionals and patients. We will innovate on gamified XR content, and develop web tools for professionals to remotely create exercises and follow user’s progress. In the project, we will analyze different tracking methods to find the most suitable solutions for rehabilitation. The project will utilize AI to predict user movement, and to analyze the activity of the user, to offer accurate data to professionals remotely.

Context

Project started with building web tools for professionals to set up rehabilitation procedures and define new excercises. With the tools, we can move different joints as needed and define key poses in the exercise, and finally generate the animation between them to offer playback to the professional.

We built a puppet with realistic joint movement, which can be used with the web tools to define the exercises, but also on the feedback side to replay the movements of the user doing the rehabilition in XR.

On the XR side, we are designing a range of different gamified content, which can be modified based on the exercises. For example, in the Potion Maker, we will define the location of the ingredients on the shelf based on the movements required by the exercise.

Project Goals

Our project aims to combine the best practices in three fields of virtual reality applications, and test out different input and analysis methods for VR limb rehabilitation to find out the most suitable solution, that’s effective but easy to use by both doctors and patients. Our main results of the project are intuitive web tools for professionals, gamified adaptive XR solutions for patients, and analysis of different tracking methods. From these, we will separate modular code packages, which will be released as open source for the EMIL network to utilize.