Project led and overseen by Dr. Fei Hu. Epic Games' Unreal Engine 5 was used as the centerpiece of a system allowing a rehabilitation doctor and their patient to interface over the internet. The doctor wears an AR headset, the patient wears a VR headset. The patient is on a treadmill with Kinect motion sensors surrounding them. 

The patient is placed into a world and is able to walk around using the treadmill, which reacts to the terrain changes the resistance of the treadmill accordingly. The doctor is able to adjust the speed and resistance of the patient's treadmill, and can monitor the patient's movements are projected onto a 3D representation of them that can be moved, rotated, and scaled. The model is animated via the Kinect's motion data.

My roles within this project were to pair the VR headset and establish its' interoperability with Unreal, program the in-game movement system to send and receive data between the patient's computer and the treadmill and react to the changing slopes of the environment, and to clean up the patient's 3D model and texture data into a usable and comprehensible model.

More Info