'LevelOne' Motion Tracking Game
Group Project for CS147: Intro to Human Computer Interaction Design. Fitness game that uses a Kinect v2 to track how well players perform an exercise routine. I was responsible for creating the computer vision model and writing the code to use the Kinect's readings, as well as designing the UI.
'LevelOne' Motion Tracking Game
Group Project for CS147: Intro to Human Computer Interaction Design. Fitness game that uses a Kinect v2 to track how well players perform an exercise routine. I was responsible for creating the computer vision model and writing the code to use the Kinect's readings, as well as designing the UI.
September - December 2017
Team Project at Stanford
About The Project:
Technology & Mediums:
C#, Electron, Adobe Illustrator
LevelOne is an Xbox Kinect game I completed as part of a 4 member team for the class CS147: Introduction to Human Computer Interaction Design at Stanford. The game's goal was to create a fitness app that encourages users who either have difficulty feeling motivated to exercise or feel intimidated by exercising because they don't know how to do it well to exercise consistently.
To do this we made a game where the user gains points and levels up by completing workout challenges against a friend or the computer. The user can also track their progress and learn new exercises through the game. We decided to use a Kinect v2 to track the user's movement so that they could receive points for doing a workout in real time and also get feedback on their form if they are doing an exercise incorrectly. The user interface was implemented in Electron and the Kinect software was implemented in C# using the Kinect for Windows SDK.
I designed the user interface and implemented the software that controls the Kinect.
Technology & Mediums:
September - December 2017
PROCESS:
User Interface Design
My contribution to the first half of this project was designing the user interface. We wanted the game to be approachable for users with little experience working out and also make the user feel like they were making visible progress each time they worked out. Therefore, I opted to go with a cartoonish style for the game and used climbing mountains as a visual metaphor for reaching exercise goals.
I created characters, backgrounds, objects and static parts of the screen in Adobe Illustrator. I also created a mock-up in MarvelApp as reference for my team member who was implementing the user interface. While designing I had to consider the fact that this game would be played with an Xbox controller and that the user would be exercising a couple paces back from the screen.
XBox Kinect Based Motion Tracking
My contribution to the second half of the project was creating a program in C# that could use the Kinect to track a user's movements and inform the frontend of the user's progress in an exercise.
I recorded my teammates and myself doing squats and jumping jacks with the Kinect. Then I used the Kinect for Windows SDK to tag the videos and create a database capable of recognizing squats and jumping jacks based on the location of someone's joints.
I imported the database into my program to use it to analyse recordings from the Kinect in real time and output the users progress in an exercise as a float. A python script was used to send the information to the frontend.