Aya: Body Tracking Interactive Game
Brain Hacking, Interaction Design
Collaborated with Danli Hu, Xianghan Ma and Yi Zhu, we developed an interactive game driven by brain and muscle tracking EEG data with OpenBCI sensors developed by OpenBCI lab. OpenBCI is an open source platform that develops bio-sensing hardware for brain computer interfacing. In OpenBCI: Brain Hacking Collaboration Lab, we used their arduino compatible biosensing boards to track EMG, ECG, and EEG signals from our physical body to control the game experience.
My role: User Experience Design / project development
The player controls the game interaction with their body movement tracked by OpenBCI muscle sensing board.
We connected the OpenBCI board with Processing to control the game interaction by tracking muscle data.
Below is the demo game that interacts with the wearer's body movement data (eyes and arms.)
OpenBCI CYTON Board to track muscle activities (Arduino) + Processing (Java)
The Ultracortex is an open-source, 3D-printable headset intended to work with any OpenBCI Board. It is capable of recording research-grade brain activity (EEG), muscle activity (EMG), and heart activity (ECG). We connected The Ultracortex Mark IV to our processing game to control our game by our muscle activity.