AHNE (Audio-Haptic Navigation Environment) is a three-dimensional user interface (3D UI) for manipulating virtual sound objects with natural gestures in a real environment. AHNE uses real-time motion tracking and custom-made glove controllers as input devices, and auditory and haptic feedback as the output. These videos present the underlying system and a possible use for the interface as a musical controller.
The user is tracked with a Kinect sensor using the OpenNI framework and OSCeleton. The user wears a glove that is embedded with sensors and a small vibration motor for the haptic feedback.
I created this while working as a research assistant at the SOPI Research Group at Aalto University.
HEI Project 2011 SOPI Research Group Aalto University