AHNE (Audio-Haptic Navigation Environment) is a three-dimensional user interface (3D UI) for manipulating virtual sound objects with natural gestures in a real environment. AHNE uses real-time motion tracking and custom-made glove controllers as input devices, and auditory and haptic feedback as the output. These videos present the underlying system and a possible use for the interface as a musical controller.
The user is tracked with a Kinect sensor using the OpenNI framework and OSCeleton. The user wears a glove that is embedded with sensors and a small vibration motor for the haptic feedback.
HEI Project 2011
SOPI Research Group
Title: AHNE – Audio-Haptic Navigation Environment