Sonification of Gestures Using Specknets

Publication Type:

Conference Paper

Source:

SMC Conference 2007 (2007)

URL:

files/proceedings/2007/64.pdf

Abstract:

This paper introduces a novel approach to gesture recognition for interactive virtual instruments. The method is based on the tracking of body postures and movement which is achieved by a wireless network of Orient-2 specks strapped to parts of the body. This approach is in contrast to camera-based methods which require a degree of infrastructure support. This paper describes the rationale underlying the method of sonification from gestures, addressing issues such as disembodiment and virtuality. A working system is described together with the method for interpreting the gestures as sounds in the MaxMSP tool.