Move That Sound There

2012

  • Type: spatial interface design
  • Media: ASUS Xtion depth camera, g-Speak SDK (Oblong Industry), OpenFrameworks, headphone
  • Capacity: maximum 2 participants
  • Duration: varies
  • Dimension: varies
  • Acknowledgement: support and feedback from colleagues at Oblong Industries
  • Research abstract: The authors describe an artistic exploration of sound in space enabled by real-time computer vision algorithms that provide hand shape and 3D hand-tracking information.
  • Documentation: Fan, Y.Y., Minnen, D. Move That Sound There: Exploring Sound in Space via a Markerless Gestural Interface. Leonardo Music Journal 23: Sound Art, pp. 31-32, MIT Press, ISSN 0961-1215, 2013  [PDF]
  • More about Oblong's g-Speak and the gestural interface in the film "Minority Report" [Link]
@