Patrons, DJs, nightclub staff, and observation provided feedback as to how the systems were being used.Findings suggest that simple mappings, fast sonic response and visual feedback worked best. Users foundthe Wii Remotes very easy to manipulate, and the movement to sound relationship clear. The Optitrack camera's intention was more obscure because it lacked visual feedback. Some patrons did not engage withthe systems because the interaction required them to move too much. Initially, users were captivated bythe sounds they produced, most however, soon lost interest with the limited possibility of sound effects.
This paper suggested a method of combining music information retrieval, motion capture technologies andbody-music mapping to foster adhoc music making by patrons inside nightclubs. Patrons could makemusic through an Optitrack Infra-red camera and Wii remotes, while a Music Information Retrieval (MIR)software provided harmonic content by analyzing the DJ's music. The most challenging part consisted indeveloping tools that could be flexible to each nightclub's environment and stimulate user participation.Although proven robust, the Music Information Retrieval patch was only tested with western music andmight not be suitable for other styles. In his summary of the progress in the field of MIR, Downie ,argues that there is limited research non-western music.Works by Blaine & Perkins,  Tahiroglu & Erkut  and Feldmeier & Paradiso  with groupcomputer music making suggest that further work can be done on implementing group music expressiontools in public venues.Results encouraged more work on visual feedback, audio effects and passive systems for observers. Theysuggest that interactive events may become an attractive entertainment alternative in nightclubs and toolsare robust enough for DJs, musicians, club owners and researchers to apply and build upon. Mostimportantly, it seems that innovative ways of using new technologies are steadily overcoming barriers foradoption of interactive music and pushing the boundaries of participation in nightclubs.
Nightclubs are ideal multimedia places for user participation. But despite the n
ightclubs’ emphasis on
music, there has been little implementation of interactive music systems, and the ones that exist have side
stepped the current role of the DJ. This study’s results suggest that Motion Capture, Music Information
Retrieval, and Body-music Mapping can provide a practical alternative for computer music expression inNightclubs. However, further work is needed to extend and replicate these findings, and to develop socialtools for music making.
Kristian Nymoen for helping develop part of the computer vision tools, COST SID for partially fundingthe project, and fourMs lab (Oslo) for providing many of the materials.
1. Bayliss, A., S. Lock, and J.G. Sheridan.
Augmenting expectation in playful arena performanceswith ubiquitous intimate technologies
. 2005. Sheffield.2. Gates, C., S. Subramanian, and C. Gutwin,
DJs' perspectives on interaction and awareness innightclubs
Proceedings of the 6th conference on Designing Interactive systems
. 2006, ACM:University Park, PA, USA. p. 70-79.3. Bertini, G., M. Magrini, and L. Tarabella,
An Interactive Musical Exhibit Based on Infrared Sensors
Computer Music Modeling and Retrieval
, R. Kronland-Martinet, T. Voinier, and S.Ystad, Editors. 2006, Springer Berlin / Heidelberg. p. 92-100.4. Lee, E., T.M. Nakra, and J. Borchers,
You're the conductor: a realistic interactive conductingsystem for children
Proceedings of the 2004 conference on New interfaces for musicalexpression
. 2004, National University of Singapore: Hamamatsu, Shizuoka, Japan. p. 68-73.