Professional Documents
Culture Documents
net/publication/221165001
CITATIONS READS
16 5,574
2 authors:
All content following this page was uploaded by Roberto Bresin on 19 May 2014.
188
Proceedings of the 2006 International Conference on New Interfaces for Musical Expression (NIME06), Paris, France
Another aspect to consider related to the mapping be- ping strategies suggested by Hunt et al. (in [12, 13, 14])
tween the record-moving gesture and the sound we hear, an overview of the existing mapping between gestures and
is clearly the sound source on the record itself. As stated, sound in scratching is presented here. The controller pa-
pitch changes and artifacts in the time domain will oc- rameters considered are record speed, sound source (on
cur in the interaction with the turntable. But these are the record), the needle’s placement in the sound groove,
not at all consistent for all sounds. For instance, short and on the mixer the use of crossfader, volume slider and
sounds of low frequency are hard to stretch out in order to tone control knobs. The audio output parameters consid-
manipulate them with the crossfader, while longer sounds ered are pitch (not necessarily in the meaning of discrete
easily allows virtuous use of crossfader. Some sounds are semitone steps), tone onsets and durations, and tone or
unfit for playing with pitch, such as the sound of a snare sound characteristic such as timbre and dynamics. Fig-
drum hit, while others such as a sample of James Brown ure 1 shows the relations between controller and audio
shouting ’aaayeah’, are perfect for that purpose. output parameters.
Not only the sounds on the record are important for
identifying the mapping. Even the silent parts before and 2.2.1 Timbre and dynamics
after each sound sample must be taken into account. If Timbre is determined by the sound source used, and the
the DJ starts to move the record before the needle reaches speed at which it is played back. In addition, the DJ can
the spot where the sound starts, the sound will start with control timbre to a certain degree using the tone control
a high pitch. If she starts the move when the needle is knobs, which is done for certain scratch techniques [9].
located within the sound, a sudden glissando effect can Dynamics, or sound level variation, is a very important
be heard. Likewise, if the DJ pulls the record back and factor for expressive playing in most musical instruments.
forth repeatedly over an entire short sound sample, we However, it is rarely found in scratching. Sound level is
will hear a succession of sharp tone onsets, while the same determined by the volume slider on the mixer, the sound
movements “inside” for instance the long James Brown source and the playback speed. The crossfader can not be
sample will generate a very different, more siren-like sound regarded as a controller for dynamics, as its fading curve is
gliding fast up and down in pitch. far too steep. The needle’s placement in the sound groove
Consequently, if the record on the turntable consisted can have a great effect on dynamics, as many sounds de-
of a long, unchanging sound, such as a synthesized tone crease in amplitude over time.
of constant pitch, the musician’s gesture in moving the Timbral and dynamical variations can also be achieved
record would be more audible and apparent. by choosing locations with different amount of wearing
The three most common gestures for moving the record on the record. In records where one sound is repeated
are to place the hand flat down with fingertips on the (e.g. for several minutes, as in [7]) the sound can be more
record and use the elbow to move; to hold the hand at an detoriated in some grooves than others, making the same
angle and use the wrist; and to hold the hand steady and sample sound different depending on where the needle is
only make small movements by using the finger joints. In located [11].
the first two cases, the hand and fingers are flexible and
can supplement the main gesture. 2.2.2 Pitch
Pitch is determined by the sound source and is adjusted
2.1.2 The audio mixer straightforwardly with the playback speed. Experienced
The audio mixer is placed between the turntable and DJs sometimes use the pitch adjustment slider on the
the loudspeaker, so the signal from the record is always turntable to “tune” the sound sample to the tonality of
going through the mixer. It has a number of controllers, the piece to which they are scratching. A large part of all
most important are the crossfader, a line/phono switch, a (scratched) tones have the same speed as, or close to, the
volume fader and one or more knobs for equalization (tone revolving turntable [10]. For many of the favored sounds
control). DJs use the crossfader much more than the other on the record, it is hard to hear a fundamental frequency.
mixer controllers. During recent years, the crossfader has Several samples, for instance the popular “Fresh” (a long
evolved from fading linearly between the two turntables in shhh sound, [8]), have a noise band with a broad maxi-
the DJ set-up to being a logarithmic fader with very steep mum, inducing the perception of some pitch.
fading curves that in practice is only an on-off switch for
sound. Traditionally, the line/phono switch was used for 2.2.3 Tone onsets and durations
turning the sound quickly and sharply on and off, but By tone onsets it is meant both the start of a tone and
today it is superseded by the crossfader, which is much the characteristics of its attack. Attack properties are
better suited to fast manipulations than the switch. controlled by record speed, sound placement and sound
The crossfader knob can be moved using different hand source. A slow push produces a slow rise in pitch and a
gestures, but two methods are dominant. The knob is “soft” attack, while a fast push produces a harder attack.
either pinched between the thumb and a finger and pushed A movement starting with the needle positioned inside a
the short distance on the fader that runs from silent to sample produces a softer attack than the same movement
sound, normally adjusted to 1-2 millimeters, or it can be starting before the sample starts. The sample of a snare
lightly hit with one or more fingers against the thumb drum hit as sound source will have a very different attack
which acts as a spring, bouncing the fader back. Either from a sample of a moaning soul singer.
way, the starting position can be both in the silent and the The rapid stream of tone attacks is a very noticeable
full sound area. The crossfader can be reversed so that the and distinguishing aspect of scratching. In a typical tech-
silent part can be on either the extreme right or the left nique with a duration a couple of tenths of a second, there
side of the fader run. can be as many as 6-9 tone attacks [10]. The most im-
portant controller for generating such rapid onsets is the
2.2 Current mapping in scratching crossfader, especially when the fingers bounce it against
By following principles for describing instrument map- the thumb. Also quick shifts in playback tempo from go-
189
Proceedings of the 2006 International Conference on New Interfaces for Musical Expression (NIME06), Paris, France
record
note characteristics sound sample
dynamics crossfader
/line switch mixer
volume slider
Figure 1: Mapping sound output parameters (left and right) to control parameters (middle) in a normal
instrument setup for scratching. Onset and pitch are undeniably the most crucial sound attributes, and
are placed to the right in the figure. Line thickness (from dashed to bold lines) represent the importance
of the connection. The bold boxes are considered to be the most essential control parameters: record
movement, sound sample properties and crossfader movement.
ing forward to going backward generates onsets. Certain for scratching with CDs, marketed in various designs by
techniques can produce more than 20 onsets a second only all leading manufacturers (e.g. Pioneer, Technics, Stanton,
using the record speed. A third control possibility is to Vestax and Denon). Common for this group of interfaces
use sound sources where short sounds are placed close to is that they do not offer new ideas for controllers nor new
each other, for instance a slow drum roll or hand-clapping. mapping possibilities.
One single gesture of moving the record over such samples DVD scratching is a similar concept to above mentioned
produces a multitude of tone attacks. scratch tools for digital media. Although few companies
The length of the sound sample influences the durations have marketed instruments for this, Pioneer being one ex-
of the tones which can be controlled by hand gestures on ception [17], it is a promising performance concept for VJs
the turntable. The crossfader can at any time shorten the (video DJs). Current version can treat the video image
duration by stopping the tone. It is often hard to sustain equivalently to sound by modulating the playback speed.
short samples for long, which is also still the weakest point The visuals introduce new output parameters for the inter-
of all the interfaces for scratching digital sound files. Even face, which parameters can be mapped to other controllers
long samples can be hard to sustain with a constant speed, than just the ’turntable’ gestures.
as the turntable’s tone arm obstructs and makes circular Mixxx by Andersen [1] is developed both as a set of
gestures problematic. performance tools and as a means of studying DJ perfor-
mances. Both mixer and turntable interfaces are replicas
2.3 New interfaces for scratching of the standard interfaces, but they also send MIDI mes-
New interfaces introduce new possibilities. Generally, sages. For performance, it enables to have a mapping layer
the common first feature is to give control over an addi- between the controller parameters and the audio output,
tional parameter, either in the sound itself or in processing so that they can be used for controlling new or existing
the sound [16]. With scratching, the first step has been sound properties. Mixxx also includes a new visual feed-
to reproduce the existing hardware (the turntable part) back technique in an augmented turntable, the Fisheye [2],
in software models and with alternative controllers, often a method for projecting a waveform image on the record.
realized as some type of a revolving wheel resembling the In the presented implementation, Mixxx is not addressing
turntable. This strategy is obviously in conflict with the DJ scratching specifically.
design principles lined up by Cook [6]. The pursuit to pro- Mixxx also includes a new visual feedback technique in
duce an acceptable virtual turntable has led to commer- an augmented turntable, the Fisheye[2], a method for pro-
cially available interfaces for controlling sound files that jecting a sound image on the record.
are quite good. Solutions for allowing control over ad- The D’Groove by Beamish et al. (in [5] and [4] intro-
ditional parameters, however, is still a rather unexplored duces haptics, induced by a force feedback motor, as a
field, and the big companies have not yet acknowledged feedback method in the turntable interface. This allows for
the potential. haptic ’visualization’ of the sounds on the record, which
In previous NIMEs and in related journals, and even in assists the DJ in for instance finding the sound sample
commercially available products, several new interfaces for ’borders’. In tests, experienced scratch DJs quickly start
DJs have been envisaged. This section of the paper gives to experiment with new techniques and performance ideas,
a short review of possible mapping strategies of a selection and learned to use the novel features that haptic feedback
of these interfaces with regards to the previous section. provided. Some new controllers were also implemented,
Of the many interfaces manipulating digitally stored but did not suggest new mapping layers or strategies, as
sounds, Final Scratch by Stanton has probably been most was the case with Mixxx.
accepted, using a time-coded vinyl record to control sound Skipproof [11] is a software tool for evaluating synthe-
files on a computer. Other such interfaces include devices sized scratch techniques, and also a scratch performance
190
Proceedings of the 2006 International Conference on New Interfaces for Musical Expression (NIME06), Paris, France
191