Professional Documents
Culture Documents
Falk Morawitz
University of Manchester,
Oxford Road,
Manchester, M13 9PL, United Kingdom
falk.morawitz@manchester.ac.uk
ABSTRACT
1.1. An introduction to NMR spectroscopy
Nuclear magnetic resonance (NMR) spectroscopy is an
analytical tool to determine the structure of chemical Nuclear magnetic resonance (NMR) spectroscopy examines
compounds. Unlike other spectroscopic methods, signals the resonance frequencies of magnetic nuclei observable
recorded using NMR spectrometers are frequently in a range under strong magnetic fields. Subjected to a magnetic field,
of zero to 20000 Hz, making direct playback possible. As each type of magnetic nucleus resonates at a characteristic
each type of molecule has, based on its structural features, frequency, its resonance frequency. Nuclei will derivate from
distinct and predictable features in its NMR spectra, NMR this resonance frequency, depending on the other nuclei it is
data sonification can be used to create auditory ‘fingerprints’ bound to. This derivation is known as chemical shift and is
of molecules. This paper describes the methodology of NMR typically recorded relative to the resonance frequency in parts
data sonification of the nuclei nitrogen, phosphorous, and per million (ppm). Depending on the chemical compound’s
oxygen and analyses the sonification products of DNA and structure, the resonance of a nucleus can split further into
protein NMR data. The paper introduces On the Extinction of sets of resonances (figure 1), so-called splitting patterns. The
a Species, an acousmatic music composition combining resonance frequencies of a chemical compound, their
NMR data sonification and voice narration. Ideas developed chemical shift, and its resonance splitting patterns are highly
in electroacoustic composition, such as acousmatic indicative of a compound’s chemical structure, making NMR
storytelling and sound-based narration are presented and spectroscopy one of the most valuable and most used tools in
investigated for their use in sonification-based creative organic chemistry structure elucidation and validation.
works.
1. INTRODUCTION
(1)
resonances when examined via NMR spectroscopy. 17O 3.1. Acousmatic storytelling, narration, and sonification
NMR is used comparatively little due to the low natural
abundance of oxygen-17 and its fast FID decay time of only Acousmatic storytelling is defined by Amelides as a
20 milliseconds, leading to broad NMR peaks. It is, however, combination of an acousmatic sound world with a voice
useful for examining biochemical systems as well for the narration [30]. The aim of music pieces based on acousmatic
investigation of structural and dynamic features of organic storytelling is not the exploration of sound transformations in
and metal-organic compounds [18]. Sonification of 17O space and time, as it is usual for acousmatic compositions,
NMR data predominantly yields noise-based textures with but the creation of a narrated sound world ‘closer to human
broad peaks occupying frequency ranges of zero to 4 kHz for experience’ [30], to contextualize and present cultural
esters and hydroxyl groups and between 13 and 15 kHz for information and human experiences [30]. Examples of
carboxylic functional groups. acousmatic storytelling are, H. Westernkamp’s Kit’s Beach
Soundwalk or L. Ferrari’s Far-West News. By combining
2.4. Data Sources abstract and referential sounds with a spoken narrative,
Amelides argues, acousmatic storytelling can be utilized as a
The Biological Magnetic Resonance Data Bank [16] contains vehicle for historical presentation [30], as a way to transform
more than 9000 freely accessible 15N spectra of proteins, private meaning into public meaning [31] or to present a
peptides, DNA and RNA, as well as 125 phosphorous-31 personalised story.
datasets of DNA and RNA structures. The web database The narrator in an acousmatic piece can take many forms,
nmrshiftdb2 contains approximately 100 nitrogen-15 and 50 from passive omniscient observers to real or fictional
phosphorous-31 spectra of small molecules [19]. The Wiley characters, recounting (or trying to remember) first-hand
NMR collection contains 7500 spectra for nitrogen-15, experiences [32]. Voice narration arcs are often created from
21000 datasets for phosphorous-31 and more than 5500 assembling pieces of recorded interviews and can combine
entries for oxygen-17 [20], however, these data are not freely multiple different points of view (e.g. the same moments
available. No free prediction or simulation software for 14N, recounted by a son and his mother) to form a full narrative.
15N, 31P or 17O spectra exist, however, the necessary The reoccurrence of narrators can, in those cases, act as
functionality is included in analysis software, such as leitmotifs [33]. Other sound materials used in acousmatic
ACD/Spectrus Processor [21] or NMRPredict [22], both storytelling are predominately field recordings, archival
offering free trial periods. 15N NMR spectra for proteins can sound material and cultural sound icons (e.g. musical
be predicted via [23]. quotations of national anthems or the sound of church bells)
[30], each being able to create their own independent non-
3. NMR SONIFICATION IN ACOUSMATIC MUSIC vocal narratives [34].
COMPOSITION The combination of voice narration, field recordings, abstract
sound and their subsequent transformation in time creates a
Acousmatic music is a form of electroacoustic music that is multilayered story. It falls to the listener to combine the
presented using loudspeakers only. Acousmatic composition parallel streams of narration to create a multifaceted
focuses on the gestural, textural, and spatial development of representation of events described in the acousmatic piece. A
sound material [24], exploring sound creation and process that engages the listener to interact with the
structuring processes beyond harmony, pitch, or meter acousmatic piece more closely. Amelides argues that as
[25][26]. acousmatic storytelling is less abstract than pure acousmatic
A number of acousmatic compositions based on NMR data composition, a wider audience is reached [30].
have been composed [12]. In these compositions, NMR data Principles of acousmatic composition have been proposed as
have been used for purely aesthetic purposes, to create and guidance to increase the communicative and aesthetic
experiment with these data-based timbres and their impact on properties of sonification work [35][36]. Acousmatic
compositional procedures. NMR data have also been storytelling, with its focus on the contextualisation of
implemented as auditory information on molecular states for information, the creation of shared stories and the use of
3D molecular representations in virtual reality [13]. One of acousmatic sound material to support information delivery,
the biggest challenges for the deployment of NMR data can be a valuable contribution to the discourse on
sonification in music and sound art is the abstract nature of sonification aesthetics. On the Extinction of a Species,
NMR data [13], making it hard for the audience to link the described in the following section, is an exploration of such a
sounds heard to the underlying data. However, this link combination of acousmatic storytelling and sonification.
between data and sonification-based sound material is
important for art and music-based works, as it has been noted
for various art installations that the audience gains a deeper 3.2. On the Extinction of a Species
appreciation of the artwork when the link between data and
audio-visual spectacle is clear [27]. In those cases, the On the Extinction of a Species [37] is a 23-minute, 7.1
audience can perceive science-based installations as “science channel, acousmatic composition that combines voice
and not art” [28] resulting in a shift in interaction and narration, field recordings, analog synthesis and sound
appreciation depending on the individual’s preconceived material created from the sonification of NMR data. The
notions of science [29]. Various pieces based on NMR-data structure of the piece follows events surrounding the demise
have tried to supply the missing information in a variety of and potential resurrection of the passenger pigeon (table 1
formats, including program notes, videos, workshops, talks, and figure 8).
or interactive environments [12]. Another possibility, The first section of the piece depicts a time where billions of
discussed in the following section, is the supply of necessary pigeons roamed North America, using the sound of pigeons
information via a hybrid drama of oral narration and taking flight and pigeon calls as cultural sound icons
acousmatic composition. complimented by a stable harmonic sound texture.
The 25th International Conference on Auditory Display (ICAD 2019) 23–27 June 2019, Northumbria University
Figure 8: Structure of On the Extinction of a Species and its relation to referenced events. Sound material is abbreviated as
follows: V – voice narration, Bird – sound of pigeon calls and birds taking flight, Harmonic Texture – Tonal music texture
employed in section 1, T2 – noise-based sound texture, FR – field recording, DNA – sound material based on the sonification of
DNA sequences of the passenger pigeon. Sound materials with the index (t) are sounds that were transformed based on the sound
source indicated, e.g. V(t) is sound material created by the transformation of sound type V. Graphic adopted from [12].
Section 1 2 3 4 5
Time in piece 0 – 6 min 6 – 9 min 9 – 12 min 12 – 16 min 16 – 23 min
Time referenced 1000 – 1800 AD 1800 – 1950 AD 1950 AD – now near future far future
Ongoing
The industrial
Billions of industrialisation Project ‘Revive Digital resurrection
revolution and the
Events pigeons roaming in a world and Restore’: and digital
extermination of
referenced free in North without the analysis of the preservation of the
the passenger
America passenger pigeon’s genome passenger pigeon
pigeon
pigeon
AI proclaims its AI allocates more and
desires to more resources to the
AI describes the
AI introduces resurrect the resurrection of the
Narration extermination of
itself and its - pigeon, by pigeon, until its main
content the passenger
purpose starting to functions, including
pigeon
sequence the its voice interface,
pigeon’s genome break down.
Field recordings - - City recordings - -
Pigeon calls,
sounds of birds
taking flight,
Rain hitting a
sounds of Processed bird Transformations of
concrete floor as
Cultural sound songbirds, with calls with strong the AI’s voice to bird
well as the -
icons more obvious glitch-type calls and reverse
sound of cars
sound elements transformations.
and trains
transformations
towards the end of
the section
Noise-based
sound texture Heavily NMR data Transformed sound
Abstract sound Harmonic sound
derived from processed bird sonification of material based on
material textures
trains and other calls DNA sequences DNA sequences
heavy machinery
Table 1: Structure of On the Extinction of a Species, including the main sound elements used to create multilayered narrations.
Section 2 guides the listener through the industrial revolution conclusion re-introducing and transforming sound material
and the extinction of the species in the late 18th century, from the previous sections.
using abstract noise-based sound textures reminiscent of an The piece is narrated by a fictional character, an artificial
industrial landscape. Section 3 represents the ‘now time’, a intelligence which is tasked with the retrieval, storage, and
bleak field recording of a noisy city soundscape. The fourth presentation of all data relating to extinct species. It
section of the piece envisions a future for the pigeon where addresses the audience directly and recounts the life of the
its DNA is restored from preserved samples using genome passenger pigeon accompanied by the sound material
sequencing, inspired by the real-world endeavors of ‘Revive previously described. In section 4, a key section of the piece,
and Restore’ [38]. The fifth section sees the story to its the AI decides to sequence the genome of the passenger
pigeon from incomplete DNA data to create a virtual
The 25th International Conference on Auditory Display (ICAD 2019) 23–27 June 2019, Northumbria University
[21] https://webstore.acdlabs.com/software-solutions/acd-
spectrus-processor [Accessed 29 March 2019].
[22] http://mestrelab.com/software/mnova/nmr-predict/
[Accessed 29 March 2019].
[37] https://soundcloud.com/falk-morawitz/on-the-extinction-
of-a-species-stereo-version [Accessed 29 March 2019].