Professional Documents
Culture Documents
and Charts
Chien-Hung Liu and Chuan-Kang Ting
Department of Computer Science and Information Engineeringand and
Advanced Institute of Manufacturing with High-tech Innovations
National Chung Cheng University
Chia-Yi 621, Taiwan
Email: {lch101p, ckting}@cs.ccu.edu.tw
Abstract—With the development of human science and tech- using music theory as the basis of music evaluation for
nology, applications of computer are more and more comprehen- GA to generate the dominant melody and accompaniments.
sive. Using artificial intelligence (AI) to drawing, thinking, and Although the music theory provides an objective measure
problem solving becomes a significant topic. Recently, research
on automatic composition using AI technology and especially for music evaluation, the weight of each rule is determined
evolutionary algorithms is blooming and has received promising by subjective personal experience. To solve this issue, the
results. A common issue at the current evolutionary composition present study further employs the information from music
systems is their requirement for subjective feedback of human charts to determine the weights for an objective evaluation.
sensation as evaluation criterion, which is vulnerable to the Through the music theory rules and weights, the proposed
fatigue and decreased sensitivity after long-time listening. This
paper proposes using music theory with the information from GA can generate music without depending upon subjective
music charts in the evaluation criterion to address this issue. personal experience. In addition, we adopt the musical forms
Specifically, we generate the weighted rules based on music to improve the structure of compositions. The homophony
theory for the fitness function. The weights are determined is made up with accompaniment of the main theme. This
according to the download numbers from music charts. These study conducts simulations to examine the performance of the
weights obtained can interpret the music style and render an
objective measure of compositions. Experimental results show proposed evolutionary composition system.
that the proposed method can effectively achieve satisfactory The remainder of this paper is organized as follows. Sec-
compositions. tion II reviews related work in evolutionary composition.
Index Terms—Evolutionary computation, automatic compo- Section III elucidates the proposed GA for composition. The
sition, music theory, fitness function, computational creativity, experimental results are presented in Section IV. Finally,
creative intelligence.
Section V gives the conclusions of this study.
I. I NTRODUCTION II. R ELATED W ORK
Computational creativity using computational intelligence In the light of its effectiveness in global search and opti-
and artificial intelligence technologies blooms in many fields, mization, evolutionary computation is widely used in com-
such as music, visual art, literature, architecture and industrial putational composition. McIntyre [2] first applied GA to
design. Particularly, automatic music composition receives generate four-part Baroque harmony. Laine and Kuuskankare
much attention in that music plays an important role in [3] adopted GA to find the music functions and estimate their
nowadays human life and entertainment. In composing music, parameters for generation of music. The music functions serve
many elements need to be considered, e.g., rhythm, melody, as a logical and general music expression. Pazos et al. [4]
texture, musical form, tone color and tonality. This variety used GA with the interaction of several musicians to build
gives the plenty of beautiful music; however, it also makes a model for creating rhythmic patterns. Further, Marques et
composition difficult. al. [5] generated and weighted the composition rules as a
Evolutionary algorithms have been utilized in automatic basis for distinguishing good and bad music. By analyzing the
composition in view of its successes in dealing with large- features of good songs, Towsey et al. [6] divided them into five
scale complex problems. Genetic algorithm (GA) is especially categories and utilized these features to evolve music by GA.
commonly used in the music composition and accompani- In addition, Schoenberger [7] analyzed works of many famous
ment systems due to its recognized capability in search and composers like Bach based on Western tonal theory. Khalifa
optimization. The GA-based composition systems ordinarily et al. [8] proposed adopting four motifs in composing music.
evaluate the generated compositions based on the interaction These motifs are evaluated according to some grammar rules.
with humans. Although this human feedback is of great use for Chen et al. [9], [10] presented the CFE framework considering
evaluation, it suffers from the fatigue and decreased sensitivity feedback as a key element in music composition.
after long-time listening, which makes this evaluation manner Some studies focus on automatic accompaniment. In addi-
very exhaustive and impractical. Liu and Ting [1] proposed tion to the dominant melody, accompaniment plays an impor-
978-1-4673-6010-4/13/$31.00 2013
c IEEE 63
tant role in music because good accompaniment can effectively
Initialization
Postprocessing
strengthen harmony, tighten the structure of tunes, and rein-
force the expression of music. Luo et al. [11] developed a real-
time accompaniment system for the sung voice. The system Population Termination Music Form
detects the pitches of the sung voice and accordingly creates
the score from the mixture of sung voice and accompaniment.
Experimental results show that this system is robust against Survivor Selection
noise and can provide good accompaniment for the sung Evolution Accompaniment
64 2013 IEEE Symposium on Computational Intelligence for Creativity and Affective Computing (CICAC)
Table II
S ONG NAME & DOWNLOAD NUMBER
2013 IEEE Symposium on Computational Intelligence for Creativity and Affective Computing (CICAC) 65
Table III
RULES OF FITNESS FUNCTION & WEIGHT
66 2013 IEEE Symposium on Computational Intelligence for Creativity and Affective Computing (CICAC)
,
' ILWQHVV
,
' ILWQHVV
,,
' ILWQHVV
,,
' ILWQHVV
,,,
' ,,,
'
,9
' ,9
'
9
' ILWQHVV
9
' ILWQHVV
,
' ,
'
,,
' ,,
'
,,,
' ,,,
'
,9
' ,9
'
9
' 9
'
Figure 4. Form 1-1 Figure 5. Form 1-2
2013 IEEE Symposium on Computational Intelligence for Creativity and Affective Computing (CICAC) 67
,
' ILWQHVV ILWQHVV
,
'
,,
' ILWQHVV ILWQHVV
,,
'
,,,
' ,,,
' ILWQHVV
,9
' ,9
' ILWQHVV
9
' ILWQHVV ILWQHVV
9
'
,
' ,
'
,,
' ILWQHVV ILWQHVV
,,
'
,,,
' ,,,
'
,9
' ,9
'
9
' 9
'
Figure 6. Form 1-3 Figure 7. Form 2
Table IV
PARAMETER SETTING OF GA
chord accompaniments are used to match the note density of
the melody and main accompaniment. Parameter Value
68 2013 IEEE Symposium on Computational Intelligence for Creativity and Affective Computing (CICAC)
V
b V V D V V V V V E ;V
V
V V; F F
V V+ V V+
F F V+ F
V+ b F F V; VV V V V;V +F
V V V;
^ VV V V V+V V+ V ¦
V
V;
5
;V V; F V ¦ V ;V F E ;V E VV VVVVV
b F
V+ V V V
V
V+
F
+
V
F V V V ¦ F E F V+ b V V V ;V V V+ V + V VVV
V VV V V
V
;V c V V V VV
V
V V V VVV V V V V V VVV V V V V V V V V V V V
9
;V V V E F V V; V
b F V; E ;V F F V+ V V+ V V E V; F E E F
V V
13 5
VV
b D E F V; E F ;V V E ;V F ;V F V V V V F ;V V; V; F F V;
V ;V V + F ;V V V F + V VVVV
V V V¦ b V V V V V VV V
V; VV
V
; V
b F V+ F F V+ V V V ¦ V+ F E
17
V; F V E V; F V
V+ F +
b D F E E ^ V V ^ V
V V V V+ V V ^
V
c V V V V V V
V V V VVV V V V V V VVV V V V V V V V V V V V V
Figure 8. Resultant composition from initialization V V
V V V V F V; VV
V V V V V V V V V V; F V V
9
V;
b V V V V+ F V V+ F F F V V+ ^ V V V V V V V V V ¦ V; b V V V V V V F V+ V V
5
VV E F+
VV VV VF V V V V V F V+ V ¦ ;V F F ;V
b
V; F F V; V ;V V + F V; V V F V+V V V V V V V b V V V+ V V V+
V V V V V
c ^ V ^ V ^ V V ^ V
V V V V; V V ^^ V V V ^^ V V V ^^ VV V ^^ V V V
9
V V V V V;
b F V V V F V+ V V V V V V V V V V F
V
V V 13
V V V V F V; V V V V V V V VVVV VV
F
V V V V V V V+ V V V
13
V V V; V
V V V V V V V VVVV VV b
b F V V V V ¦ V+ V+V V; V
V; V V V V^
b V V V V V V F V+ V F V V
V V V; V ¦
17
V V V V
VV VVVV VVV VV
b V V V V V VV V F V+ ^
c ^ V ^ V ^ V V V V
^^ V V V ^^ V V V ^^ VV V V V VV V V
Figure 9. Resultant composition from GA 17
V; F F V; V V V V
b V F V ;V V V V V
V ;V V + V F V+ ^
V V V
V. C ONCLUSIONS V
b F+
V V V V¦ V+ V V V+ F E V V V+ V V V V V
This study proposes an evolutionary composition system V V V+
based on music theory and charts. Specifically, we develop
a GA for composition and design its fitness function using c
V V V VV V V V V V VV V V V V V V V V V V V V VVV VV
V V V V V V
weighted rules based on music theory. In particular, this study
proposes using the information from music charts to determine
the weights of rules. The resultant proto-compositions are Figure 10. Resultant composition from GA with post-processing
further modified considering musical form and integrated with
accompaniment.
The proposed evolutionary composition has three major with music background, the resultant compositions sound
advantages. First, the stochastic property of GA produces harmonious and follow the sense of melody progress.
diversity in the generated melodies. Second, the evaluation Some tasks remain for future work. First, more music
is utterly objective and overcomes the drawbacks of human- theory rules should be considered. Second, the derivation of
assisted evaluation suffering from fatigue and preference. With weights can use the information from other music charts for
the proposed fitness function, one can further examine a song’s composition of different music genres.
score in terms of music theory. The weights obtained can ACKNOWLEDGMENT
represent the style of the songs and serve as the basis for an
objective evaluation of compositions. Third, the use of musical This work was supported by the Ministry of Education,
form makes the resultant compositions more structured. Taiwan.
Experimental results show that the proposed method can R EFERENCES
effectively achieve satisfactory compositions. Based on mu-
[1] C.-H. Liu and C.-K. Ting, “Polyphonic accompaniment using genetic
sic theory, the evolutionary composition avoids generating algorithm with music theory,” in Proceedings of the 2012 IEEE Congress
disharmony and noisy melodies. According to the audience on Evolutionary Computation, 2012.
2013 IEEE Symposium on Computational Intelligence for Creativity and Affective Computing (CICAC) 69
extension using genetic algorithms,” Educational Technology & Society,
vol. 4, no. 2, pp. 54–65, 2001.
[7] J. Schoenberger, “Genetic algorithms for musical composition with
19200
coherency through genotype,” Master’s thesis, College of William and
Mary, 2002.
19000 [8] Y. Khalifa, B. Khan, J. Begovic, A. Wisdom, and A. Wheeler, “Evolu-
Mean Best Fitness
70 2013 IEEE Symposium on Computational Intelligence for Creativity and Affective Computing (CICAC)