Available

Available online
online at
at www.sciencedirect.com
www.sciencedirect.com

ScienceDirect
Available online at www.sciencedirect.com
Procedia
Procedia Computer
Computer Science
Science 00
00 (2022)
(2022) 000–000
000–000
www.elsevier.com/locate/procedia
www.elsevier.com/locate/procedia
ScienceDirect
Procedia Computer Science 216 (2023) 266–273

7th International Conference on Computer Science and Computational Intelligence 2022

Augmented reality android based: Education of modern and

traditional instruments
Doni Purnama Alamsyahaa*, Jeremy Marcel Parulianbb, Asti Herlianabb
aEntrepreneurship
Entrepreneurship Department,
Department, BINUS Business School
School Undergraduate
Undergraduate Program,
Program, Bina
Bina Nusantara
Nusantara University,
University, Jakarta
Jakarta 11480,
11480, Indonesia
Indonesia
a
BINUS Business
bb
Information
Information System
System Program,
Program, Universitas Adhirajasa Reswara
Universitas Adhirajasa Reswara Sanjaya,
Sanjaya, Bandung
Bandung 40291,
40291, Indonesia
Indonesia

Abstract
Abstract

Musical
Musical instruments
instruments in in Indonesia
Indonesia are
are divided
divided into
into two
two types,
types, namely
namely traditional
traditional musical
musical instruments
instruments andand modern
modern musical
musical
instruments,
instruments, which
which in in this
this study
study will
will be
be discussed
discussed with
with more
more than
than ten
ten musical
musical instruments.
instruments. Today,
Today, there
there are
are still
still many
many Indonesian
Indonesian
people
people who
who do do not
not know
know traditional
traditional musical
musical instruments
instruments and
and modern
modern musical
musical instruments
instruments duedue to
to lack
lack of
of knowledge
knowledge and and the
the lack
lack of
of
means to
means to provide
provide visual
visual access
access to
to both
both traditional
traditional and
and modern
modern musical
musical instruments.
instruments. TheThe purpose
purpose ofof this
this research
research is
is to
to help
help people
people
recognize traditional
recognize traditional musical
musical instruments
instruments andand modern
modern musical
musical instruments
instruments digitally
digitally easily.
easily. The
The method
method used
used inin this
this research
research isis the
the
Marker-Based AR
Marker-Based AR method,
method, because
because itit takes
takes aa marker
marker on
on each
each object
object toto display
display aa clear
clear object
object in
in the
the Augmented
Augmented Reality
Reality application
application
to find
to find information
information from from anan image
image directly.
directly. The
The results
results of
of this
this study
study are
are in
in the
the form
form of
of an
an Android-based
Android-based Augmented
Augmented Reality
Reality
application with
application with aa page
page display
display feature,
feature, displaying
displaying information
information onon 3D
3D objects
objects of
of traditional
traditional musical
musical instruments
instruments and
and modern
modern musical
musical
instruments with
instruments with writing
writing and
and sound,
sound, asas well
well as
as showing
showing how
how to
to use
use the
the application.
application.

© 2022
© 2023 The Authors. Published by Elsevier B.V.B.V.
© 2022 The
The Authors.
Authors. Published
Published by
by ELSEVIER
ELSEVIER B.V.
This is
This is an
an open
open access
access article
article under
under the
the CC BY-NC-ND
BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0)
This is an open access article under the CC CC BY-NC-ND license
license (https://creativecommons.org/licenses/by-nc-nd/4.0)
(https://creativecommons.org/licenses/by-nc-nd/4.0)
Peer-review under
Peer-review underresponsibility
responsibilityofofthethe scientific
scientific committee
committee of of 5th
the the 7th International Conference on Computer Science and
Peer-review under responsibility
Computational Intelligence 2022 of the scientific committee of the 5th International
International Conference
Conference on
on Computer
Computer Science
Science and
and
Computational
Computational Intelligence
Intelligence 2022
2022
Keywords: Augmented
Keywords: Augmented Reality,
Reality, Traditional
Traditional Instrument,
Instrument, Modern
Modern Instrument,
Instrument, Android
Android Based.
Based.

* Corresponding author
* Corresponding author
E-mail address:
E-mail doni.syah@binus.ac.id
address: doni.syah@binus.ac.id

1877-0509 ©
1877-0509 © 2022
2022 The
The Authors.
Authors. Published
Published by
by ELSEVIER
ELSEVIER B.V.
B.V.
This
This is
is an
an open
open access
access article
article under
under the
the CC
CC BY-NC-ND
BY-NC-ND license
license (https://creativecommons.org/licenses/by-nc-nd/4.0)
(https://creativecommons.org/licenses/by-nc-nd/4.0)
Peer-review
Peer-review under
under responsibility
responsibility of
of the
the scientific
scientific committee
committee of
of the
the 7th
7th International
International Conference
Conference on
on Computer
Computer Science
Science and
and
Computational
Computational Intelligence
Intelligence 2022
2022

1877-0509 © 2023 The Authors. Published by Elsevier B.V.

This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0)
Peer-review under responsibility of the scientific committee of the 7th International Conference on Computer Science and Computational
Intelligence 2022
10.1016/j.procs.2022.12.136
 Doni Purnama Alamsyah et al. / Procedia Computer Science 216 (2023) 266–273 267
Alamsyah et al / Procedia Computer Science 00 (2022) 000–000 261

1. Introduction

Musical instruments in Indonesia can be divided into several types including traditional musical instruments and
modern musical instruments (1–3). Musical instruments are usually used to accompany singing or an event that
requires music (4–6). Many Indonesians are interested in the art of musical instruments, so many companies or courses
open up learning to make music (7,8). Based on data on the number of music course businesses in Bandung and its
surroundings, since 2019 music courses have increased by 40% every year. One of the courses that also provides music
training services is the Doremi Music course. Doremi Music course is a course that provides traditional and modern
music training services located in Rancaekek, East Bandung Regency, with participants ranging from early childhood
to adults. Usually Doremi Music course participants need an introduction to musical instruments before deciding to
learn a musical instrument. However, the Doremi Music course currently does not have a complete introduction to the
types of musical instruments ranging from traditional musical instruments and modern musical instruments. Based on
these problems, we need a media that can help identify the types of musical instruments completely and look real
considering that nowadays it is not easy to find musical instruments in complete physical form (9,10). The proposed
solution to the problem in this study is the introduction of musical instruments using AR (augmented reality)
technology, based on several previous studies that have proven that AR technology provides the solutions needed for
similar problems such as the introduction of modern technology, musical instruments that bring up 3D objects
(2,11,12). which looks like real and makes it easier to recognize the musical instrument, namely traditional Lampung
musical instruments. In addition, AR technology has also been used for the recognition of batik clothes (13,14) and
produces objects that almost look real so that they are easier to recognize (12,15,16).
Based on the background exposure, this study proposes an Augmented reality-based application to introduce the
types of traditional and modern musical instruments with the Marker Based method where this method uses a marker
or a two-dimensional object marker that has a pattern that will be read by a computer through a camera that connected
to a computer. The device to identify the marker in this case is the QR Code for scan to mobile system (17,18). The
expected result in this research is a mobile-based application with the output in the form of a three-dimensional musical
instrument along with the sound issued by the device.

2. Method

The research method used in this study in general is a case study method which is divided into data collection and
software development (Augmented Reality). In general, the description of the methodology in this study is explained
through several stages. The data collection method used in this research is literature study, which is collecting
information from various sources related to research such as books and journals. Second, interviews were conducted
with Doremi Music Owner and Doremi Music Admin Staff to get an idea of the system that was running previously.
Meanwhile, for the system design stage in this study, the UML Use Case Diagram was used.

2.1. Software Development Method

The software development method in this research is the waterfall method. Starting with the analysis, where the
analysis is carried out by analyzing user and system requirements for this AR-based musical instrument recognition
application. The user needs are two users and a login page is needed, a musical instrument display page, a QR code
scan page and an admin page. The second stage is design, where design is the stage of making designs on the
introduction of musical instruments using Augmented reality technology regarding program architecture, style,
appearance and material requirements for programs, including:
1. The flowchart shows two workflows, namely the overall flow of the application system that will be created, and
also explains the form of interaction between the user and the system and explains the system flow in displaying
three-dimensional (3D) objects and 2-dimensional (2D) videos when the marker is detected by camera.
2. Navigation structure The navigation structure explains how the application system will work.
3. Storyboard Storyboard here explains how the storyline or description of each scene in the application will be
delivered in animated images.
268 Doni Purnama Alamsyah et al. / Procedia Computer Science 216 (2023) 266–273
262 Alamsyah et al / Procedia Computer Science 00 (2022) 000–000

The third stage of coding, this stage is the coding stage where the author uses the Java programming language to
create an AR-based mobile application for the introduction of musical instruments. The last stage is the testing stage,
which is carried out to ensure that the designed program does not experience errors. Black box testing is used in this
study.

2.2. Augmented Reality Marker Based Method

Marker-based tracking is AR that uses a two-dimensional object marker that has a pattern that the computer will
read via a webcam or camera connected to a computer, usually a black and white illustration with a bold black border
and white background. The computer will recognize the position and orientation of the marker and create a 3D virtual
world, namely points (0,0,0) and 3 axes, namely X, Y, and Z. The application of the Marker-based tracking method
requires library software, namely Arttoolkit. The software works by using video tracking to calculate real camera
positions and orientation patterns on marker paper in real time. Once the original camera position is known, the virtual
camera can be positioned at the same point and 3D objects can be drawn on the marker.
Augmented reality application for introducing musical instruments in a brochure. At the start of the program, the
reading of the markers in the brochure is read out by the camera and initialized according to the pattern. The application
will initialize 3D according to the pattern read out and mentioned above the marker. Then the app starts rendering the
3D object model over the markers on the brochure. This musical instrument as a virtual mockup was made with
Archicad 12 software. To make it, modeling is first carried out as the first stage of the process. The modeling process
is done by reading a 2-dimensional image of a musical instrument to produce a 3D object with a perspective view.

3. Result and Discussion

This application for introducing musical instruments at the Android-based Doremi Music course institution is a
system made in the form of android that can be used to help introduce musical instruments for participants who want
to take musical instrument courses at Doremi Music. The following are user requirements in this study.
1. Participant Pages:
A1. Participants can view musical instrument information.
A2. Participants can see 3D objects of musical instruments.
A3. Participants can hear the sound produced by musical instruments.
2. Admin Pages:
B1. Admin can manage participant data.
B2. Admin can manage musical instrument data.
B3. Admin can Login.
B4. Admin can Logout

3.1. UML Use case Diagram

The following is an illustration of the Use case Diagram of the application of introducing musical instruments on
Android-based Doremi Music using this Marker Based Method.
 Doni Purnama Alamsyah et al. / Procedia Computer Science 216 (2023) 266–273 269
Alamsyah et al / Procedia Computer Science 00 (2022) 000–000 263

Fig. 1. Usecase Diagram

3.2. Description of Use Case

Applications for recognizing musical instruments on AR-based Doremi Music Participants can view musical
instrument information and 3D objects of musical instruments described in described in Table 1 and Table 2. .
Applications for recognizing musical instruments on AR-based Doremi Music Participants can Hear the sound of
Musical Instruments described in Table 3. Application of musical instrument recognition on AR-based Doremi Music
Login is explained in Table 4 and musical instrument recognition application on AR-based Doremi Music Logout is
described in Table 5. Application of musical instrument recognition in Doremi Music Use case admin Doremi
Managing Musical Instrument and participants data is explained in Table 6 and Table 7.
Table 1. Description Use Case of Music Information
Use Case Name Participants Can View Musical Instrument Information
Requirements -
Goal View all musical instrument information
Pre-conditions -
Post-conditions Show all descriptions of musical instruments
Primary Actors Participants
Main Flow (Basic Path) Participants choose a musical instrument menu
Participants see the types and descriptions of musical instruments

Table 2. Description Use Case of 3D Object on Music

Use Case Name Participants Can See 3D Musical Instruments
Requirements -
Goal Seeing the 3D object of a musical instrument above the marker
Pre-conditions -
Post-conditions Tampil objek 3D alat musik diatas marker
Primary Actors Participants
Main Flow (Basic Path) Participants choose the scan menu
Participants point the camera at the marker
The system detects markers and patterns
3D object display system
264 Alamsyah et al / Procedia Computer Science 00 (2022) 000–000
270 Doni Purnama Alamsyah et al. / Procedia Computer Science 216 (2023) 266–273

Table 3. Description Use Case of Listen to Music

Use Case Name Listening to Musical Instruments
Requirements -
Goal Listening to Musical Instruments
Pre-conditions -
Post-conditions Participants Hear the sound of Musical Instruments
Primary Actors Participants
Main Flow (Basic Path) Participants choose the scan menu
Participants point the camera at the marker
The system detects markers and patterns
3D object display system
Participants select the volume menu
The system displays the sound of musical instruments

Table 4. Description Use Case of Admin (LogIn)

Use Case Name Doremi Admin Login
Requirements -
Goal Successfully login to the app
Pre-conditions Doremi admin has entered the appropriate username and password
Post-conditions Login to the app
Primary Actors Admin Doremi
Main Flow (Basic Path) Doremi admin enter username
Doremi admin enter password

Table 5. Description Use Case of Admin (LogOut)

Use Case Name Doremi Admin Logout
Requirements -
Goal Successfully exited the app
Pre-conditions Doremi admin presses the Logout button
Post-conditions Exit the app
Primary Actors Admin Doremi
Main Flow / Basic Path Doremi admin presses the Logout button
System issue session

Table 6. Description Use Case of Data Instruments and Participants

Use Case Name Doremi Admin Manages Musical Instrument Data
Requirements Login
Goal Add, Delete, Edit Musical Instrument Data
Pre-conditions Doremi admin selects the musical instrument menu
Post-conditions Musical instrument data added, deleted or updated
Primary Actors Admin Doremi
Main Flow (Basic Path) Doremi admin selects the musical instrument menu
Doremi admin chooses add action if you want to add
Doremi admin chooses delete action if you want to delete
Doremi admin chooses the edit menu if you want to make changes to the
data
System save changes

3.3. ERD (Entity Relationship Diagram)

Making applications for the introduction of musical instruments on Android-based Doremi Music, the author
creates a database called db_doremi. The following is the design of the Entity Relationship Diagram in making this
system described in Figure 2.
 Doni Purnama Alamsyah et al. / Procedia Computer Science 216 (2023) 266–273 271
Alamsyah et al / Procedia Computer Science 00 (2022) 000–000 265

Fig. 2. Entity Relationship Diagram

3.4. Logical Record Structure

Making applications for the introduction of musical instruments on Android-based Doremi Music, the author
creates a database called db_doremi. The following is the design of the Logical Record Structure in making this system
described in Figure 3.

Fig. 3. Logical Record Structure

This study describes the stages in making augmented reality to support android-based learning related to musical
instruments. The results of this study are useful in educating musical instruments in Indonesia to students more
visually. Previous research studies have explained that visual and interactive learning methods increase student
learning absorption. The findings of this study are the implementation of the previous theory, that the importance of
visualization through augmented reality in supporting the learning of modern and traditional musical instruments
instruments (1–3,19). Furthermore, the information contained in the results of this study for the education industry, that
technology support through augmented reality is needed to support the learning process.

3.5. User Interface

The result of the research on the introduction of traditional and modern musical instruments at the android-based
Doremi course institution this time is the appearance of the interface. The resulting interface is as follows:
1. Marker Analyze
272 Doni Purnama Alamsyah et al. / Procedia Computer Science 216 (2023) 266–273
266 Alamsyah et al / Procedia Computer Science 00 (2022) 000–000

The first user interface that used to read star the AR program was marker. This completeness is taken by providing
a QR code to the image of the musical instrument that will be used as image tracking. The home display is the
initial display of the Android program for the introduction of modern and traditional musical instruments which is
the basic application for its introduction

Fig. 4. Marker

2. User Interface
After the user selects the check button for musical instruments, a view will appear, see traditional musical
instruments and see modern musical instruments. The last interface in the Android application is the knowledge
display of musical instruments. The function of this display is to provide more knowledge about the selected
musical instrument (Figure 5).

Fig. 5. Home User Interface

4. Conclusion and Recommendation

Based on the results of the study, several conclusions were obtained, namely that Augmented Reality technology
is one method that is quite effective to be used as an introduction medium, especially the introduction of musical
instruments. With the introduction of musical instruments in the Doremi Music course, it can make it easier for
 Doni Purnama Alamsyah et al. / Procedia Computer Science 216 (2023) 266–273 273
Alamsyah et al / Procedia Computer Science 00 (2022) 000–000 267

prospective course participants to choose the type of musical instrument to be taken. The information provided for
prospective music course participants can be more detailed and complete with the introduction of this musical
instrument application. This augmented reality method can provide the best description of the types of musical
instruments, both traditional and modern, with the completeness of each existing musical instrument. This research is
still far from perfect because there are still research limitations, namely the study only discusses the augmented reality
method for musical instruments, there are still many other teaching aids in education that need to be conveyed. This
becomes a recommendation for further research to reveal materials or other sources of instruments. So that augmented
reality is able to become an important part in the delivery of knowledge.

References

[1] Lee K, Lee S. Augmented Reality in Education and Training Cite this paper. TechTrends. 2012;56(2):13–20.
[2] Indriani R, Sugiarto B, Purwanto A. Pembuatan Augmented Reality Tentang Pengenalan Hewan Untuk Anak Usia Dini Berbasis Android
Menggunakan Metode Image Tracking Vuforia. Seminar Nasional Teknologi Informasi dan Multimedia. 2016;73–8.
[3] Wu HK, Lee SWY, Chang HY, Liang JC. Current status, opportunities and challenges of augmented reality in education. Comput Educ.
2013;62:41–9.
[4] Wilson NC, Stokes D. Managing creativity and innovation. The challenge for cultural entrepreneurs. Journal of Small Business and Enterprise
Development. 2005;12(3):366–78.
[5] Othman NA, Alamsyah DP, Utomo SM. IT Infrastructure and Perceived Ease of Use to Increase E-Learning Adoption. In: 2022 International
Conference on Information Management and Technology (ICIMTech). 2022. p. 89–93.
[6] Alamsyah DP, Ramdhani Y, Arifin T, Febrilla F, Setiawan S. Prediction of Immunotherapy Success Rate: Particle Swarm Optimization
Approach. In: 2022 2nd International Conference on Intelligent Technologies (CONIT). 2022. p. 1–5.
[7] Hidayati KH, Nafiiyah NN. Aplikasi Alat Musik Tradisional Gamelan Jawa Berbasis Android. Jurnal Teknika. 2017;9(1):10.
[8] Nasution RA. Pembelajaran Seni Musik bagi Pengembangan Kognitif Anak Usia Dini. Jurnal Keguruan UIN Sumatera Utara. 2016;4:11–21.
[9] Indriana, Alamsyah DP, Othman NA. Toward an E-Learning Adoption: Student Perspectives. In: 2022 International Conference on ICT for
Smart Society (ICISS). 2022. p. 1–4.
[10] Othman NA, Alamsyah DP, Ratnapuri CI, Kurnianingrum D. The Perceived Ease of Use In Mobile Payment Support by Responsiveness,
Smartness and Mobility. J Theor Appl Inf Technol [Internet]. 2022;100(11):3696 – 3706.
[11] Achmad ZA, Ida R, Mustain M. A Virtual Ethnography Study: The Role of Cultural Radios in Campursari Music Proliferation in East Java.
ETNOSIA : Jurnal Etnografi Indonesia. 2020;5(2):221–37.
[12] Kesim M, Ozarslan Y. Augmented Reality in Education: Current Technologies and the Potential for Education. Procedia Soc Behav Sci.
2012;47(222):297–302.
[13] Eiris R, Gheisari M, Esmaeili B. Pars: Using augmented 360-degree panoramas of reality for construction safety training. Int J Environ Res
Public Health. 2018;15(11).
[14] Martin J, Bohuslava J, Igor H. Augmented reality in education 4.0. International Scientific and Technical Conference on Computer Sciences
and Information Technologies. 2018;1(September):231–6.
[15] Putri N, Aryanto R, Ratnapuri CI, Alamsyah DP. Development of Seasonal Product in Star-Up Business. In: Proceedings of the International
Conference on Industrial Engineering and Operations Management. Sao Paulo, Brazil: IEOM Society International; 2021. p. 1216–21.
[16] Alamsyah DP, Mazia L, Hakim L, Sukajie B, Noor CM, Solihat A. Utilization of Technology and Perceived Complexity. In: IEOM Society
International, editor. Proceedings of the International Conference on Industrial Engineering and Operations Management. Sao Paulo, Brazil;
2021. p. 1004–10.
[17] Susanti L, Alamsyah DP. Perceived Ease of Use as a Precursor of Mobile Payment E-Wallet. In: 2022 IEEE Zooming Innovation in Consumer
Technologies Conference (ZINC). 2022. p. 123–7.
[18] Susanti L, Alamsyah DP. Model of Relative Advantage on Mobile Payment: The Support of Responsiveness and Smartness. In: 2022
International Conference on ICT for Smart Society (ICISS). 2022. p. 1–5.
[19] Lee CH, Chiang H Sen, Hsiao KL. What drives stickiness in location-based AR games? An examination of flow and satisfaction. Telematics
and Informatics. 2018 Oct 1;35(7):1958–70.