## DESIGN AND METHOD

The design and method of this research consist of the following steps:

- Literature review: This step involves reviewing and analyzing the relevant and
existing literature on sign language, mobile technology, augmented reality, machine
learning, and related topics, to identify and understand the concepts, theories,
models, methods, and best practices that can inform and support this research.
- System design: This step involves designing and prototyping the mobile
application, including the user interface, the functionality, the content, and the
architecture, using the principles and techniques of user-centered design, agile
development, and rapid prototyping.
- System implementation: This step involves implementing and testing the mobile
application, including the augmented reality interface, the machine learning model,
the sign language curriculum and content, and the system integration, using the
tools and frameworks of Android Studio, Unity, ARCore, TensorFlow Lite, and
Firebase.
- System evaluation: This step involves evaluating and improving the mobile
application, including the usability, effectiveness, and impact, using the methods
and instruments of user testing, questionnaire, interview, observation, and data
analysis.

## SIGNIFICANCE

The significance of this research is expected to be:

- Theoretical: This research will contribute to the body of knowledge on sign

language, mobile technology, augmented reality, machine learning, and related
topics, by providing new insights and findings that can enrich and extend the
existing literature and theories.
- Practical: This research will produce a mobile application that can help deaf and
hearing people to learn Indonesian sign language in an interactive and immersive
way, using augmented reality and machine learning. This mobile application will be
a useful and innovative tool that can improve the accessibility and quality of sign
language education and communication in Indonesia.
- Social: This research will benefit the deaf and hearing people in Indonesia, by
enhancing their linguistic and cultural diversity, promoting their social inclusion
and participation, and improving their personal and professional development and
opportunities.

## CONCLUSION

This research proposal has presented the research title, background, problem
statement, research goal, rationale, design and method, and significance of the
proposed research project, which aims to develop a mobile application that can help
deaf and hearing people to learn Indonesian sign language in an interactive and
immersive way, using augmented reality and machine learning. This research project
is expected to be completed in four years, from 2024 to 2028, and to produce a
valuable and innovative contribution to the field of sign language, mobile
technology, augmented reality, machine learning, and related topics, as well as to
the society of deaf and hearing people in Indonesia.

## BIBLIOGRAPHY

[1] A. K. M. N. Islam, M. Billah, M. A. Razzak, and M. M. Hassan, "Sign language

recognition using sensors-enabled glove: A comprehensive review," IEEE Access, vol.
7, pp. 100512-100531, 2019.
[2] A. S. Utami, A. A. S. Gunawan, and A. W. Pratama, "Indonesian sign language
recognition using convolutional neural network," in 2018 International Conference
on Information and Communications Technology (ICOIACT), 2018, pp. 649-654.

[3] D. C. Nguyen, S. Park, and S. W. Lee, "Finger spelling recognition using

convolutional neural networks and recurrent neural networks," in 2018 25th IEEE
International Conference on Image Processing (ICIP), 2018, pp. 2162-2166.

[4] E. Efthimiou, S.-E. Fotinea, T. Hanke, J. Glauert, R. Bowden, A. Braffort et

al., "Sign language technologies and resources of the dicta-sign project," in
Proceedings of the 5th Workshop on the Representation and Processing of Sign
Languages: Interactions between Corpus and Lexicon, 2012, pp. 37-44.

[5] F. Dominio, M. Donadeo, G. Marin, P. Zanuttigh, and G. M. Cortelazzo, "Hand

gesture recognition with depth data," in Proceedings of the 4th ACM