Preserving Piano Playing Techniques through Contactless Sensor Fusion System

Application Why This Research? Novelty/ Features

Piano Technique Preservation

Piano pedagogy
Touchless sensing

Piano Technique Reproduction Technique Preservation

Sensor does not alter
piano playing
experience
Music Reproduction
Remote Finger Tracking
X-Y position tracking for
finger tracking and
sound dynamics sensing

How it Works?
E-Field

Electrode – Finger Sound Signal Data Storage

Capacitive Sensor Tracking Dynamics Processing and Display

Researcher: Choo Chee Wee

 ARTIFICIAL NEURAL NETWORK

Electrode
Sensing Area

Electrode Electrodes under the keyboard

ARTIFICIAL NEURAL NETWORK

Area of
deviation

Sensing
Area

Targeted
position

Deviation from
target
LIST OF PUBLICATIONS
Journals
1. Choo Chee Wee, Muralindran Mariappan, Resot Iggau, Brendan Khoo and Wong Wei Kitt (2016), Circuit Design and Development
of Contactless Sensor System for Finger Tracking in Piano Playing, Journal of Advanced Research in Applied Sciences and
Engineering Technology (ARASET) Special Issue: Artificial Intelligence and Robotics SCOPUS Indexed Volume 5, Issue No. 2. Dec
2016, pp 46 – 54 (ISSN 2462-1943).
2. Choo Chee Wee, Muralindran Mariappan, Razak Mohd Ali Lee, Resot Inggau and Wong Wei Kitt (2015), A Review and Design
Methodology of Preserving Piano Playing Techniques through Contactless Sensor Fusion System, Journal of Applied Sciences Research
(JASR) Volume 11(20), Special 2015, pp. 26-38 (ISSN: 1819-544X (Print), EISSN: 1816-157X (Online)
3. Choo Chee Wee, Muralindran Mariappan, Razak Mohd Ali Lee, Wong Wei Kitt and Jong Chia Sing (2017), Piano Playing
Techniques Preservation using Contactless Sensor Fusion System, Advance Science Letters - SCOPUS Indexed (Volume xx, Issue No.
x, pp. Accepted - Pending Publication ICCSE 2016 (69))
Conferences
1. Choo Chee Wee, Muralindran Mariappan, Resot Iggau, Brendan Khoo and Wong Wei Kitt (2016), Circuit Design and Development
of Contactless Sensor System for Finger tracking in Piano Playing, 1st International Conference on Advance Technology and Applied
Sciences (ICaTAS 2016) in Conjunction with Malaysia-Japan Joint International Conference (MJJIC 2016), Kuala Lumpur, Malaysia, 6-
7 September 2016
2. Choo Chee Wee, Muralindran Mariappan, Razak Mohd Ali Lee, Wong Wei Kitt and Jong Chia Sing (2016), Piano Playing
Techniques Preservation using Contactless Sensor Fusion System, International Conference on Computational Science and
Engineering (ICCSE 2016), Kota Kinabalu, Sabah, 28-30 November 2016
3. Choo Chee Wee, Muralindran Mariappan, Razak Mohd Ali Lee, Resot Inggau and Wong Wei Kitt, Preserving Piano Playing Techniques
through Contactless Sensor Fusion System: Current Trends and Design Methodology, 2nd International Conference On Material,
Mechatronics, Manufacturing and Mechanical Engineering (ICMMMM 2015), Kuching, Malaysia, 2-3 October 2015
4. Choo Chee Wee, Muralindran Mariappan and Wong Wei Kitt, Preserving Piano Playing Techniques through Contactless Sensor System:
Signal Processing and Data Training using Artificial Neural Network, 2017 IEEE International Conference on Automatic Control and
Intelligent Systems (I2CACIS 2017), Kota Kinabalu, Sabah, 21 October 2017 -Pending Publication