Jian Zhao

Assistant Professor at School of Computer Science, University of Waterloo

E-mail: jianzhao@uwaterloo.ca
Shaikh Shawon Arefin Shimon
Ph.D. Student at School of Computer Science, University of Waterloo
E-mail: ssarefin@uwaterloo.ca

Purpose
This study aims at collecting gesture location data around ear for identifying gesture preferences while
interacting with smart earbuds. New technologies allow us to know the hands around the earbuds.
We are exploring gesture location and shape preferences and shapes around the year to support new
gesture sensing capabilities with earbuds to enrich and blend human-computer interaction into
everyday tasks. In this study, you will wear a headband with markers and attach one marker index finger
of your non-dominant hand. These devices will be provided by the researcher. You will be asked to
perform gestures on specific areas around your non-dominant side with your non-dominant hand.
While performing the gestures, you will be sitting down in an area surrounded by cameras in front of a
computer. These cameras will be tracking your head and finger motion as you perform the gesture.
Gesture prompts will be provided on the screen of the computer.

The study is open to anyone being comfortable wearing a headband, and markers attached to fingers
on left hand. During the study, you will be asked to remove any jewelleries, to not interfere with the
camera-based trackers. However, you cannot participate if you wear medical implants (e.g., pacemaker)
or if you are allergic to Velcro, silicone, or nickel. Between the study, the headband and the markers
will be sanitized. There are no anticipated risks to take part in the study.

What you will be asked to do

You will be seated at a desk wearing headband and markers on your fingers on left hand. An application
on the computer will show you a gesture to perform around the ear (Mid-Air or On-Skin). You will repeat
this gesture multiple times. The gestures involved will be simple gestures such as Taps, Swipes and
Pinching.
Demographics such as age and earbud usage habits will be collected after the in-person study. In
between the study, questionnaires will be asked after every block of gestures. At any point during the
study, you will be able to take a break if needed.
The study should take approximately 75min. Participation in this study is voluntary and you may
withdraw from the study anytime without penalty by informing the researcher. You can request your
data to be removed from the study up until March 2024 as it is not possible to withdraw your data once
papers have been submitted to publishers.

Potential benefits of the study

Participation in this study may not provide any personal benefit to you. The time commitment is about
75 minutes. The study will benefit the academic community and society in general by contributing a
better understanding of human behaviors in earable interaction.

Confidentiality and Data Security

The survey will be conducted over qualtrix forms. When information is transmitted over the internet
privacy cannot be guaranteed. There is always a risk your responses may be intercepted by a third party
(e.g., government agencies, hackers). University of Waterloo researchers will not collect or use internet
protocol (IP) addresses or other information which could link your participation to your computer or
electronic device without first informing you.
The data will be stored with unique identifiers. Data will be retained on secure server in the School of
Computer Science at the University of Waterloo. All data will be stored for a minimum of 7 years. The
raw data from the sensors might be shared publicly and will be anonymized. No identification will be
shared or associated with the shared data. Your identity will be confidential. With permission,
anonymized quotations may be used in publications/presentations resulting from this research.

Safety
If one or more of the following conditions apply to you, please advise the researcher.
Medical Devices
The devices used in this study may generate radio waves that may interfere with the normal operation
of medical devices. You cannot participate in the study if you wear medical implants such as pacemaker
or cochlear implant due to this watch feature.
Allergies
The headstrap has a velcro strap and Markers contain Silicone. If you are allergic to Velcro or silicone,
the manufacturer recommends not wearing the watch. You cannot participate in the study if you are
allergic to Velcro or silicone.

Remuneration
Remuneration in the form of $[15] CAD will be given as an amazon gift card or e-transfer. If you begin
a session but do not complete, your participation in the study will end and you will be remunerated for
a pro-rated amount based on time spent in the experiment. Specifically, the time spent will be rounded
to the nearest completed 15 minutes (e.g., time = 15, 30, 45, …) and the remuneration total will be Time
/ 60 * $[15]. The remuneration will be taxable: it is your responsibility to report this amount for income
tax purpose.

Contact Information
If you have any questions about this study, or would like additional information to assist you in reaching
a decision about participation, please feel free to contact:

Shaikh Shawon Arefin Shimon

E-mail: ssarefin@uwaterloo.ca
OR
Faculty Supervisor,
Jian Zhao
E-mail: jianzhao@uwaterloo.ca
This study has been reviewed and received ethics clearance through a University of Waterloo Research
Ethics Board (ORE#44041). If you have questions for the Board, contact the Office of Research Ethics,
at 1-519-8884567 ext. 36005 or reb@uwaterloo.ca.
Thank you in advance for your interest in this project.

Yours sincerely,
Shaikh Shawon Arefin Shimon
 Consent Form
ORE#44041
By signing this consent form, you are not waiving your legal rights or releasing the investigator(s) or
involved institution(s) from their legal and professional responsibilities.

Project: Data collection for gesture recognition with wearables

I have read the information presented in the information letter about a study being conducted by
Shaikh Shawon Arefin Shimon, under the supervision of Dr. Jian Zhao. I have had the opportunity to
ask any questions related to this study, to receive satisfactory answers to my questions, and any
additional details I wanted.
This project has been reviewed by, and received ethics clearance through a University of Waterloo
Research Ethics Board (ORE#44041). I was informed that if I have any comments or concerns resulting
from my participation in this study, I may contact the Office of Research Ethics at (519) 888-4567 ext.
36005 or reb@uwaterloo.ca.

 I agree to participate this study.

 I am aware that my interactions with the study systems will be logged.
 I agree to allow logs of my interactions to be used in teaching, scientific
presentations and/or publications.
 I agree to allow my interaction with the system to be video and audio
recorded for analysis.
 I agree to allow my interview session to be audio recorded to ensure accurate
transcription and analysis.
 I agree to allow my video and audio clips to be used in teaching, scientific
presentations and/or publications with the understanding that my face (if
appear in the video) will be blocked and my pitch and tone will be changed.
 I agree to the use of anonymous quotations in any presentation or publication
that comes from this research.

Muzamil Hafeez
Participant Name: ________________________________+_____________________
7/27/2023
Date: ________________________