Academic Research Topics in

Human-Computer Interaction


Internet of Things

Perspective on 
 Social Media

Smart Appliances / Home
Cloud Compu:ng
Interface
 Web Usability
 Augmented Reality
Intelligent User Experience Engineering Word Processor Email
User-generated

Content
Virtual Reality
Persuasive Technology
Mobile Compu:ng
What’s 

Sunu Wibirama
 next? Intelligent User Interfaces
sunu@ugm.ac.id Natural User Interfaces
1980s 1990s 2000s
Department of Electrical Engineering

and Information Technology

Faculty of Engineering 

Universitas Gadjah Mada 

INDONESIA

SW | Perspective on Intelligent User Experience Engineering SW | Perspective on Intelligent User Experience Engineering
Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama

Locally Rooted, Globally Respected www.ugm.ac.id Locally Rooted, Globally Respected www.ugm.ac.id
1 2

Intelligent User Experience Engineering

Human-centered design
Image Processing
 Information 

Computer Vision Engineering

Signal Processing Components

Artificial 

Human Factors

Intelligence

Components Intelligent
 Components
UX Engineering

User Experience (UX) 


Machine Learning

Interface Design
Deep Learning
Applied Psychology

SW | Perspective on Intelligent User Experience Engineering SW | Perspective on Intelligent User Experience Engineering
Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama

Locally Rooted, Globally Respected www.ugm.ac.id Locally Rooted, Globally Respected www.ugm.ac.id
3 4
 Where to start? Premiere Academic Conference (1)
https://chi2020.acm.org

Special Interest Group of 


Computer-Human Interaction

SW | Perspective on Intelligent User Experience Engineering SW | Perspective on Intelligent User Experience Engineering
Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama

Locally Rooted, Globally Respected www.ugm.ac.id Locally Rooted, Globally Respected www.ugm.ac.id
5 6

Premiere Academic Conference (2)

More information: https://etra.acm.org

What kind of research


that I am doing now?

SW | Perspective on Intelligent User Experience Engineering SW | Perspective on Intelligent User Experience Engineering
Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama

Locally Rooted, Globally Respected www.ugm.ac.id Locally Rooted, Globally Respected www.ugm.ac.id
7 8
 Introduction to Eye Tracking Technology
How an eye tracker works
1
The illuminators create
near-infrared illumination
towards the eyes

2 The camera takes high-

resolution images of the
user’s eyes

Pupil

3 Image processing
algorithm is used to find Corneal 

specific details in the
user’s eyes for defining reflection
gaze points (where the
user is looking at)

Pupil Center Corneal Reflection 


SW | Perspective on Intelligent User Experience Engineering SW | Perspective on Intelligent User Experience Engineering technique
Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama

Locally Rooted, Globally Respected www.ugm.ac.id Locally Rooted, Globally Respected www.ugm.ac.id
9 10

Eye Movements and Interactive Applications Implementation: Gazethru (2019)

1 2
saccade
fixation

Fixation-based application

smooth
pursuit

SW | Perspective on Intelligent User Experience Engineering SW | Perspective on Intelligent User Experience Engineering A user triggers a content by looking at 

Smooth pursuit-based application Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama
Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama the moving button
Locally Rooted, Globally Respected www.ugm.ac.id Locally Rooted, Globally Respected www.ugm.ac.id
11 12
 Future works (1) Future works (2)
Robust event detection and object selection techniques
 We are using special sensor
for smooth pursuit-based interactive application (Tobii eye tracker)
to conduct eye tracking. 

Event Detection Signal Denoising Tobii eye tracker uses IR
Raw Object camera

*to classify eye
Data movement types *without filter Selection
In future, we want to use 

Moving Average Filter Smoothened
Noisy gaze Hidden Markov
 Noisy gaze gaze position an ordinary webcam to perform
position Model position Kalman Filter signal Euclidean eye tracking and to build a
signal signal Distance smooth pursuit-based
Machine Learning Naive Segmented
 interactive application.
Primary 
 PPMC
Linear Regression
Data All types of
Only Exponential Moving Only
Mahalano-

This leads to challenging
Deep Learning particular bis Distance
eye
types of eye Average particular computer vision problems open
movements: types of eye
-fixation
movements
movements Other 
 for research.

e.g.: Other types 

-saccade e.g.: similarity

-fixation of signal denoising?
-PSO -fixation measures?
-smooth
-smooth -smooth
pursuit
pursuit pursuit

Herlina, S. Wibirama, I. Ardiyanto (2018) Visible light (570nm)
 Short wavelength IR 
 Long wavelength IR

S. Murnani, S. Wibirama, N.A. Setiawan (2020) Sensor: Webcam (700nm) (850nm)
Future research (open for PhD / M.Eng. thesis)
Sensor: IR camera Sensor: IR camera

SW | Perspective on Intelligent User Experience Engineering SW | Perspective on Intelligent User Experience Engineering
Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama

Locally Rooted, Globally Respected www.ugm.ac.id Locally Rooted, Globally Respected www.ugm.ac.id
13 14

Please read our papers

download here: http://ugm.id/bootcamp2020

S. Wibirama, I. Ardiyanto, T. Satriya, T.B. Adji,

N. A. Setiawan, M. T. Setiawan, “An
Improved Pupil Localization Technique for
Real-Time Video-Oculography under
Extreme Eyelid Occlusion”, International
Journal of Innovative Computing, Information
and Control, Vol. 15, No. 4, 2019, pp.
1547-1563. (Publisher: ICIC International, Q2

Thank You
ScimagoJR)

Sunu Wibirama, Suatmi Murnani, and http://sunu.staff.ugm.ac.id

Noor Akhmad Setiawan, “Spontaneous
Gaze Gesture Interaction in the
Presence of Noises and Various Types
of Eye Movements”, in Symposium on
Eye Tracking Research and Applications
2020, June 2–5, 2020, Stuttgart,
Germany. (Publisher: ACM, New York)

SW | Perspective on Intelligent User Experience Engineering SW | Perspective on Intelligent User Experience Engineering
Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama Copyrighted © 2020 | Do not distribute without written permission from Dr. Sunu Wibirama

Locally Rooted, Globally Respected www.ugm.ac.id Locally Rooted, Globally Respected www.ugm.ac.id
15 16