SKR4307

CHAPTER 4C: Voice User Interface (VUI)

Noon Gil
1. Mobile & IoT – Input
Mechanism

• Keyboard – Hard to type for too long, eyes

on the screen
• Touch – Gestural languages are hard to
learn, limited use case for IoT.
• Eye Gaze – Infrared Sensor (futuristic)
 https://thinksmartbox.com/products/eye-gaze/
• Voice - Yes!!
2. Mobile First to Voice First
3. IOT –
Simply
innovati
on over
time
3.1 IoT Voice Interface: Raspberry Pi

• https://www.canakit.com/raspberry-pi-zero-wireless.html
3.2 Raspberry Pi
based Voice
application
architecture
3.3 ALEXA-
AVS – Sample
app

1. https://github.com/alexa
/alexa-avs-sample-app
2. https://www.codemade.i
o/project-raspberry-pi-al
exa-voice-service/
4. Voice Interactions
Types
1. Command based
2. Speech to Text (STT) / Text to
Speech (TTS)
3. Conversational
4. Personal identification – Biometric
4.1 Command Based
4.2 Speech to Text: Dictation
4.3 Text to Speech: Language translation
• Google Text to Speech API - Powered by Machine Learning:
https://www.google.com/aclk?sa=l&ai=DChcSEwjen9Ldh97tAhWLMCsKHaa0DR0YABA
DGgJzZg&sig=AOD64_2p9x0QerqXgkmAahEE8BxM0VkNjw&q&adurl&ved=2ahUKEw
i3ycvdh97tAhXOgtgFHa9SAWoQ0Qx6BAgHEAE
4.4 Conversational / AI based: chatbot
4.5 Personal Identification: Voice Biometrics
5. VUI – Speech Recognition Technology
• Allows people to interact with a computer, smartphone or other
device through voice commands
• The prime examples
 Apple’s Siri
 Amazon’s Alexa
 Google’s Assistant
 Microsoft’s Cortana

• Design experiences for these devices using tools like Botsociety.

… cont.

• Unique of VUI – uses voice as the primary

mode of interaction
 Versus traditional keyboard-mouse-monitor
combination
 Versus touch screen

• Voice-first approach allow users:

 Initiate automated services
 Execute day-to-day tasks in a faster
 More intuitive manner
6. Benefits Of VUI
• Natural user interface
 Screen becomes secondary
 Screen fatigue
• Assistive technology users
 Low vision user benefit from audio
input/output
• Internationalization and offline support
 Language and Internationalization support is
easier to integrate
 • Conversation is natural and intuitive
7. CUI : Conversational
• Low on cognitive load
User Interface For
• Ubiquitous computing - IOT, Mobile,
Bots Car, Smart Home etc.
8. Future of Interface -
“Personalized UX”
using voice

• Goal: To communicate
naturally with machine
• AI powered & voice driven:
 Tone of voice
 Choice of words etc.
9. Steps for designing VUI

i. Research audience
ii. Define capabilities and shape the product
 Creating key scenarios of interaction
 Make sure these scenarios work with voice
 The three factors- Intent, Utterance, Slot

iii. Create a prototype

iv. Test product
v. Refine
• The dialogue flow is the answer to the
question of “how to create voice
interaction between user and
technology”
• Can use several prototyping tools at
disposal for VUI
• Some of the most popular ones are
Amazon Alexa Skill Builder,
Sayspring, and Google’s SDK
Your Further Reading

1. How-to Guide for a Flawless Voice User Interface Design:

https://appinventiv.com/blog/voice-user-interface-design/#7

2. How Can Google Voice Assistant App Make Your Business

Efficient?:
https://appinventiv.com/blog/google-voice-assistant-app-develop
ment/
Reference

1. Bots & IOT – Oracle Code Conference – San Francisco (Mar

2017)
2. Top Benefits of Chatbots for Business:
https://litslink.com/blog/top-benefits-of-chatbots-for-business
3. https://appinventiv.com/blog/voice-user-interface-design/#7