Silent Sound Technology Guide

Silent Sound Technology
Najeeb P [EPAKECS029]
Guide : Raseek C , Asst.Professor
Department of Computer Science and Engineering
Government Engineering College,Sreekrishnapuram
12th March 2014

Introduction
Why ..... ???
Methods
Design
Features
Restrictions
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 2

• Silence is the best answer for all the situations... even your
mobile understands!
• A technolgy that transforms the information without using our

vocal chords.

Introduction
Why ..... ???
Methods
Design
Features
Restrictions

Need For Silent Sound Technology
1
http://www.go-gulf.com/crowd talking on mobile phones-300x225.jpg
Need For Silent Sound Technology
• For a better way of communication in noisy public place.
• Perfect solution for those who lost their voice.

Introduction
Why ..... ???
Methods
Design
Features
Restrictions

Two methods are used
• Electromyography(EMG)
• Image Processing

Electromyography(EMG)
2
http://www.telecomspace.com/les/cebit/device.jpg
• Even by saying words without producing sound weak electric

currents are sent from brain to speech muscles. This
phenomenon is called ELECTROMYOGRAPHS.
• A technique for evaluating and recording the electrical activity

produced by articulatory muscles.
• The transducers involved convert the pulses into electrical

signals.

3
Reference[1]
Working..
• The sensors(each with two ne-wired electrodes) are attached

to the dierent part of the face
• The electrical activity is recorded
• The sensors has to be placed at various locations to obtain an

accurate signal

Working...
• Vocoder (voice encoder) converts this electrical signals into

speech patterns.
• Compare them with pre recorded speech pattern of spoken

words
• When there is a match, that sound is transmitted on to the

other end of the line.

Sensors used
• Pressure sensors
• Vibration sensors
• Electromagnetic sensor
• Motion sensors

Image Processing
4
http://www.telecomspace.com/silent sound/image processing.png
Image Processing
• Converting digital data tape into a lm image with minimal

corrections and calibrations.
• In the silent sound technology the output of this image

processing is an audio record.

Introduction
Why ..... ???
Methods
Design
Features
Restrictions

Components
• Data acquisition
• Online recognition
• Sound playback or synthesis

EMA based silent speech interface
5
Reference [1]
Data Collection and Processing[1]
Stimuli and Procedure
• A xed number of sentences for basic greeting and

conversation were selected form a list of most frequently used
sentences among AAC users
• The electromagnetic articulograph AG500 was used to register

the 3-D movements of the tongue, lip, and jaw when a subject
was talking.
• The articulograph records the movement by establishing a

calibrated electromagnetic eld.

Data Collection and Processing[1]
Data Processing
• Head movements were subtracted from the tongue and lip

locations.
• A zero-phase low-pass lter was applied for removing signal

noise.
• All sequences were manually segmented and annotated with

sentences.

Introduction
Why ..... ???
Methods
Design
Features
Restrictions

Features
• Native speakers can silently utter a sentence in their language,

and the receivers can hear the translated sentence in their
language.
• It appears as if the native speaker produced speech in a foreign

language.

Features
• The translation technology works for languages like English,

French and German.
• Allow people to make silent calls without bothering others.

Introduction
Why ..... ???
Methods
Design
Features
Restrictions

Restrictions
• This device presently needs nine leads to be attached to our

face which is quite impractical to make it usable.
• Complicated to identify person and emotions.
• Technology is dicult to apply in some language like Chinese,

where dierent tones can hold many dierent meanings.

Introduction
Why ..... ???
Methods
Design
Features
Restrictions

Applications
• Helping people who have lost their voice due to illness or

accident.
• Telling a trusted friend your PIN number over the phone

without anyone eavesdropping assuming no lip-readers are
around.
• Silent Sound Techniques is applied in Military for

communicating secret/condential matters to others.
• Eective calls in crowded place.

Introduction
Why ..... ???
Methods
Design
Features
Restrictions

Conclusion
• Silent Sound Technology one of the recent trends in the eld of

information technology implements Talking without Talking.
• It will be one of the innovation and useful technology and in

coming future this technology will be use in our day to day life
• The online algorithm still has room for improvement.

REFERENCE
• [1] Ashok samal,Frank Rudzicz,Jordan R Green and Jun Wang,

Sentence recognition from articulatory movements for Silent
Speech Interfaces ,IEEE International Conference on
Acoustics, Speech, and Signal Processing (ICASSP), 2012 ,
Page(s): 4985 - 4988 .
• [2] Ashok samal,Jordan R Green, Jun Wang and Tom D.

Carrell, Vowel recognition from continuous articulatory
movements for speaker dependent application, Signal
Processing and Communication Systems (ICSPCS), 2010 ,
Page(s): 1-7.

• [3] Guangqi Cao, Meng M. Helen and Zhiyong Wu,A Unied
Framework for Multilingual Text-to-Speech Synthesis with
SSML Specication as Interface,IEEE Tsinghua Science and
Technology ,2009 , Page(s): 623 - 630 .

Thank You for the attention

Silent Sound Technology Guide

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Silent Sound Technology Guide

Uploaded by

Copyright:

Available Formats

Silent Sound Technology

Guide : Raseek C , Asst.Professor

Department of Computer Science and Engineering

Government Engineering College,Sreekrishnapuram

12th March 2014

Why ..... ???

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 2

• A technolgy that transforms the information without using our

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 3

Why ..... ???

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 4

• For a better way of communication in noisy public place.

• Perfect solution for those who lost their voice.

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 6

Why ..... ???

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 7

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 8

• Even by saying words without producing sound weak electric

• A technique for evaluating and recording the electrical activity

• The transducers involved convert the pulses into electrical

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 10

• The sensors(each with two ne-wired electrodes) are attached

• The electrical activity is recorded

• The sensors has to be placed at various locations to obtain an

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 12

• Vocoder (voice encoder) converts this electrical signals into

• Compare them with pre recorded speech pattern of spoken

• When there is a match, that sound is transmitted on to the

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 13

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 14

• Converting digital data tape into a lm image with minimal

• In the silent sound technology the output of this image

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 16

Why ..... ???

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 17

• Sound playback or synthesis

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 18

Stimuli and Procedure

• A xed number of sentences for basic greeting and

• The electromagnetic articulograph AG500 was used to register

• The articulograph records the movement by establishing a

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 20

• Head movements were subtracted from the tongue and lip

• A zero-phase low-pass lter was applied for removing signal

• All sequences were manually segmented and annotated with

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 21

Why ..... ???

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 22

• Native speakers can silently utter a sentence in their language,

• It appears as if the native speaker produced speech in a foreign

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 23

• The translation technology works for languages like English,

• Allow people to make silent calls without bothering others.

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 24

Why ..... ???

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 25

• This device presently needs nine leads to be attached to our

• Complicated to identify person and emotions.

• Technology is dicult to apply in some language like Chinese,

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 26

Why ..... ???

Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 27

• The sensors(each with two ne-wired electrodes) are attached

• Converting digital data tape into a lm image with minimal

• A xed number of sentences for basic greeting and

• A zero-phase low-pass lter was applied for removing signal

• Technology is dicult to apply in some language like Chinese,

• Eective calls in crowded place.

• Silent Sound Technology one of the recent trends in the eld of