Bi 15

HIN THC O

Trnh Thnh Trung

trungtt@soict.hust.edu.vn

1
TNG QUAN
-

nh ngha
Thc ti o Virtual Reality
Coates (1992):
Hin thc o l m phng in t cc thit b
knh, qun o v mi trng 3 chiu in t cho
php ngi dng tng tc vi

Greenbaum (1992):
Hin thc o l nhng nh ca th gii thc c
my tnh sinh ra phn hi li cc chuyn ng
ca con ngi. Vic tng tc vi mi trung m
phng ny thng qua d liu ln ph hp vi cc
thit b nh tng tc loa, knh hay gng tay m
phng
3

nh ngha
(Isdale, 1998)
L mt cch hnh nh ha, iu khin v
tng tc vi my tnh v cc d liu c bit
phc tp

Theo kinh nghim con ngi:

Hin thc o l mi trng truyn dn to ra
nhng cm nhn cho con ngi vi vi mi
trng m n m t.

Cc thut ng khc thng dng:

Virtual Worlds, Virtual Environments, Immersive
VR, Cyberspace ...
4

Lch s pht trin

1962 : Sensorama (t hng phim Morton Heilig)
1970 : Th hin ha th gii o ln mn hnh
1970 : Thit b Head Mounted Display u tin: bi Daniel
Vivkers t Utah University ( tng ca Ivan Sutherland /
MIT)
1982 : Dataglove
1980-85 : Sn phm hin thc o thng mi u tin
tn Virtual Cockpit (British Aerospace) c kh nng nm
bt c ng ca u, tay, mt. Hin th hnh n v m
thanh 3D, nhn dng ging ni, phn hi tng tc...
1990-95 : Tr nn ph bin trong phim nh, sch bo...
2010-nay: Pht trin cc thit b hin thc o hng
ngi dng ph thng
5

 Sng ng - Vividness (biu

din c mi trng chnh
xc)
breadth (visibility,
audibility, touch, smell)
depth (quality, fidelitychnh xc)

Tng tc - Interactivity
(cho php ngi dng c
kh nng thay i mi
trng )
speed (update rates,
time lag)
mapping (text, speech,
gestures, gaze, complex
behavior patterns)

So snh VR v cc dng media khc

6

2
THNH PHN KIN TRC
-

Kin trc h thng ca

virtual environments

Thnh phn kin trc

i tng, thc th - Objects, entities ( t, nh,
bu tri, )
Tnh cht hnh hc - Shape, color, texture
Tnh cht vt l - Weight, speed, position, etc

Ngi dng - User

Tng tc vi mi trng, c th c nhn thy
bng camera
C hnh th tham gia vo th gii o (avatar)
C th nghe, ni (voice recognition)
C th di chuyn (gesture recognition)
9

Thnh phn kin trc

a ngi dng - Multi user
Mng my tnh - Network connection
M phng - Simulation
iu khin ng dng
iu khin hng s kin (trnh va chm)
M phng hng theo tnh cht vt l ca i
tng

Th gii, mi trng - World

Kt ni tt c nhng phn khc nhau vo thnh 1
mi trng m ngi dng hot ng trong
10

c im
Virtual reality (VR) phi m bo
Th gii l tng sinh ra bi my tnh
m bo ging tht v hnh dng
tng tc vi ngi dng cng kiu vi th gii thc.

Trong thc t t c chp nhn:

a ra chun thp hn.
t ra nhiu kha cnh ca th gii thc

Ho nhp - immersion.
Mi trng VR l ho nhp - immersive nu n em
li cho ngi dng cm gic tn ti trong mi trng
ch khng phi l cm gic ang quan st
11

c im thc t ca hin thc o

Mt VR tht khng tn ti, lm con ngi cm
thy thoi mi khi c cc nhm ln, Phi c
c c im
Cm gic ho nhp - immersion: Sinh ra cc
cnh gy cm nhn thuc v mi trng o
ca ngi dng..
Cho php tng tc vi cc i tng trong
cnh nh cch ngi dng lm trong thc t
chp nhn tnh xp x vi hn hp l.
12

c im thc t ca hin thc o

To cng nhiu cm nhn trn cc gic quan
cng tt
Nhn v nghe - Sight & sound l nhng gic quan c
bn nht v s cm nhn. Lc mi trng o nh 1
tm knh ho m chung ta c a vo trong
Ngoi ra xc gic cng ang a vo nghin cu
(haptic interfaces).
V gic v khu gic Tm thi chng ta khng cn
nghin cu v vn ny
Gic quan th 6: y l gic quan m chng ta thng
khng th x l c, tr mt s trng hp c bit
nh cc m phng li my bay
13

Cng ngh trong VR

Mn hnh hin th - Visual displays: hin th th gii
o n ngi s dng.
H thng theo di - Tracking systems: theo di v tr
v hng ca ngi dng trong mi trng o
H thng tnh ton - Computation Systems: thc
hin nhng tnh ton cn thit sinh ra khng
gian o
Thit b xc gic - Haptic devices: cung cp thao
tc v nhn c cc cm gic phn hi t th gii
thc
Audio systems - phn hi m thanh t thc ti o
14

Cm nhn mi trng o
hearing

sound

ears,body

The ability to hear; the auditory faculty; SYN. audition,

auditory sense, sense of hearing, auditory modality.

sight

image

eyes

The ability to see; the faculty of vision; SYN. vision, visual

sense, visual modality.

skin

The faculty of touch; SYN. sense of touch, skin senses, touch

modality, cutaneous senses.

touch

surface /
temperature

smell

odour

nose

The faculty of smell; SYN. sense of smell, olfaction, olfactory

modality.

taste

savour, flavour

tongue/
nose

The faculty of taste; SYN. gustation, sense of taste, gustatory

modality.

kinesthesia

position,
movement,
muscular
tensions

muscles

The perception of body position and movement and muscular

tension etc; SYN: kinaestesia, feeling of movement

proprioceptio
n

balance,
acceleration,
position,
location,
orientation,
movement of
the body

ear

The ability to sense the position and location and orientation

and movement of the body and its parts.

15

Cm nhn mi trng o
a) monoscopic cues( cnh
mono)
relative size
interposition and occlusion(
lng lo)
perspective distortion(
mo)
lighting and shadows
texture gradient
motion parallax ( th sai
chuyn ng)

b) binocular (stereoscopic) cues

stereo disparity (phn tch)
convergence (hi t)
16

Yu cu ca thc ti o
Cnh-scene: cn c v, sinh ra ph thuc vo im nhn
ca ngi dng
V tr ca mt cn xc nh, thit b theo di xc nh hng v
v tr ca u v mt. Theo Phn mm cn hiu chnh ma
trn chiu ph hp c kt qu..
Cnh hin th 3-D .
stereo vision: Khi hai mt nhn c hai hnh nh khc
nhau, chng ta s cm nhn c cm gic 3D
y l s nh la mt s dng s nhn bit v tiu c
ca mt

Ngi dng phi c kh nng tc ng li mi trng

Kh nng theo di ( xc nh v tr ca u/mt)
Tc ng trc tip ln chuyn ng ca ngi dng thng
qua cc thit b theo di trn qun o hoc cung cp cho
my tnh video nhiu gc nhn khc nhau ca ngi s
dng
17

3
NG DNG
-

ng dng
Kho c hc: Ti
to li nhng di
tch lch s b
ph hy hoc
khng cn tn ti

Khung cnh tn tch Homolovi IV

19

ng dng
o to, hun luyn:
Cho php ngi hc c
th c rn luyn trc
khi s dng thit b tht,
c bit l khi vic s
dng thit b tht l kh
khn hoc qu tn km

M phng li my bay ca khng qun M

20

ng dng
Vin tng:
Kin to
nhng khung
cnh khng
c tht

Kin trc s ti hin li khung cnh kin trc

21

ng dng
Gii tr: Xy dng cc khung cnh vin tng phc
v mc ch gii tr nh tr chi, phim nh...

Game Skyrim ng dng trong hin thc o

22

4
PHN LOI
-

Phn loi
Desktop VR
Non-immersive:
chut 3d, window
system
3D world hin th tren
mn hnh, chut v
bn phm l u vo
tng tc.
Gi thp, dng c vi
PC thng dng.
VRML, Games
24

Phn loi
Window on a World (WoW)
Mt s h thng s dng mt mn
hnh truyn thng hin th th gii
trc quan (visual world).
Ngi ta phi xem mn hnh hin th
nh l mt ca s m qua ca s
ngi ta c th thy mt th gii o.
Thch thc i vi lnh vc ho
my tnh l lm cho hnh nh trong
ca s trng ging nh tht, m
thanh nghe ging tht v cc i
tng hnh ng ging tht.
One must look at a display screen
as a window through which one
beholds a virtual world. The
challenge to computer graphics is to
make the picture in the window look
real, sound real and the objects act
real [Computer Graphics].
25

Phn loi
nh x video (video-mapping)
y l mt bin th ca cch tip cn theo kiu WoW. Tip cn
theo kiu ny s kt hp mt on video hnh nh ngi s
dng vi ho 2D. Ngi s dng s thy mt mn hnh hin
th tng tc ca hnh anh ta vi my tnh.
DVR h thng n gin s dng cc thit b tng tc thng
thng nh : chut 3d, window system. Th gii 3D c hin
th trn mn hnh, chut v bn phm l u vo tng tc.

26

Phn loi
nh x video (video-mapping) (tip)
u im ca h thng v cc ng dng loi nay l chi ph v gi
c thp, c th dng c c vi PC thng dng v cc thit b
thng dng khc.
Ph hp vi vic pht trin nhng ng dng i tr v cc sn
phm cp thp khng cn n i chnh xc tuyt i.

27

Phn loi
Th gii thc b sung (augmented
reality)
S kt hp gia ho v th
gii thc to thnh 1 h thng
chung phc v cho vic nhn
nhn v nh gi th gii thc.
Kt hp Telepresence v cc h
thng thc ti o cho ta mt
thc ti hn hp(Mixed Reality)
hay cc h thng m phng
lin mch (Seamless
Simulation systems).
y, cc d liu vo sinh ra
bi my tnh s c hp nht
(kt hp) vi cc d liu vo
telepresence v/hoc quan
im (cch nhn) v th gii
thc ca ngi s dng.

28

Hin din o
"Virtual presence is experienced by a person when sensory
information generated only by and within a computer compels
a feeling of being present in an environment other than the
one the person is actually in (Sheridan, 1992, pg.6)
Presence: l cm nhn tm l xut hin mt mi trng da
vo cng ngh hnh thnh theo kiu ho nhp - immersive.
Trn thc t h thng hot ng theo kiu ny khng cn thit
p dng cho tt c mi ngi m ch cho mt vi ngi c vai
tr nht nh trong cng ng.
Vic tch hp gia immersive v presence lun l bi ton kh
cho cng ngh . Mt ng dng ca Presence l: Telepresence
v teleoperate

29

Telepresence
Telepresence: L thut ng m t vic s dng cc cng ngh khc
nhau gy hiu ng t ngi dng ti mt v tr khc.
Telepresence l mt cch mng tng, hnh dung cc th gii c
sinh ra hon ton trong my tnh. y l mt k thut kt ni cc cm
bin t xa trong th gii thc vi cm gic ca ngi iu khin. Cc
cm bin t xa ny c th c nh v trn mt robot, ging nh l
cc cng c.
Lnh cu ho s dng cc phng tin iu khin t xa x l nhng
trng hp nguy him. Cc bc s gii phu s dng cc thit b v
cng nh trn nhng dy cp thc hin ca phu thut m khng
cn rch ra mt l ln trn c th bnh nhn. Cc thit b ny c mt
video camera nh u lm vic (business end).
Cc robot c trang b cc h thng telepresence ny thay i
cch thc thc hin cc cuc th nghim v bin su hoc ni la. K
thut ny ngoi ra cn c p dng trong cc cuc nghin cu v
tr...
30

Telepresence

31

Ho nhp
To ra cm gic ho nhp gia ngi dng v mi trng, hnh nh
quan st l hnh nh ngi s dng nhn c bao gm c khng gian
v phng hng.
Phn hnh nh ngi dng quan st c ch l 1 phn rt nh so vi
khng gian hin th
Thng thng cng ngh cho hin th ng vai tr quan trng v cc
cm nhn khc cng c kim tra.
H thng thc ti o - VR systems s to cho ngi dng l mt phn
ca th gii o ang c m phng ch khng n thun mi trng
o ang m phng l 1 gc ca th gii thc m ngi dng hin hu.
H thng immersive VR u tin l h thng m phng li my bay m
s ha nhp l s kt hp tinh xo gia cc thit b tht v cc
hnh nh o. Bung li tht vi cc thit b thc t cho php phi cng
s dng nh 1 chuyn bay bnh thng. Hnh nh hin th l nhng
cnh o c chun b sn.
32

Phn loi
1.

Immersive Virtual Environments- mi trng o ho nhp

cc i tng tng tc quan st c v c lp hon ton vi
th gii tht
Cnh o phn ng li cc hnh ng tng tc ca i tng.
cc i tng khng th tc ng ln mi trng tht

2.

Semi-Immersive Virtual Environments-mi trng o bn ho nhp

cc i tng c th tc ng ln c mi trng tht v o
vai tr ca cc i tng trong mi trng o ln hn nhiu so
vi mi trng tht
tc ng nn mi trng thc l rt hn ch

3.

Non-Immersive Virtual Environments VR thng thng

cc cnh 3D nh l 1 phn ca th gii tht (mi trng vt l)
cc i tng p li hon ton trong th gii tht
Tn ti rt t quan h vi mi trng o - VE

33

5
CC THIT B VR
-

M hnh phn cng chung

Physical Simulation
and Animation

Lights
Illustration Model
Head Position
INPUT
Hand Position

Objects
Geometry
Surface Properties
Dynamic Properties
Physical Constrains
Acoustic Properties

Visual

Audio

OUTPUT

Haptic

Collision Detection

35

H thng VR c bn
Head Tracker Receiver
Head-mounted display(HMD)
Head phones
Microphone
Glove

Video Camera

Glove tracker
receiver

Voice
Recognition

Haptics

3D Sound
Processor

Face / Gesture /
Motion Analysis

Host Computer
3D Tracker
System

Tracker
Transmitter

VE

Real-time OS

Machine
Intelligence

Graphics
Processor

VE
Database

36

Mn hnh v cc thit b tng tc

Visual Displays (3D imagery)
Head Mounted Displays (HMD)
Projection Displays (CAVE, Virtual Plane)

Acoustic Displays (spatial sound)

Multi-Channel Sound Systems
Specialized Convolution Processors (e.g.
Convolvotron)

Haptic Displays (force feedback)

Robot Arms (e.g. Grope, Phantom)
Active Joystics (e.g. Microsoft Sidewinder)
Vibrotactile Devices (e.g. Logitec Cyberman)

Head Mounted Display (HMD)

Oculus Rift, c pht trin bi Oculus VR,

c Facebook mua li nm 2014
38

CAVE Automatic Virtual

Environment

Christes CAVE

39

Haptic Displays

Bn phm ni ca Tactus cho php bn phm o

trn mn hnh cm ng ni ln v phn hi nh
bn phm cng
40

Cc loi thit b Haptic Device

Xc nh v tr v hng tay
Cc thit b phn hi li lc v m-men
Cc thit b xc gic
Cc thit b to ra cc kch thch nh nng hay
lnh

41

Cc giao din cm nhn

42

Cc giao din ng hc

43