performs the operation with tools that translate the doctor's motions outside the

patient's body to relatively small cutting and sewing operations inside.

 performs the operation with tools that translate the doctor's motions outside the
patient's body to relatively small cutting and sewing operations inside.

telepresence the ability

telepresence
to directly
theinteract
ability to
(often
directly
via computer
interact (often
mediation)
via computer
with a mediation) with a
physically real, remote
physically
environment
real, remote
from environment
the first-person from
point
theof
first-person
view; therepoint
are no
of view; there are no
restrictions on the restrictions
location of the
on the
remote
location
environment,
of the remote
and there
environment,
are no restrictions
and there are no restrictions
on the size of the device
on theused
size of
to the
carrydevice
out the
useduser's
to carry
commands
out the at
user's
the remote
commands at the remote
location. location.

The definition of telepresence

The definitionassumes
of telepresence
that the user
assumes
viewsthat
the the
remote
userworld
views from
the remote world from
the vantage point of
thethe
vantage
remotepoint
device.
of the
In contrast,
remote device.
the term
In contrast,
teleoperation
the refers
term teleoperation
to refers to
cases where the operator
cases where
uses athe
remote
operator
device
usestoainteract
remotewith
device
thetoenvironment,
interact with the environment,
while viewing that while
deviceviewing
from another
that device
perspective–watching
from another perspective–watching
the device from anthe device from an
external camera. external camera.

Teleoperation is different
Teleoperation
than television,
is differentwhere
thanthe
television,
participant
where
merely
the participant
watches themerely watches the
remote environment remote
and does
environment
not interact.
and Thus
does the
not requirement
interact. Thusfor
theviewing
requirement
the for viewing the
world “live” (i.e., synchronously)
world “live” (i.e.,
thatsynchronously)
characterizes teleoperation
that characterizes
is notteleoperation
met. Telep- is not met. Telep-
resence in general isresence
considered
in general
an inside-out
is considered
view an
of ainside-out
world, whereas
view ofteleoperation
a world, whereas teleoperation
generally provides generally
an outside-in
provides
view.an(Inside-out
outside-inversus
view. (Inside-out
outside-in isversus
discussed
outside-in
in is discussed in
Chapter 7.) Chapter 7.)

The difference between

The difference
telepresence
between
and teleoperation
telepresence can and be
teleoperation
further illustrated
can be by
further illustrated by
the control of a model
the control
airplaneof(figure
a model
1-11).
airplane
With(figure
telepresence,
1-11). With
the operator
telepresence,
sees the operator sees
and interacts with the
andenvironment
interacts withjust
theas
environment
they would ifjust
theyas were
they would
physically
if they
present
were physically present
inside the airplane,inside
whereas
the simple
airplane,
remote
whereas
(tele)simple
operation
remoteis when
(tele) operation
the view andis when the view and
interaction come from
interaction
an outside
come(second
from anperson)
outside point
(second
of view.
person)
In this
point
example,
of view. In this example,
flying a radio-controlled
flying airplane,
a radio-controlled
one typically
airplane,
standsone
on typically
the ground stands
andonwatches
the ground
as and watches as
the airplane performsthe airplane
the command
performs
sentthe
to it
command
from a position
sent to external
it from atoposition
the craftexternal to the craft
itself. To make thisitself.
operation
To make
telepresence,
this operation
a camera
telepresence,
would need
a camera
to be mounted
would need to be mounted
inside the craft, allowing
inside the craft,
user toallowing
view thethe
flight
userfrom
to view
thethe
point
flight
of view
fromathe
pilot
point of view a pilot
would have (compare would
withhave
figure
(compare
1-12). with figure 1-12).
FIGURE 1-11. Telepresence
FIGURE 1-11.
can beTelepresence
differentiated
canfrom
be differentiated
teleoperationfrom
by theteleoperation
point of by the point of
view and the mechanism
view andforthe
control.
mechanism
(A) In normal
for control.
remote
(A) control
In normal
operation,
remote control
the operation, the
point of view is from
point
outside
of view
theisplane.
from (B)
outside
A radio-controlled
the plane. (B) Amodel
radio-controlled
airplane canmodel
be airplane can be
considered a telepresence
considered
application
a telepresence
if the point
application
of viewifand
the control
point ofare
view
as and
if from
control are as if from
inside the cockpit. inside the cockpit.

A (Image courtesy Aof(Image

Bruce Stenulson
courtesy ofofBruce
the South
Stenulson
Park Area
of the
RCSouth
Society);
ParkBArea
(Image
RC Society); B (Image
courtesy of Chris Oesterling
courtesy of[N8UDK]
Chris Oesterling
of the Detroit
[N8UDK]
Amateur
of theTelevision
Detroit Amateur
Club) Television Club)

FIGURE 1-12. A remotely

FIGUREoperated
1-12. A remotely
robot equipped
operated with
robot
video
equipped
cameras, with
speakers,
video cameras, speakers,
and a shotgun allow
and
police
a shotgun
to virtually
allowput
police
themselves
to virtually
into
put
potentially
themselvesdangerous
into potentially dangerous
situations for conflict resolution and enable them to communicate with the parties
at the other end.
 situations for conflict resolution and enable them to communicate with the parties
at the other end.

(Image courtesy of(Image

ZMC Productions).
courtesy of ZMC
See color
Productions).
plate 2 See color plate 2
Telepresence: the ability to directly interact (often via computer mediation) with a
physically real, remote environment experienced from the first-person POV; without
restrictions on the location or size of the device used to carry out the user’s com-
mands at the remote location.
 Telepresence: the ability to directly interact (often via computer mediation) with a
physically real, remote environment experienced from the first-person POV; without
restrictions on the location or size of the device used to carry out the user’s com-
mands at the remote location.

The definition of telepresence

The definitionassumes
of telepresence
that the user
assumes
viewsthat
the the
remote
userworld
views from
the remote world from
the vantage point of
thethe
vantage
remotepoint
device.
of the
In contrast,
remote device.
the term
In contrast,
teleoperation
the refers
term teleoperation
to refers to
cases where the operator
cases where
uses athe
remote
operator
device
usestoainteract
remotewith
device
thetoenvironment,
interact with the environment,
while viewing that while
deviceviewing
from another
that device
perspective—watching
from another perspective—watching
the device from anthe device from an
external camera. external camera.

Teleoperation is different
Teleoperation
than television,
is different where
thanthe
television,
participant
where
merely
the participant
watches merely watches
the remote environment
the remote
and does
environment
not interact.
and Thus
does the
not requirement
interact. Thusfor the
viewing
requirement for viewing
the world “live” (i.e.,
thesynchronously)
world “live” (i.e.,
thatsynchronously)
characterizes teleoperation
that characterizes
is notteleoperation
met. is not met.
Telepresence in general
Telepresence
is considered
in general
an inside-out
is considered
view an
of ainside-out
world, whereas
view ofteleop-
a world, whereas teleop-
eration generally provides
eration generally
an outside-in
provides
viewan (inside-out
outside-invs.view
outside-in
(inside-out
is discussed
vs. outside-in is discussed
in Chapter 8). in Chapter 8).

The difference between

The difference
telepresence
between
and teleoperation
telepresence can and be teleoperation
further illustrated
can be by further illustrated by
the control of a model
the control
airplaneof(Fig.
a model
1-15).airplane
With telepresence,
(Fig. 1-15). With the operator
telepresence,
sees andthe operator sees and
interacts with the environment
interacts withjust
theas environment
they would just if they
as they
were would
physically
if they
present
were physically present
inside the airplane,inside
whereasthe simple
airplane,
remote
whereas(tele)simple
operation
remote is when
(tele) operation
the view and is when the view and
interaction come from
interaction
an outside
come(second
from an person)
outside POV.
(second
In thisperson)
example,POV.flying
In this
a example, flying a
radio-controlled airplane,
radio-controlled
one typically
airplane,
standsone
ontypically
the ground stands
andon watches
the ground
as theand watches as the
airplane performs commands
airplane performs
sent tocommands
it from a position
sent toexternal
it from atoposition
the craftexternal
itself. Toto the craft itself. To
make this operation make
telepresence,
this operation
a cameratelepresence,
would need a camera
to be mounted
would need inside
to bethemounted inside the
craft, allowing the craft,
user toallowing
view thethe
flight
userfrom
to view
thethePOV flight
a pilot
fromwould
the POV
have a(compare
pilot would have (compare
with Figs. 1-15B and
with
1-16).
Figs. 1-15B and 1-16).
Figure 1-15. Telepresence
Figure 1-15.
can beTelepresence
differentiatedcanfrom
be differentiated
teleoperationfrom
by the teleoperation
point of by the point of
view and the mechanism
view and forthe
control.
mechanism
(A) In normal
for control.
remote(A) control
In normal
operation,
remote control
the operation, the
point of view is from
point
outside
of view
theisplane.
from (B)
outside
A radio-controlled
the plane. (B) Amodel
radio-controlled
airplane canmodel
be airplane can be
considered a telepresence
consideredapplication
a telepresence
if the point
application
of viewifand
the control
point ofare
view
as and
if from
control are as if from
inside the cockpit from
insidethe
thepilot’s
cockpit
perspective.
from the pilot’s perspective.

(A) Image courtesy(A)

of Image
Bruce Stenulson
courtesy ofofBruce
the South
Stenulson
Park Area
of the
RCSouth
Society.
Park(B)Area
Image
RC Society. (B) Image
courtesy of Chris Oesterling
courtesy of(N8UDK)
Chris Oesterling
of the Detroit
(N8UDK)
Amateur
of theTelevision
Detroit Amateur
Club. Television Club.
Figure 1-16. A remotely
Figureoperated
1-16. A remotely
robot equipped
operatedwith
robot
video
equipped
cameras,with
speakers,
video cameras, speakers,
and a shotgun allowandpolice
a shotgun
to virtually
allowput
police
themselves
to virtually
into
put
potentially
themselvesdangerous
into potentially dangerous
situations for conflict
situations
resolution
for conflict
and enable
resolution
them toandcommunicate
enable themwith
to communicate
the parties with the parties
at the other end. at the other end.

Image courtesy of Image

ZMC Productions.
courtesy of ZMC Productions.
Figure 1-17. Today,Figure
low-cost1-17.
quadcopters
Today, low-cost
can bequadcopters
flown remotely
can using
be flown
theremotely
outside inusing the outside in
perspective. Many perspective.
drones also provide
Many drones
video also
transmission
provide video
that allows
transmission
a pilot to
that
view
allows a pilot to view
their flight from antheir
inside-out
flight from
point of
an inside-out
view—as though
point ofseated
view—as
in the
though
cockpit—a
seated in the cockpit—a
scenario we refer as
scenario
telepresence.
we refer
(Photographs
as telepresence.
courtesy
(Photographs
of Matthewcourtesy
Brennan.)
of Matthew Brennan.)
Telepresence
 Telepresence
Telepresence allowsTelepresence
you to be in allows
one place,
you yet
to bebeinable
onetoplace,
perceive
yet be
andable
act to
likeperceive
you areand act like you are
present in a different
present
place.in This
a different
differs from
place.remote
This differs
controlfromby how
remote
you control
interface bywith
how you interface with
the remote environment.
the remote Withenvironment.
remote control, With youremote
use some control,
typeyouof controller
use someand type of controller and
perhaps communication
perhaps system
communication
to control something
system to control
at a distance,
somethingbut your
at a actions
distance, but your actions
and perception areandthatperception
you are controlling
are that you something
are controlling
at a distance.
somethingFor example,
at a distance. For example,
if you press a button
if you
thatpress
causesa button
a light that
to turncauses
on 1000
a light miles
to turn
away,onthat
1000 would
milesbe away, that would be
remote control of that
remotelight.control
Telepresence,
of that light.
however,
Telepresence,
simulateshowever,
that yousimulates
are in the that you are in the
remote location. With
remotethis location.
example,With you would
this example,
see the youenvironment
would seethat the isenvironment
1000 that is 1000
miles away from your
milesactual
awaylocation
from your andactual
you would
locationinteract
and youwithwould
that environment
interact with that environment
as though you wereasactually
thoughthere.
you were
Then, actually
to turnthere.
on that
Then,light
to you
turnwould
on that turnlight
it on
you would turn it on
just as you would ifjust
youaswere
you right
wouldthere.
if youOr,wereif you
rightarethere.
sittingOr,inifayou
flightaresimulator
sitting in a flight simulator
cockpit but are actually
cockpit flying
but an
areairplane
actually (that
flyingactually
an airplane
exists)(that
in aactually
remote exists)
location, in a remote location,
and when you lookand outwhen
the window
you look youout
see thethat
window
remote youlocation
see that inremote
the same location
way in the same way
that you would if you
thatwere
you actually
would ifflying
you werethe airplane
actually flying
that isthe
in that
airplane
location,
that is then
in that location, then
you are experiencing
youtelepresence
are experiencing(Figuretelepresence
1.32). (Figure 1.32).

Figure 1.32. If these

Figure
pilots,1.32.
whoIfare
these
sitting
pilots,
in awho
stationary
are sitting
location
in a stationary
in a flight location in a flight
simulator, were coupled
simulator,
to anwere
actual
coupled
airplane
to that
an actual
they were
airplane
flying
that
bythey
theirwere
actions
flying by their actions
in this stationary cockpit,
in this stationary
and the views
cockpit,
theyand
sawthe
in the
views
windows
they saw
were
in the
provided
windows were provided
by live video feeds by
from
livethat
video
remote
feeds airplane,
from thatand
remote
their airplane,
gauges reflected
and theiractual
gauges reflected actual
measurements from measurements
the remote airplane,
from thethey
remote
wouldairplane,
be experiencing
they would telepresence.
be experiencing telepresence.

Image courtesy of Image

NASA. courtesy of NASA.
The relationship of augmented reality with telepresence is exactly the same as it is
with the nonaugmented world. If you are using an augmented reality application as
though you are in a remote location and the augmented reality application affects
that remote location, it would be considered augmented reality in telepresence.
An example of an augmented reality telepresence application would be to have a
telepresence situation where people at a distance can see me (and I can see them)
giving a demonstration of augmented reality as though I was in the room with them,
yet I am actually doing the demonstration in my own office.
 The relationship of augmented reality with telepresence is exactly the same as it is
with the nonaugmented world. If you are using an augmented reality application as
though you are in a remote location and the augmented reality application affects
that remote location, it would be considered augmented reality in telepresence.
An example of an augmented reality telepresence application would be to have a
telepresence situation where people at a distance can see me (and I can see them)
giving a demonstration of augmented reality as though I was in the room with them,
yet I am actually doing the demonstration in my own office.

Telepresence is included
Telepresence
as a case
is included
of “augmented
as a case
virtuality”
of “augmented
on Milgram’s
virtuality”
virtuality
on Milgram’s virtuality
continuum. (See later.)
continuum. (See later.)
made salient. As with other forms of presence, designers share the assumption that
increases in self-presence are correlated with higher levels of cognitive performance,
and, possibly, emotional development. In the words of Socrates, the goal to “know
thyself ’ is a worthy journey -- it may be the only journey!
 made salient. As with other forms of presence, designers share the assumption that
increases in self-presence are correlated with higher levels of cognitive performance,
and, possibly, emotional development. In the words of Socrates, the goal to “know
thyself ’ is a worthy journey -- it may be the only journey!

Questions of identity
Questions
formation of identity
and self-consciousness
formation and self-consciousness
are very broad issuesareper-
very broad issues per-
taining to the formation
tainingoftothe
theindividual.
formationMost
of theprocesses
individual.
areMost
by noprocesses
means unique
are by no means unique
to virtual environments.
to virtual
Butenvironments.
the interactionBut withthe
computers
interaction
raises
withsome
computers
interesting
raises some interesting
questions in this domain
questions
(e.g.,
in Turkle,
this domain
1985).(e.g.,
So inTurkle,
assessing
1985).
theSo
role
in of
assessing
virtual the role of virtual
environments in influencing
environments self-presence,
in influencing
we should
self-presence,
concentrate
we should
on thoseconcentrate
aspects on those aspects
of the environmentofthat
the are
environment
radically different
that are from
radically
the different
physical world.
from the physical world.

Two issues emergeTwo

as most
issuespertinent
emergeto asvirtual
most pertinent
environments
to virtual
as opposed
environments
to physical
as opposed to physical
environments. Bothenvironments.
pertain to theBoth
effectpertain
of progressive
to the effect
embodiment,
of progressive
that embodiment,
is, the that is, the
embodiment of theembodiment
user’s body viaof the
close
user’s
coupling
body to
viathe
close
interface
coupling
andtorepresenta-
the interface and representa-
tions of coupled body
tionsviaoffirst
coupled
personbody
avatar
via first
geometry
personandavatar
behavior.
geometry and behavior.

Embodiment inEmbodiment
an avatar andinthe
aneffects
avatarof
andmental
the effects
modelofofmental
the selfmodel of the self
When the user is embodied
When thein
user
an is
avatar
embodied
two things
in anare
avatar
occurring:
two things are occurring:

1. the mental model

1. of thethe
user’s
mental
body
model
(bodyofschema
the user’s
or body
bodyimage)
(body schema
may be or body image) may be
influenced by the mappinginfluenced
of the physical
by the mapping
body to the
of the
geometry
physicaland
bodytopology
to the geometry and topolog
of the virtual body, of the virtual body,
2. The virtual body
2. may have
Theavirtual
different
bodysocial
maymeaning
have a different
(i.e., social
social
role)
meaning
than the(i.e., social role) than th
user’s body. user’s body.

The latter, the social

Themeaning
latter, the
of the
social
avatar,
meaning
is situationally
of the avatar,
or environmentally
is situationally or environmentally
dependent. For example,
dependent.
a “cowboy”
For example,
avatar will
a “cowboy”
have different
avatar social
will havemeaning
differentin social meaning in
historic “wild west”historic
environment,
“wild west”
a “Newenvironment,
York Bar” environment,
a “New York Bar” or inside
environment,
a pickup or inside a pickup
truck in a contemporary
truck insouthern
a contemporary
rural environment.
southern rural
The social
environment.
role of avatar
The social
body role
is of avatar body is
partially determined,partially
but not
determined,
defined, bybut its not
geometry
defined, andbykinematics.
its geometry Implicit
and kinematics.
and Implicit and
explicit social normsexplicit
that may
social
benorms
partially
thatidiosyncratic
may be partially
to theidiosyncratic
virtual environment
to the virtual environment
and imported fromand theimported
user’s social
from environment
the user’s social
finalize
environment
the social-semiotic
finalize therolesocial-semiotic role
and identity of theandavatar.
identity
Issues
ofoftheclass,
avatar.
gender,
Issuesoccupational
of class, gender,role, body
occupational
type, etc.role, body type, etc.
are raised when considering
are raised this
when aspect
considering
of embodiment.
this aspectTheof social
embodiment.
meaningThe of body
social meaning of body
morphology and socialmorphology
role andand
its effect
socialonrole
theand
self-schema
its effect on is athe
rich
self-schema
area. But most
is a rich area. But most
aspects of it (e.g., stereotyping)
aspects of it (e.g.,
are not
stereotyping)
particularlyare unique
not particularly
to virtual environments,
unique to virtual environments,
and only partially under
and onlythepartially
control ofunder
designers.
the control
For this
of designers.
reason, I willFornot
thispursue
reason, I will not pursue
it further here. it further here.

Rather I will pursueRather

a topicI will
more pursue
unique
a topic
to virtual
moreenvironments.
unique to virtual
Theenvironments.
interaction The interaction
of the virtual environment
of the virtual
with environment
the user’s bodywith
schema
the user’s
in immersive
body schema
virtual
in envi-
immersive virtual envi-
ronments may have ronments
a number may of implications
have a number forof
theimplications
design of virtual
for theworlds.
designWeof virtual worlds. We
can say that in almost any virtual environment system with any significant level
of embodiment, there are three bodies present: the objective body, the virtual body,
and the body schema. These three bodies may be present even in comparatively
primitive, non-interactive virtual environments like standard television (Meyers and
Biocca, 1992). The objective body is the physical, observable, and measurable body
of the user. The virtual body is the representation of the user’s body inside the virtual
environment. The body schema is the user’s mental or internal representation of his
or her body.
avatar should not be seen as some virtual environment equivalent of the selection of
clothing or costume, especially in immersive virtual environments. It appears that
embodiment can significantly alter body schema. Metaphorically, we might say
that the virtual body competes with the physical body to influence the form of the
phenomenal body. The result is a tug of war where the body schema may oscillate
in the mind of the user of the interface (see Meyers and Biocca, 1992).
avatar should not be seen as some virtual environment equivalent of the selection of
clothing or costume, especially in immersive virtual environments. It appears that
embodiment can significantly alter body schema. Metaphorically, we might say
that the virtual body competes with the physical body to influence the form of the
phenomenal body. The result is a tug of war where the body schema may oscillate
in the mind of the user of the interface (see Meyers and Biocca, 1992).
Class-of-Service Requirements for
Quad-Play Networks
 Class-of-Service Requirements for
Quad-Play Networks
Vinod Joseph, BrettVinod
Chapman,
Joseph,inBrett
Deploying
Chapman,
QoS in
forDeploying
Cisco IP and
QoSNext
for Generation
Cisco IP and Next Generation
Networks, 2009 Networks, 2009

3.10.5 Classifying
3.10.5
TelePresence
Classifying TelePresence
One of the first questions
One of theto be
first
answered
questionsrelating
to be answered
to TelePresence
relating
QoSto TelePresence
design QoS design
is: Should TelePresence
is: Should
be assigned
TelePresence
to a dedicated
be assignedclasstoora should
dedicated
it be
class
assigned
or should it be assigned
to the same class as
toexisting
the same videoconferencing/video
class as existing videoconferencing/video
telephony (also known telephony
as (also known as
multimedia conferencing,
multimediaas per
conferencing,
the Cisco modified
as per the
RFC-4594
Cisco modified
model)?RFC-4594
The answer model)? The answer
to this question directly
to thisrelates
question
to whether
directly relates
TelePresence
to whether
has the
TelePresence
same service-level
has the same service-level
requirements as these
requirements
other two asinteractive
these other
video
twoapplications
interactive video
or whether
applications
it has or whether it has
unique service-level
unique
requirements.
service-level
Fromrequirements.
the previously From
mentioned
the previously
requirements
mentioned requirements
it becomes apparentit becomes
that TelePresence
apparent hasthatunique
TelePresence
(and higher/tighter)
has unique (and service-lev-
higher/tighter) service-lev-
el requirements than
el requirements
do generic videoconferencing/video
than do generic videoconferencing/video
telephony applications;telephony applications;
therefore, TelePresence
therefore,
requires
TelePresence
a dedicated requires
class along
a dedicated
with a dedicated
class alongclassificat-
with a dedicated classificat-
ion marking value.ion marking value.

Videoconferencing/video
Videoconferencing/video
telephony applications
telephony
have traditionally
applicationsbeen
have marked
traditionally
to been marked to
(RFC-2597) Assured (RFC-2597)
Forwarding Assured
Class 4,
Forwarding
which is the
Class
recommendation
4, which is the from
recommendation
both from both
the Cisco QoS Baseline
the Cisco
as well
QoSas Baseline
the Ciscoas
modified
well as the
version
Ciscoofmodified
RFC-4594.version
However,
of RFC-4594. However,
the AF PHB includesthepolicing
AF PHB(to includes
conforming,
policing
exceeding,
(to conforming,
and violating
exceeding,
trafficandrates)
violating traffic rates)
as well as correspondingly
as well asincreasing
correspondingly
the dropincreasing
preferences
the(to
drop
Drop
preferences
Preference(to1,Drop Preference 1,
2, and 3, respectively),
2, and
ultimately
3, respectively),
dropping ultimately
traffic according
droppingtotraffic
the drop
according
preference
to the drop preference
markings. TelePresence
markings.
trafficTelePresence
has a very low traffic
tolerance
has a very
to drops
low tolerance
(0.05 percent)
to drops (0.05 percent)
and therefore would andnot
therefore
be appropriately
would notserviced
be appropriately
by an AF PHB.serviced
Because
by anofAFthe
PHB. Because of the
low-latency and jitter
low-latency
service-leveland requirements
jitter service-level
of TelePresence,
requirementsit ofmight
TelePresence,
seem it might seem
attractive to assignattractive
it an (RFC-3246)
to assignExpedite
it an (RFC-3246)
Forwarding Expedite
(EF) PHB;
Forwarding
after all,(EF)
therePHB; after all, there
is nothing in RFC-3246
is nothing
that dictates
in RFC-3246that only
thatVoIP
dictates
can that
be assigned
only VoIPtocan
thisbe
PHB.
assigned to this PHB.
However, it is important
However,
to recognize
it is important
that VoIP
to recognize
behaves considerably
that VoIP behaves
differently
considerably
than differently than
video. VoIP has constant
video. VoIP
packet hassizes
constant
and packet
packetrates,
sizeswhereas
and packetvideo
rates,
packet
whereas
sizes video packet sizes
vary and video packet
varyrates
and video
also varypacket
in a rates
randomalsoand
varybursty
in a random
manner.and Thus
bursty
if both
manner. Thus if both
video and voice werevideo
assigned
and voiceto the
were sameassigned
markingto the
value
sameandmarking
class, (bursty)
value video
and class, (bursty) video
could easily interfere
could
witheasily
(well-behaved)
interfere with voice.
(well-behaved)
Therefore, for voice.
bothTherefore,
operational forand
both operational and
capacity-planning purposes,
capacity-planning
it is recommended
purposes, itnotis recommended
to mark both voicenot toand
mark
video
both
to voice and video to
EF. This recommendation
EF. This isrecommendation
reflected in bothisthe reflected
Cisco QoSin both
Baseline
the Cisco
as well
QoSas Baseline
the as well as the
Cisco modified RFC-4594
Cisco modified
model. RFC-4594 model.
What, then, should TelePresence be marked to? The best formal guidance is provided
in the Cisco modified RFC-4594 model, where a distinction is made between a
Multimedia Conferencing (i.e., generic Videoconferencing/Video Telephony) service
class and a Real-Time Interactive service class. The Real-Time Interactive service
class is intended for inelastic video flows, such as TelePresence. The recommended
marking for this Real-Time Interactive service class, and thus the recommended
marking for TelePresence, is Class Selector 4 (CS4).
What, then, should TelePresence be marked to? The best formal guidance is provided
in the Cisco modified RFC-4594 model, where a distinction is made between a
Multimedia Conferencing (i.e., generic Videoconferencing/Video Telephony) service
class and a Real-Time Interactive service class. The Real-Time Interactive service
class is intended for inelastic video flows, such as TelePresence. The recommended
marking for this Real-Time Interactive service class, and thus the recommended
marking for TelePresence, is Class Selector 4 (CS4).
> Read full chapter
hand, wideband audio coding activities have been dominated by the work developed
for the MPEG/Audio standards. New research in wideband audio coding at lower
rates is now in progress, mostly stimulated by plans for MPEG standards and by
demand of new technologies for audio streaming over the Internet. As more and
more audio data become available in databases and over the Internet, locating a
particular audio clip may not be an easy job. Chapter 3 presents technologies to
address issues related to management and retrieval in audio databases.
hand, wideband audio coding activities have been dominated by the work developed
for the MPEG/Audio standards. New research in wideband audio coding at lower
rates is now in progress, mostly stimulated by plans for MPEG standards and by
demand of new technologies for audio streaming over the Internet. As more and
more audio data become available in databases and over the Internet, locating a
particular audio clip may not be an easy job. Chapter 3 presents technologies to
address issues related to management and retrieval in audio databases.
accomplished with video, analog electronics, and mechanical linkages. In these
instances, telepresence does not overlap with AR. There is no notion of a virtual
world and no information augmentation about the situation with which the user is
interacting. Without the need to overlap virtual information onto the real world, the
registration problem does not exist.
accomplished with video, analog electronics, and mechanical linkages. In these
instances, telepresence does not overlap with AR. There is no notion of a virtual
world and no information augmentation about the situation with which the user is
interacting. Without the need to overlap virtual information onto the real world, the
registration problem does not exist.
of discrete early reflections [41]–[43]. It has been shown [43] that these reflections
are the dominant source of monitoring nonuniformities. These nonuniformities
appear in the form of frequency-response anomalies in rooms where the difference
between the direct and reflected sound level for the first 15 ms is less than 15 dB
[44], [45] (Fig. 6). High levels of reflected sound cause comb filtering in the frequency
domain, which in turn gives rise to severe changes in timbre. The perceived effects
of such distortions were quantified with psychoacoustic experiments [41], [46] that
demonstrated their importance.
 of discrete early reflections [41]–[43]. It has been shown [43] that these reflections
are the dominant source of monitoring nonuniformities. These nonuniformities
appear in the form of frequency-response anomalies in rooms where the difference
between the direct and reflected sound level for the first 15 ms is less than 15 dB
[44], [45] (Fig. 6). High levels of reflected sound cause comb filtering in the frequency
domain, which in turn gives rise to severe changes in timbre. The perceived effects
of such distortions were quantified with psychoacoustic experiments [41], [46] that
demonstrated their importance.

Fig. 6. The time-domain

Fig. 6. response
The time-domain
of a loudspeaker
responsesystem
of a loudspeaker
includes thesystem
directincludes the direct
sound as well as the
sound
sound as due
wellto
asmultiple
the sound
reflections
due to multiple
from the reflections
local acoustical
from the local acoustical
environment. Psychoacoustic
environment. evidence
Psychoacoustic
indicates evidence
that in order
indicates
for these
that reflections
in order for these reflections
not to be perceived,
nottheir
to be
spectrum
perceived,
level
their
should
spectrum
be 15 level
dB below
should
thebelevel
15 dB
of the
below the level of the
direct sound. direct sound.

A solution that hasAbeen

solution
proposed
that has
to alleviate
been proposed
the problems
to alleviate
of early
the reflections
problems of is early reflections is
near-field monitoring.near-field
In theory,
monitoring.
the direct Insound
theory,isthe
dominant
direct sound
when is thedominant
listener iswhen the listener is
very close to the loudspeakers,
very close to thus
the loudspeakers,
reducing the roomthus reducing
effects tothe below
room audibility.
effects to below audibility.
In practice, however,In practice,
there arehowever,
several issues
therethat
are several
must beissues
addressed
that mustin order
be addressed in order
to provide high-quality
to provide
soundhigh-quality
[47]. One such sound
issue
[47].
relates
One tosuch
theissue
largerelates
reflectingto the large reflecting
surfaces that are typically
surfacespresent
that arenear
typically
the loudspeakers.
present near Strong
the loudspeakers.
reflections Strong
from a reflections from a
console or a video/computer
console or monitor
a video/computer
act as baffle monitor
extensions
act asfor
bafflethe extensions
loudspeaker, for the loudspeaker,
resulting in a boostresulting
of midbass
in afrequencies.
boost of midbass
Furthermore,
frequencies.
evenFurthermore,
if it were possibleeven if it were possible
to place the loudspeakers
to placefar
theaway
loudspeakers
from largefar reflecting
away from surfaces,
large reflecting
this would surfaces,
only this would only
solve the problem solve
for middle
the problem
and high forfrequencies.
middle and Low-frequency
high frequencies. roomLow-frequency
modes room modes
do not depend on do surfaces
not depend
in the local
on surfaces
acoustical
in the
environment
local acoustical
but rather
environment
on the but rather on the
physical size of thephysical
room. These
size ofmodes
the room.
produce
These standing
modes waves
produce thatstanding
give risewaves
to that give rise to
large variations in frequency
large variations
response
in frequency
(Fig. 7). Such
response
amplitude
(Fig. 7).
andSuchphaseamplitude
distortionsand phase distortions
can completely destroy carefully designed 3-D audio reproduction that relies on the
transaural techniques described above.
 can completely destroy carefully designed 3-D audio reproduction that relies on the
transaural techniques described above.

Fig. 7. Frequency-response
Fig. 7. Frequency-response
problems that ariseproblems
in the lowthat
frequencies
arise in thedue
low
tofrequencies
stand- due to stand-
ing-wave buildup ining-wave
small rooms
buildup
andininsmall
higher
rooms
frequencies
and in higher
due tofrequencies
interactionsdue
withto interactions with
elements in the local
elements
acoustical
in the
environment
local acoustical
(e.g.,environment
CRT screen, table
(e.g., top,
CRTuntreated
screen, table top, untreated
walls). walls).
Fig. 8. A properly designed
Fig. 8. A properly
direct-path
designed
dominant direct-path
system that
dominant
compensates
system for
thatfre-
compensates for fre-
quency anomalies quency
produces anomalies
a much flatter
producesfrequency
a muchresponse.
flatter frequency
Frequencies
response.
belowFrequencies below
100 Hz are reproduced
100 Hzwith
are
a separate
reproduced
subwoofer
with a separate
(response
subwoofer
not shown)(response
that is placed
not shown) that is placed
at a known distance at from
a known
the listener
distancetofrom
alleviate
the listener
anomalies
to alleviate
from standing
anomalies
waves.
from standing waves.

Standing waves associated

Standingwith waves
theassociated
acoustics with
of small
the rooms
acoustics giveofrise
small
to rooms
funda- give rise to funda-
mental limitations mental
in the quality
limitations
of reproduced
in the quality
sound,
of reproduced
particularlysound,
in the uniformity
particularly in the uniformity
of low-frequency response.
of low-frequency
Variations
response.
in this frequency
Variationsregime
in this can
frequency
be as large
regime can be as large
as ±15 dB for different
as ±15listening
dB for different
locations listening
in a typical
locations
room. The in a advantage
typical room.of The advantage of
immersive audio rendering
immersiveonaudiodesktop
rendering
systems onlies
desktop
in the systems
fact thatlies
thein
position
the factofthat the position of
the loudspeakers and
the the
loudspeakers
listener areand
known
the listener
a priori.are
It isknown
therefore
a priori.
possible
It is therefore
to use possible to use
signal processing (equalization)
signal processing
to correct
(equalization)
the low-frequency
to correct the
response.
low-frequency
This smooth
response. This smooth
response, however,response,
can only however,
be achievedcanfor
only
a relatively
be achieved
small
forregion
a relatively
aroundsmall
the region around the
listener. To correct listener.
over a larger
To correct
regionover
andacompensate
larger regionforand
listener
compensate
movement,
for listener
it is movement, it is
necessary to track the
necessary
listener's
toposition
track theand
listener's
use adaptive
positionsignal-processing
and use adaptive methods
signal-processing methods
that allow real-timethatcorrection
allow real-time
of spatial
correction
as well asoffrequency-response
spatial as well as frequency-response
attributes. attributes.
use of a center loudspeaker helps create a solid sound image between the left and
right loudspeakers and anchors the sound to the center of the stage.
 use of a center loudspeaker helps create a solid sound image between the left and
right loudspeakers and anchors the sound to the center of the stage.

For desktop applications,

For desktop
in whichapplications,
a single user in which
is located
a single
in front
userofisalocated
CRT display,
in front
weof a CRT display, we
no longer have theno luxury
longerof ahave
center
the loudspeaker
luxury of a center because
loudspeaker
that position because
is occupied
that position is occupied
by the display. Sizeby
limitations
the display.prevent
Size limitations
the front loudspeakers
prevent the frontfromloudspeakers
being capablefrom being capable
of reproducing theofentire
reproducing
spectrum; thethus,
entire a separate
spectrum; subwoofer
thus, a separate
loudspeaker
subwoofer
is usedloudspeaker is used
to reproduce the lowto reproduce
frequencies. theThe
lowtwo frequencies.
front loudspeakers
The two frontcan create
loudspeakers
a virtualcan create a virtual
(phantom) image that(phantom)
appearsimage
to originate
that appears
from the to originate
exact centerfrom of the
theexact
display center of the display
provided that the listener
provided is that
seated thesymmetrically
listener is seated withsymmetrically
respect to thewith loudspeakers.
respect to the loudspeakers.
With proper head andWithloudspeaker
proper headplacement,
and loudspeakerit is possible
placement,
to recreate
it is possible
a spatially
to recreate a spatially
accurate sound field accurate
with thesound
correctfield
frequency
with the response
correct frequency
in one exact response
position,
in one exact position,
the sweet spot. Eventheinsweet
this static
spot. case,
Even however,
in this staticthe case,
soundhowever,
originating the sound
from eachoriginating from each
loudspeaker arrivesloudspeaker
at each ear at arrives
different
at each
timesear(about
at different
200 μstimes
apart),
(about
thereby200giving
μs apart), thereby giving
rise to acoustic cross
rise
talk
to [Fig.
acoustic
1(b)].cross
These talktime
[Fig.
differences,
1(b)]. Thesecombined
time differences,
with reflection
combined with reflection
and diffraction effects
and caused
diffraction
by theeffects
head, caused
lead tobyfrequency-response
the head, lead to frequency-response
anomalies anomalies
that are perceived as
that
a lack
are perceived
of clarity [48].
as a lack of clarity [48].

This problem can be Thissolved

problemby adding
can beasolved
cross-talk
by adding
cancellation
a cross-talk
filter (as
cancellation
described filter (as described
above in the description
above of in transaural
the description
methods)
of transaural
to the signal
methods)
of each
to loudspeaker.
the signal of each loudspeaker.
While this solutionWhilemay be thissatisfactory
solution mayfor the
be satisfactory
static case, for
as soon
the static
as thecase,
listener
as soon as the listener
moves even slightly, moves
the conditions
even slightly,
for the
cancellation
conditions arefor
nocancellation
longer met,areandnothelonger met, and the
phantom image moves phantom towardimage
the moves
closest toward
loudspeaker
the closest
becauseloudspeaker
of the precedence
because of the precedence
effect. In order, therefore,
effect. Intoorder,
achieve
therefore,
the highest
to achieve
possiblethequality
highest
of possible
sound for quality
a of sound for a
nonstationary listenernonstationary
and preserve listener
the spatial
and preserve
information
the spatial
in theinformation
original material,
in the original material,
it is necessary to know
it is the
necessary
precisetolocation
know the of precise
the listener
location
relative
of the
to the
listener
loudspeakers
relative to the loudspeakers
[47], [49], [50]. In the
[47],section
[49], [50].
below,
In the
we describe
section below,
an experimental
we describesystem
an experimental
that system that
incorporates a novel
incorporates
listener-tracking
a novelmethod
listener-tracking
in order tomethod
overcomein order
the difficulties
to overcome the difficulties
associated with two-ear
associated
listening
withastwo-ear
well as listening
the technological
as well aslimitations
the technological
imposedlimitations
by imposed by
loudspeaker-basedloudspeaker-based
desktop audio systems.
desktop audio systems.