Tele-Graffiti

By:
Under the guidance of: Nagendra K.
Mrs.Prabhavathi K.
(4BW07EC410)

1
CONTENTS
 Introduction
 What exactly it means ?
 What actually it consists of ?
 How does it look like ?
 Hardware models
 System software architecture

2
Introduction
 Remote Education- Teacher and student
can interact in Real-time by using hand drawn
sketches on papers. Initially it was video taped
which was difficult to solve many querries.

 Tele-collaboration- architects from

different sites can communicate with existing
plan.

3
What is Tele-Graffiti all about?
 Tele-Graffiti is a remote sketching system
allowing two or more users to communicate via
hand-drawn sketches.
 What one person writes at one site is captured
using a video camera, transmitted to the other
site(s), and displayed there using an LCD
projector.
 First design was xerox “double digital desk”
it has disadvantage of real time paper tracking
and video transmission.

4
What it consists of?
 PC
 Camera
 Projector
 Mirror
 Paper and computer interface
 Communication Network (LAN) for
transmission and reception of images

5
How does it look like?

6
7
Hardware

8
 Adjusting the stand has 2 degrees of freedom to
adjust camera, projector and the mirror

9
 Adjust the projected area: adjust the mirror and projector to create
rectangular region on desktop.

 Adjust the viewable area: adjust the mirror and camera to match the centre
of an image with projector.

10
Adjust the optical axis and the zoom wit
“Auto zoom”

 Set the zoom: zooming in decreases working

area whereas zooming out increases the area.

 Auto zoom: used to automatically set the zoom

of the camera so that the viewing area of the
camera matches the projection area of projectr

11
12
 Projector model

Projector Intensity
Gain of projector
Radiance of light projected

Irradiance of light received

Area of projector lens

Distance from projector lens to paper via the mirror

Angle principal ray makes with optical axis

Angle principal ray makes with normal of paper

13
Paper Model

Radiance of the reflected light

Total ambient incoming irradiance
Albedo of the paper

Camera Model

Irradiance of the light captured on image plane of the camera

Area of the camera lens
Distance between the length and image plane
Angle between principal ray and optical axis

14
 Camera Intensity
Gain of the Camera

Complete imaging model

15
 System software

Architecture- 4 threads

 Drawing thread: continuous display of latest image

received “Image to display”.

 Paper Detection thread: continuous grab of images and

tracking of paper, updates “local paper vertices” and
“Image to send”.

 Sending thread: continuous conversion of images to send

from YUV to RGB, compresses and sends with “local paper
vertices”.

 Receiving thread: continuously wait for images and

“remote paper vertices” to arrive, decompresses then
update “Image to display”.

16
System architecture

17
The 4 threads share the following data

 Image to display: latest image received and its

shared between receiving and drawing thread.

 Remote paper vertices: estimated paper vertices

in the image to display.

 Image to send: YUV image that is shared between

paper detection and receiving thread.

 Local paper vertices: estimated paper vertices in

the captured image.

18
Image Warping

19
Paper Detection-Paper Tracking Algorithm

 Down-sample and smooth the captured

image (only for slower CPU).
 Detect edges in sample
 Remove edges which come from the
projection of previous time steps
 Group edge pixels w.r.t their angles
 Divide edge pixels into paper-clipboard and
clipboard-desk edges
 Fit lines for each edge group
 Estimate paper orientation
20
21
Communication between Tele-Graffiti Sites

Communication Protocol

22
Present and Future trends

 Real-Time paper tracking and Video transmission

 Hand-Based user Interface and Automatic
summarization
 Feedback analysis for Gain selection and Image
separation
 3D Paper tracking
 Sketch Interpretation

23
 BIBLIOGRAPHY
 URL: http://www-graphics.stanford.edu/projects/RWB/

 http://www.ri.cmu.edu/projects/project 423.html

 ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=937712

 www.toodoc.com

 www.scribd.com

24
25
26