Seminar

Smart Quill

SMART QUILL
With the introduction of handheld computers, the present trend has started preferring small computers to do computation. This has made computer manufacturers to go for almost gadget like computers. Reducing the size of handheld computers can only be taken so far before they become unusable. Keyboards become so tiny you require needle-like fingers to operate them and screens that need constant cursor controls to read simple text. The introduction of mart!uill has sol"ed some of these problems. #yndsay Williams of $icrosoft, %K is the in"entor of mart!uill,a pen that can remember the &ords that is used to &rite, and then transform them into computer text. The pen is slightly larger than ordinary fountain pen, &ith a screen on the barrel. %ser can enter information into these applications by pushing a button .'nformation can be entered using his(her o&n hand&riting. %ser can use any platform for &riting like paper, screen, tablet or e"en air. There is also a small three-line screen to read the information stored in the pen. %sers can scroll do&n the screen by tilting the pen. The pen is then plugged in to an electronic docking station, text data is transmitted to a desktop computer, printer, modem or to a mobile telephones to send files electronically.

Department of CSE

NCET, Shadnagar

Seminar

Smart Quill

INTRODUCTION
#yndsay Williams of $icrosoft Research)s *ambridge %K lab is the in"entor of the martquill, a pen that can remember the &ords that it is used to &rite, and then transform them into computer text . The idea that +it &ould be neat to put all of a handheld,-. type computer in a pen,+ came to the in"entor in her sleep. /'t0s the pen for the ne& millennium,1 she says. 2ncouraged by 3igel 4allard, a leading consultant to the mobile computer industry, Williams took her prototype to the 4ritish Telecommunications Research #ab, &here she &as promptly hired and gi"en money and institutional support for her pro5ect. The prototype, called mart!uill, has been de"eloped by &orld-leading research laboratories run by 4T 6formerly 4ritish Telecom7 at $artlesham, eastern 2ngland. 't is claimed to be the biggest re"olution in hand&riting since the in"ention of the pen. The sleek and stylish prototype pen is different from other electronic pens on the market today in that users don)t ha"e to &rite on a special pad in order to record &hat they &rite. %ser could use any surface for &riting such as paper, tablet, screen or e"en air. The mart!uill isn)t all space-age, though -- it contains an ink cartridge so that users can see &hat they &rite do&n on paper. mart!uill contains sensors that record mo"ement by using the earth)s gra"ity system, irrespecti"e of the platform used. The pen records the information inserted by the user. 8our &ords of &isdom can also be uploaded to your ,* through the /digital ink&ell1, &hile the files that you might &ant to "ie& on the pen are do&nloaded to mart!uill as &ell. 't is an interesting idea, and it e"en comes &ith one attribute that makes entire history of pens pale by comparison9if someone else picks your :ence mart!uill recognizes only the o&ner0s hand&riting. mart!uill and tries to &rite &ith it- it &on0t. 4ecause user can train the pen to recognize a particular hand&riting. mart!uill is a computer housed &ithin a pen &hich allo&s you to do &hat a normal personal organizer does .'t0s really mobile because of it0s smaller size and one handed use. ,eople could use the pen in the office to replace a keyboard, but the main attraction &ill be for users &ho usually take notes by hand on the road and type them up &hen returning to the office. mart!uill &ill let them skip the step of typing up their notes.

Department of CSE

NCET, Shadnagar

Seminar

Smart Quill

WORKING OF SMARTQUILL
mart!uill is slightly larger than an ordinary fountain pen. %sers can enter information into these applications by pushing a button on the pen and &riting do&n &hat they &ould like to enter .The mart!uill does not need a screen to &ork. The really cle"er bit of the technology is its ability to read hand&riting not only on paper but on any flat surface ; horizontal or "ertical. There is also a small three-line screen to read the information stored in the pen< users can scroll do&n the screen by tilting the pen slightly. The user trains the pen to recognize a particular hand&riting style - no matter ho& messy it is, as long as it is consistent, the pen can recognize it. The hand&ritten notes are stored on hard disk of the pen. The pen is then plugged into an electronic +ink&ell+, text data is transmitted to a desktop computer, printer, or modem or to a mobile telephone to send files electronically. %p to => pages of notes can be stored locally on the pen. . tiny light at the tip allo&s &riting in the dark. When the pen is kept idle for some time, po&er gets automatically off.

DISPLAY TECHNOLOGY
Technology used in mart!uill for display is Kopin *orp0s *yber -isplay technology. *yber -isplay is a inch diagonal #*- that uses circuitry built on a silicon &afer, then remo"ed and mounted to glass. The displays are integrated to miniature monitors using its o&n backlighting, optics, '* and packaging.

Department of CSE

NCET, Shadnagar

Seminar

Smart Quill

HANDWRITING RECOGNITION AND SIGNATURE VERIFICATION

.ccelerometers measure hand mo"ement in ? or @ planes An board - , con"erts to . *'' characters for pen applications Write on paper, flat surface, "ertical &all or in air ingle character recognition on pen Record cursi"e letters and do&nload to ,* for decoding ,ass&ord by signature recognition mart!uill &orks by measuring the pen)s mo"ements and matching them to the mo"ements that produce letters and &ords programmed into its memory. 't)s similar to the &ay a microphone detects sound. *onsistency of hand&riting, rather than neatness, is the only condition for accuracy. There are ? techniques used for this purpose B=7 .ccelerometer technology ?7 :and&riting recognition soft&are

Department of CSE

NCET, Shadnagar

Seminar

Smart Quill

ACCELEROMETER TECHNOLOGY
This technology uses a de"ice called .ccelerometer &hich is used for measuring motion. . tiny accelerometer in a pen could be used to detect the stops and starts, arcs and loops of hand&riting, and transmit this information to a small microprocessor that &ould make sense of it as text. There)s also the possibility of "ie&ing a full page of text through a special monocular magnified +"irtual+ screen that could be built into the end of the pen. 'n"isible &riting in air is achie"ed through this unique technology called accelerometer that monitors hand mo"ements and can also be used as a C"irtual hinge0 to scroll around the small screen on the pen and detect left or right-handed use. 't records mo"ement by using the earth)s gra"ity system, &hether you &rite on paper or in the air. :ence it is independent of surface used. $o"ements are stored &ithin the on the sleek built in screen. There are ? types of accelerometer B=. Two Axes Accele o!e"e #$ This accelerometer measures acceleration in t&o axes. .n example for T&o .xes .ccelerometer is .-D#?>? .ccelerometer. mart!uill. This information is transmitted on to a small microprocessor that &ould make sense of it as a text displayed

?. T% ee Axes Accele &"o #$ This accelerometer measures acceleration in three axes. .n example for Three .xes .ccelerometer is Tronics E(- ?g accelerometer.

PROTOTYPE OF SMARTQUILL
This mart!uill prototype records &riting on paper for radio transmission to a

pocket pc, desktop, cell phone or tablet computer. The accelerometer tracks the angular mo"ement of the top of the pen at an angle in the air and these angles plotted as x(y position on pc screen.

Department of CSE

NCET, Shadnagar

Seminar

Smart Quill

.n early hard&are prototype picture sho&s, left to right, tilt sensor , ,'* F bit microcontroller, batteries, and G@@$hz =?>> 4aud radio transmitter. *urrently a radio recei"er on the R ?@? port of a pc records the pen mo"ement for analysis "ia pc. The pen &ill po&er do&n after a period of no mo"ement so doesn)t need an on(off s&itch. The battery life is approximately ?? hours.

HANDWRITING RECOGNITION SOFTWARE

This soft&are embedded in the microprocessor of the pen is used to recognize hand&riting of the user. ,en &orks in con5unction &ith a regular ,* on to &hich users install special hand&riting recognition soft&are. The hand&riting recognition soft&are translates mo"ements in to text on screen. :and&riting recognition soft&are constitutes t&o ma5or phasesB =. :and&riting transcription ?. :and&riting recognition H&'(w )")'* " &'sc )+")o' 'n this phase, the recorded acceleration signals are then transcripted to it0s original form. :ere this aspect is sol"ed using Csimple0 double integration method in order to retrace the pen tip mo"ement on paper.

Method:'n order for this principle to &ork properly, &e ha"e to sol"e t&o main problemsB Hirstly, &e ha"e to kno& pen0s spatial orientation in order to &ithdra& the earth gra"ity component to the measured accelerations. econdly, &e ha"e to succeed in the double integration, &hich is to sol"e all the deri"ation problems due to this method. We can seeB Hig 6=7 represents the acceleration signals recorded &hile one is &riting a small capital 4.

Department of CSE

NCET, Shadnagar

Seminar

Smart Quill

H'I 6=7

Handwriting recognition The second huge aspect is the characters and signatures recognition. The hard&are 6accelerometers plus contact detector7 embedded in the pen has pro"ed a really efficient combination for this application. Method The same method is used to recognize the characters &ritten by a single user and to find &hose signature is the one that has 5ust been done. We use a simple 2uclidian distance as the comparison process, and of course the decision process is the smaller distance found. The first step -=- consists in creating the reference database for the characters as for the signatures. Hor this a mean signal is computed for each recorded symbol.

Department of CSE

NCET, Shadnagar

Seminar
The second step is the recognition process

Smart Quill

=. Hor the creation of database, each symbol &as reproduced se"eral times and a mean normalized symbol &as computed. ?. Hor recognition process, the unkno&n symbol is first normalized, the distance bet&een this symbol and the entire database symbol is computed. Then the unkno&n symbol is recognized as the one &ith the lo&est distance. Protocol The results sho&n in this part are for signature recognition but they are similar as the one obtained for character recognition. The corpus used for signatures &as made by => different signatures from => different people. They made => attempts for the database, and J others for the test base. 'n Hig =, &e can see the accelerometers signals recorded during 8ani0s signing process. Hig ? sho&s the distances computed bet&een the unkno&n signature and the ones in the database. 8ani0s signature &as the last one learnt 6number =>7 and &e clearly see in Hig K that his signature &as &ell recognized.

H'I 6=7 DISPLAY SCROLLS ,Y TILTING SCREEN

Department of CSE

NCET, Shadnagar

Seminar
scroll buttons- 4elo& is an image of mart!uill tilting

Smart Quill
creen designed by #indsey

4y tilting the pen, user can choose applications and scroll through &ith out using Williams for 4T #abs. The pen &ould align text if it &as held in left or right hand so the text &as the correct &ay up for left or right handed people. This &as done by using $icro 2lectromechanical ystems 6$2$ 7 tilt sensors to measure tilt angle to earth. The mart!uill microcontroller read the angle and then mapped the large screen display onto the small G line display. mart!uill could also scroll through pages of display by tilting it in the hand and po&er off if no hand mo"ement &as detected or pen &as flat on a desk. The demonstration unit belo& sho&s display in"erting as mart!uill &as in"erted in the hand. The choice of &ords &as limited to &hat characters the #*- display dri"er could sho& &hile upside do&n 6left hand picture7 ; only =G of the ?L letters of the alphabet &ere usable. These =G characters &ere then processed by anagram soft&are to produce K>> &ords that used these characters. The shopping list belo& &as produced from this limited dictionary to demonstrate the text in"ersion .

COMMUNICATION WITH OTHER DEVICES 2arlier mart!uill models de"eloped by 4T laboratories communicated &ith the

,* "ia a radio transmitter, but the current prototype hooks up to a ,* "ia a cable and electronic docking station called an +ink&ell.+ .The data stored in the memory is uploaded to the personal computer &hen it is placed in to a docking station. .n electronic docking station is a small cabinet to &hich a laptop or notebook computer can be attached for use as a desktop computer, usually ha"e a connector for externally connected de"ices, such as hard dri"es or scanners and ports that can be linked to components such as keyboard, monitor and printer. 't can also be connected to printer, modem or mobile phones to send data electronically. The output accelerometer signals from the pen are digitized &ith a 3ational 'nstrument capture card &ith a frequency He of =>>>:z and a lo& pass filter at HcM=(@NHe .

Department of CSE

NCET, Shadnagar

Seminar

Smart Quill

Huture models could recei"e e-mails and pager messages "ia a &ireless messaging system .This enables t&o-&ay &ireless communication &ith other computing de"ices .

MEMORY mart!uill has G$4 22,RA$ memory. .t a time, up to => pages of notes can be stored locally on the pen. The data is stored in the memory on the pen until it is uploaded to the personal computer. mart!uill &orks by measuring the pen)s mo"ements and matching them to the mo"ements that produce letters and &ords programmed into its memory. 't)s similar to the &ay a microphone detects sound. POWER mart!uill is po&ered by ... battery. 't &ill run for about ?Jhrs on a single ... battery. The pen exhibits automatic po&er on(off system. The pen &ill po&er do&n after a period of no mo"ement. o it supports automatic on(off system.

Department of CSE

10

NCET, Shadnagar

Seminar
APPLICATIONS =.

Smart Quill

mart!uill isn0t all space-age. 't contains an ink cartridge so that users can see &hat they &rite on paper .:ence a simple application of mart!uill is that it &rite notes on paper. This information recorded in the pen is then do&nloaded to ,*.

?.

The information stored in the pen can be input to other de"ices such as mobile phones, printers, modems, desktop computers etc for different applications.

@.

't also pro"ides handheld computer applications such as digital diary, contacts, calculators etc.

G.

't is used for recei"ing pager and e-mail messages. This is possible through recent technology in"ol"ed in mart!uill, the &ireless messaging system &hich allo&s t&o &ay communication bet&een de"ices .

J. L.

mart!uill synchronizes files, e-mails and messages to ,*. mart!uill can be used for "oice record and supports speech recognition. Ooice record is made possible through .-,*$ speech compression .

P.

mart!uill also allo&s third party to add on applications.

ADVANTAGES =. Ane of the ma5or asset is that mart!uill does not need a screen to &ork. This is ensing+ system &hich uses semiconductor possible through re"olutionary + patial

accelerometers. .ccelerometers senses pen(hand mo"ement instead of shapes. ?. @. mart!uill pro"ides intuiti"e user interface. ecurity ; facilitiesB ecurity is another important feature. 't is made possible through t&o

Department of CSE

11

NCET, Shadnagar

Seminar

Smart Quill
recognize a particular hand&riting style. The symbols regularly used by user gets stored in the memory, by frequent use of the pen. :ence the pen accepts only the o&ner0s hand&riting and re5ects intruders hand&riting.'t enables signature "erification. :ence ,ass&ords could be entered in the form of signatures .

a. 't enables hand&riting recognition .%ser can train the pen to

G. The

mart!uill is also a @--mouse, &hen t&isted in air in a certain &ay it enables

scrolling of the screen. 't also automatically detects left or right handed use. J. ,o&er sa"ing a. mall screen size requires less battery po&er . b. 3o mo"ement of the pen causes auto po&er do&n L. mart!uill is all mobile, smaller in size and enables one-handed use.

CONCLUSION mart!uill &ill be brought to the market by the end of ?>>L.The estimated cost of this futuristic pen is around QL>>. mart!uill supports t&o factors B small size and con"enient use. The future of mart!uill ensures all computation po&er the user needs right inside the pen. Reducing the size of handheld computers can only be taken so far before they become unusable. Keyboards become so tiny you require needle-like fingers to operate them and screens that need constant cursor controls to read simple text. The introduction of mart!uill is the best solution for this problem.

Department of CSE

12

NCET, Shadnagar