CSE

SRTIST, NLG

INTRODUCTION
Over the past couple of years, a new class of interactive device has begun to emerge, what can best be described as surface computing. Two examples are illustrated in this report. They areSurface Table top Perceptive Pixel

The Surface table top typically incorporates a rear-projection display coupled with an optical system to capture touch points by detecting shadows from below. Different approaches to doing the detection have been used, but most employ some form of IR illumination coupled with IR cameras. With todays camera and signal-processing capability, reliable responsive and accurate multi-touch capabilities can be achieved. The multitouch pioneer and his company, Perceptive Pixel, have devoted the better part of two years to building an entirely new multitouch framework from the ground up. Instead of simply mapping multitouch technology to familiar interfaces and devices, Han's goal is far more sweeping: To use the technology as a foundation for an entirely new operating system. Because they are new to most, the tendency in seeing these systems is to assume that they are all more-orless alike. Well, in a way that is true. But on the other hand, that is perhaps no more so than to say that all ICs are more-or-less alike, since they are black plastic things with feet like centipedes which contain a bunch of transistors and other stuff. In short, the more that you know, the more you can differentiate. But even looking at the two systems in the photo, there is evidence of really significant difference. The really significant difference is that one is vertical and the other is horizontal. Why is this significant? Well, this is one of those questions perhaps best answered by a child in kindergarten. They will tell you that if you put a glass of water on the vertical one, it will fall to the floor, leading to a bout of sitting in the corner. On the other hand, it is perfectly safe to put things on a table. They will stay there. Microsoft Surface The new concept thats driving the webosphere crazy is the new and totally innovative Microsoft Surface Computing. Microsoft Surface is basically a surface computer that erases the

SURFACE COMPUTING 1

CSE

SRTIST, NLG

borders between physical and virtual worlds. It is the new approach of interacting with Digital Content in a physical manner using abstract technology. Microsoft is the first company ever to bring such an idea to the market as a commercial product. Surface computing is a new way of working with computers that moves beyond the traditional mouse-and-keyboard experience. It is a natural user interface that allows people to interact with digital content the same way they have interacted with everyday items such as photos, paintbrushes and music their entire life: with their hands, with gestures and by putting real-world objects on the surface. Surface computing opens up a whole new category of products for users to interact with. Surface computing is a completely intuitive and liberating way to interact with digital content. It blurs the lines between the physical and virtual worlds. By using your hands or placing other unique everyday objects on the surface such as an item youre going to purchase at a retail store or a paint brush you can interact with, share and collaborate like youve never done before. Imagine youre out at a restaurant with friends and you each place your beverage on the table and all kinds of information appears by your glass, such as wine pairings with a restaurants menu. Then, with the flick of your finger, you order dessert and split the bill. We really see this as broadening content opportunities and delivery systems. Surface computing is a powerful movement. In fact, its as significant as the move from DOS [Disk Operating System] to GUI [Graphic User Interface]. Our research shows that many people are intimidated and isolated by todays technology. Many features available in mobile phones, PCs and other electronic devices like digital cameras arent even used because the technology is intimidating. Surface computing breaks down those traditional barriers to technology so that people can interact with all kinds of digital content in a more intuitive, engaging and efficient manner. Its about technology adapting to the user, rather than the user adapting to the technology. Bringing this kind of natural user interface innovation to the computing space is what Surface Computing is all about.

SURFACE COMPUTING 2

CSE

SRTIST, NLG

HISTORY
Surface computing is a major advancement that moves beyond the traditional user interface to a more natural way of interacting with digital content. Microsoft Surface, Microsoft Corp.s first commercially available surface computer, breaks down the traditional barriers between people and technology to provide effortless interaction with all forms of digital content through natural gestures, touch and physical objects instead of a mouse and keyboard. The people will be able to interact with Surface in select restaurants, hotels, retail establishments and public entertainment.

An Idea Inspired by Cross-Division Collaboration

In 2001, Stevie Bathiche of Microsoft Hardware and Andy Wilson of Microsoft Research began working together on various projects that took advantage of their complementary expertise in the areas of hardware and software. In one of their regular brainstorm sessions, they started talking about an idea for an interactive table that could understand the manipulation of physical pieces. Although there were related efforts happening in academia, Bathiche and Wilson saw the need for a product where the interaction was richer and more intuitive, and at the same time practical for everyone to use. This conversation was the beginning of an idea that would later result in the development of Surface, and over the course of the following year, various people at Microsoft involved in developing new product concepts, including the gaming-specific Play Table, continued to think through the possibilities and feasibility of the project. in October 2001 a virtual team was formed to fully pursue bringing the idea to the next stage of development; Bathiche and Wilson were key members of the team.

Humble Beginnings on a Table

In early 2003, the team presented the idea to Bill Gates, Microsoft chairman, in a group review. Gates instantly liked the idea and encouraged the team to continue to develop their thinking. The virtual team expanded, and within a month, through constant discussion and brainstorming, the first humble prototype was born and nicknamed T1. The model was based on an IKEA table with a hole cut in the top and a sheet of architect vellum used as a diffuser. The evolution of Surface had begun. A variety of early applications were also built, including pinball, a photo browser and a video puzzle. As more applications were developed, the team saw the value of the surface computer beyond simply gaming and began to favor those applications that
SURFACE COMPUTING 3

CSE

SRTIST, NLG

took advantage of the unique ability of Surface to recognize physical objects placed on the table. The team was also beginning to realize that surface computing could be applied to a number of different embodiments and form factors. Over the next year, the team grew significantly, including the addition of Nigel Keam, initially software development lead and later architect for Surface, who was part of the development team eventually tasked with taking the product from prototype to a shipping product. Surface prototypes, functionality and applications were continually refined. More than 85 early prototypes were built for use by software developers, hardware developers and user researchers.

One of the key attributes of Surface is object recognition and the ability of objects placed on the surface to trigger different types of digital responses, including the transfer of digital content. This feature went through numerous rounds of testing and refining. The team explored various tag formats of all shapes and sizes before landing on the domino tag (used today) which is an 8-bit, three-quarter-inch-square tag that is optimal thanks to its small size. At the same time, the original plan of using a single camera in the vision system was proving to be unreliable. After exploring a variety of options, including camera placement and different camera lens sizes, it was decided that Surface would use five cameras that would more accurately detect natural movements and gestures from the surface.

T1 PROTOTYPE :

SURFACE COMPUTING 4

CSE

SRTIST, NLG

In 2004, the team grew and became the Surface Computing group. Surface prototypes, functionality and applications were continuously refined. The team built more than 85 early prototypes for use by software developers, hardware developers and user researchers.

Hardware Design:
The Tub model

By late 2004, the Microsoft Surface development platform was established and attention turned its form. A number of different experimental prototypes were built, including the tub model that was encased in a rounded plastic shell, a desk-height model with a square top and cloth-covered sides and even a bar height model. After extensive testing and user research, he current look and feel of Surface was finalized in 2005.

OUTER DESIGN OF SURFACE COMPUTER:

The next phase of the development of Surface focused on continuing the journey from concept to product. Although much of what would later ship as Surface was determined, there was significant work to be done to develop a market-ready product that could be scaled to mass

SURFACE COMPUTING 5

CSE

SRTIST, NLG

production. So much work goes into turning a prototype into a product that can handle the strain and stress of everyday use, Keam said. For instance, when we developed the T1 prototype, it couldnt be moved without having to recalibrate it. Now, obviously the product can easily be moved. To get Surface to where it is today, the code had to be rewritten from the ground up. In early 2006, Pete Thompson joined the group as general manager, tasked with driving end-toend business and growing development and marketing. Under his leadership, the group has grown to more than 100 employees.

Today Surface has become the market-ready product once only envisioned by the group, a 30-inch display in a table-like form factor thats easy for individuals or small groups to use collaboratively. The sleek, translucent surface lets people engage with Surface using touch, natural hand gestures and physical objects placed on the surface. Years in the making, Microsoft Surface is now poised to transform the way people shop, dine, entertain and live. Seeing Surface grow from a small germ of an idea to a working prototype and then to a full-fl edged market ready product has been an amazing journey, Wilson said. This is a radically different user-interface experience than anything Microsoft has done before, and its really a testament to the innovation that comes from marrying brilliance and creativity.

SURFACE COMPUTING 6

CSE

SRTIST, NLG

SPECIFICATIONS
DISPLAY
Type: 30-inch XGA DLP projector. Graphics card with 256 MB of memory. Maximum resolution: 1024 x 768 Maximum pressure on the display: 50 pounds/square inch/3.5 kg per cm.

INPUT

Camera-based vision system with LED infrared direct illumination. Bluetooth keyboard and mouse (available to administrators).

COMPUTING SYSYTEM
2.13-GHz Intel Core TM 2 Duo processor Memory: 2 GB dual-channel DDR2

AUDIO
Output type: Stereo flat panel built-in speakers Output compliant standards: Stereo Input: None

I/O CONNECTIONS
2 headphone jacks 6 USB 2.0 ports Ethernet port (Gigabit Ethernet card [10/100/1000]) External monitor port Bays for routing cables
SURFACE COMPUTING 7

CSE On/Standby power button

SRTIST, NLG

DESIGN AND WORKING

SCREEN

INFRARED

CPU

5.CAMERA

(1)

SCREEN:

A diffuser turns the Surface's acrylic tabletop into a large horizontal "multitouch" screen, capable of processing multiple inputs from multiple users. The Surface can also recognize objects by their shapes or by reading coded "domino" tags.

SURFACE COMPUTING 8

PROJECTOR

CSE

SRTIST, NLG

(2) INFRARED:
Surface's "machine vision" operates in the near-infrared spectrum, using an 850-nanometerwavelength LED light source aimed at the screen. When objects touch the tabletop, the light reflects back and is picked up by multiple infrared cameras with a net resolution of 1280 x 960.

3) CPU:
Surface uses many of the same components found in everyday desktop computers a Core 2 Duo processor, 2GB of RAM and a 256MB graphics card. Wireless communication with devices on the surface is handled using WiFi and Bluetooth antennas (future versions may incorporate RFID or Near Field Communications). The underlying operating system is a modified version of Microsoft Vista.

(4)PROJECTOR:
Microsoft's Surface uses the same DLP light engine found in many rear projection HDTVs. The footprint of the visible light screen, at 1024 x 768 pixels, is actually smaller than the invisible overlapping infrared projection to allow for better recognition at the edges of the screen.

(5)CAMERA:
Microsoft Surface uses cameras to sense objects, hand gestures and touch. This user input is then processed and displayed using rear projection. Image processing system processes the camera images to detect fingers, custom tags and other objects such as paint brushes when touching the display

SURFACE COMPUTING 9

CSE

SRTIST, NLG

TECHNOLOGY
The technology allows non-digital objects to be used as input devices. This is made possible by the fact that, in using cameras for input, the system does not rely on restrictive properties required of conventional touch screen or touchpad devices such as the capacitance, electrical resistance, or temperature etc. The computer's "vision" is created by a near-infrared, 850-nanometer-wavelength LED light source aimed at the surface. When an object touches the tabletop, the light is reflected to multiple infrared cameras allowing it to sense, and react to items touching the tabletop.

Microsoft Surface uses cameras to sense objects, hand gestures and touch. This user input is then processed and displayed using rear projection. Specifically Microsoft Surface uses a rear projection system which displays an image onto the underside of a thin diffuser. An image processing system processes the camera images to detect fingers, custom tags and other objects such as paint brushes etc when touching the display. The objects recognized with this system are reported to applications running in the computer so that they can react to object shapes, 2D tags, movement and touch.

SURFACE COMPUTING 10

CSE

SRTIST, NLG

How it works: The surface itself isnt touch-sensitive, but a series of cameras inside the table can see when someone places or drags a finger, hand or any other object on or across the tabletop screen. Internal projector lights screen from beneath. Interface: People can use their hands to touch and move virtual objects on the screen, just as they would with a mouse on a traditional PC. The system also can recognize objects placed on the surface, based on their shape or on special codes affixed to them. Size: 22 inches high, 21 inches deep, 42 inches wide, with 30-inch screen. Essentially, Microsoft Surface is a computer embedded in a medium-sized table, with a large, flat display on top that is touch-sensitive. The software reacts to the touch of any object, including human fingers, and can track the presence and movement of many different objects at the same time. In addition to sensing touch, the Microsoft Surface unit can detect objects that are labeled with small "domino" stickers, and in the future, it will identify devices via radiofrequency identification (RFID) tags.

Domino Tags:
Surface uses the domino tag to identify objects. These domino tags are also called as Gamma tagging. These domino tags similar to bar codes. The tags consist of a pattern of variously sized dots. Geometrical arrangement of the dots implies the position of the object. Surface can respond to 52touches at a time.

SURFACE COMPUTING 11

CSE

SRTIST, NLG

FEATURES
DIRECT INTERACTION:
Users can actually grab digital information with their hands and interact with content through touch and gesture, without the use of a mouse or keyboard.

SURFACE COMPUTING 12

CSE

SRTIST, NLG

MULTI USER:
The horizontal form factor makes it easy for several people to gather around surface computers together, providing a collaborative, facetoface computing experience.

SURFACE COMPUTING 13

CSE

SRTIST, NLG

OBJECT RECOGNISATION :
Users can place physical objects on the surface to trigger different types of digital responses, including the transfer of digital content.

SURFACE COMPUTING 14

CSE

SRTIST, NLG

APPLICATIONS WATER:
Water is used as an "attract mode" for the Surface desktop, and it is certainly attractive. A unique feature that comes preinstalled with Surface is the pond effect "Attract" application. Simply, it is a "picture" of water with leaves and rocks within it. By touching the screen, you can create ripples in the water just like you were putting your hand into a real stream, Additionally, the pressure of touch alters the size of the ripple created, and objects placed into the water create a barrier that ripples bounce off, just as they would in real life

MUSIC:
The Music application works like a virtual jukebox, displaying music arranged by album and allowing the user to flip over albums, select songs, and drag them to the "Now Playing" section. In addition to playing music that is already stored on the unit's hard drive, Music can also transfer songs from portable music players

SURFACE COMPUTING 15

CSE

SRTIST, NLG

PHOTOS :
Sharing photos is a much more unrestricted activity. Photos are arranged into albums that look like piles. Tapping the pile once spreads it around the screen and from there user can drag, rotate, and resize the images. Since Surface can detect many touches at the same time, multiple people can sort and resize pictures.

SURFACE COMPUTING 16

CSE

SRTIST, NLG

VIDEO PUZZLE :
Video Puzzle showcases the power of the little identification tags mentioned above. In Video Puzzle, these virtually invisible tags are placed upon small squares of glass. When the pieces of glass are put on the table, the screen starts playing video clips underneath each one. Because the video moves whenever you move the squares, it creates the illusion that the glass itself is displaying the video, which looks very futuristic. As you move the squares around, you quickly realize that the video clips are all pieces of a larger video. Flipping the glass squares over inverts the video playing underneath, making completing the puzzle even more of a challenge. When you complete the puzzle correctly, the system senses the achievement, congratulates you, and shows you the time taken to finish. According to Mark Bolger, the current record for finishing when the pieces are fully randomized is 1 minute and 53 seconds.

PAINT:

SURFACE COMPUTING 17

CSE

SRTIST, NLG

Paint programs have been a natural demonstration application for new platforms ever since Mac Paint graced the first Macintosh back in 1984. Surfaces paint program is even lighter on features than Mac Paint was, but the natural user interface makes up for this deficiency. There are three draw modes that can be toggled by touching an icon on the bottom of the toolbar: brush, paint, and reveal, the last of which is kind of a negative brush that shows a background bitmap underneath. The brush mode is a bit spotty and tends to skip, but the paint mode is smooth and fun. You can draw using one finger, all your fingers at once (good for drawing hair), the palm of your hand, or using any natural object such as a regular paintbrush. Using the program is like having a flashback to finger painting back in kindergarten (minus the mess), and certainly children will have tons of fun with this kind of application.

DINING RESTAURENT USES :

SURFACE COMPUTING 18

CSE

SRTIST, NLG The application allows diners to see a virtual menu on screen. Items can be dragged into a

central ordering area order right from the table beverages and food selections then split the bill and pay electronically at the same time by putting customers card on the surface.

PATIENT INTERFACE
A demo application that shows how a digital health care system could be streamlined using Surface for patient consultations in Texas Health.

SURFACE COMPUTING 19

CSE

SRTIST, NLG :

DAVINCIBYRAZORFISH

It is an experimental app that allows users to draw and manipulate objects using a real-world physics engine to simulate movement

T-MOBILE STORES :

SURFACE COMPUTING 20

CSE

SRTIST, NLG Two cell phones can be placed on the surface and compare the different price points and

features, experiment with ring tones and look at plans then program the phone to your liking and have it all set to use before you walk out of the store

MICROSOFT SURFACE GLOBE :

SURFACE COMPUTING 21

CSE

SRTIST, NLG Microsoft surface Globe pretty much puts the whole world in your hands (well, kind of!).

It uses the Virtual Earth 3D engine to display a 3D version of the world. Using multi-touch, you can navigate to different regions, get local information, and pin your favorite locations. You can even fly around 3D models of buildings in some cities.

SURFACE COMPUTING 22

CSE

SRTIST, NLG

USAGE OF SURFACE TODAY

USAGE OF SURFACE TODAY

SURFACE COMPUTING 23

CSE

SRTIST, NLG Currently only commercially available and being used in the retail, hospitality, automotive, banking and healthcare industries.

Current customers are AT&T, T-Mobile, the Rio All Suite Hotel & Casino in Las Vegas, Sheraton Hotels, Disney Innovations House in California, Hotel 1000 in Seattle, Harrahs Entertainment, and Starwood Hotels and Resorts Worldwide.

SURFACE COMPUTING 24

CSE

SRTIST, NLG

ADVANTAGESS & DISADVANTAGES

SURFACE COMPUTING 25

CSE

SRTIST, NLG

ADVANTAGESS & DISADVANTAGES

ADVANTAGES
1. Four features are the main advantage of surface computing. 2. Large surface area to view different windows and applications. 3. Data Manipulation - Selecting, moving, rotating and resizing (manipulating objects on the screen is similar to manipulating them in the manual world). 4. Designing made easier. Quick and easy to use. 5. Time saving by eliminating many processes. 6. Intuitive user interaction with natural gestures. 7. Collaborative computing experience. 8. Seamless- no wires or USB ports. 9. Instant download/upload of photos. 10. Users have more control of technology- ordering food or manipulating photos fast. 11. Educational- learn more info about the products you are using. 12. New and improved learning experience

SURFACE COMPUTING 26

CSE

SRTIST, NLG

DISADVANTAGES :

1. Incredibly expensive and not Portable - table has to stay put.

2. Loss of Privacy - Open for many to view. 3. Screen Visibility - Glare, finger prints/dirt and human interaction obscuring interface. Dim lighting required to avoid washing out of screen. 4. Poor Accuracy - Fat fingers are not as accurate as a mouse or stylus. 5. Fatigue - Reaching across the table often can cause the arms to ache. Have to be careful of table surface to not damage it 6. Objects needs to be tagged (domino tags or RFIDs).

SURFACE COMPUTING 27

CSE

SRTIST, NLG

FUTURE ENHANCEMENTS

FUTURE ENHANCEMENTS
Although surface computing is a new experience for consumers, over time Microsoft

SURFACE COMPUTING 28

CSE

SRTIST, NLG believes there will be a whole range of surface computing devices and the technology will become pervasive in peoples lives in a variety of environments.

Computer scientists hope to incorporate this kind of technology in peoples daily lives Future goals are to surround people with intelligent surfaces-look up recipes on kitchen counter or table, control TV with coffee table, etc

As form factors continue to evolve, surface computing will be in any number of environments- schools, businesses, homes, restaurants, retail, automotive, banking and healthcare industries and in any number of form factors. Eventually every household may have one in place of their everyday coffee table.

SURFACE COMPUTING 29

CSE

SRTIST, NLG

CONCLUSION

SURFACE COMPUTING 30

CSE

SRTIST, NLG

CONCLUSION
Microsoft Surface is the future of computers. Surface Computing brings to life a whole new way to interact with information that engages the senses, improves collaboration and empowers consumers. It takes existing technology and presents it in a new way. It isn't simply a touch screen, but more of a touch-grab-move-slide-resize-and-place-objects-on-top-of-screen and this opens up new possibilities that weren't there before. By utilizing the best combination of connected software, services and hardware developing surface computing products that push computing boundaries, deliver new experiences that break down barriers between users and technology.

SURFACE COMPUTING 31

CSE

SRTIST, NLG

A computer on every desktop Now we say Every desktop will be a computer

SURFACE COMPUTING 32

CSE

SRTIST, NLG

BIBLIOGRAPHY

BIBLIOGRAPHY

Kinematic geometry of surface machining: By Kerenvi & Richardson

SURFACE COMPUTING 33

CSE

SRTIST, NLG

An approach for surface reconstruction of 3D CAD models.Tiwari, Amid; Pathmark, V.Chatterjee, A. Dhande, S.G.

Web Links:
1. http://www.microsoft.com/surface/about.html 2. http://www.popularmechanics.com/technology/industry/4217.html 3. http://www.microsoft.com/surface/about_faqs/faqs.aspx . 4. http://en.wikipedia.org/wiki/Surface_computing

SURFACE COMPUTING 34