SUBJECT CODE : CCS352 Strictly os per Revised Syllabus of ANNA UNIVERSITY Choice Based Credit System (CBCS) Vertical - 5 (Creative Media) (CSE / IT / AlaDS) MULTIMEDIA AND ANIMATION | Atul P Godse MS. Software Systems (BITS Pilani) BE. Industrial Electronics Formerly Lecturer in Department of Electronics Engg, Vishwokarma Institute of Technology Pune Dr. Mrs. Deepali A. Godse ME., Ph.D. (Computer Engg.) Head of Information Technology Department, Bharati Vidyapeeth's College of Engineering for Women, Pune PUBLICATIONS ‘An Up-Thrust for Knowledge @ scanned with OKEN Scanner— MULTIMEDIA AND ANIMATION Subject Code : CCS352 Veil - 5 (Creative Media) (CSE / IT / AlaDS) © Copyright with Authors {i ebbing ih ned ond ebook version) reserved wth Technical Publication. No Pott of ths bog ‘hold be reproduced in ony fom, Blectronic, Machanicc, Photocopy + any information storage and ‘sirel sytem wihou por pemison in wring om Technical Pleas, Pore Published by TECHNICAL) °° Pen, otice No.1, 412, Shoniwor Peth, Pune - 411030, M.S. INDIA, Printer : Yogi Pinters& Binders SiNo. 10/14, Ghd Ida Ete, Nanded Village Road, TL Hae Dat. Pune 411041 9789355053036 (1) o @ scanned with OKEN ScannerPREFACE ‘The importance of Multimedia and Animation is well known in various engineering fields. Overwhelming response to our books on various subjects inspired us to write this book. The book is structured to cover the key aspects of the subject Multimedia and Animation. The book uses plain, lucid language to explain fundamentals of this subject. The book provides logical method of explaining various complicated concepts and stepwise methods to explain the important topics. Each chapter is well supported with necessary illustrations, practical examples and solved problems. All the chapters in the book are arranged in a proper sequence that permits each topic to build upon earlier studies. All care has been taken to make students comfortable in understanding the basic concepts of the subject. Representative questions have been added at the end of section to help the students in picking important points from that section. The book not only covers the entire scope of the subject but explains the philosophy of the subject. This makes the understanding of this subject more clear and makes it more interesting. The book.will be very useful not only to the students but also to the subject teachers. The students have to omit nothing and possibly have to cover nothing more. We wish to express our profound thanks to all those who helped in making this book a reality, Much needed moral support and encouragement is provided on numerous occasions by our whdle family. We wish to thank the Publisher and the entire team of Technical Publications who have taken immense pain to get this book in time with quality printing. é Any suggestion for the improvement of the book will be acknowledged and well appreciated. Authors AP. Godse Dy. D. A. Godse Dedicated to Neha and Feuturaj @ scanned with OKEN ScannerSYLLABUS Multimedia and Animation - [CCS352] UNITI. INTRODUCTION TO MULTIMEDIA eH Distributed multimedia Definitions, Elemepts, Multimedia Hardware and Software, Dist Te a system, Challenges: security, sharing. distribution, stofdge, retrieval, processing, Multimedia’ metadata, Multimedia databases, Hypermedia, Multimedia eating (Chapter -1) SOMPUting UNITIT = MULTIMEDIA FILE FORMATS AND STANDARDS File formats - Text, Image file formats, Graphic Video file formats, Color in image and video, for the web. (Chapter - 2) and animation file formats, Digital audio and Color Models. Multimedia data and file formats UNIT IIT MULTIMEDIA AUTHORING Authoring metaphors, Tools Features and ‘Types + Card and Page Based Tools, icon and Object Based Tools, Time Based Tools, Cross Platform Authoring Tools, Editing Tools, Painting and Drawing Tools, 3D Modeling and Animation Tools, Image Editing Tools, audio Editing Tools, Digital Movie Tools, Creating interactive presentations, virtual learning, simulations. (Chapter - 3) UNITIV AN: IMATION Principles of animation : staging, Squash and stretch, timing, action, 2D, 2 % D, and 3p Snimation, Animation techniques : K Kinematics, Hind Drawn, Character rigging, Fluid Simulation, skeletal animation, ski (Chapter - 4) UNITY onion skinning, secondary eyframe, Morphing, Inverse Stop motion, motion graphics, Reality, Augmented Reality Vector animation, ‘inning Virtual MULTIMEDIA APPLICATIONS Social networks, smart Phones, surveillance, Analytics Multimedia Strear " ming cloud, media on demand, security and Online SOCial net ir multimedi i ' ontology, Content: based retrieval ™ ) @ scanned with OKEN ScannerTABLE OF CONTENTS Chapter-1 Introduction to Multimedia (1 - 1) to (1 - 42) 1.1 Introduction. 1.1.1 Use of Multiple Media... 1.1.2 Non Linearity 1.1.3 Interactivity 1.1.4 Integrity, 1.1.5 Digital Representation. 1.2 Definitions Multimedia Elements / Components... 1.4.1 Multimedia Playback 1.4.2 Multimedia Production .. 1.5 Distributed Multimedia Systems. 1.5.1 Introduction. " 4.5.2 Components of a Distributed Multimedia System........ 1.5.3 Managing Hypermedia Records as Objects. 1.5.4 Managing Distributed Object: 1.6 Multimedia Sharing and Distribution: (7 Itimedia Metadata ‘L741 Metadata Function: 1.7.2 Metadata Classification 1.7.3 Metadata Applications .. 1.8 Multimedia Databases .. 1.8.1 Multimedia Storage and Retrieval... 1.8.2 Database Management Systems for Multimedia Systems. 1.8.3 Database Organization for Multimedia Applications. 1.8.4 Transaction Management for Multimedia Systems “10 Hypermedia ™ @ scanned with OKEN Scanner1.11 /Multimedia Learning .......00. 1.11.1 Principles of Multimedia Learning .... 41.11.1.1 The Coherence Principle 1.1.1.2 The Signaling Principle. 1.1.1.3 The Redundancy Principle. 1.1.1.4 The Spatial Contiguity Principle. 1.11.15 The Temporal Contiguity Principle. 1.1.1.6 The Segmenting Principle 1.11.17 The Pre-Training Principle, 1.11.18 The Modality Principle. 1.11.19 The Multimedia Principle... 1.11.1.10 The Personalization Principle. 1.11.1.11 The Voice iple 2.11.1.12 The Image Principle 1.41.2 Model of Multimedia Learning Theory... 1.12 Two Marks Questions with Answers, ext File Formats Types of Text 2.2.1.1 Unformatted Text 2.2.1.2 Formatted Text. 2.2.1.3 Hypertent., @ scanned with OKEN Scanner2.3.1.2 Disadvantages of BMP Fike Format . 2.3.2 TIFF (Tagged Image File Format). 2.8.2.1 Advantages of TIFF Format sun I 2.3.2.2 Disadvantages of TIFF Fartnat., 2.3.3 JPEG (Joint Photographers Expert Group) 2.3.3.1 Advantages of JPEG Format 2.3.3.2 Disadvantages of JPEG Format... 2.3.4 GIF (Graphics Interchange Format) urmunnsnnne 2.3.4.1 Advantages of GIF File Format srronne 2.3.4.2 Disadvantages of GIF File Format 2.3.5 BMP File Format 2.3.5.1 BMP File Structure. 2.3.5.2 Bitmap File Header . 2.3.6 TIFF (Tagged Image File Format) .. 2.3.6.1 TIFF File Structure 2.3.7 GIF File Format... 2.3.7.1 GIF File Structure .. Zgnimation File Formats nun 2-30 Espieital Audio File Formats. 2.5.2 AIFF. 2.5.3 VOC. 2.5.4 AV so 2.5.5 MPEG.. 2.5.6 RMF. 2.5.7 WMA. jour in Image and Video... 2.7.1 Colour Characteristics. 2.7.1.1 Luminance or Brightness: 2.7.1.2 Hue... 2.7.1.3 Saturation 2.7.2 Properties of Light. 2.7.3 CIE Chromaticity Diagram. @ scanned with OKEN Scanner2.8 Colour Models “2.8.1 RGB Colour Model 2.8.2 VIO Colour Model 2.83 CMY Colour Model. 2.8.4 HSV/HSL/HSI Colour Model 2.8.5 HLS Colour Model 2.8.6 YUV Colour Model 2.8.7 CMYK Colour Model 2.9 Colour Mixing . 2.10 Colour Selection and Applications . ata and File Formats for the Web... 2.12 Two Marks Questions with AnsWerS sass Chapter - 3 Multimedia Authoring 3.1 Authoring Metaphors. 3.1.1 Card and Page-Based Tools 3.1.2 Icon and Object Based Tools... 3.1.3 Time Based Tools... 3,2 Features of Authoring Too! ‘I Text Editing and Word Processing Tools 3.3.2 Painting and Drawing Tools.. 3.3.3 3-D Modeling and Animation Tools. 3.3.4 Image-Editing Tools. 3.3.5 Audio Editing Tools 7 Video and Digital Movie Tools g Interactive Presentations. irtual Learning 3.5.2 Types of Virtual Learning . 3.5.3 Features of Virtual Learning. 3.5.4 Advantages of Virtual Learning 3.5.5 Disadvantages of Virtual Learning (siti) @ scanned with OKEN Scanner3.6 Simulations. 3.6.1 Types of Simulation 3.6.2 Advantages of Simulation... 3.6.3 tations of Simulation 3.6.4 Applications of Simulation. 3.7 Two Marks Questions with Answers... Chapter-4 Animation ° (4- 1) to (4 - 68) 4.1 Introduction... (tvs of Animation 4.2.1 Traditional Animation 4.2.2 Path Animation...... 4.2.3 2D Animation. 4.2.4 3D Animation. 2.5 2.5D Animat n. inciples of Animation 4.3.1 Squash and Stretc! 4.3.2 Slow-in and Slow-out.... 4.3.3 Maintaining 30 Effects... 4.3.4 Staging (Setting the Scene) 43.5 Anticipation .. 4.3.6 Secondary Action.. 4.3.7 Timing 4.3.8 Exaggeration 4.3.9 Follow Through. 4.3.10 Overlap. 4.3.11 Straight-Ahead Action and Pose-to-Pose Action . } 4.4 Animation Techniques.. A.4.1 Keyframes and Morphin, 4.4.1.1 Morphing ... 4.4.1.2 Tweening .. 4.4.2 Kinematics and Inverse Kinematics .. 4 Terminologies (ix) f | t I @ scanned with OKEN Scanner4.4.2.2 Forward Kinematics... 4.4.2.3 Inverse Kinematics...... 443 Hand Drawn (Traditional) 4.44 Character Rigging... 4.45 Vector Animation .. 4.6 Stop Motion, 4.4.7 Motion Graphics 4,48 Fluid Simulation 4.49 Skeletal Animation. 4.4.10 Skinning.. rtual Reality ———— Three I's of Virtual Reality 45.2 Components of VR System ... 4.5.3 Applications of VR System. 45.3.1 Art and Entertainment. 45.3.2 Education. 45.3.3 Manufacturing and Architecture ... 45.3.4Science 4.5.3.5 Medicine and Surgery... 45.3.6 Robotics 45.3.7 Military... 4.5.3.8 Other Application: 4.5.4 Virtual Reality Device: 45.4.1 Hand Gloves... 45.4.2 Head Mounted Tracking System... 45.43 VR chair. 4544ccD 4545 ,CR, 458.6 3D Sound system ne Head Mounted Display * of Virtual Reality, aa ‘Window-On-World / Desktop vr, $5.2Video Mapping vi 455.3 Immersive yj @ scanned with OKEN Scanner45.5.8 Telepresence. 4.5.5.5 FISN-Tank VR smn i nee 4-57 GS )rurened Reality, 4.6.1 Comparison Between Virtual Reality and Augmented Reality 4.6.2 Advantages and Disadvantages 4.6.3 Applications. 4.7 Two Marks Questions with Answers Chapter-5 Multimedia Applications (5 - 1) to (5 - 32) 5.1 Multimedia Big Data Computing. 5.1.1 Features of Multimedia Big Data. 5.1.2 Challenges of Multimedia Big Data 5.2 Social Networks / Online Social Networking.. 5.3 Smart Phones... 5.4 Surveillance Analytics. ultimedia Cloud Computing 5.5.1 Cloud Computing Characteristics 5.5.2 Cloud Infrastructure .. 5.5.3 Cloud Service Delivery Models. 5.5.4 Cloud Deployment Models... 5.5.4.1 Public Cloud ...... 5.5.4.2 Private Cloud .. 5.5.4.3 Community Cloud .. 5.5.4.4 Hybrid Cloud 5.5.4.5 Comparison Between Various Cloud Types. 5.5.5 Pros and Cons of Cloud Computing. GP Mutimedia Streaming 5.6.1 Streaming Process 5.6.2 Advantages of Multimedia Strear 5.6.3 Factors affecting Streaming Performance.. Expedia On Demand (MOD). 5.7.1 Interactive TV (ITV) and Set Top Box (STB) (xi) @ scanned with OKEN Scanner5,7.2 Broadcast Schemes... 5.7.2.1 Staggered Broadcasting 5.7.2.2 Pyramid Broadcasting 5.7.2.3 Harmonic Broadcasting 5.7.2.4 Pagoda Broadcasting .. 5,73 Buffer Management .. (cei and Forensics 5.8.1 Active Image Authentication 5.8.2 Passive Image Authenticatio itimedia Ontology ) Content-based Retrieval From Digital Libraries {1 Two Marks Questions with Answers wn... Solved Model Question Paper @ scanned with OKEN ScannerIntroduction to Multimedia Syllabus Definitions, Elements, Multimedia Hardware and Software, Distributed multimedia systems, Challenges : security, sharing /distribution, storage, retrieval, processing, computing. Miultimedia metadata, Multimedia databases, Hypermedia, Multimedia Learning. Contents 4.4 Introduction 1.2 Definitions 13° Multimedia Elements / Components 1.4 Mulimedia Hardware and Software (5) Distributed Multimedia Systems - May-08, 09, 10, 11, 16, , Dec.-08, 09, 11, 15, 16, 1.6_Muttimedia Sharing and Distribution “1.7 Multimedia Metadata 1.8 Multimedia Databases. +++, Dee.-04, 08, 15, 16, » May-09, 15, 1.9 Challenges of Multimedia Systems 1.10 Hypermedia 1.11 Multimedia Learning 1.12 Two Marks Questions with Answers aa @ scanned with OKEN Scanner‘ ON 1-2 tic timed one iain Introduction 10 Mutiny, EEE introduction + Multimedia is an integration of text, image, graphic, audio, video and animation, Due to its varying scope, several definitions have been proposed by many authors, ‘The main characteristics of multimedia system include : «Use of multiple media «Non linearity «Interactivity = Integrity «Digital representation Use ‘of Multiple Media * The word multimedia itself indicates use of multiple media, which is its main characteristic. Multiple media is a combination of different modes of communication. « Text being the most primitive mode of communication has been evolved with various forms and scripts and is in continuous use even today, with various transformations applied to it. * Gradually picture replaced the use of text, since hundreds of words can be easily defined by a single picture, Pictures are used globally as a main mode of communication to express ideas in today's world, because pictures do not require a language for expression. * Pictures can be further divided into images and graphics. Images are real world pictures usually captured by a camera. Visual presentations such as portraits, hand drawn sketches, diagrams are called graphics. * Since text, images and graphics do not change over time, their combination is referred to as static elements. After these static elements, the next mode of communication which is also evolved since a long time is, sound. Sound is used everywhere since it can combine huge number of effects, music and human speech of various tones and frequencies. As technology advanced, combination of images and sound called movies evolved. Movies comprises of sei ries of back to back pict ination of indigo h Pictures with a perfect coordina! Movies can further b ” is : ¢ divided into motion pictu: Bn Motion Pictures are recorded on pictures and motion videos. , : a film and motion videos are recorded on a mag} TECHNICAL PUBLICATIONS® . an up-thrust for ‘knowledge @ scanned with OKEN ScannerMultimedia and Animation 1-3 Introduction to Multimedia * With further improvement in technology, animated pictures and movies evolved. Animation is an illusion of imaginary pictures or scenarios which gained fame particularly amongst kids, * Sound, movies (videos) and animations are time varying elements of a multimedia system. * It is a convention to use at least one static media such as text image or graphics and one time varying media such audio, video or animation for a multimedia presentation. Media Static media Time varying media toy | ry 1 Text mages Graphics Sound Movies Animations. nh Motion Motion Animated Animated pictures videos pictures videos Fig. 1.1.1 Multimedia fundamentals Non * Multimedia presentations allow users to navigate from one point to another within the presentation with minimum time delay. This characteristic of multimedia inearity systems is called hon linearity. * There is a limitation to this characteristic. The user cannot navigate arbitrarily. Only navigation along the paths predefined by the users is possible. «This is done to ensure that the presentation runs in a consistent manner without losing its integrity. ‘* In contrast to non linear presentations, linear presentations do not allow users to change timing between the frames and navigate within the presentation. ‘* Non. linearity can be achieved only if the user interacts with the multimedia presentation. Therefore non linearity and interactivity goes hand in hand in multimedia systems. * This interactive session can be achieved with proper use of pre defined options like hyperlinks, popup menus and buttons. TECHNICAL PUBLICATIONS® = an up-thrust for knowledge @ scanned with OKEN Scanneraed Introduction to Mutimoia Murti ona Animation «This is made pt capable of accep suitable output or «This is a very powerful tool in js widely used today in training and reat scope for next generation e-learning tools. es which exploit these tools are Computer Based Training ime system which sible only when the user defines a real s ting, analyzing inputs from the user and accordingly giving a ‘a feedback, This creates a great impact on human mind. ol in grabbing attention and involvement of the user. It and learning modules available online and has «The education packag (CBD) and Computer Aided Instructions (CAD. Integrity » Integrity is of importance in applications where several media types are working at a time. + Itshould be possible to integrate them or make them part of a single entity or the multimedia presentation. ‘« The author has to decide which part of element is user controlled and’ which element cannot be controlled by the user. » For example, the user will not be able to change the background music or animations associated with the multimedia presentation if the author has designed it like that. * This characteristic allows user to play any number of media files like playing a movie, editing a text document, designing an animation and listening to music on’ a music player all within a single platform without compromising its integrity. REY Digital Representation * Now all the above characteristics can work well only if they are represented digitally. For this they have to be controlled by a computer. @ scanned with OKEN ScannerMattimedia and Animation 1-5 Introduction to Mutimedia 1. What is multimedia ? 2 What are the characteristics of multimestia ? Explain each one in detail 3. Write a short note on = a) Use of multiple media.) Nom linearity ©) Interactivity 4) Digital representation. Definitions Interactive multimedia : It is a platform where the user or the viewer can control the elements of multimedia presentation. Hypermedia : It is an interactive media in which the user can navigate through a structure of linked elements. Multimedia developers : These are people who generate and manipulate images, text, audio and video, use multimedia computer tools and technologies to weave them together. Multimedia project : A multimedia project is a unique process that requires ignificant effort and resources in order to reach a definite outcome within specified time and cost restrains. Multimedia title : It is the title of the project which is instructive and gives information about the project that has to be delivered, sold or downloaded. Linear project : It is a non interactive multimedia project in which the user is not provided with navigable and interactive tools. The user only sits and watches the project. Non linear project : It is a interactive multimedia project in which the user is provided with navigable and interactive tools. + Authoring tools : These are software tools that are designed to manage all the elements of multimedia and provide user interaction. Integrated multimedia : It is final multimedia presentation in which all the source documents are merged together. Graphical User Interface (GUD) : This is the actual graphics present on the screen which provides rules for users input. It is the sum of what elements are to be played and how they are suppose to appear. * Multimedia environment : It is the hardware and software involved in creation of a multimedia project. TECHNICAL PUBLICATIONS” - an up-thrust for knowledge @ scanned with OKEN Scanner‘Multimedia and Animation 1-6 Pec ro 1. Define the following : a) Interactive multimedia 0) Hypermedia ¢) Multimedia developers ©) Multimedia project 5 Wetec J) Linear project g) Non linear projet 1) Authoring tools 1) Integrted multimedia.) GUE ¥) Multimedia environment EE] Multimedia Elements / Components + Many multimedia applications such as presentations, training, messaging ele require intermixing of moving images with document images and graphical tox, displays. * They involve dynamic handling of data consisting of a mix of text, voice, atidio components, video components and image animation. * The user can cut sections of any or all of these components and paste them tg create a new application such as a spreadsheet, a desktop publishing system or an animated sequence of events. Such applications are called integrated multimedia applications, * This section discusses the components of multimedia systems. They are also called data elements for multimedia systems. Data elements for multimedia systems Facsimile (Fax) + Iis the first communication technology used to transfer document images over 2 telephone line. * A fax machine usually consists of an image scanner, a modem and a printer combined into a single package. , * Now days, the basic technology widely used, has evolved to allow higher scanning density for better quality fax. Document images * Some documents such as business documents need serious storage to retain for long periods of time. Also, a large number of copies of the original documents may be needed for a large number of people. The multimedia access to such documents allows storage for long period of tim, removes the need for making several copies of the original for storage and distribution, TECHNICAL PUBLICATIONS® - an up-thrust for knowledge @ scanned with OKEN ScannerMultimedia and Animation 1-7 Introduction to Multimedia |} Photographic images + The photographic images are highly needed than typed documents. They are used frequently for a wide range of applications such as employee records for instant identification at a security gate, fingerprint cards, bank signature cards, photo identification systems, real estate systems with photographs of houses, patient medical histories etc. Geographic Information Systems (GIS) maps * The GIS systems store the graphical information of the map along with a database | containing information relating highlighted map elements or item information. For | example, details of the floors, rooms and workers in an office building. * The maps created in a GIS system are being used widely for urban planning, natural resources and wildlife management. Voice commands and voice synthesis + The computer operations can be performed by giving spoken commands to the computer. These are called voice commands. | * Voice synthesis allows the presentation of the results of an action to the user in a | synthesized voice. For example, patient monitoring system in an operation theater. ‘Thus, voice commands and voice synthesis allow hand-free operations of a computer. Audio messages * Text messages can be substituted by audio messages. An audio message can be recorded using a microphone equipped with a computer and it can be attached to an electronic mail message. For example, audio message attachments to documents such as maintenance manuals. Video messages * Video messages can be embedded in electronic mail messages like audio messages. They can range from a single snapshot to full-motion video clips. Full-motion stored and live video * Full-motion stored and live video allow full-motion stored video for electronic mail or live video for presentation and video conferencing. * Itis a very useful idea for on-line training and maintenance manuals. The concept of virtual reality can be created by adapting three-dimensional video techniques. Holographic images * The technologies adapted by all the data elements studied so far present a flat view of information. Holographic images extend the concept of virtual reality. TECHNICAL PUBLICATIONS® - an up-thrust for knowledge @ scanned with OKEN Scanner1-8 Introduction £0 Mun, and Animation moti sows the user to get “nee” @ part. For example, the operation of enging o Inallow’s Ue viewed using holographic images. from inside can Fractals « Fractals jg based on syn! are regular objects with 2 high degree of irregular shape. This technology thesizing and storing algorithms that describe the information, The PCs can be made multimedia enabled with specifications which can assure q ¢ multimedia productions. The Multimedia Marketing Council (MMC) Manes these specifications and are known as Multimedia PC (MPC) specifications. 4 Sumber of companies like Microsoft Corp, Zenith Data System, Philips Consumer Electronics Co., Media Vision, NEC Technologies etc. are included in the MMC. In this section we Will discuss about the hardware and software requirements of a multimedia quality playback o computer. The hardware and software requirements of a multimedia PC can be categorized into two classes. 1. Multimedia playback. 2. Multimedia production. Multimedia playback usually requires smaller amount of resources, that is for viewing an existing multimedia presentation. Multimedia production generally requires greater and more powerful resources. They should fulfil all requirements for designing and developing a multimedia presentation. In both cases, storage and processing requirements are much greater than non multimedia PCs because media components (e.g. images, audio, video) need large file sizes and powerful processors for manipulation and presentation as compared to plain text files. Multimedia Playback The hardware and software requirements of multimedia playback are listed below. * Processor and memory Tbe presence should be at least Pentium class and RAM should be a minimum of (Note : 32 MB RAM is recommended for smoother playback). TECHNICAL PUBLICATIONS® - an up-thrust for knowledge @ scanned with OKEN Scanner‘Muttimedia and Animation 1-9 Multimedia Production Introduction to Multimedia + Hard disk Hard disk should be at least 540 MB in capacity with 15 ms access time and should be able to provide 1.5 MB/sec sustained throughput. * Monitor and video display adapter Monitor and video display adapter should conform to SVGA standards and should be able to support 800 x 600 display mode with true color (16.7 million colors). VRAM should be at least 4 MB. * CD-ROM drive The PC should have a CD-ROM drive with a speed of at least 4X. (Note : Higher speeds like 36X are recommended.) Most of the multimedia Presentations are delivered and executed from a CD-ROM disc. Sound card The PC should have a sound card with attached speakers to hear sounds. Keyboard and mouse The PC should have 101-keys keyboard and two-button mouse. The hardware and software requirements of multimedia production are listed below. * Processors and memory The processors should be at least of the Pentium II class or higher. RAM should be at least of 128 MB. (Note : 256 MB RAM is recommended). * Disk ‘A huge amount of disk space, typically 10 GB is required. (Note : 40 GB disk space is recommended). © Monitor and video display adapter Monitor and video display adapter should conform to SVGA standards and should be able to support 800 x 600 display mode with true color (16.7 million colors). VRAM should be at least 4 MB. (Note : 8 MB VRAM is recommended). CD-ROM drive and CD-writer The PC should be equipped with a CD-ROM drive having a speed of at least 4X. (Note : Higher speeds like 36X are recommended). The PC should also have a CD-writer because most of the multimedia presentations are delivered on a CD-ROM disc. TECHNICAL PUBLICATIONS® = an up-thrust for knowledge @ scanned with OKEN Scannerera, introduation to Multimedia 10 + Sound card, speakers and mi § icrophones di The PC should have a sound card and attached speakers for playback of audio components, db One or more microphones capable of being connected to the sound card lear required for recording of sound. For example, human speech, envirory sound ete. * Keyboard, mouse, scanner, video capture card The PC should have standard input devices like keyboard and mouse, = Additional input devices and accessories would be required for digitizing media components. A scanner would be required for converting paper images into the electronic form. A video capture card would be required for converting analog video from a video cassette to the digital form © System software It should be compatible with Windows 95 or higher, with standard software for Playback of media files in standard formats. Additional software would be required for editing the media components and authoring the presentation. Editing software are used to manipulate media components to suit the developers requirements. For example, Adobe Photoshop, CorelDraw (for image editing), CoolEdit and SoundForge (for audio editing) etc. Authoring software are used to integrate all the edited media into a single presentation and build navigational pathways for accessing the media. For example, Macromedia Director, Asymmetrix ToolBook etc. * Application programs ’ In some cases application programs like Web browsers (eg, Internet Explorer), media players (e.g. QuickTime Movie Player, Real Media Player) and document readers (e.g. PowerPoint Viewer, Adobe Acrobat Reader) might be required to display additional content. Web browsers would be required to display web content. For example, Microsoft Internet Explorer, Netscape Navigator. To create web content HTML and javascript editors might be required. For example, Microsoft Frontpage, Macromedia DreamWeaver etc. io tel 1, Discuss hardware and software requirements of multimedia playback. 2. Discuss hardware and software requirements of multimedia productiori. TECHNICAL PUBLICATIONS® - an up-thrust for knowledge @ scanned with OKEN Scanner‘Muttimedia and Animation 1-11 Introduction fo Multimedia " RGA Distributed multimedia Systems Introduction The LANs are privately owned networks within a single building or campus of upto a few Kilometres in size, The personal computer and workstations in the company offices or factories are interconnected by LAN. Because of LAN, it becomes easy to share resources and exchange the information. 1h LAN, the single cable is used that operates as an ethemet bus shared by all ‘users, LANS are privately owned and can provide the data rates upto 10 Mbps. Using multiport repeaters (bridges), a number of LANs can be operated independently and can acces: '$ resources on other LANs. In the ring network, a number of transmission links are joined together in the form of a ring through repeaters (bridges). Token ring networks were desi igned to use flexible twisted pair wiring. They could be physically configured in a s tar topology (hub and spokes). The centralization of an increasing number of network connections is possible using cabling hubs. The 10BaseT hubs allow multiple networks, multiple media network protocols to be operational on the same hub, Th types and multiple e distance limits of ethernet can be overcome using bridges and routers, * The developments in the LAN contiectivity provides the basis for the solutions required for multimedia systems. Im distributed system, users share the same data a network. Here, the performance These parameters determine the their multimedia applications. cross a complex multilevel Parameters of the network are very important. level of functionality available to the users for 1m this section, we will discuss the components of distributed multimedia systems, the architectural requirements of the corporate distributed infrastructure placed by multimedia applicatio ms and how to address them in the design of multimedia systems. | EE components of a Distributed Multimedia System * When a multi-user system in designed to support multimed k consists of a number of ia applications, it system components. Each componei E Specific function, nt has assigned a TECHNICAL PUBLICATIONS? - an up-thust for knowledge @ scanned with OKEN Scanner(rvoductio 0 Mutiny Multimedia rr that function. Folloing 1d for * It serves a dedicated function and can be optimize onment. are the components of a typical multimedia application envi 1. Applications software 2 Container object store 3. Image and still video store 4. Audio and video component store 5. Object directory service agent 6. Component service agent 7. User interface service agent 8. Networks (LAN and WAN) * Let us discuss these components. 1. Application software ‘await. ch * Its the multimedia application. It creates, edits or displays multimedia objects, The functionality of application determines how to manipulate multimedia objects, * It also decides the extent to which the user can control the rendering of multimedia objects. 2. Container object store * It stores container objects in a network object server. A hypermedia document or a database record (or object) is used as a container. Multimedia objects are embedded in or linked to a container object. * The application starts out with the container objects. When the user displays related information or specifically calls for display or playback of the objec multimedia objects are called. * The examples of container objects are relational databases, object-oriented databases, document databases, flat files etc. 3. Image and still video store * It is a mass storage component for images and still video, Some images need to be stored for long durations and are not editable, for example, medical x-rays, document images ete, * Such images can be stored on WORM (write once read man} ain ) optical disk servers. Optical disk libraries Gjukeboxes) are used for very high volte fo ° 4. Audio and video component store + It is the storage resource used for storin database decides the life of a video object, TECHNICAL. PUBLICATIONS’ UP-thrIst for knowledge @ scanned with OKEN ScannerMultimedia and Animation 1-13 Introduction to Multimedia | ¢ The sections of the video may be cut out or its parts may be resequenced. Thus, | the video objects may be edited on a time-scale basis. The frames can be added, deleted or moved for resequencing, Audio objects can also be edited ‘on a time-scale basis. Audio-video servers may use magneto-optical (rewritable) drives for large-volume storage. WORM optical disk may be used for storing video objects. For isochronous playback, audio and | video objects need fast magnetic disk drives, 5. Object directory service agent * This agent manages identification for all multimedia object types. This identification must be unique for the network and over time. * The functions of creating objects, locating existing multimedia objects are then performed using object directory service. The directory service is also used for retrieval and playback. |: 6. Component service agent * Tt locates each embedded or linked component object of a multimedia container. It also manages proper sequencing for rendering of the multimedia objects. | 7. User interface service agent * It manages the display windows on a user workstation, interacts with the user, sizes the display windows and scales the decompressed object to the selected E window size. | 8. Networks (LAN and WAN) f + Here, the network refers to the corporate-wide network. It consists of all LAN and WAN interfaces required for supporting a particular application for a specific group of users, Managing Hypermedia Records as Objects Object Linking and Embedding (OLE) * Microsoft's ‘Object Linking and Embedding allow objects to be linked or embedded. Normally, the presentation data of an object is present in a linked object and the original data plus information needed to edit the object, that is, the native data is Present in a pointer to an actual file. An emibedded object contains both presentation and native data, That is, the embedded object includes the object itself and the information needed to edit the object. TECHNICAL PUBLICATIONS® - an up-thrust for knowledge @ scanned with OKEN ScannerIntroduction fo Muttnody ‘an be transferred * A document becomes larger because of embedding. However, ean ena {© another workstation and edited. Even though an embedded copy is edited, the original copy of the object remains unaffected. * The database becomes very large because of embedded video objects ai slovis data cetrieval for all components of the hypermedia document, If the hypermedia document includes one or more video objects, the embedding can be a problem. * When an icon for an embedded object is double-clicked, the application that Created the object starts and the object can be viewed ot edited. Objects can nest inside of other objects to several levels of nesting and an object can be dragged from one window to another window. * Ian embedded object is double-clicked, the document remains open and the user inlerface changes - the menus change, toolbars, palettes and other controls appear as necessary for the application, * The embedded object can be edited using the tools provided in its creater application without changing a context * With nes number of database records or hypermedia documents. ied hypermedia objects, the same multimedia object may be included in a Difference between linking and embedding 1. The object gets stored with the container document because of embedding while it gets stored in a specialized object server with linking, 2, An embedded object is always available with the container; a linked object depends on resolving the link to a copy on an accessible server. 3. Editing an embedded object affects only the embedded copy while editing a linked copy affects all container documents that reference it, Managing Distributed Objects * In this section we will discuss, how to locate and retrieve objects in a multi-user environment, Also we will address issues such as replication, archival, load balancing and purging. Interserver communications + In a fully enterprise-wide distributed system, multimedia objects may be distributed on a number of servers spread across the enterprise. * The design requirements that play a role in defining interserver communications for efficient use of system and network resources are listed below. = Object replication «Object distribution TECHNICAL PUBLICATIONS® - an uptnrust for knowledge | @ scanned with OKEN Scanner‘Multimedia and Animation 1-16 Introduction to Multimedia «Object recompilation i = Object management. «The types of communications between servers are listed below : = Obtain a token from an object nameserver for creating a new multimedia object; the object is not accessible by other users until complete and released. = Search the object class directory for the current locations of that object and the t least expensive route for accessing it. * Perform a shared read lock on the object to ensure that it is not archived or purged while it is being retrieved, = Replicate a copy of the object; update the object nameserver directory. = Copy an object for nonpersistent use. = Test and set an exclusive lock on an object for editing purposes; create new versions. = Pause the retrieval of an abject to support a user action or to pace the retrieval to the speed supported by the network. * The requirements of all the above services are different. These services can be provided in a fully distributed environment using a sound server architecture. Object server architecture * An object server architecture should support multimedia applications for a large number of users. The key elements of this architecture are listed below : = Multimedia application E = Common object management API » Common request broker «Object nameserver * Object directory manager © Object server = Object manager = Network manager = Object data store ‘Object identification * A miiltimedia system includes a large number of objects that must be stored on a variety of different servers and accessible from a large number of dient workstations. So, every object requires a unique identity. TECHNICAL PUBLICATIONS® ~ an up-thrust for knowledge @ scanned with OKEN ScannerIntroduction 10 Mutiny, Multimedia and Anim tion , all other objects is cay, * The property of an object that distinguishes it from @ % ‘object identity’. * Objects can be distinguished from one an objec! identification must be maintained within the ay undergo. imrespective of potential bindings that the object ™Y 1 have an identifier tha * A rule for unique object identification : An object with time) a8 well as wig Unique in a time dimension (that is, it does not chang cation in 2 eto) wnt location (that is, its identity does not change with its that it cannot be modified by any programmed action. ther in many potential ways, ‘py r t, must not be changes Object revision management * For same applications, it may be important to trace the object for a historical perspective on the changes. a * Versioning of objects is an important characteristics of the object-oriented design approach. The new object version is created from in older version. back to previous versions of Optimizing network location of objects a . * Locations of text, image, audio, still video and stored full-motion video objects is an important design consideration. ‘ * Multimedia objects for different classes can be a part of one database or separate databases. They can reside on one server or multiple servers. * Automatic relocation of object copies and purging makes searching difficult unless the nameservers for each object server are automatically updated. Object directory services * A multimedia object directory manager is the "nameserver" for all multimedia objects in a LAN. 2 The object directory manager manages changes to the object directory resulting from object manager actions. It also manages replication and synchronization of the replicated object directories, Multimedia object retrieval * The multimedia object manager performs the functions of m; from the multimedia applications for retrieviny storing new or edited multimedia objects created lanaging all requests 'g existing multimedia objects ot by the user. Database replication techniques + Database used in a wide area network by a Ja i faaportent akon russ Ya large number of users raise three 1. Sharing of all data objects by all users on the network. 2. Providing acceptable performance to all use SieGis) oo eeu eure Gog PUBLICATIONS” «69 up-tust for knowledge Ca a @ scanned with OKEN Scanner‘Multimedia and Animation 1-17 Introduction to Muttimedia 3. Allowing all users to update the database depending on: the tasks being performed by them. * It is required to maintain multiple copies of data objects distributed around the network to meet the above goals. TERE UNEE NE * Database duplication can be used to ensure multiple identical copies. Database teplication in widely distributed databases used by a large number of users is a very real issue for hypermedia document databases due to their large sizes. | Object migration schemes "+ Replication is useful and necessary to meet the immediate needs of user. However, replication may leave a large number of infrequently used multimedia objects on servers such that their existance on a permanent basis on ‘all replicated servers cannot really be justified * Some form of migration to alternate media, slower high-volume near-line media or off-line media, must be.considered in the design. + It is important to consider management of objects, not only immediately after their creation but over the longer term, in the design of a multimedia system. Optimizing object storage ‘© The same multimedia object can be referenced by two different types of databases. ‘* The same multimedia object can be a part of different databases on different servers, all linked by LANs and WANS. Alll references can point to the same copy of the multimedia object. © The performance results from location and multiple simultaneous access. To achieve optimized performance, it is required to set up several copies of the k multimedia object on different servers. © The size and isochronicity requirements for multimedia affect storage as well as k performance. The design approaches for optimizing data storage for multimedia 5 objects are given below. t | & Optimizing servers by object type f Automatic load balancing across server p = Versioned object management. f Mass storage for multimedia servers «Large storage requirements of multimedia object servers are economically fulfilled by magnetic disk memories, optical disk memories and Redundant Arrays of Inexpensive Disks (RAID). * Each form of storage has a unique advantage in the storage hierarchy. TECHNICAL PUBLICATIONS® - an up-hrust for knowledge @ scanned with OKEN ScannerIntroduction fo Muttimegi, Muttimedia and Animation 1. What is I ia Tiuking "= adding ? Explain. | lypermedia linking and embedding ? Exp! a detritelobe | \| | | r 2 Write short notes on i) Object linking and embedding. i?) Man"8"S gr pep ‘AU. Explain in detail. ! i ? 3. What are the components avnilable in distributed multimedia system" ° ETM omc) 4. Explain distributed multimedia systems. Rea ree eee) : 5. What are the features of distributed multimedia systems 6 Explain the components of distributed multimedia system. DOE ‘AU : May-16, Marks 8 2. Explain about the components of a distributed multimedia system. 8. Explain any 110 components of a typical multimedia application environment. | . faim Ue EEA Muttimedia sharing and Distribution * Once created, multimedia content must be published and distributed to users. Traditional storage and distribution media, such as optical discs, have largely been replaced in recent years by USB flash drives or Solid-State Drives (SSD), or, more conveniently, the Internet. * Consider YouTube, the most popular video-sharing website on the Internet. A user can easily create a Google account and channel (as Google now owns YouTube) and then upload a video that will be shared with all or selected users. YouTube also supports titles and tags, which are used to categorize videos and link similar videos together. The YouTube page also includes a list of related videos that YouTube has recommended based on the title and tags. © The link to this video can also be fed into other social networking sites like Facebook or Twitter, potentially reaching many users in a short time. * However, the scaling challenge for multimedia content distribution is enormous To reach 100 million viewers, delivering TV-quality video encoded in MPEG4 (1.5 Mbps) will require 1.5 Tops of aggregate capacity. Review Question | 1. Write a note on multimedia sharing and distribution, ~ 1 © @ scanned with OKEN ScannerMultimedia and Animation 1-19 Introduction to Multimedia Multimedia Metadata * Metadata is defined as data that provides information about another piece of ; content but not the data itself, such as a picture or the text message's content. It i assists users in understanding the meaning of the data and is essential in ensuring, f compliance with regulations and data governance initiatives. |= Metadata contains information such as the data's origin, meaning, location, i ownership and creation. For example, metadata within a digital image may | include information such as the image's size, resolution, time of creation and colour depth. It is useful for data classification, organisation, labelling, sorting and searching. / Metadata Functions * Function of metadata include : * Description and organisation : Metadata describes and organises data resources in a repository. A repository's information is organised by audience or topic. It is also hierarchically organised by dynamically constructing pages from database-stored information. Experts can create new metadata by registering, cataloging and indexing * Search and retrieval : Appropriate descriptive metadata makes it easier for users to locate and obtain required metadata and data resource information. It enables the grouping of similar resources and the differentiation of dissimilar ones. Utilization and preservation : Metadata aids in the tracking of a data resource's life cycle. It keeps track of changes, permissions and version control. Data resources should be subjected to a continuous preservation regime and undergo refresh, migration and integrity checking operations to ensure their long-term availability. Information creation, multi-versioning and reuse : Different iterations of a resource may be created for preservation, research, or product development. Administrative and descriptive metadata on the resource should be included by ‘ digitizers. Metadata is critical for the long - term preservation and accessibility of materials. Unique aspects for tracing the provenance of digital objects and describing their physical properties are required for resource preservation and maintenance. Facilitates interoperability : It is simple to share resources like metadata harvesting and cross-system search using established metadata schemes, standardised transfer mechanisms and crosswalks between schemes and APIs. TECHNICAL PUBLICATIONS® - an up-thrust for knowledge @ scanned with OKEN Scannerto Mullnodig Muttimodia and Animation 1-20 Introduction ° re and i * Metadata management software helps to evaluate, curate, apt Lore metadata. Metadata Classification i ait * Metadata can be classified into several types based on ils functionall The six key types of metadata to be aware of are a8 follows ¢ y and source, © Structural metadata * Descriptive metadata * Preservation metadata * Administrative metadata * Provenance metadata * Definitional metadata Structural metadata * Structural metadata contains useful information that aids in the establishment of object relationships. This enables users to comprehend and effectively utilise the data resource. * Structural metadata also contains information about the hierarchical structures that exist between various data resources. A table of contents, as well as page, section, and chapter numbering, may be included. © Its primary function is to improve the display and navigation of collected data, which is aided by a page-turning programme that specifies the order of page graphics. It is influenced by the manner in which photographs are delivered to the user and saved in the repository. Descriptive metadata * Descriptive metadata is useful for discovering and identifying a data resource. It describes the what, when, where and who of a resource. It contains information about the data’s content and context. It is well-organized. «It may also define the physical characteristics of the resource, such as its medium. type and dimensions. * It aids users in searching for and retrieving information at the system level. At the Web level, it allows users to find resources by hyperlinking documents, Preservation metadata ‘© Preservation metadata is information related to the management of collections and information resources for the purpose of preservation, TECHNICAL. PUBLICATIONS® - an up-thrust for kno @ scanned with OKEN ScannerMultimedia and Animation 1-21 Introduction to Multimedia Be, I * It involves documenting the process of preserving physical and digital versions of resources and includes all of the information required to manage and protect digital assets over time. + Preservation metadata in digital repositories may deal with rights management and include information on the rights holders who authorise such actions. Administrative metadata * Administrative “ metadata provides information that is useful in resource management, It contains information on governance, access controls and security. It contains technical information on copyright, rights management and licence agreements. It may include technical data on the creation and quality control of works, rights management, access control, user requirements and action information preservation. It is governed by project-specific procedures based on the local requirements of the Project and’ may include contract agreements and payment information. It combines preservation and technical knowledge. Provenance metadata | ¢ Provenance metadata provides useful information about a data resource's origins. . It contains information on data ownership, any transformations that the data may have undergone, data usage and data archival. This data aids in the tracking of a resource's lifecycle. * When a new version of a data set is created, Provenance metadata is generated, which indicates the relationship between different versions of data objects. Users can query the relationship between versions and include fine - or coarse - grained Provenance data on data resources. Metadata for definitions _* Definitional metadata is metadata that provides a common vocabulary to facilitate @ shared understanding of the data's meaning. The data's meaning includes information on the data's definitions, rules that govern the data’s context and calculations. It may also include information on the logic used when creating derived data in - order to fully comprehend its meaning, Definitional metadata is divided into semantic and schematic categories. A textual description ‘or vocabulary can be used to ser mantically describe structured and ‘unstructured data sets, Structured data sets can be Presented by a database schema, @ scanned with OKEN Scannerwl troduction to Mt Mutimctia and Animation ee tT | ERE Metadata Applications 1 ; 4, The following are the * Metadata in various forms can be used in a variety of ways 18 are the top metadata applications in an organisation + 1, Database management : In. Database Manage! aaihad catiaiats of a-column name and x row number that are associaled 10h @ Pleoy of data. ‘The SQL. standard specifies a standardised method for accessing metadata known as the schema; however, not all databases use this method, Metadata facilitates the organisation, interpretation and request of data. ment System (DBMS), metadata : 2. Internet searches : Websites contain metadata that has @ significant impact on their ranking and success. It ‘al to include metadata details such asa meta title and a meta description when creating a webpage. A meta title briefly describes the topic of the page to give readers an idea of what to expect. 3. Social networking sites : Metadata in social media gives users more control over how their content is shared on platforms like Facebook and Twitter, When users optimise their content, their posts receive more interactions than posts that are not optimised. For example, when users publish links on Facebook, it extracts metadata such as the post's title, a brief description of the post and featured image, the post's URL and the website's name. Users can use Facebook's Open Graph and Twitter Cards to optimise and control how their posts are displayed. 4. Languages of markup : Markup languages enable users to recognise specific elements of a document, such as a paragraph or a header. A Standard Generalised Markup Language (SGML) or Extensible Markup Language (XML) is one of them (XML). SGML enabled the exchange of machine - readable documents. XML is a set of standardised rules for attaching information to text in order for machines to read it. = It works by enclosing text chunks like words, sentences, or paragraphs in tags that describe what's between them. Users can search for keywords in markup content across multiple documents. 5. Applications for tracking consumers : Metadata is frequently used by retail and online shopping websites to track consumer habits and movements. They collect any data that they are legally permitted to collect, such as theif customers’ device type, location, purchases, clicks and times of access to the sites. = They use this information to paint a pi 3 1 seoeicbona and habits, which ae cate a ee ‘customers! preferences: @ a This data can also be used to segment clus ect ane ° ee 4 , em tal advertisements. Similatly, governments can monitor Web activity by using 4 TECHNICAL PUBLICATIONS® - an up.tnust for bain ge Baas: @ scanned with OKEN Scanner‘Multimedia and Animation 1-23 Introduction to Multimedia metadata from web pages and emails, This data can be used for mass surveillance. 6. Information categorization : Classification involves arranging information logically so that it can be found when needed, Taxonomy is the classification of this information into classes or categories and metadata is the data associated with the items. This information can be embedded in the content or in an external content management system. ECAC ead 1. What is metadata ? 2. What are the functions of metadata ? 3. Give the classification of metadata, 4, Explain the applications of metadata. Multimedia Databases COC ee * The user requirement is the addition of multimedia applications and document management as a fully integrated add-on capability to existing systems and applications. «The benefits of multimedia systems are given below. = Since the electronic form is used rather than paper form to file, store and retrieve documents, the time and space needed are reduced significantly. A data management system provides automatically maintained indexing. This eliminates missing file conditions which increases productivity. 1 Multiple users can access the same document simultaneously for display on screen or hardcopy print. Multidimensional information flow within the organization is improved. = There is no necessity of distributing multiple paper copies, so time and money spent on photocopying are reduced. = Because of stored visual interaction, the system provides rapid and correct responses to requests for information. = The paper-based information is converted into a manageable, strategic asset. This allows easy inclusion in other reports and documents. = Integration of multimedia applications and document management with existing applications provides significant dividends in business efficiency of the administrative staff, It also presents significant design challenges in adapting storage management techniques. TECHNICAL PUBLICATIONS® - an up-thrust for knowledge @ scanned with OKEN Scanneree ee ee a Introduction to Multinedie — | Muttimedia and Animation 1-24 Animate EERE Muttimedia storage and Retrioval ls aw considerations which a, * Multimedia storage is characterised by a number of new Cons me listed below, + Massive storage volumes * Large object sizes Multiple related objects = Temporal requirements for retrieval and so on. Some of these factors are discussed here. Massive data volumes * More than 80 % of strategic information typically r simevaiidl t is automated. There are a lot of problems using paper records, films and tapes as given below. esides on paper and only 20 % = They are difficult to integrate, control, search, access and distribute. = Locating them needs searching through massive storage files, complex indexing systems understood only by a few key staff personnel and require a major organizational effort to ensure that they are returned in proper sequence to their original storage locations. = Indexing them is complex especially when these different media are combined into a single multimedia document. Storage technologies * The computerized information systems that handle data, text and graphics can be used to manage information that originates on paper, film, audio and/or video tapes and direct camera input. This results in an integrated strategic information base that can be accessed by many people simultaneously, quickly and easily. Multimedia object storage + A real purpose is served by storing multimedia object in an optical medium only if it can be located rapidly and automatically. Optical media provides very dense storage. Retrieval speed is also an important issue that depends on the following factors. Storage latency. » Compression efficiency (size of the data relative to display resolution). «Transmission latency (transmission media and speed) «Decompression efficiency, * Indexing is essential for fast retrieval of information. TECHNICAL PUBLICATIONS® - an up-thrust for knowledge 4 a @ scanned with OKEN Scanneredia and Animation 1-25 Introduction to Multimedia Multimedia document retrieval * A multimedia document can be identified by storage platter identification and its relative position on the platter. Then these objects are grouped using a database in folders or within complex objects representing hypermedia documents. This is the very basic method used for identifying images in most multimedia systems. IRE:Z4 Database Management Systems for Multimedia Systems _ * Incorporating different forms of information, including text, graphics and video into applications is the most significant challenge for application developers and database managers. Even compressed multimedia objects can be very large. Playback of some of these objects must happen in real time at fixed rates. Also, the database system must be fully distributed since most multimedia applications are based primarily on communications technologies such as electronic mail. A number of database storage choices are available. Some of them are listed below. « Extension of existing Relational Database Management Systems (RDBMSs). = It supports the various objects for multimedia as binary objects. Extension of RDBMSs beyond basic binary objects to the concepts of inheritance and classes. This provides extensions for object-programming front-ends and/or C++ support. ) = Converting to a full-fledged object-oriented database that supports the standard SQL language. = Converting the database and the application to an object-oriented database and using an object-oriented language, such as C++ or an object-enabled SOL for development. = The limitations of relational database systems for implementing multimedia applications stem from two areas : 1. The relational data model, 2. The relational computational model. MS extensions for multimedia », Binary Large Object (BLOB) is a data type adapted by most of the leading _ relational databases. BLOBs are used for objects such as images or other binary data types. Relational database tables include location information for the BLOBs which may be stored outside the database on separate image or video servers. The relational database is extended to access these BLOBs to present the user with a complete data set. Relational databases have the strength of rigorous set gnanagement for maintaining the integrity of the database, + TECHNICAL PUBLICATIONS® - an up-thnist for knowledge @ scanned with OKEN ScannerEy ee oe | sntroavctin to Mulino Oblect oriented databases for multimedia systems (ODMSS) * Object oriented database supports both, , * Encapsulation : Ability to deal with software entities as Uri = Inheritance : Ability to create new objects derived from a smoduilatity at * Object programming embodies the principles of reusable code an , rnted database model cases future maintenance of these databases. The object-or'e jal applicability for includes the class definition concepts which provides @ SP? object classes. multimedia data, fot “rullimeg form ia * Also, the following object database capabilities are important systems, = Message passing = Extensibility * The support of hierarchical structures. ' ODMSs are extensible. They allow incremental changes to the database applications, Object-oriented software technology includes the following important concepts that are very important for multimedia systems. « Encapsulation : It is the ability to deal with software entities as units that interact in pre-defined and controllable manner and where the control routines are integral with the entity. = Association : It is the ability to define a software entity in terms of its differences from another entity. = Clas ication : It is the ability to represent with a single software entity a °P! ‘gl ty number of data items that all have the same behavior and the same state attributes. * The important benefit of object orientation is the ability to organize the software in a more modular and reusable manner. Database Organization for Multimedia Applications The key issues of data organization for multimedia systems are listed below : = Data independence = Common distributed database architecture = Distributed database servers = Multimedia object management. All these issues are discussed here, TECHNICAL PUBLICATIONS” - an uptirust for ino Hedge @ scanned with OKEN Scanner‘Multimedia and Animation 1-27 Introduction to Multimedia "Data Independence « Key features of data independent designs are, = Storage design is independent of specific applications. « Explicit data definitions are independent of application programs. Users need not know data formats or physical storage structures. Integrity assurance is independent of application programs. + Recovery is independent of application programs. The relational database management systems automatically provides the insulation E between application and data. This is important for a multimedia database given F the long, shelf life of multimedia document-based data and the potential for a k variety of future applications that may access this data. | Common distributed database architecture r There is an opportunity to employ common distributed database architectures i because of the insulation between application and data and distributed application access. The key features are listed below : = Multiple independent data structures in system (server). = Uniform distributed access by clients. = A ssingle point for recovery of each database server. ™ Convenient data reorganization to suit requirements. |= Tunability and creation of object classes. * = Expandability. Distributed database servers * These are a dedicated resource on a network accessible to a number of applications. The database server is built for growth and enhancement. The network provides the opportunity for the growth of applications and distributed access to the data. Multimedia object management | © The multimedia object management system must be capable of indexing, grouping and storing multimedia objects in distributed hierarchical optical storage systems and accessing these objects on a keyed basis. A multimedia object may be a component in multiple hypermedia documents such as memos, presentations, video sales brochures etc. The design of object management system should be capable of indexing objects so that there is no need to maintain multiple storage copies. TECHNICAL PUBLICATIONS® - an up-thnust for knowledge @ scanned with OKEN ScannerOl aa Introduction to Matting, Muttimedia and Animation 1-28 KEE Transaction Management for Multimedia Systems mci starts when @ USer mate, pment ion i ce of events tha ; b lelay et on peta nedia document. The transaction i @ Tequest to display, edit or print a hyperm : stored ley complete when the user releases the hypermedia document and s\ ICK the edited versions or discards. / consist of text, data fields, documen, As we know, a hy edia document may i a hypermedia document may tatemotion video clips. D images, still video frames, audio messages and f transaction, the user may add new data elements. ; In most simple applications based on text and textual of numeric ea transaction is managed generally by the server that provides the storage for the data. When data has to be retrieved from multiple data servers, these transaction, become complex. When two users attempt to read from or write to the same daiz record, conflicts arise. In relational databases, multi-phase commit methodologies are used to address the conflicts. For the successful presentation of a hypermedia document to the user, its components should be available for display and Negotiations should be completed with the servers to play out the data at the rate required by the workstation. When a hypermedia document or database recond involves a number of multimedia objects, the case becomes more complex. Review Questions 1. Synchronization issue : In the multimedia ay . Give the importance of multimedia database. CRC List various database management systems used for multimedia systems. List the features of object oriented databases for multimedia systems. Discuss the key issues of data organization for multimedia system. j Write short note on : Multimedia databases. OR a | Explain in detail about multimedia database, AU : May-09, Marks 8 if | ; z 5 j Write a note on multimedia storage and retrieval Write brief notes on multimedia storage and retrival. \ Explain about key issues of data organization for multimedia systems. Es { Explain about the multimedia databases, ESC | Challenges of Multimedia Systems PPlication, various media are used be some relationship between the Sound. There arises the issue at the same time. In addition, there should media. E.g., between Movie (video) and synchronization. © TECHNICAL PUBLICATIONS? - an upto omg —_—_—_—— @ scanned with OKEN Scanner‘Multimedia and Animation 1-29 Introduction to Multimedia Data conversion : In the multimedia application, data is represented digitally. Because of this, we have to convert analog data into digital data. Compression and decompression : Multimedia deals with a large amount of data (eg., Movie, sound, etc.) which takes a lot of storage space. 4. Render different data at the same time 5. bh. Real-time data storage/retrieval, compression and decompression, processing and computing. 1. List the challenges of multimedia systems, ERD Hypermedia * Hypertext is text displayed on a computer display or other electronic devices with references (hyperlinks) to other text that the reader can immediately access. Hypertext documents are interconnected by hyperlinks, which are typically activated by a mouse click, keypress sel, or screen touch. Apart from text, the term “hypertext” is also sometimes used to describe tables, images and other Presentational content formats with integrated hyperlinks. A book can be thought of as a linear medium, meant to be read from beginning to end. A hypertext system, on the other hand, is intended to be read nonlinearly, by following links that point to other parts of the document, or even to other documents. This concept is depicted in Fig. 1.10.1, F Hypertext Normal text B Nonlinear Fig. 1.10.1 Nonlinearity ‘of Hypertext TECHNICAL PUBLICATIONS® - an up-tiust for knowledge @ scanned with OKEN Scannertuction to Mule ‘Muttimedia and Animation 1-30 = : hich contains different forms of wing graphics etc: The common * Hypermedia is an next version of hypertext wi media like, graphics, text, audio, video and mot er AO hypermedia link is image link which can take the wser to the other PS the user to click images, Movies, a nonlinear network of Hypermedia extends upon this by allowing graphics and other media apart from text to create information. . Difference between Multimedi and Hypermedia : media nu —— S.No. Comparison Multimedia os A. m=” haem ; : i extension of hypertext Bas It represents the various forms of ey ‘rarconsidered as tex based. | the information. 2 Types available oth linear and nonlinear are Only non-linear available. available, = At combines both hypertext as well as multimedia to represent information. It combines with hypertext to form a hypermedia. 4. Based on It basically and interact forks on interaction It is used for inter-connectivity among elements and also for the cross referencing. 5. Requirements It requires its own delivery It provides the clickable lis of hardware system called as multimedia increase capability delivery system, It is the combination of the It is more contr media and content which stores and used in non-linear data the information in some form — representation. across the devices. 1, What is hypertext ? 2. What is hypermedia ? 3, Give the difference between Multimedia and Hypermedia, ERE Multimedia Learning + Advances in computer graphic technologies have inspired new efforts 1 understand the potential of multimedia instruction to promote human learning. + Multimedia learning refers to situations in which people learn from words and pictures; also, optionally, using other modes, such as haptic devices, smells, of tastes. : : TECHNICAL PUBLICATIONS” - on upset for knowledge @ scanned with OKEN Scanner