Multimedia System

Chapter Six : Fundamental Concepts in Video

1
Color Models in Video
YUV
YCbCr
YIQ
YUV
defines a color space in terms
Luminance (Y)
the brightness
Chrominance (U & V)
the difference between a color and a reference white at the
same luminance.
models human perception of color more closely than the standard
RGB model

2
YUV Color Model
 Color information(3 chrominance signals U and V) Where,

 If b/w image, U = V = 0. --> No chrominance!

3
YCbCr Color Model
It is a scaled and shifted YUV
Cb = (B - Y) / 1.772 + 0.5
Cr = (R - Y) / 1.402 + 0.5
The chrominance values are always in the range of 0 to 1.

YIQ Color Model

Although U and V nicely define the color differences, they do
not align with the desired human perceptual color sensitivities.
I and Q are scaled and rotated version of U&V
I = 0.877(R - Y) cos 33 - 0.492(B - Y) sin 33
4 Q = 0.877(R - Y) sin 33 + 0.492(B - Y) cos 33
  Y = 0.3R + 0.59G + 0.11B
 Chrominance
 I = 0.6R – 0.28G - 0.32B (cyan-orange axis)
 Q = 0.21R – 0.52G + 0.31B (purple-green axis)
 Human eyes are most sensitive to Y,
next to I, next to Q.

Q
5
 Video
A sequence of still images (photographs) that create
the illusion of movement when played in succession.

Types of Video Signals

Video Signals(Transmission mode) can be classified as
1. Composite Video
2. S-Video
3. Component Video

6
 Composite Video
Chrominance & Luminance signals are mixed into a
single carrier wave, which can be separated at the
receiver end.
Yield less precise color definition.
Colors cannot be manipulated or corrected
Uses only one wire when connecting to a TV
Used in broadcast TV’s
Compatible with B/W TV
Mixing of signals leads interference

7
 S-Video
S stands Super / Separated
Uses 2 wires, one for luminance & the other for
chrominance signals
Less cross talk
Humans are able to differentiate spatial resolution
in gray-scale images with a much higher acuity
than for the color part of color images.
As a result, we can send less accurate color
information than intensity information

8
 Component Video
Each primary is sent as a separate video
signal.
The primaries can either be RGB or a
luminance-chrominance transformation
of them (e.g., YIQ, YUV).
Uses three wires when connecting to
TV
Best color reproduction
Requires more bandwidth and good
synchronization of the three components

9
 Analog Video & Digital Video

Analog Video
Represented as a continuous (time varying) signal
Uses either progressive or interlaced scanning
Progressive scanning
traces through a complete picture (a frame) row-wise for
each time interval.

10
 Analog Video
•Interlaced scanning
- The odd-numbered
lines are traced first, and
then the even-numbered
lines are traced.
This results in "odd" and
"even" fields
With interlaced scan, the
odd and even lines are Interlaced Scan
displaced in time from
each other.
11
 Broadcast Video( TV) Standards
Four broadcast and video standards and recording
formats commonly used around the world are:
 NTSC
 PAL
 SECAM
 HDTV
Each system is based on a different standard that
defines the way information is encoded to produce
the electronic signal that ultimately creates a
television picture.

12
 NTSC (National Television System Committee)
 It uses the familiar 4:3 aspect ratio
the ratio of picture width to its height
 Uses 525 scan lines per frame at 30 frames per second (fps).
 follows the interlaced scanning system,
each frame has two fields, with 262.5 lines/field.

 Uses 20 lines at the beginning of every field for Vertical

retrace control
leaving 485 lines per frame

 Uses YIQ Color Model

 Uses a bandwidth of 6MHz
 Mostly used in North America and Japan
13
PAL (Phase Alternating Line)
 Widely used in Western Europe, China, India, and many
other parts of the world.
 Uses 625 scan lines per frame, at 25 frames/second, with a
4:3 aspect ratio and interlaced fields
 Uses the YUV color model
 Uses a bandwidth of 8 MHz

SECAM (System Electronics Avec Memory)

 the third major broadcast TV standard.
 uses 625 scan lines per frame, at 25 frames per second, with a 4:3
aspect ratio and interlaced fields.
 SECAM differs from NTSC and PAL color systems in its basic
technology and broadcast method.
 Uses YUV color model
only one of the U or V signals will be sent on each scan line.
14
 Digital Video
Digital video is represented as a sequence of digital
images.
Advantages over analog:

Video can be stored on digital devices or in memorycan be

played back on a computer’s monitor without special hardware.
Direct random access the video  nonlinear video editing
The ability to compress the video

Almost all digital video uses component video

15
 Chroma Subsampling
Video requires massive amounts of bandwidth.
There is a desire to reduce the signal.
The human visual system is much more sensitive to
variations in brightness than color
we can reduce the Cb and Cr components of YCbCr
Can be achieved by sub sampling
Sub-sampling to reduce image resolution or size

The subsampling scheme is commonly expressed as a

three part ratio J:a:b (e.g. 4:2:2) that describe the number
of luminance and chrominance samples in a conceptual
region that is J pixels wide, and 2 pixels high. The parts are
(in their respective order):
16
J: horizontal sampling reference (width of the conceptual region).
Usually, 4.
a: number of chrominance samples (Cr, Cb) in the first row of J
pixels.
b: number of changes of chrominance samples (Cr, Cb) between

first and second row of J pixels.

Types of subsampling
4:4:4
4:2:2
4:1:1
4:2:0

17
In a 4:4:4 scheme, each 8×8 matrix of RGB pixels converts
to three YCrCb 8×8 matrices:
one for Y and one for each of the two (Cr & Cb)

8x8 : 8x8 : 8x8

4:4:4

18
 Chroma Subsampling
A 4:2:2 scheme creates
one 8×8 luminance matrix but decimates every two
horizontal pixels to create each chrominance-matrix entry.
reducing the amount of data to 2/3rds of a 4:4:4 scheme.

4:2:2

19
 Chroma Subsampling
A 4:2:0 scheme decimate chrominance both horizontally
and vertically

4:2:0

4:1:1
20
 High Definition TV (HDTV)
 The main thrust of HDTV (High Definition TV) is not to
increase the definition in each unit area, but rather to increase
the visual field especially in its width.
The first generation of HDTV was based on an analog
technology developed by Sony and NHK in Japan in the late
1970s.
Uncompressed HDTV will demand more than 20 MHz
bandwidth
Even after compression, it requires more than one channels to
transmit high quality signals.
The salient difference between conventional TV and
HDTV:
HDTV has a much wider aspect ratio of 16:9 instead of 4:3.
HDTV moves toward progressive (non-interlaced) scan. The
rationale is that interlacing introduces serrated edges to moving
21 objects and flickers along horizontal edges.
 Characteristics of Digital video
 A frame is a single in a video sequence and is the same as single cell
of movie film.
 The basic Characteristic of digital video are:
 The Duration of the video(Time)
 Frame size
 Frame rate
 Color bit depth or resolution
 Data rate (bit rate)
Frame size
 Every frame is an orthogonal bitmap digital image it comprises a
raster of pixels. If it has a width of W pixels and a height of H
pixels we say that the frame size is WxH.
 “Full-screen” video is 640x480 pixels.
 The most common frame size for web video is 160x120 pixels.
22  Not recommend to use a frame size larger than 320x240 for web.
 Frame rate
Digital video comprises a series of orthogonal bitmap digital
images displayed in rapid succession at a constant rate. In the
context of video these images are called frames. We measure the
rate at which frames are displayed in frames per second (FPS)
Frame rate is measured in number of frames per second (fps).
Standard TV-quality video uses 30 fps.
Color bit depth
The color of a pixel is represented by a fixed number of bits. This is
called the color depth of the video.
The number of pixel colors in each frame affects the size of the video.
The file size of the video will be greatly reduced by changing the
number of colors from 24-bit to 8-bit.
It sacrifices the image quality of the video.

23
Data rate (bit rate)
 This is the rate that the data must be transferred in order to ensure the
video can play smoothly without interruption.
 It is measured in kilobytes per second (K/sec or Kbps).
 It can be calculated by dividing the size of the file (in K) by the movie
length (in seconds).
E.g. the video file size is 1.9MB  1900K
Play 40 seconds long, Data rate = 47.5K/sec
BR = W * H * bitdepth * FPS
 Consider the Internet bandwidth!
Calculate space requirements of Video
 The size of a digital video file directly related to the frame rate,
size, duration and color depth.
• An example video can have a duration (T) of 1 hour (3600sec), a
frame size of 640x480 (WxH) at a color depth of 24bits and a frame
rate of 25fps. This example video has the following properties
24
VS = W * H * bitdepth * FPS * T= BR * T
pixels per frame = 640 * 480 = 307,200
bits per frame = 307,200 * 24 = 7,372,800 = 7.37Mbits
bit rate (BR) = 7.37 * 25 = 184.25Mbits/sec
video size (VS)= 184Mbits/sec * 3600sec = 662,400Mbits
= 82,800Mbytes = 82.8Gbytes
 pixels_per_frame = W * H
 pixels_per_second = W * H * FPS
 bits_per_frame = W * H * bitdepth

 NTSC video (640 x 480 and 29.97 fps)

Frame size = ([Pixel width x pixel height x bit depth]/8)/1024
E.g. 200KB/Frame : 6.0 MB/sec
200KB x 30 fps = 6000KB/s, 6 MB/sec
 PAL video (768 x 576 and 25 fps)
E.g. 200KB/Frame : 5.0 MB/sec
200KB x 25 fps = 5000KB/s, 5 MB/sec
25
 Digital Video Containers(Video File Formats)
 Common containers for video are , Flash video(.flv), MPEG(.mp4),
QuickTime(.mov),Windows Media Format(.wmv),WebM(.webm),
and RealMedia(.rm)

 Containers may include data compressed by a

choice of codecs, and media players may
recognize and play back more than one video file
container format.

MPEG(Moving Picture Experts Group )

 MPEG is a real-time video compression algorithm.
 MPEG-4 includes numerous multimedia capabilities and is a
preferred standard.
 MPEG-7 (or Multimedia Content description Interface) integrates
information about motion video elements with their use.
26
Standards for Video
CCIR 601 CCIR 601
HDTV CIF QCIF
NTSC PAL
Luminance
1920 x 1080 720 x 486 720 x 576 352 x 288 176 x 144
Resolution
Chrominance
960 x 540 360 x 486 360 x 576 176 x 144 88 x 72
Resolution
Color
4:2:2 4:2:2 4:2:2 4:2:0 4:2:0
Subsampling

Frames/sec 60 30 25 15 15

Aspect Ratio 16:9 4:3 4:3 4:3 4:3

Interlacing Yes Yes Yes No No

CCIR – Consultative Committee for International Radio

CIF – Common Intermediate Format (approximately VHS quality)
QCIF – Quarter CIF

27