Multimedia Information

Representation
Chapter 2

1
Images
 Color principles
 Pixel depth
 Spatial resolution
 Aspect ratio

2
Color Principles

3
Pixel Depth
 Images are displayed in the form of a two dimensional
matrix of individual picture elements (pixels)
 The number of bits per pixel (pixel depth) determines the
ranges of different colors that can be produced
 8 bits (256 different levels of gray)
 24 bits (8 bits for each of R, G, and B)
 32 bits (8 bits for each, plus transparency)

4
Pixel Depth

5
Computer Desktop Encyclopedia
 2-bit Grayscale 3-bit RGB 9-bit RGB

4-bit Grayscale 6-bit RGB 12-bit RGB

6 http://en.wikipedia.org/wiki/List_of_monochrome_and_RGB_palettes
Spatial Resolution and Aspect Ratio

7
Spatial Resolution

8 http://www.unifiedav.com
Aspect Ratio

4:3 16:9 21:9

9 http://www.mediacollege.com/video/aspect-ratio/
Example

10
Video
 Video is composed of multiple frames; each frame is one image
 Frame rate refers to number of frames displayed each second
in a video or live stream

11 http://www.mediacollege.com/video/frame-rate/
Video
 Color signals
 Video signals
 Analog video
 Digital video

12
Color Signals
 Whole spectrum of colors can be produced by using
different properties of three primary colors: red (R),
green (G), and blue (B)
 Three main properties of color source
 Brightness: how much white (or black) is mixed in the color
 Hue: the actual color of the source
 Saturation: the amount of grey in a color (intensity or purity)

13
Hue, Saturation and Brightness
 Hue  Saturation

 Brightness

14 © Mark Boulton (Designing for the Web)

Color Signals
 Luminance refers to brightness of source

Ys  0.299Rs  0.587Gs  0.144Bs

 Where Ys is the amplitude of the luminance signal and Rs,

Gs and Bs are the magnitudes of the three color
component signals that make up the source
 Hue and saturation are referred to as chrominance
 The blue chrominance (Cb), and the red chrominance (Cr)
are used to represent hue and saturation
Cb  Bs  Ys Cr  Rs  Ys

15
Example

16
Example
 RGB

 YCbCr

17
YCbCr – RGB Conversion

18
Color Signals
 The human visual system is less sensitive to color than to
luminance
 The two chrominance signals can tolerate a reduced
resolution relative to that used for luminance signal
(chroma-subsampling)
 Saving in bit rate and bandwidth can be achieved by using
the luminance and two color difference signals instead of
RGB signal directly

19
Example

20
Image where Y, Cb and Cr have full (horizontal and vertical) resolution.

21
Image where Cb and Cr have been downsampled a factor 2 both horizontally
and vertically, i.e half of the image information has been removed.
22
Analog TV Standards

525 (NTSC) and 625 (PAL/CCIR/SECAM)

Frame refresh rate = 60 times per second (NTSC)
= 50 times per second (PAL/CCIR/SECAM)
23
Analog TV Standards
 In PAL system (625-line system), Cb and Cr are referred
to as U and V respectively
Y  0.299R  0.587G  0.114B
U  0.493( B  Y )
V  0.877( R  Y )
 NTSC system (525-line system) forms two different
signals referred to as I and Q
Y  0.299R  0.587G  0.114B
I  0.74( R  Y )  0.27( B  Y )
Q  0.48( R  Y )  0.41( B  Y )

24
YUV – RGB Conversion

25
Analog TV Standards

26 http://en.wikipedia.org
Digital TV Standards

27 http://en.wikipedia.org
YCbCr – RGB Conversion

28
Video Display Interfaces
 Analog display interfaces

Component video Composite video S-video VGA

 Digital display interfaces

DVI HDMI DisplayPort

29
Video Scanning Sequence
 Interlaced scanning – scanning odd and even lines in an
alternate order (lines or rows 1,3,5, etc... followed by
lines or rows 2,4,6).
 Progressive scanning – scanning each line (or row of
pixels) in a sequential order (1,2,3, …)

30
Interlaced Scanning

Odd Field

Even Field

31  P. Havaldar and G. Medioni (Multimedia Systems)

Progressive Scanning

32  P. Havaldar and G. Medioni (Multimedia Systems)

YCbCr Chroma-Subsampling
 4:4:4
 Each of YCbCr components have the same sample rate
 4:2:2
 Cb and Cr components are sampled at half the sample rate of Y
 4:1:1
 Cb and Cr are sampled at one quarter horizontally
 4:2:0
 Cb and Cr are sampled at half both horizontally and vertically

33
YCbCr Chroma-Subsampling

full horizontal resolution ½ horizontal resolution

full vertical resolution full vertical resolution

¼ horizontal resolution ½ horizontal resolution

full vertical resolution ½ vertical resolution
34 http://www.pcmag.com/encyclopedia/term/57460/chroma-subsampling
Digital Video Formats
 Source intermediate format (SIF)
 Common intermediate format (CIF)
 Quarter CIF (QCIF), sub-QCIF (SQCIF)

35
Digital Video Formats
 High-Definition TV (HDTV)

36
High-Definition TV

37 http://commons.wikimedia.org
Example

38
Example (cont.)

39