Video Editing

Adobe Premiere
CyberLink Power Director
Adobe After Effects
Final Cut Pro

Video
Digital video appears in many multimedia applications, particularly on the Web.
As with audio, websites can stream digital video to increase the speed and availability of playback.
Common digital video formats include Flash, MPEG, AVI, WMV and QuickTime.
Most digital video requires use of browser plug-ins to play within Web pages, but in many cases the
user's browser will already have the required resources installed.

3.2 Video Coding of MPEG-1

The main objective of MPEG-1 was to reach a medium quality video with a constant total bit- rate of 1.5
Mbp s for storing video and audio on CD-ROM.

What Video Format Should I Use?

File size & quality
Digital Storage Space -‐ To calculate the amount of storage space you will need for a project, digital
video requires approximately 200 MB per minute of footage, or roughly 12 GB per hour. Of course this
varies according to your recording device and the quality it is set to record at. Frames per Second – The
standard for FPS is 29.97, increasing the FPS allows for more images per second thus a smoother image.
Decreasing FPS will make the video a bit choppy and not nearly as smooth.
Video Bitrate -‐ Bitrate is a measurement of the number of bits that are transmitted over a set length of
time. Your overall bitrate is a combination of your video stream, audio stream & metadata in your file
with the majority coming from your video stream. The higher the bit rate the better the quality the
bigger it will be.
Resolution – this is the number of pixels present in the images of the video. This determines whether
your video is standard definition or high definition. The higher the resolution the clearer the image the
bigger the file.
• DV (Digital Video): Usually used for video grabbed via firewire off a video camera. Fixed at 720x480 @
29.97FPS, or 720x576 @ 25 FPS. Not very highly compressed.
 How is digital video stored?
Digital video can be stored on digital media such as Blu-ray Disc, on computer data
storage, or streamed over the Internet to end users who watch content on a desktop
computer screen or a digital smart TV. Today, digital video content such as TV shows
and movies also include a digital audio soundtrack.

Definition
Video representation, as the name implies, specifies a way of representing a
video.

While some work refers to video representation as the way to present or express
video content through some extracted or summarized content units such as
scenes or objects, the majority regard it more as the way the video content is
stored. In other words, it is about video format which describes the sequence,
structure and content of frames that create the moving video image, along with
any possible audio or text (closed caption) information.

Historical Background
A video can be represented in either analog or digital formats. Typical analog
formats include NTSC (National Television System Committee), PAL (Phase
Alternating Line) and SECAM (Séquentiel couleur à mémoire, French for
“Sequential Color with Memory,”) which are commonly used in the domain of
commercial broadcast. On the other hand, due to the rapid development of
computer technologies, the...

 DIGITAL VIDEO • Digital video combines features of graphics and audio to create dynamic content
for multimedia products. • Content for digital video originate from video camera or film that has been
capture and digitized for the computer. • It may also be created by putting graphic image together to
create animation.

1. SOURCES OF DIGITAL VIDEO

 Digital video can consist of much more than movie can taken from existing film
resources, it can be also include:
 Recording of live action, usually captured with a video camera.
 A series of graphic images played in rapid succession similar to a cartoon • Still
images taken from film, videotape, or live action.
2.  Digital video takes on many more forms than a digital movie.
Digital video:
Is captured from television, VCR, and camera sources.
Controllers which are used to control VCR, video disk, camera, and other video
devices.
Video capture hardware that accepts video input and turns it into a digital format.
 Uses graphic overlay techniques in which digital video images are placed on top
of other graphics data on the computer screen.

3  Multimedia Elements: Video

Videos allow the audience to view actual events instead of just reading about or listening to them.
Sources for videos include web sites and stock film companies.

14  Multimedia Elements: Video

Videos can be used in: CD-ROMS Games Presentations Video simulations Video conferences
Websites.

Videos vary in quality.

15  The Video Format The file format of the video determines:

Which programs can open and play it.

How much storage space it occupies. How fast it travels over an Internet connection.

16  Video File Formats AVI (Audio Video Interleave) MOV (Movie)

Windows format, plays in Windows Media Player Very good quality, even at smaller resolutions
Large file size – not recommended for delivering video over the Internet. Popular format for videos
stored on a computer.MOV (Movie)Apple format, plays in the QuickTime Player Very good quality
Popular format for videos downloaded from the Internet. Teacher Note: The most common player
has been listed. Other players may play the video files. For example, QuickTime will play a large
variety of files besides .mov files.

17  Video File Formats MPEG (Moving Pictures Expert Group) RM (RealMedia)

The standard for compression and storage of audio and motion video for use on the World Wide
Web.

Creates video small file sizes.

Popular format for videos downloaded from the Internet.Its biggest advantage is that It will play in
many different media players.RM (RealMedia)Plays in the RealPlayer player.Typically contains a
movie clip.Popular format for streaming video viewed over the Internet.Real Player is generally
supported by many different computers and operating systems.

18  Video File Formats WMV (Windows Media Video) FLV (Flash Video)
Proprietary video format developed by Microsoft.Plays in Windows Media Player.Popular format for
streaming video viewed over the Internet.FLV (Flash Video)New file format widely used on the
Internet.Plays in Adobe Flash Player.Very small file size.Popular format for streaming video viewed
over the Internet
 Video
Digital video appears in many multimedia applications, particularly on

,
the Web. As with audio websites can stream digital video to increase

the speed and availability of playback .

Common digital video formats include Flash, MPEG, AVI, WMV and
QuickTime. Most digital video requires use of browser plug-ins to play
within Web pages, but in many cases the user's browser will already
have the required resources installe

How do you represent video?

The basics that are needed to represent a video or to define a video format is
listed below.
1. Video resolution, which equals the frame size measured in pixels.
2. Aspect ratio, which describes the dimensions of video screens and video picture
elements or pixels. ...
3. Color space, which specifies the video's color representation.

FULL-MOTION VIDEO PROCESSING

In the early twenty-first century, broadcast television and
videotapes record moving pictures by using 30 still pictures or
frames for every second of motion. Broadcasts and videotapes
use a standard developed in the 1950s in the United States, the
National Television Standards Committee broadcast standard.
Other countries use 25 frames per second and have different
image-aspect ratios (ratio of height to width). At the start of the
twenty-first century, the high-definition and digital television
broadcasting being introduced will change the standards;
pictures will have better quality because of an increase in the
number of pixels and a change in the aspect ratio of the picture.
Stored text, pictures, original document images, sound files,
and video files can be protected through encryption methods,
read/write protection, password management, and copyright
protection that keep intruders from copying or accessing
sensitive files.
More expensive tuner and capture cards on computers allow for
"full-motion" capture by saving all of the frames and sound.
Because these files become very large (640 × 480 pixels per
frame times 30 frames per second—over 9 million characters
for 1 second), several methods have been developed for
compressing motion video files. Video is compressed to save it
as a smaller file and is decompressed during playback. Several
codec systems use hardware including computer chips and
software such as MPEG (Motion Picture Experts Group). Since
video files are large, they are usually brief recordings or clips
from video. The clips are used in business presentations, on
Web pages, as product descriptions, or as other media bytes to
emphasize an important point in a short time. Advances in
storage capacity and speed of newer storage media will
eventually allow for smoother and longer clips. Video streaming
from Web sites stores large video clips on the host Web site
and allows the video to "stream" in smaller segments to the
Internet user.
3.1 Video representation

Generally, in video processing, video frames are usually represented as a matrix. In our

method, we use the luminance information to keep the data in every single frame, with a vector
structure. To simplify pre-processing, pixel values are directly extracted as features.

1.0 Introduction Digital video has become mainstream and is being used in a wide range of applications
DVD, digital TV, HDTV, video telephony, and teleconferencing. These digital video applications are
feasible because of the advances in computing and communication technologies as well as efficient
video compression algorithms. Most of the video compression standards are based on a set of principles
that reduce the redundancy in digital video. In this unit we explained motion estimation by discussing
video coding techniques with MPEG-1.

3.1 Video representation
Video representation is the first and one of the most important sub-problems in video pre-
processing. A good representation should include the key point and useful information for
discrimination while discarding unnecessary information.
Generally, in video processing, video frames are usually represented as a matrix. In our method,
we use the luminance information to keep the data in every single frame, with a vector structure.
To simplify pre-processing, pixel values are directly extracted as features. The video frame is
first down-sampled to a smaller icon to reduce spatial redundancy together with noises, and then
the icon is projected into a high dimensional space and become a point. In this way, different
video clips of different human actions performed by different subjects under different image
formation conditions span a space with complex structure and relationships. The spatial features
in the clips are kept in a vector form while the temporal ones are included in the trajectory as
well.
Considering a video clip which contains n frames, with W×H pixels in each frame, the kth
frame Fk can be represented as a point in the space RW×H. Actually the frame of
size W×H still contains more information than necessary, so down-sampling it will reduce the
number of elements while keeping adequate information for recognition. The down-sampling
step reduces the original frame down to a smaller w×h one. By down-sampling each frame can
be further represented as a point in a space of smaller dimension, i.e., Rw×h. After this
processing, the trajectory still contains sufficient statistical discriminative information for
classification.
View chapter Purchase book

A Unified Framework for Video Summarization, Browsing, and

Retrieval
Ziyou Xiong, ... Thomas S. Huang, in Handbook of Image and Video Processing (Second
Edition), 2005
4.1.2 Representation Based on Groups
To obtain a more meaningful video representation when the video is long, related shots are
merged into groups [3, 5]. In [5], Zhang et al. divide the entire video stream into multiple video
segments, each of which contains an equal number of consecutive shots. Each segment is further
divided into sub-segments; thus constructing a tree structured video representation. In [3], Zhong
et al. proposed a cluster-based video hierarchy, in which the shots are clustered based on their
visual content. This method again constructs a tree structured video representation.
View chapter Purchase book

MPEG-1 and -2 Compression

TOM LOOKABAUGH, in Multimedia Communications, 2001
7.3.2.4 Field and Frame Prediction
While MPEG-1 does not consider the possibility of field-based video representations, MPEG-2
specifically does allow for increased compression efficiency on interlaced material. One way in
which this is accommodated is by allowing either field- or frame-based prediction for each
macroblock (often termed adaptive field/frame compression). In the case of field-based
prediction, the macroblock is divided into two field macroblocks. The top field macroblock is
predicted from the top fields in one or two anchor pictures using the modes appropriate for the
picture type. The lower field macroblock is predicted from the lower fields in one or two anchor
pictures. Note that the subdivision of chroma here corresponds to the chroma subsampling
constraints for field representation described previously.
Field-based prediction can be highly effective in instances of substantial horizontal acceleration.
In these cases, an object captured in two different fields appears to have serrated vertical edges
when viewed as a frame, with the depth of the serration varying with time due to acceleration.
Frame-based motion estimation is ineffective in this case and leaves a good deal of difficult-to-
compress high-frequency serrations left over. Field-based prediction can perform quite well. On
the other hand, for more benign motion cases, frame-based prediction can more effectively
exploit vertical redundancy. Allowing a choice between the modes to occur on a
macroblock basis gives the best of both worlds at the cost of a slight increase in overhead (the
net effect being in favor of allowing the choice).
View chapter Purchase book

Optical flow-based representation for video action detection

Samet Akpınar, Ferda Nur Alpaslan, in Emerging Trends in Image Processing, Computer Vision
and Pattern Recognition, 2015
Abstract
In this study, a new model to the problem of video action recognition has been proposed. The
model is based on temporal video representation for automatic annotation of videos.
Additionally, the generic model inspires other video information retrieval processes including
temporal video segmentation. Video action recognition is a field of multimedia research enabling
us to recognize the actions from a number of observations, where representation of temporal
information becomes important. Visual, audio, and textual features are important sources for
representation. Although textual and audio features provide high-level semantics, retrieval
performance using these features highly depends on the availability and richness of the
resources. Visual features such as edges, corners, and interest points are used for forming a more
complicated feature, namely, optical flow. For developing methods to cope with video action
recognition, we need temporally represented video information. For this reason, we propose a
new temporal segment representation to formalize the video scenes as temporal information. The
representation is fundamentally based on the optical flow vectors calculated for the frequently
selected frames of the video scene. Weighted frame velocity concept is put forward for a whole
video scene together with the set of optical flow vectors. The combined representation is used in
the action-based video segment classification. Proposed method is applied to significant datasets
and the results are analyzed by comparing with the state-of-the-art methods. The basic formalism
mentioned in the method is also handled for video cut detection in the perspective of temporal
video segmentation.
Chapter 6 : VIDEO
1. 1. 1 CHAPTER 6 VIDEO
2. 2. 2 6.1 Video Concept6.1 Video Concept • Video is an excellent tool for delivering
multimedia. • Video places the highest performance demand on computer and its memory
and storage. • Digital video has replaced analog video as the method of choice for making
and delivering video for multimedia.
3. 3. 3 6.1 Video Concept6.1 Video Concept • Digital video device produces excellent finished
products at a fraction of the cost of analog. • Digital video eliminates the image-degrading
analog-to- digital conversion. • Many digital video sources exist, but getting the rights can be
difficult, time-consuming, and expensive.
4. 4. 4 6.2 Analogue Video6.2 Analogue Video • Video information that is stored using
television video signals, film, videotape or other non-computer media • Each frame is
represented by a fluctuating voltage signal known as an analogue wave form or composite
video.
5. 5. 5 6.2 Analogue Video6.2 Analogue Video • Composite analogue video has all the video
components: – brightness, colour and synchronization • Then combined into one signal for
delivery • Example : traditional television signal DIGITAL ANALOGUE
6. 6. 6 6.3
7. Video Display
Video Display
Progressive scan :
used in computer monitors and digital televisions.
displays all the horizontal lines of a picture at one time as a single frame.
Interlaced scan :
used in standard television formats
displays only half of the horizontal lines at a time (the first field,
containing the odd-numbered lines, is displayed, followed by the
second field, containing the even-numbered lines)

8. 7. 7 6.4 Video Signal Broadcast6.4 Video Signal Broadcast

9. 8. 8 NTSCNTSC • National Television Standards Committee – Standards for coding
information into an electronic signal, to make a TV picture – US, Japan • Amplitude
modulation • Frame of video: 525 vertical scan lines • 30 frames per second • Two passes
drawing (Interlacing) – Odd-numbered lines – followed by even-numbered (60 Hz) – Helps
prevent flicker
10. 9. 9 PAL, SECAMPAL, SECAM • PAL: Phase Alternate Line – Europe, Australia, South
Africa – 625 scan lines – 25 frames per second – Odd/even line interlacing – Amplitude
modulation • SECAM: Sequential Color and Memory – France, Russia – Also 625-line, 25
frames per sec, interlaced – Frequency modulation
11. 10. 10 HDTVHDTV • High Definition Television – Advanced Television Systems Committee
(ATSC, www.atsc.org) • Six video formats (resolution & frame rate combinations) – 16:9
aspect ratio (width:height ratio) – 1080 x 1920-pixels or 720 x 1280-pixels – 24, 30, 60
frames/sec • MPEG-2 coding for video • Digital Audio Compression (AC-3) for audio
12. 11. 11 6.5
Digitizing Video
 Digital video combines features of graphics and audio to create dynamic
content for multimedia products.
 Video is simply moving pictures.
 Digitized video can be edited more easily.
 Digitized video files can be extremely large.
 Digital video is often used to capture content from movies and television
to be used in multimedia.
 A video source (video camera ,VCR, TV or videodisc) is connected to a
video capture card in a computer.
  As the video source is played, the analog signal is sent to the video card
and converted into a digital file (including sound from the video).
VCRVCR Video Overlay Board /Video Overlay Board / Video Capture
CardVideo Capture Card PCPC
13. 13. 13 Analogue signal from VCR Converted to DIGITAL by VIDEO CAPTURE CARD The
converted signal is entered inside a computer Signal is processed Video is edited using
video editing software software
14. 14. 14 6.7 Digital Video6.7
 Digital Video
 Digital video is the digitisation of analogue video signals into numerical
format
 It creates the illusion of full motion by displaying a rapid sequence of
changing images on a display device.
 Conversion from analogue to digital format requires the use on an ADC
(Analogue to Digital Converter)
 A Digital to Analogue Converter (DAC) can be used to output digital video
on analogue equipment
 Video clip stored on any mass-storage device can be played back on a
computer’s monitor without special hardware.
 Setting up a production environment for making digital video, requires some
hardware specifications.
 Some specifications include computer with FireWire connection and cables,
fast processor, plenty of RAM, fast and big hard disk.
File Size and Formats

There is an important consideration: – file size in digitized video which included

1. Frame rate
2. Image size
3. Color depth.
1. Frame Rate – animation is an illusion caused by the rapid display of still images.
– television and movies play at 30 fps but acceptable playback can be
achieved with 15 fps.
2. Image Size Image Size – A standard full screen resolution is 640x480 pixels but to
safe storing space a video with 320x240 for a computer
display is still acceptable.
– New high-definition televisions (HDTV) are capable of
resolutions up to 1920×1080p60,
1920 pixels per scan line by 1080 scan lines, progressive, at
60 frames per second.
3. Color DepthColor Depth – The quality of video is dependent on the color quality
(related to the number of colors) for each bitmap in the frame sequence.
– The color depth below 256 colors is poorer-quality image.
– The frame rate to below 15 fps causes a noticeable and
distracting jerkiness that unacceptable.
– Changing the image size and compressing the file therefore
become primary ways of reducing file size. 24 bit 8 bit (256 colors)16 bit
15. 21. 21 Video CompressionVideo Compression • Two types of COMPRESSION: – Lossless
compression.Lossless compression. • Preserves the exact image throughout the
compression and decompression process. • E.g: text images is to identify repeating words
and assign them a code.
16. 22. 22 Video CompressionVideo Compression – Lossy compression.Lossy compression. •
Eliminates some of the data in the image and therefore provides greater compression ratios
 than lossless compression. • Applied to video because some drop in the quality is not
noticeable in moving images.
17. 23. 23 Video File FormatsVideo File Formats • AVI Format (.avi)AVI Format (.avi) The AVI
format, which stands for audio video interleave, was developed by Microsoft. The Some of
the most common players that support the avi format aresupport the avi format are: • Apple
QuickTime Player (windows & Mac), Microsoft Windows Media Player (Windows & Mac),
VideoLAN VLC media player (Windows & Mac) AND Nullsoft Winamp File FormatsFile
Formats
18. 24. 24 • Quicktime Format (.mov) The QuickTime format was developed by Apple and is a
very common one. It is often used on the internet, and for saving movie and video files. • The
format contains one or more tracks storing video, audio, text or effects. . It is compatible with
both Mac and Windows platforms, and can be played on an Apple Quicktime player. File
FormatsFile Formats
19. 25. 25 • MP4 Format (.mp4) This format is mostly used to store audio and visual streams
online, most commonly those defined by MPEG. It Expands MPEG-1 to support video/audio
"objects", 3D content, low bit rate encoding and support for Digital Rights Management. •
The MPEG-4 video format uses separate compression for audio and video tracks; video is
compressed with MPEG-4 video encoding; audio is compressed using AAC compression,
the same type of audio compression used in .AAC files. • The mp4 can most commonly be
played on the Apple QuickTime Player or other movie players. Devices that play p4 are also
known as mp4 players. File FormatsFile Formats
20. 26. 26 STREAMING VIDEO
1. Windows Media Video Format (.wmv)
2. 3GP File Extension (.3gp)
3. Apple QuickTime Player
4. RealNetworks RealPlayer
5. VideoLAN VLC media player
6. Advances Streaming Format (.asf)
7. Real Media Format (.rm) File FormatsFile Formats
21. 27. 27 Video Editing TerminologyVideo Editing Terminology • LinearLinear – It plays end to
end in one direction, usually pertains to videotape editing specifically the editing of linear
tape segments into one final master tape.
22. 28. 28 6.9 Video Editing Terminology6.9 Video Editing Terminology • Linear VS Non-
linearLinear VS Non-linear – Refers to the editing of disk-based digital video. – The software
provides an on screen map of what the final video sequences should look like incorporating
the edits, splices, special effects, transitions and sound tracks.
23. 29. 29 Special EffectsSpecial Effects • TransitionsTransitions – Such as fading, wiping,
splatters, scrolling, stipple and many more are available by simply dragging and dropping
that transition between the two video clips.
24. 30. 30 Special EffectsSpecial Effects • CHROMA KEYCHROMA KEY – The ability to
superimpose one clip over another is a valuable technique. – The technique of green
screening is identical except that the color green is used for the screen and later digitally
removed. – The blue screen and green screen superimposing are just two of the
superimposing technique available.
25. 31. 31 Special EffectsSpecial Effects
26. 32. 32 Video Hardware and SoftwareVideo Hardware and Software VCRVCR Video Overlay
Board /Video Overlay Board / Video Capture CardVideo Capture Card Video digitalVideo
digital Editing SoftwareEditing Software MULTIMEDIA PCMULTIMEDIA PC
27. 33. 33 Video Editing SoftwareVideo Editing Software • Incorporating transitions such as
dissolves, wipes and spin. • Superimposing titles and animating them, such as fly-in logo. •
Applying special effects to various images, such as twisting, zooming, rotating and distorting.
 • Synchronizing sound with the video. • Apply filters that control color balance, brightness &
contrast, blurring, distortions and morphing.
28. 34. 34 Obtaining Video ClipsObtaining Video Clips • Shoot a new footage • Pre existing
video clips • Buying from others (licensing rights)
29. 35. 35 Shooting and Editing VideoShooting and Editing Video • Equipment needed : 1) Good
camera 2) Lighting equipment 3) Powerful PC :
30. 36. 36 Advantages of using VideoAdvantages of using Video • Captures interest • Increase
retention • Clarifies complex physical actions and relationships • Can incorporate other
media
31. 37. 37 6.10 Disadvantages of using Video6.10 Disadvantages of using Video • Is expensive
to produce • Requires extensive memory and storage • Requires special equipment • Does
not effectively illustrate abstract concepts and static situations
32. 38. 38 SummarySummary • Digital video method is used for making and delivering video for
multimedia. • Compression techniques help to reduce the file sizes to more manageable
levels • 2 types of compression lossless and lossy. • Standards for compression program are
JPEG and MPEG.