You are on page 1of 6

David Fan Video Fingerprinting System in Embedded Platform

Page 1 of 6

David Fan
Wonderful world
2D Blitter Design

Video Fingerprinting System in Embedded Platform


October 20, 2011 in computer vision, work experience | No comments

The proposed system identifies TV advertising using video fingerprinting technology and a localized overlay of text/graphics that may operate on TV, tablet PCs, mobile phones, and other devices, according to the result of visual identification.

(http://www.fanxc.net/wp-content/uploads/2011/10/image21.png)

http://www.fanxc.net/?p=365

18/04/2012

David Fan Video Fingerprinting System in Embedded Platform


Fig.1. Top level diagram of the proposed system

Page 2 of 6

System Requirement

Requirement Detection speed Local library Suitable for hw acceleration

Goal 0.5~1.0 second per clip Less than 100MB for 10hrs video nX faster than real time (n=5~100)

Feature Requirement

- The video fingerprinting system should be designed to cope with the following distortions: 1. Scaling and aspect ratio change 2. Nonlinear scaling 3. Cropping 4. Letterbox format 5. Logo addition 6. Compression, especially for B frames 7. Frame rate changes a) Find stable frames so that even if key frame is dropped, matching can also be achieved by using neighbor frames. b) If temporal correlation is utilized, robustness to frame rate change must be taken into account. 8. Post-processing in OSD pipeline a) Sharpness adjustment

http://www.fanxc.net/?p=365

18/04/2012

David Fan Video Fingerprinting System in Embedded Platform


b) Deblocking c) De-ringing d) Contrast adjustment e) Luminance adjustment 9. Assume no rotation
System Design

Page 3 of 6

Overview

We adopted a local feature based scheme, since it has perfect robustness to all distortions except for big aspect ratiao changes. Proposed querying scheme is shown as follows:

(http://www.fanxc.net/wp-content/uploads/2011/10/image22.png)

Fig.2. Proposed querying scheme

http://www.fanxc.net/?p=365

18/04/2012

David Fan Video Fingerprinting System in Embedded Platform


Database building scheme

Page 4 of 6

(http://www.fanxc.net/wp-content/uploads/2011/10/image23.png)

Fig.3. database building diagram - Related topics

http://www.fanxc.net/?p=365

18/04/2012

David Fan Video Fingerprinting System in Embedded Platform

Page 5 of 6

(http://www.fanxc.net/wp-content/uploads/2012/01/clip_image002.gif)
Tags: computer vision, video fingerprinting

No comments

Comments feed for this article

Trackback link: http://www.fanxc.net/wp-trackback.php?p=365

Reply
Your email address will not be published. Required fields are marked * Name * Email * Website Your comment

http://www.fanxc.net/?p=365

18/04/2012

David Fan Video Fingerprinting System in Embedded Platform

Page 6 of 6

You may use these HTML tags and attributes: <a href="" title=""> <abbr
title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Post Comment

http://www.fanxc.net/?p=365

18/04/2012