Trustworthy Media

Blind Passive Media Forensics for Content Integrity Verification

Shih-Fu
Shih Fu Chang
Chang, Columbia University,
University http://www.ee.columbia.edu/trustfoto
http://www ee columbia edu/trustfoto

M di Forensics
Media F i
•Develop robust and flexible techniques for verifying the authenticity
off audio-visual
di i l information
i f ti andd th
thereby
by restoring
t i g its
it ttrustworthiness
t thi
•Ensure information accountability in critical applications:
Journalism law enforcement
Journalism, enforcement, intelligence
intelligence, and citizen audio-video
audio video
reporting
p ti g

1a 2a 3a

Shot mixing
Unique audio
audio-visual
visual
capture / 4 signatures
g or artifacts
f
encode generated in each
scene/ Post-
device Edit process / production stage
event
1b 2b
3b
re encode
re-encode Object splicing ((indicated in ggreen)) &
capture
t /
may be used for
media
encode archive
integrity verification
verification.

Approach and Impact

New approach Research Impact
• Recover Device Signatures • Content Source ID
• Detect Tampering Artifacts • Digital Tampering Detection
• Explore Editing Path/Graph • Internet Media Migration Patterns

Problems and Solutions

Differences iin acquisition

Diff i iti device
d i signatures
i t
reveall potential
t ti l tampering
t i evidences
id

Camera cue BG noise

GR

Consistent?
Detect Near-Duplicate
Near Duplicate Images and Reconstruct
Camera cue
Editi Relation
Editing R l ti Graph
G h
ÆU
BG noise
GR Understand Migration
g Paths of Internet Images
g

NSF Cyber Trust Principal Investigators Meeting

March 16-18, 2008
New Haven, CT