CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Fast Separation of Direct and Global Images

Nayar, Krishnan, Grossberg, and Raskar SIGGRAPH 06

Andries van Dam

Project website: www.cs.columbia.edu/CAVE/projects/separation/

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Global Illumination

Direct illumination

Indirect illumination

Total illumination

Andries van Dam

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Fa s t S e p a r a t i o n o f D i r e c t a n d G l o b a l I m a g e s

Can separate these in real life! Assumptions

Indirect illumination varies slowly One (pointlike) light source

Lit: + Shadow: = min + = max = max min

Cast thin shadow across scene

Extract direct and indirect pixel-by-pixel over entire video

Andries van Dam

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Video

Andries van Dam

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Diffuse Interreflection

Total illumination (normal image)

Andries van Dam 5

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Diffuse Interreflection

Direct illumination
Andries van Dam 6

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Diffuse Interreflection

Indirect illumination (diffuse interreflection)

Andries van Dam 7

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Rose

Total illumination (normal image)

Andries van Dam 8

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Rose

Direct illumination
Andries van Dam 9

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Rose

Indirect illumination (subsurface scattering)

Andries van Dam 10

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Tr a n s l u c e n t s u r f a c e s

Total illumination (normal image)

Andries van Dam 11

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Tr a n s l u c e n t s u r f a c e s

Direct illumination
Andries van Dam 12

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Tr a n s l u c e n t s u r f a c e s

Indirect illumination (translucent transmission)

Andries van Dam 13

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Tu b o f o b j e c t s

Total illumination (normal image)

Andries van Dam 14

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Tu b o f o b j e c t s

Direct illumination (looks like OpenGL)

Andries van Dam 15

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Tu b o f o b j e c t s

Indirect illumination
Andries van Dam 16

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Outdoor environments

Total illumination (normal image)

Andries van Dam 17

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Outdoor environments

Direct illumination
Andries van Dam 18

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Outdoor environments

Indirect illumination
Andries van Dam 19

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Subsurface scattering

Total illumination (normal image)

Andries van Dam 20

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Subsurface scattering

Direct illumination
Andries van Dam 21

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Subsurface scattering

Indirect illumination (subsurface scattering)

Andries van Dam 22

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Human face

Total illumination (normal image)

Andries van Dam 23

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Human face

Direct illumination
Andries van Dam 24

CS123 : INTRODUCTION TO COMPUTER GRAPHICS

Human face

Indirect illumination
Andries van Dam 25