VIEWPOINT

INTERPOLATION OF
IMAGES FROM A LIGHT
FIELD (3D) CAMERA AND A
DSLR (2D) CAMERA
Raghuraman Anantharaman
Immatrikulationnummer: 2254859
Supervisor: Marcos Lopez-Martinez
 • To acquire a 3D scene in as
much detail as possible.
• To interpolate intermediate
Motivation: views without acquiring them.
• Applications : Image
rendering, street view from
new perspective.
 • Two cameras: 3D LF from
Raytrix and Nikon D50 (2D).
• Raw images from LF camera
are processed and the images
from 2D camera are used as
Approach: input directly.
• Interpolation is carried out to
view intermediate images.
• 21 different viewpoints are set
up with a camera mount.
Raytrix and Nikon camera
Imaging Process of the
lightfield camera:
• Light field we see in space - 7D
continuous plenoptic function.
• Instead we use a 4D LF.
• Ray positions :indexed by their
cartesian coordinates on two
parallel planes L(x,y,u,v).
 Imaging
Process of LF
camera: All
rays
Imaging process : Depth
variation (changing focus)
• If different x planes : different
focusing of objects
• 3D scene : different viewpoint
and new objects in focus.
RxLive 4.0:
• RxLive helps us acquire images
from the Raytrix LF camera.
• We make sure proper
connections are in place and
start.
• Calibrate the camera: MLA
calibration followed by Metric
calibration.
 • Linear variation in pictures is
considered.
• Two images ( ex: left and right)
Linear are taken as inputs.
Interpolation: • Rectified images are computed.
• Rectified interpolated view is
derectified.
• An interpolated view is obtained.
Linear Interpolation: Flowchart
Acquisition of the 3D
scene:
• Sparsely sampled LF vs densely
sampled LF.
• 21 different viewpoints ( a
rectangle of 60 cm by 24 cm)
• Spacing: 10 cm –horizontal, 12
cm vertical
• 3D scene at 200 cm away from
camera.
Acquisition of the 3D scene:
Acquisition of the 3D scene:
Results: LF camera
• Vital : No microlens structure in the final image (MLA and metric)
• Total focused images: 50 cm, 180 cm.
Results: 3D scene with
LF camera
• With the new objective: images
not perfect.
• Microlens structure still in place.
• Vignetting : whitedisc diameter
incompatible.
Results: 3D scene captured by 2D camera
Results: Rectified images
Results: Disparity map and Interpolated view