Computational Photography

Coded Apertures

by dr. Francho Melendez

lab 5

  • difficulties?
  • questions?
  • Good Looking Results?

today's schedule

  • Recap
  • Blur
  • Deblurring Blur
  • Focal Sweep
  • Coded Appertures
  • Focus Deblurring
  • Depth estimation
  • Lab 6

recap

several llumination coding strategies

motion tracking

  • motion capture, unique temporal code for LEDs
  • e.g. phase space:
    • 960 fps
    • < 10 ms latency
    • visible or IR LEDs

pulse systems: LIDAR

continues wave

comercial devices

light stage 3

photometric stereo

spatial coding

assisted stereo

blur

source of blur

let's take a picture

source of blur

in this case camera shake

image Formation

is a convolution

image Formation

Deblurring is a deconvolution

deconvolution: 2 types

old Problem

non-blind deconvolution

defocus blur

non-blind deconvolution

ill posed problem

blind deconvolution

ill posed problem

today we focus on defocus Blur

How can be restricted to be solved?

first let's go back to aperture

apertures revisited

aperture and PSF

aperture and PSF

aperture and PSF

aperture and PSF

aperture and PSF

aperture and PSF

  • Depth-dependent PSF

  • Circular apperture is not (well) invertible

aperture and PSF

  • Depth-dependent PSF
    • Engineer PSF to be depth invariant -> deconvolution is easier

  • Circular apperture is not (well) invertible
    • Engineer PSF to be broadband (flat Fourier magnitudes) -> well posed (Coded Appertures)
    • Coded apperture for depth recovery
    • Coded apperture based on perception

depth invariant PSF

change Focal Length with Time


[Nagahara et al. 2008]

focal sweep

focal sweep

focal sweep

Weiner deconvolution + denoising [Dabov et al.]

lattice focal lens

lattice focal lens

diffusion

coded apertures

avoid cero crossing

better invertibility

may include transparency

[Masia 2012]

optimize for perception

what do we do with depth?

depth and deblurring

aperture and PSF

can we extract depth from defocus and deblur?

ill posed

challenges

key contributions

[Levi et al. 2007]

defocus as local convolution

defocus as local convolution

overview

how to restrict the deconvolution problem?

defocus as local convolution

natural images

prior


[Levin et al. 2007]

what about depth?

second idea

PFS changes with Scale

why coded?

how?

1D intuition

aperture design

aperture design

all together

depth regularization

depth regularization

results

refocus

refocus

refocus

refocus

refocus

today's lab

Due: 8 December

  • Deconvolution with Gaussian Prior
    • Frequency Domain
  • Deconvolution with Sparse Prior
    • Spatial Domain
  • Image Reconstruction
    • Similar to focal stack
  • Depth from defocus
    • Calibrated Filters

announcements

Lecture 7

Lab 6


franchomelendez@cs.uni.wroc.pl

credits and references and aditional readings

These slides have been prepared with materials, slides, and discussions from the following.

  • Gordon Wetzstein
  • Anat Levin
  • Rob Fergus
  • Svetlana Lazebnik