Computational Photography

femto-photography

by dr. Francho Melendez

femto-photography

what is femto-photography?

what is femto-photography?

capture method

visualization

normal visualization:problems

looking around corners

resolution

setup

other applications

other applications

other applications

other applications

other applications

nano-photography

using time of flight cameras

advantages

  • cost reduced 3 orders of magnitude
  • capture time much faster (hours to seconds)
  • robust to ambient illumination
  • light efficient
  • lower temporal resolution (femto-nano)

single bounce (ToF)

real world is multi-path

Correlation between paths and modulation frequencies (1 pixel)

results

results

coded time of flight

coded time of flight

coded time of flight

coded time of flight

coded time of flight

coded time of flight

results

results

transient rendering

applications

  • Visible geometry [Wu2014,OToole2014…]
  • Transparent Objects [Kadambi2013]
  • Hidden geometry [Velten2012…]
  • Reflectance [Naik2011…]
  • GI Components Separation [Wu2014…]

why simulate it?

  • femto-photography

  • Very expensive, sensitive and difficult to handle
  • nano-photography

  • Less temporal resolution, needs reconstruction, prone to errors

simulation can help

  • ground truth for testing
  • Forward-model for inverse problems
  • Can test new systems before building them
  • Freedom to tweak the physics

Steady-State Light Transport

Transient Light Transport

transient rendering

transient rendering

transient rendering

transient rendering

transient rendering

transient rendering

sampling in time

sampling in time

sampling in time

sampling in time

sampling in time

reconstruction

reconstruction

reconstruction

reconstruction

sampling distribution

time-based sampling

average scattering

more scattering

comparison noise

results

next week

  • Thursday is last Lecture
  • Computational Light Transport
  • Recap and feedback
  • Lab to present anything missing
  • Need to present all labs to Pass the subject!

credits and references and aditional readings

These slides have been prepared with materials, slides, and discussions from the following.

  • Andreas Velten et al.
  • Felix Heide et al.
  • Achuta Kadamir et al.
  • Adrian Jarabo et al.