Computational Photography

Introduction

by dr. Francho Melendez

what's computational photography

Computational photography is a relatively new field at the convergence of photography, computer vision, image processing, and computer graphics. Its goal is to overcome the limitations of traditional photography using computational techniques to enhance the way we capture, manipulate, and interact with visual media.

Mantis Shrimp possesses the most sophisticated visual system known in Earth

True facts about the mantis shrimp

http://awesci.com/eyes-of-the-mantis-shrimp-colours-and-hexnocular-vision/

Create photo that could not have been taken by a traditional Camera (?)

Goal: Record a richer, multi-layered visual experience

  • Overcome limitations of today’s cameras

  • Support better post-capture processing

  • Enables new classes of recording the visual signal

  • Synthesize “impossible” photos

plenoptic function

  • $L = L(x,y,z, \theta, \phi, \lambda, t)$
  • plenoptic imaging

  • coded photography

  • computational displays

  • capturing light transport

plenoptic imaging (epsilon photography)

coded photography

computational displays

  • 3D Displays
  • Light Field Displays
  • HDR Displays
  • Volumetric Displays

capturing light transport

  • Image Relighting
  • Separate direct from indirect illumination
  • Separate relflectance components
  • Femtophotography

Some Gurus

Examples

this course

objectives

knowledge

  • Get an overview of the field
  • Learn concepts of Digital Photography
  • Understand how different C.P. techniques work at high-level
  • Understand the fundamentals of this techniques

skills

  • Experience with implementing image processing algorithms
  • Experience with the practicalities of Digital Photography
  • Review a technical paper
  • and present it

attitudes

  • Reflect about the future of Photography
  • Reflect about future applications of Photography
  • Reflect about the importance of cameras at present and future
  • Look at photography with a different mindset

course structure

  • Lecture: Thursday 12:15 - 13:45
  • Lab: Thursday 14:00 - 16:00
  • 15 Lectures
  • 5 Jan is Friday

classes structure

  • First 45 minutes: Overview of the topic, techniques, applications, etc (high level)
  • Rest: Fundamentals, details, implementation, lab oriented (low level)
  • Introduction to the day's lab.
  • Do you want break?

labs

  • You prefer to use your own laptop?
  • No "late"
  • Minimun must work
  • Must be on time for grading

evaluation (tentative)

  • Labs - 85%
    • Submission Weekely
    • might be one or two exeptions
  • Paper review - 15%
    • 10 Minutes Presentation
  • a bigger project of your choice?

about you

  • Experience with Photography?
  • Python? C++?
  • image processing, CG?
  • feedback, ideas, discussion. Welcome.

interesting stuff

master projects

Ph.D.


franchomelendez@cs.uni.wroc.pl

internships


franchomelendez@cs.uni.wroc.pl

SIGGRAPH Chapter


franchomelendez@cs.uni.wroc.pl

www.franchomelendez.com

tutoring

thursday 16:00 - 18:00

but I should be around 338


franchomelendez@cs.uni.wroc.pl

credits and references and aditional readings

These slides have been prepared with materials, slides, and discussions from the following.

today's lab


Fundamentals of Digital Photography Applets.
  • Read the descriptions
  • Play around with applets
  • Get an understanding of
    • relationship between aperture and exposure
    • Gamma correction
    • Depht of field
    • Spatial Convolution
    • Color Theory