Today

Overview

• Definitions
• Content overview and examples
• Course organization
• Mild homework for next week

what's computational photography

Computational photography is a relatively new field at the convergence of photography, computer vision, image processing, and computer graphics. Its goal is to overcome the limitations of traditional photography using computational techniques to enhance the way we capture, manipulate, and interact with visual media.

Create photo that could not have been taken by a traditional Camera (?)

Goal: Record a richer, multi-layered visual experience

• Overcome limitations of today’s cameras

• Support better post-capture processing

• Enables new classes of recording the visual signal

• Synthesize “impossible” photos

Mantis Shrimp possesses the most sophisticated visual system known in Earth

http://awesci.com/eyes-of-the-mantis-shrimp-colours-and-hexnocular-vision/

plenoptic function

• $L = L(x,y,z, \theta, \phi, \lambda, t)$

• plenoptic imaging

• coded photography

• computational displays

• capturing light transport

plenoptic imaging (epsilon photography)

• Dynamic range
• HDR Imaging
• Spectral imaging
• Asorted Pixels
• Angular Information (light fields)
• Light Fields
• Field of view
• Panorama Stitching
• Depth of field
• Flexible DOF Photography
• Space
• Super-resolution, Gigapixel imaging

coded photography

• Coded Illumination
• Flash/No-flash photography
• Coded Exposure
• Flutter Shutter
• Coded Apertures
• Mask on lens

computational displays

• 3D Displays
• Light Field Displays
• HDR Displays
• Volumetric Displays

capturing light transport

• Image Relighting
• Separate direct from indirect illumination
• Separate relflectance components
• Femtophotography

Tentative Syllabus

Some Gurus

• Ramesh Raskar, MIT Camera Culture
• Jack Tumblin
• Mark Levoy, Stanford (now in Google, now in Alphabet?)
• Richard Szeliski, Microsoft Research
• Frédo Durand, MIT
• Shree K. Nayar, Columbia University
• Alexei (Alyosha) Efros, UC Berkley
• Paul Devebec, ICT
• Diego Gutierrez, Universidad de Zaragoza
• Gordon Wetzstein, Stanford University

Examples

this course

objectives

knowledge

• Get an overview of the field
• Learn concepts of Digital Photography
• Understand how different C.P. techniques work at high-level
• Understand the fundamentals of this techniques

skills

• Experience with implementing image processing algorithms
• Experience with the practicalities of Digital Photography
• Review a technical paper
• and present it

attitudes

• Reflect about the future of Photography
• Reflect about future applications of Photography
• Reflect about the importance of cameras at present and future
• Look at photography with a different mindset

• Lectures are compulsory
• Lecture: Thursday 10:15 - 11:45
• Lab: Thursday 12:00 - 14:00
• 15 Lectures
• 2 NOV Holiday

classes structure

• First 45 minutes: Overview of the topic, techniques, applications, etc (high level)
• 3-4 SIGGRAPH Papers
• Rest: Fundamentals, details, implementation, lab oriented (low level)
• some time focus on 1 particular paper
• Introduction to the day's lab.

labs

• Lab time mostly for marking
• implementation of some fundamental ideas
• play with some special type of data

evaluation (tentative)

• Labs - 85%
• 1 or 2 weeks labs
• minus 10% per week for late submission (up to 30%)
• minimum 50%
• Paper review - 15%
• 10 Minutes Presentation

• Experience with Photography?
• Python? C++?
• image processing, CG?
• feedback, ideas, discussion. Welcome.
• topics you are interested in?

www.franchomelendez.com

tutoring

thursday 16:00 - 18:00

but I should be around 338

franchomelendez@cs.uni.wroc.pl

credits and references and aditional readings

These slides have been prepared with materials, slides, and discussions from the following.

• A tutorial on Computational Photography [Gutierrez et al.]
• Epsilon photography to Coded Photography [Raskar]
• Examples from [Raskar, Tumblin, Debevec]
• Computational Plenoptic Photography [Wetzstein el al.]

• Read the descriptions
• Play around with applets
• Get an understanding of
  • relationship between aperture and exposure
  • Gamma correction
  • Depht of field
  • Spatial Convolution
  • Color Theory