Computational photography is a relatively new field at the convergence of photography, computer vision, image processing, and computer graphics. Its goal is to overcome the limitations of traditional photography using computational techniques to enhance the way we capture, manipulate, and interact with visual media. This course covers fundamentals and applications of hardware and software techniques, with an emphasis on software methods. We will study many interesting, recent image based algorithms and implement them to the degree that is possible.
We will cover topics such as
- Cameras and image formation
- Image stitching / completion / inpainting
- Texture synthesis, super-resolution, denoising.
- Light fields
- Image based lighting and rendering
- High dynamic range
- Intrinsic Images
- Coded aperture photography
- Modeling and synthesis using Internet data
- … more interesting topics.
Tentative Syllabus 2016-2017:
|Class Date||Contents||Details||Lecture notes||Lecture notes (PDF)||Lab|
|5 October, Thu||Introduction||Computational Photography Overview. Details about the course.||Lecture 1||Lecture 1||Lab0: Get familiar with Photography concepts.
|12 October, Thu||Canceled||Needs to be recovered!|
|19 October, Thu||Digital Photography, Image processing pipeline.||Digital Camera, Basic Optics, Sensor, Demosaicing, White Balance, Gamma Correction, JPEG compresion.||Lecture 2||Lecture 2||Lab 1: Due 26-10|
|26 October, Thu||Computational Imaging I||HDR, TMO, Burst Photography. Confocal||Lecture 3||Lecture 3|
|2 Novemeber, Thu||No class||Rector's Day|
|9 Novemeber, Thu||Computational Imaging II||Panoramas,Homographies, Warping, mosaics.||Lecture 4||Lecture 4||Lab 3: Check SKOS|
|16 November, Thu||Computational Imaging III||Internet data and Photo-collections||Lecture 5||Lecture 5|
|23 November, Thu||Computational Illumination||Time of Flight, Light Stage, Photometric Stereo.||Lecture 6||Lecture 6||Lab 4: Check SKOS|
|30 November, Thu||Coded Apertures||Blur. Deconvolution. Coded Apertures. Focal Sweep.||Lecture 7||Lecture 7|
|7 December, Thu||Coded Exposures||Flutter Shutter. Parabolic Sweep.||Lecture 8||Lecture 8||Lab 5: Check SKOS|
|7 December, Thu||Light Fields||Definition, Capture, and Applications.||Lecture 9||Lecture 9|
|14 December, Thu||Compressive Imaging||Light Field extensions. Compressive Sensing.||papers for review|
|21 December, Thu||Computational Displays||Computational Displays, Human Vision System.||Choose paper to present|
|4 January, Thu||Computational Light Transport||Computational Light Transport|
|11 January, Thu||Student Presentations||Presentations|
|18 January, Thu||Femtophotography and Transient Rendering||Femtophotography and Transient Rendering|
|25 January, Thu||Summary and Closure|
Some of the materials used in class build on that from other instructors. In particular, we will use some materials from Gordon Wetzstein, Marc Levoy, Fredo Durand, Ramesh Raskar, Shree Nayar, and Alexei A. Efros, who in turn uses materials from Steve Seitz, Rick Szeliski, Paul Debevec, Stephen Palmer, Paul Heckbert, David Forsyth, Steve Marschner and others. Many thanks to them for sharing their work and knowledge.
Similar Courses at other Universities