Computational Photography
Course description:
Computational photography is a relatively new field at the convergence of photography, computer vision, image processing, and computer graphics. Its goal is to overcome the limitations of traditional photography using computational techniques to enhance the way we capture, manipulate, and interact with visual media. This course covers fundamentals and applications of hardware and software techniques, with an emphasis on software methods. We will study many interesting, recent image based algorithms and implement them to the degree that is possible.
We will cover topics such as
- Cameras and image formation
- Image stitching / completion / inpainting
- Texture synthesis, super-resolution, denoising.
- Light fields
- Image based lighting and rendering
- High dynamic range
- Intrinsic Images
- Coded aperture photography
- Modeling and synthesis using Internet data
- … more interesting topics.
Tentative Syllabus 2016-2017:
| Class Date | Contents | Details | Lecture notes | Lab |
|---|---|---|---|---|
| 6 October, Thu | Introduction | Computational Photography Overview. Details about the course. | Lecture 1 | Lab0: Get familiar with Photography concepts. D.P. Applets |
| 13 October, Thu | Digital Photography, Image processing pipeline. | Digital Camera, Basic Optics, Sensor, Demosaicing, White Balance, Gamma Correction, JPEG compresion. | Lecture 2 | Lab 1 |
| 20 October, Thu | Computational Imaging I | HDR, TMO, Burst Photography. Confocal | Lecture 3 | Lab 2 sec1 sec2 sec3 sec4 |
| 3 Novemeber, Thu | Computational Imaging II | Panoramas,Homographies, Warping, mosaics. | Lecture 4 | Lab 3 |
| 10 Novemeber, Thu | Computational Imaging III | Internet data and Photo-collections | Lecture 5 | Lab 4 |
| 17 November, Thu | Computational Illumination | Time of Flight, Light Stage, Photometric Stereo. | Lecture 6 | Lab 5 |
| 24 November, Thu | Coded Apertures | Blur. Deconvolution. Coded Apertures. Focal Sweep. | Lecture 7 | Lab 6 |
| 1 December, Thu | Coded Exposures | Flutter Shutter. Parabolic Sweep. | Lecture 8 | No Lab |
| 8 December, Thu | Light Fields | Definition, Capture, and Applications. | Lecture 9 | Lab 7 |
| 15 December, Thu | Compressive Imaging | Light Field extensions. Compressive Sensing. | Lecture 10 | Choose paper for seminar |
| 12 January, Thu | Computational Displays | Computational Displays, Human Vision System. | Lecture 11 | No Lab |
| 19 January, Thu | Student Presentations | List of papers | Lab 8 | |
| 26 January, Thu | Femtophotography and Transient Rendering | Femtophotography, Transient Rendering. | Lecture 12 | |
| 2 Feburary, Thu | Light Transport & Review & Closure | Light Trasport Matrix. Examples of Light Transport Matrices. Operations on Light Transport Matrix. Optical Programming. Recapitulation, Feedback, Closure§ | Lecture 13 | Marking Lab 8 |
Acknowledgements
Some of the materials used in class build on that from other instructors. In particular, we will use some materials from Gordon Wetzstein, Marc Levoy, Fredo Durand, Ramesh Raskar, Shree Nayar, and Alexei A. Efros, who in turn uses materials from Steve Seitz, Rick Szeliski, Paul Debevec, Stephen Palmer, Paul Heckbert, David Forsyth, Steve Marschner and others. Many thanks to them for sharing their work and knowledge.
Similar Courses at other Universities