MAS 964 (H): Special Topics in Media Technology:
Camera Culture
Spring 2008


Class Times: Wednesday 10:30am-12:30pm
Units: 0-9-0
Location: E15-235
Instructor: Ramesh Raskar

raskar(at)media.mit.
Office Hours: By appointment (Room #324)

Course description

With more than a billion people with networked, mobile cameras in their hands, we are seeing a rapid evolution in activities based on visual exchange. People’s daily activities are increasingly based on pervasive recording and eager consumption of images and video. In this seminar course, we will look at the technical as well the social aspects of this rapidly evolving camera culture.

Current systems accomplish mid and high-level visual processing by analyzing images from ordinary cameras that have limited abilities. Can innovative camera-like sensors overcome the tough problems in scene understanding and generate insightful awareness? Can new algorithms exploit, for example, unusual optics, programmable wavelength control or femto-second accurate photon counting to decompose the sensed values into perceptually critical elements? A significant enhancement in those cameras for scene analysis, and superior metadata tagging for effective sharing and display will bring about a revolution in visual communication. The new tools will spawn new visual art forms, optically smart sensors will empower disabled persons, pixel-coordinated interactions will harvest productivity of crowdsourcing for complex tasks and image-savvy commerce will bring together cultures separated by language barriers.

We will explore novel hardware and software tools based on advanced lenses, digital illumination, modern sensors and emerging image-analysis algorithms. The camera culture is transforming social interactions, reshaping businesses and influencing communities worldwide. We will explore innovative protocols for sharing and consumption of visual media.

Format

The course will consist of lectures and guest talks followed by in-class discussion. The guest talks will be by the leaders in imaging industry.

Prerequisites

Familiarity with imaging, camera techniques, applied optics and signal processing will be helpful. 

Grading

Each student will present one topic based on papers from the reading list and write one survey paper. To receive credit, you must attend regularly, present material on chosen topics and participate in discussions.

Schedule

Follow the link for each class to find a detailed description, suggested readings, and class slides. Some of the later classes may be subject to reordering or rescheduling.



Date Topic (tentative)
Notes
Guest Speaker/Class Discussion
Links
1 Feb 06
Introductions  [PPT] 56 MB
[PDF]
7 MB
What will a camera look like in 10 years, 20 years?

Summary of Discussion

2 Wed 13 Feb

Imaging Devices, Modern Optics and Lenses

[PPT] 21MB

[PDF] 6 MB

Class Notes
How can we augment the camera to support best 'image search'?

Summary of Discussion
http://www.cybergrain.com/tech/hdr/
http://www.vision.caltech.edu/lihi/Demos/SquarePanorama.html
http://www.distantfocus.com/projects/montage/
http://lensbabies.com/
http://www.merl.com/people/raskar/Mask/
3 Wed 20 Feb Mobile Photography
[PPT]  8MB

Class Notes
What are the beneficial opportunities in pervasive recording of public spaces? (no surveillance/privacy discussion for now)

Summary of Discussion
http://research.nokia.com/researchteams/vcui/
http://pictearth.com/
4 Wed 27 Feb Visual Social Computing and Citizen Journalism
Class Notes
How can we enable next generation of user generated MOBILE visual media and content?

http://www.snapfishlab.com/SnapFishWeb/PublicHome.do
Community Photo Collections at U of Washington
5 Wed 05 Mar

Emerging Sensor Technologies


What will be in Photoshop2028?

Nokia Research, Mobile Computational Photography
http://www.canesta.com/html/electronic_perception_technology.htm
http://www.3dvsystems.com/
http://news.bbc.co.uk/2/hi/science/nature/7190107.stm
6
Wed 12 Mar Beyond Visible Spectrum
How will our notion of visual information change with UltraHigh Speed Imaging?

RedShift Technologies(Matthias Wagner, Thermal Imaging)
http://redshiftsystems.com/site/
http://media.corporate-ir.net/media_files/irol/95/95372/InvestorPresQ307.pdf
http://www.cedip-infrared.com/
Sports Applications
7
Wed 19 Mar


Intel Research (Rahul Sukthankar)
http://www.engadget.com/2007/08/23/olympus-fe-series-of-shooters-detect-smiles-not-snark/
SPRING BREAK


8
Fri 04 Apr Trust in Imaging

Google Maps Streetview (Augusto Roman, project co-founder) (Note this talk is on FRIDAY)
Hany Farid on image tampering
Bill Mitchel, MIT's book on The Reconfigured Eye: Visual Truth in the Post-Photographic Era
Georgia Tech Capture Resistant Environment
NYTimes Anti-Paparazzi Flash
BBC Camcorder Piracy

9
Wed 09 Apr Computational Imaging in Sciences


Sony Playstation EyeToy (Richard Marks, inventor Eye-Toy, Cameras at Home)

http://www.tissuevision.com/
10
Wed 16 Apr

Solutions for Visually Challenged



Sandy Pentland
http://www.pbs.org/kcet/wiredscience/story/97-mixed_feelings.html
http://www.lifechips.org/events/islc2006/people/pbachyrita.html
http://www.nytimes.com/2005/12/11/magazine/11ideas_section3-14.html
http://www.seeingwithsound.com/
Low vision and assistive technologies (scroll to near the bottom)
http://www.envisionamerica.com/ (mostly products)
11
Wed 23 Apr NO class



12
Wed 30 Apr

Cameras in Developing Countries

Future Products and Business Models



Microsoft (April 29th, Note this talk is on TUESDAY)
http://www.vision.jhu.edu/iccv2007-cvdc/
http://research.microsoft.com/research/tem/
http://news.bbc.co.uk/2/hi/south_asia/7147796.stm
13
Wed 07 May Student Presentations

Canon USA (Consumer Imaging Group) (TBA)
14
Wed 14 May Student Presentations
HP Research Labs (Tom Malzbender on CameraPhone Usage, GPS-based tools)






Reading List

A list of suggested readings will be provided for each class.

Computational Photography


More Links

What is Computational Camera, Shree Nayar http://www1.cs.columbia.edu/CAVE/projects/what_is/
Great collection of projects, Shree Nayar http://www1.cs.columbia.edu/CAVE/projects/cc.php
Stanford Projects, Marc Levoy and collaborators http://graphics.stanford.edu/projects/lightfield/
Community Photo Collections at U of Washington http://grail.cs.washington.edu/projects/cpc/
CSAIL-MIT work on Computational Photography http://people.csail.mit.edu/fredo/photo.html
Jack Tumblin's 'Questions' for the field http://www.cs.northwestern.edu/~jet/research.html




 Ramesh Raskar