Compact, low power 3D camera for mobile devices. This sensor makes the space beyond the device and around the user gesture-sensitive.
CoDAC is a new time-of-flight based range acquisition system for acquiring depth maps of piecewise-planar scenes with high spatial resolution using a single, omnidirectional, time-resolved photodetector and no scanning components. In contrast with 2D laser scanning used in LIDAR systems and low-resolution 2D sensor arrays used in TOF cameras, CoDAC demonstrates that it is possible to build a non-scanning range acquisition system with high spatial resolution using only a standard, commercially-available, low-cost photodetector and spatial light modulator.
Collaborative group situations present opportunities for designing meaningful whole-body input and interaction techniques. In this project we focus on the action of sharing information in a group through posters and signs held up by its members and translating that action meaningfully based on the group context. Live audience events like reality-TV shows, sports events, and classrooms are example scenarios where this action is most commonly elicited. We attempt to automate the process of recognizing whenever people hold their signs up and feed this information back into the system or to remote audiences. In classroom situations, this tool would offer a quick way of gauging solutions to short questions which can then be projected back into the classroom. In the live-audience case, it offers a way of engaging remote spectators that can vote on all aggregated signs and projecting relevant information back into the live-audience space.
Video content is being consumed in a host of new ways-viewers are no longer restricted to same-time or same-place viewing. However, the experience of watching with a group is inherently social and often desirable despite the physical distribution of group members. Back Talk, is a system designed to create a sociable television watching experience. We enhance TV viewing with an auditory environment around a listener. We have explored and leveraged the richness of audio to convey presence of remote viewers. We have developed a framework for capturing and translating engagement of an individual into a set of audio cues that are played spatially around a listener. Such auditory enhancements can augment video content consumption in the future.
A. Colaço, A. Kirmani, G. A. Howland, J. Howell, V. K Goyal, Compressive Depth Map Acquisition Using a Single Photon-Counting Detector: Parametric Signal Processing Meets Sparsity, CVPR June 2012, (Paper )
A. Kirmani, A. Colaço, F. Wong, V. K Goyal, Exploiting Sparsity in Time-of-Flight Range Acquisition Using a Single Time-Resolved Sensor, Optics Express, vol. 19, no. 22, pp. 21485-21507, October 2011. (Paper )