1,721,183 research outputs found
Rendering Wave Effects with Augmented Light Field
No full textRay–based representations can model complex light transport but are limited in modeling diffraction effects that require the simulation of wavefront propagation. This paper provides a new paradigm that has the simplicity of light path tracing and yet provides an accurate characterization of both Fresnel and Fraunhofer diffraction. We introduce the concept of a light field transformer at the interface of transmissive occluders. This generates mathematically sound, virtual, and possibly negative-valued light sources after the occluder. From a rendering perspective the only simple change is that radiance can be temporarily negative. We demonstrate the correctness of our approach both analytically, as well by comparing values with standard experiments in physics such as the Young's double slit. Our implementation is a shader program in OpenGL that can generate wave effects on arbitrary surfaces.Alfred P. Sloan FoundationNokia Research Cente
Computer vision on tap
No full textWe demonstrate a concept of computer vision as a secure, live service on the Internet. We show a platform to distribute a real time vision algorithm using simple widely available Web technologies, such as Adobe Flash. We allow a user to access this service without downloading an executable or sharing the image stream with anyone. We support developers to publish without distribution complexity. Finally the platform supports user-permitted aggregation of data for computer vision research or analysis. We describe results for a simple distributed motion detection algorithm. We discuss future scenarios for organically extending the horizon of computer vision research
Scale Invariant Metrics of Volumetric Datasets
Full text linkNature reveals itself in similar structures of different scales. A child and an adult share similar organs yet dramatically differ in size. Comparing the two is a challenging task to a computerized approach as scale and shape are coupled. Recently, it was shown that a local measure based on the Gaussian curvature can be used to normalize the local metric of a surface and then to extract global features and distances. In this paper we consider higher dimensions; specifically, we construct a scale invariant metric for volumetric domains which can be used in analysis of medical datasets such as computed tomography (CT) and magnetic resonance imaging (MRI)
Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos
No full textWe show that, via temporal modulation, one can observe and capture a high-speed periodic video well beyond the abilities of a low-frame-rate camera. By strobing the exposure with unique sequences within the integration time of each frame, we take coded projections of dynamic events. From a sequence of such frames, we reconstruct a high-speed video of the high-frequency periodic process. Strobing is used in entertainment, medical imaging, and industrial inspection to generate lower beat frequencies. But this is limited to scenes with a detectable single dominant frequency and requires high-intensity lighting. In this paper, we address the problem of sub-Nyquist sampling of periodic signals and show designs to capture and reconstruct such signals. The key result is that for such signals, the Nyquist rate constraint can be imposed on the strobe rate rather than the sensor rate. The technique is based on intentional aliasing of the frequency components of the periodic signal while the reconstruction algorithm exploits recent advances in sparse representations and compressive sensing. We exploit the sparsity of periodic signals in the Fourier domain to develop reconstruction algorithms that are inspired by compressive sensing
Computational Schlieren Photography with Light Field Probes
Full text linkWe introduce a new approach to capturing refraction in transparent media, which we call light field background oriented Schlieren photography. By optically coding the locations and directions of light rays emerging from a light field probe, we can capture changes of the refractive index field between the probe and a camera or an observer. Our prototype capture setup consists of inexpensive off-the-shelf hardware, including inkjet-printed transparencies, lenslet arrays, and a conventional camera. By carefully encoding the color and intensity variations of 4D light field probes, we show how to code both spatial and angular information of refractive phenomena. Such coding schemes are demonstrated to allow for a new, single image approach to reconstructing transparent surfaces, such as thin solids or surfaces of fluids. The captured visual information is used to reconstruct refractive surface normals and a sparse set of control points independently from a single photograph.Natural Sciences and Engineering Research Council of CanadaAlfred P. Sloan FoundationUnited States. Defense Advanced Research Projects Agency. Young Faculty Awar
Cities Are Physical Too: Using Computer Vision to Measure the Quality and Impact of Urban Appearance
No full textFor social scientists, developing an empirical connection between the physical appearance of a city and the behavior and health of its inhabitants has proved challenging due to a lack of data on urban appearance. Can we use computers to quantify urban appearance from street-level imagery? We describe Streetscore: a computer vision algorithm that measures the perceived safety of streetscapes. Using Streetscore to evaluate 19 American cities, we find that the average perceived safety has a strong positive correlation with population density and household income; and the variation in perceived safety has a strong positive correlation with income inequality
Depth of Field Analysis for Multilayer Automultiscopic Displays
Full text linkWith the re-emergence of stereoscopic displays, through polarized glasses for theatrical presentations and shuttered liquid crystal eyewear in the home, automultiscopic displays have received increased attention. Commercial efforts have predominantly focused on parallax barrier and lenticular architectures applied to LCD panels. Such designs suffer from reduced resolution and brightness. Recently, multilayer LCDs have emerged as an alternative supporting full-resolution imagery with enhanced brightness and depth of field. We present a signal-processing framework for comparing the depth of field for conventional automultiscopic displays and emerging architectures comprising multiple light-attenuating layers. We derive upper bounds for the depths of field, indicating the potential of multilayer configurations to significantly enhance resolution and depth of field, relative to conventional designs.Massachusetts Institute of Technology. Media LaboratoryMIT Camera Culture GroupNational Science Foundation (U.S.) (Grant IIS-1116452)United States. Defense Advanced Research Projects Agency. MOSAIC ProgramUnited States. Defense Advanced Research Projects Agency. SCENICC ProgramAlfred P. Sloan Foundation (Research Fellowship)United States. Defense Advanced Research Projects Agency. (Young Faculty Award
Primal-dual coding to probe light transport
Full text linkWe present primal-dual coding, a photography technique that enables direct fine-grain control over which light paths contribute to a photo. We achieve this by projecting a sequence of patterns onto the scene while the sensor is exposed to light. At the same time, a second sequence of patterns, derived from the first and applied in lockstep, modulates the light received at individual sensor pixels. We show that photography in this regime is equivalent to a matrix probing operation in which the elements of the scene's transport matrix are individually re-scaled and then mapped to the photo. This makes it possible to directly acquire photos in which specific light transport paths have been blocked, attenuated or enhanced. We show captured photos for several scenes with challenging light transport effects, including specular inter-reflections, caustics, diffuse inter-reflections and volumetric scattering. A key feature of primal-dual coding is that it operates almost exclusively in the optical domain: our results consist of directly-acquired, unprocessed RAW photos or differences between them.Alfred P. Sloan Foundation (Research Fellowship)United States. Defense Advanced Research Projects Agency (DARPA Young Faculty Award)Massachusetts Institute of Technology. Media Laboratory (Consortium Members
Analysis on errors due to photon noise and quantization process with multiple images
No full textIn the scenes with deflective and/or reflective medium such as fogs or mirrors, where the contrast levels among the intensity values of the pixels in the image are very small, even a small estimation improvement on the intensity value of each pixel could make a big difference for the perceptual quality of the final image if we want to subtract the interference components from the original image. In this paper we analyze the average quantization error, total error and photon noise from multiple images with fixed and varied exposure time. We observe that by properly controlling and varying exposure time with multiple images, one can obtain an image with better performance than that of the conventional wisdom, where multiple images are taken repeatedly with the same exposure time
Eyeglasses-free display: towards correcting visual aberrations with computational light field displays
Full text linkMillions of people worldwide need glasses or contact lenses to see or read properly. We introduce a computational display technology that predistorts the presented content for an observer, so that the target image is perceived without the need for eyewear. By designing optics in concert with prefiltering algorithms, the proposed display architecture achieves significantly higher resolution and contrast than prior approaches to vision-correcting image display. We demonstrate that inexpensive light field displays driven by efficient implementations of 4D prefiltering algorithms can produce the desired vision-corrected imagery, even for higher-order aberrations that are difficult to be corrected with glasses. The proposed computational display architecture is evaluated in simulation and with a low-cost prototype device.National Science Foundation (U.S.) (grant number IIS-1219241)National Science Foundation (U.S.) (grant number IIS-1116718)Natural Sciences and Engineering Research Council of Canada (NSERC Postdoctoral Fellowship
- …
