Abstract:Event cameras, which feature pixels that independently respond to changes in brightness, are becoming increasingly popular in high-speed applications due to their lower latency, reduced bandwidth requirements, and enhanced dynamic range compared to traditional frame-based cameras. Numerous imaging and vision techniques have leveraged event cameras for high-speed scene understanding by capturing high-framerate, high-dynamic range videos, primarily utilizing the temporal advantages inherent to event cameras. Additionally, imaging and vision techniques have utilized the light field-a complementary dimension to temporal information-for enhanced scene understanding. In this work, we propose "Event Fields", a new approach that utilizes innovative optical designs for event cameras to capture light fields at high speed. We develop the underlying mathematical framework for Event Fields and introduce two foundational frameworks to capture them practically: spatial multiplexing to capture temporal derivatives and temporal multiplexing to capture angular derivatives. To realize these, we design two complementary optical setups one using a kaleidoscope for spatial multiplexing and another using a galvanometer for temporal multiplexing. We evaluate the performance of both designs using a custom-built simulator and real hardware prototypes, showcasing their distinct benefits. Our event fields unlock the full advantages of typical light fields-like post-capture refocusing and depth estimation-now supercharged for high-speed and high-dynamic range scenes. This novel light-sensing paradigm opens doors to new applications in photography, robotics, and AR/VR, and presents fresh challenges in rendering and machine learning.

Event-based Vision in Magneto-Optic Kerr Effect Microscopy

Virtual k-Space Modulation Optical Microscopy.

Microsaccade-inspired Event Camera for Robotics

An imaging system for high-throughput magneto-optical Kerr effect characterization of combinatorial materials libraries

Event-based vision sensor enables fast and dense single-molecule localization microscopy

Event-Based Motion Magnification

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Event-based vision sensor for fast and dense single-molecule localization microscopy

Meta Light Field Event Imaging System(Invited)

Motion-Aware Optical Camera Communication with Event Cameras

The Roboscope: Smart and Fast Microscopy for Generic Event-Driven Acquisition

Scan-less microscopy based on acousto-optic encoded illumination

Event-based Visual Inertial Velometer

High-speed particle detection and tracking in microfluidic devices using event-based sensing

PL-EVIO: Robust Monocular Event-based Visual Inertial Odometry with Point and Line Features

EMVS: Event-Based Multi-View Stereo—3D Reconstruction with an Event Camera in Real-Time

Event Ellipsometer: Event-based Mueller-Matrix Video Imaging

Recent Advances in Bio-Inspired Vision Sensor: A Review

Electric-Magneto-Optical Kerr Effect in a Hybrid Organic-Inorganic Perovskite.

Event fields: Capturing light fields at high speed, resolution, and dynamic range