Bharatesh Chakravarthi,Aayush Atul Verma,Kostas Daniilidis,Cornelia Fermuller,Yezhou Yang
Abstract:Event-based vision, inspired by the human visual system, offers transformative capabilities such as low latency, high dynamic range, and reduced power consumption. This paper presents a comprehensive survey of event cameras, tracing their evolution over time. It introduces the fundamental principles of event cameras, compares them with traditional frame cameras, and highlights their unique characteristics and operational differences. The survey covers various event camera models from leading manufacturers, key technological milestones, and influential research contributions. It explores diverse application areas across different domains and discusses essential real-world and synthetic datasets for research advancement. Additionally, the role of event camera simulators in testing and development is discussed. This survey aims to consolidate the current state of event cameras and inspire further innovation in this rapidly evolving field. To support the research community, a GitHub page (<a class="link-external link-https" href="https://github.com/chakravarthi589/Event-based-Vision_Resources" rel="external noopener nofollow">this https URL</a>) categorizes past and future research articles and consolidates valuable resources.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to provide a comprehensive review of event cameras, trace their development history, introduce the basic principles, and compare them with traditional frame - based cameras, emphasizing their unique characteristics and operational differences. In addition, the paper also explores the diverse applications of event cameras in different fields, and discusses the key real - world and synthetic datasets as well as the role of simulators in testing and development. Through these contents, the paper aims to integrate the current state of event cameras and stimulate further innovation in this rapidly developing field.
Specifically, the goals of the paper include:
1. **Introduce the basic principles of event cameras**: Explain how event cameras work, especially how they generate "events" by detecting changes in light intensity instead of capturing static images like traditional cameras.
2. **Comparison with traditional frame - based cameras**: Compare in detail the technical differences between event cameras and traditional frame - based cameras, highlighting the advantages of event cameras in terms of low latency, high dynamic range, and low power consumption.
3. **Review key technological milestones**: Outline the key progress in event camera technology, laying the foundation for future research directions.
4. **Explore diverse applications**: Introduce the applications of event cameras in fields such as object detection, moving object segmentation, object tracking, object classification, gesture / action recognition, flow / depth / pose estimation, semantic segmentation, video deblurring, video generation, neural radiance fields (NERF), visual odometry, high - resolution video reconstruction, and motion capture.
5. **Discuss important datasets and simulators**: Introduce the key event datasets and simulators for research and development, emphasizing their role in promoting technological progress.
6. **Provide a resource summary**: Classify and organize past and future research articles through GitHub pages, integrate valuable resources, and support the development of the research community.
In conclusion, this paper aims to provide researchers with a comprehensive perspective on the current state and technological progress of event cameras, while promoting continuous innovation in this field.