Avian eye–inspired artificial vision takes a step forward

Qing Liu,Yihui Zhang

DOI: https://doi.org/10.1126/scirobotics.adp5682

IF: 25

2024-05-31

Science Robotics

Abstract:Bioinspiration from avian eyes allows development of artificial vision systems with foveated and multispectral imaging.

robotics

What problem does this paper attempt to address?

Avian eye–inspired perovskite artificial vision system for foveated and multispectral imaging

Jinhong Park,Min Seok Kim,Joonsoo Kim,Sehui Chang,Mincheol Lee,Gil Ju Lee,Young Min Song,Dae-Hyeong Kim

DOI: https://doi.org/10.1126/scirobotics.adk6903

IF: 25

2024-05-31

Science Robotics

Abstract:Avian eyes have deep central foveae as a result of extensive evolution. Deep foveae efficiently refract incident light, creating a magnified image of the target object and making it easier to track object motion. These features are essential for detecting and tracking remote objects in dynamic environments. Furthermore, avian eyes respond to a wide spectrum of light, including visible and ultraviolet light, allowing them to efficiently distinguish the target object from complex backgrounds. Despite notable advances in artificial vision systems that mimic animal vision, the exceptional object detection and targeting capabilities of avian eyes via foveated and multispectral imaging remain underexplored. Here, we present an artificial vision system that capitalizes on these aspects of avian vision. We introduce an artificial fovea and vertically stacked perovskite photodetector arrays whose designs were optimized by theoretical simulations for the demonstration of foveated and multispectral imaging. The artificial vision system successfully identifies colored and mixed-color objects and detects remote objects through foveated imaging. The potential for use in uncrewed aerial vehicles that need to detect, track, and recognize distant targets in dynamic environments is also discussed. Our avian eye–inspired perovskite artificial vision system marks a notable advance in bioinspired artificial visions.

robotics
Hyperspectral Imaging Bioinspired by Chromatic Blur Vision in Color Blind Animals

Shuyue Zhan,Weiwen Zhou,Xu Ma,Hui Huang

DOI: https://doi.org/10.3390/photonics6030091

IF: 2.536

2019-01-01

Photonics

Abstract:Hyperspectral imaging remote sensing is mutually restricted in terms of spatial and spectral resolutions, signal-to-noise ratio and exposure time. To deal with this trade-off properly, it is beneficial for imaging systems to have high light flux. In this paper, we put forward a novel hyperspectral imaging method with high light flux bioinspired by chromatic blur vision in color blind animals. We designed a camera lens with high degree of longitudinal chromatic aberration, a monochrome image sensor captured the chromatic blur images at different focal lengths. Finally, by using the known point spread functions of the chromatic blur imaging system, we process these chromatically blurred images by deconvolution based on singular value decomposition inverse filtering, and the spectral images of a target were restored. We constructed three different targets for validating image restoration based on a typical octopus eyeball imaging system. The results show that the proposed imaging method can effectively extract spectral images from the chromatically blurred images. This study can facilitate development of a novel bionic hyperspectral imaging, which may benefit from the high light flux of a large aperture and provide higher detection sensitivity.
Bio-inspired hemispherical compound eye camera

jianliang xiao,young min song,y xie,viktor malyarchuk,inhwa jung,k choi,zhuangjian liu,hyunsung park,chaofeng lu,rakhwan kim,rui li,kenneth b crozier,yonggang huang,john a rogers

DOI: https://doi.org/10.1117/12.2041112

2014-01-01

Abstract:Compound eyes in arthropods demonstrate distinct imaging characteristics from human eyes, with wide angle field of view, low aberrations, high acuity to motion and infinite depth of field. Artificial imaging systems with similar geometries and properties are of great interest for many applications. However, the challenges in building such systems with hemispherical, compound apposition layouts cannot be met through established planar sensor technologies and conventional optics. We present our recent progress in combining optics, materials, mechanics and integration schemes to build fully functional artificial compound eye cameras. Nearly full hemispherical shapes (about 160 degrees) with densely packed artificial ommatidia were realized. The number of ommatidia (180) is comparable to those of the eyes of fire ants and bark beetles. The devices combine elastomeric compound optical elements with deformable arrays of thin silicon photodetectors, which were fabricated in the planar geometries and then integrated and elastically transformed to hemispherical shapes. Imaging results and quantitative ray-tracing-based simulations illustrate key features of operation. These general strategies seem to be applicable to other compound eye devices, such as those inspired by moths and lacewings (refracting superposition eyes), lobster and shrimp (reflecting superposition eyes), and houseflies (neural superposition eyes).
Biomimetic Optoelectronics with Nanomaterials for Artificial Vision

Zhenghao Long,Yu Zhou,Yucheng Ding,Xiao Qiu,Swapnadeep Poddar,Zhiyong Fan

DOI: https://doi.org/10.1038/s41578-024-00750-6

IF: 83.5

2024-01-01

Nature Reviews Materials

Abstract:Vision is crucial for intelligent machines to detect and interact with their environments. However, conventional artificial vision systems (AVS) are hindered by several limitations, including narrowed field of view, optical aberrations, limited adaptability and suboptimal efficiency. Advancements in nanomaterials have facilitated the development of biomimetic optoelectronics that structurally or functionally mimic biological eyes. Two main approaches have revolutionized AVS: biomimetic designs that replicate the superior optical performance of biological eyes, enhancing the field of view, imaging quality and adaptability, and neuromorphic optoelectronics that integrate processing functions at the sensory endpoints, thus boosting computational and energy efficiency. This Review emphasizes nanomaterial-based biomimetic optoelectronics, featuring novel curved image sensors and neuromorphic devices. We delve into advanced nanomaterials and innovative design strategies that underpin these novel AVS. This Review aims to offer valuable insights to inspire researchers to advance the development of next-generation vision devices. Inspired by biological systems, artificial vision technologies have advanced considerably, particularly with the development of curved image sensors, which improve visual data capture, and neuromorphic optoelectronics, which enable efficient in-sensor processing. This Review provides a comprehensive discussion of current nanomaterial-based biomimetic optoelectronics.
Arthropod Eye-Inspired Digital Camera With Unique Imaging Characteristics

Jianliang Xiao,Young Min Song,Yizhu Xie,Viktor Malyarchuk,Inhwa Jung,Ki-Joong Choi,Zhuangjian Liu,Hyunsung Park,Chaofeng Lu,Rak-Hwan Kim,Rui Li,Kenneth B. Crozier,Yonggang Huang,John A. Rogers

DOI: https://doi.org/10.1117/12.2050820

2014-01-01

Abstract:In nature, arthropods have a remarkably sophisticated class of imaging systems, with a hemispherical geometry, a wide-angle field of view, low aberrations, high acuity to motion and an infinite depth of field. There are great interests in building systems with similar geometries and properties due to numerous potential applications. However, the established semiconductor sensor technologies and optics are essentially planar, which experience great challenges in building such systems with hemispherical, compound apposition layouts. With the recent advancement of stretchable optoelectronics, we have successfully developed strategies to build a fully functional artificial apposition compound eye camera by combining optics, materials and mechanics principles. The strategies start with fabricating stretchable arrays of thin silicon photodetectors and elastomeric optical elements in planar geometries, which are then precisely aligned and integrated, and elastically transformed to hemispherical shapes. This imaging device demonstrates nearly full hemispherical shape (about 160 degrees), with densely packed artificial ommatidia. The number of ommatidia (180) is comparable to those of the eyes of fire ants and bark beetles. We have illustrated key features of operation of compound eyes through experimental imaging results and quantitative ray-tracing-based simulations. The general strategies shown in this development could be applicable to other compound eye devices, such as those inspired by moths and lacewings (refracting superposition eyes), lobster and shrimp (reflecting superposition eyes), and houseflies (neural superposition eyes).
Feline eye–inspired artificial vision for enhanced camouflage breaking under diverse light conditions

Min Su Kim,Min Seok Kim,Mincheol Lee,Hyuk Jae Jang,Do Hyeon Kim,Sehui Chang,Minsung Kim,Hyojin Cho,Jiwon Kang,Changsoon Choi,Jung Pyo Hong,Do Kyung Hwang,Gil Ju Lee,Dae-Hyeong Kim,Young Min Song

DOI: https://doi.org/10.1126/sciadv.adp2809

IF: 13.6

2024-09-20

Science Advances

Abstract:Biologically inspired artificial vision research has led to innovative robotic vision systems with low optical aberration, wide field of view, and compact form factor. However, challenges persist in object detection and recognition against complex backgrounds and varied lighting. Inspired by the feline eye, which features a vertically elongated pupil and tapetum lucidum, this study introduces an artificial vision system designed for superior object detection and recognition in a monocular framework. Using a slit-like elliptical aperture and a patterned metal reflector beneath a hemispherical silicon photodiode array, the system reduces excessive light and enhances photosensitivity. This design achieves clear focus under bright light and enhanced sensitivity in dim conditions. Theoretical and experimental analyses demonstrate the system's ability to filter redundant information and detect camouflaged objects in diverse lighting, representing a substantial advancement in monocular camera technology and the potential of biomimicry in optical innovations.

multidisciplinary sciences
Recent advances in bioinspired vision sensor arrays based on advanced optoelectronic materials

Hao Li,Huiwen Yu,Di Wu,Xidi Sun,Lijia Pan

DOI: https://doi.org/10.1063/5.0160748

IF: 6.6351

2023-08-01

APL Materials

Abstract:Animals can learn about the outside world in many ways, and the visual organ is a key organ for acquiring information about the outside world. With the continuous development of intelligent technology, artificial vision techniques are becoming easier and more automated; however, the rigidity, process complexity, and complicated optical components of traditional commercial photodetectors have hindered their development in bionic vision. In recent years, a new generation of optoelectronic materials has attracted extensive research due to their simple preparation process, continuously tunable bandgap, and excellent optoelectronic properties. Two-dimensional optoelectronic materials and perovskites have become the most promising and effective optoelectronic materials for next-generation optoelectronic devices. Based on the excellent properties of next-generation optoelectronic materials, they have also triggered intensive exploration by researchers in the field of visual bionics. This paper highlights a review of the latest research progress of next-generation optoelectronic materials, including their preparation methods, working mechanisms, structural designs, and advances in the field of imaging. The applications of new generation optoelectronic materials in visual bionics by simulating biological visual structures are also described. Finally, the prospects and challenges for the development of next-generation optoelectronic materials in the emerging field of bionic vision are discussed.

materials science, multidisciplinary,physics, applied,nanoscience & nanotechnology
Birdlike broadband neuromorphic visual sensor arrays for fusion imaging

Pengshan Xie,Yunchao Xu,Jingwen Wang,Dengji Li,Yuxuan Zhang,Zixin Zeng,Boxiang Gao,Quan Quan,Bowen Li,You Meng,Weijun Wang,Yezhan Li,Yan Yan,Yi Shen,Jia Sun,Johnny C Ho

DOI: https://doi.org/10.1038/s41467-024-52563-4

2024-09-27

Abstract:Wearable visual bionic devices, fueled by advancements in artificial intelligence, are making remarkable progress. However, traditional silicon vision chips often grapple with high energy losses and challenges in emulating complex biological behaviors. In this study, we constructed a van der Waals P3HT/GaAs nanowires P-N junction by carefully directing the arrangement of organic molecules. Combined with a Schottky junction, this facilitated multi-faceted birdlike visual enhancement, including broadband non-volatile storage, low-light perception, and a near-zero power consumption operating mode in both individual devices and 5 × 5 arrays on arbitrary substrates. Specifically, we realized over 5 bits of in-memory sensing and computing with both negative and positive photoconductivity. When paired with two imaging modes (visible and UV), our reservoir computing system demonstrated up to 94% accuracy for color recognition. It achieved motion and UV grayscale information extraction (displayed with sunscreen), leading to fusion visual imaging. This work provides a promising co-design of material and device for a broadband and highly biomimetic optoelectronic neuromorphic system.
Recent Advances on Apposition Compound Eye Cameras

Y. M. Song,Y. Xie,V. Malyarchuk,J. Xiao,I. Jung,K.-J. Choi,Z. Liu,H. Park,C. Lu,R.-H. Kim,R. Li,K. B. Crozier,Y. Huang,J. A. Rogers

DOI: https://doi.org/10.1364/cleo_at.2013.ath5a.5

2013-01-01

Abstract:This work presents digital cameras that resemble, both structurally and functionally, apposition-type compound eyes of daylight insect. Hemispherical imagers with 180 artificial ommatidia yield 160 degree field of view and nearly infinite depth-of-field.
Inspiration from Visual Ecology for Advancing Multifunctional Robotic Vision Systems: Bio‐inspired Electronic Eyes and Neuromorphic Image Sensors

Changsoon Choi,Gil Ju Lee,Sehui Chang,Young Min Song,Dae‐Hyeong Kim

DOI: https://doi.org/10.1002/adma.202412252

IF: 29.4

2024-10-16

Advanced Materials

Abstract:Rich diversity of animal vision systems provides valuable inspiration for advancing robotic vision systems. Here, recent developments in bio‐inspired electronic eyes and neuromorphic image sensors drawing inspiration from natural ocular structures and their visual perception mechanisms, as well as their integration examples with mobile robotic and biological systems, are introduced. In robotics, particularly for autonomous navigation and human–robot collaboration, the significance of unconventional imaging techniques and efficient data processing capabilities is paramount. The unstructured environments encountered by robots, coupled with complex missions assigned to them, present numerous challenges necessitating diverse visual functionalities, and consequently, the development of multifunctional robotic vision systems has become indispensable. Meanwhile, rich diversity inherent in animal vision systems, honed over evolutionary epochs to meet their survival demands across varied habitats, serves as a profound source of inspirations. Here, recent advancements in multifunctional robotic vision systems drawing inspiration from natural ocular structures and their visual perception mechanisms are delineated. First, unique imaging functionalities of natural eyes across terrestrial, aerial, and aquatic habitats and visual signal processing mechanism of humans are explored. Then, designs and functionalities of bio‐inspired electronic eyes are explored, engineered to mimic key components and underlying optical principles of natural eyes. Furthermore, neuromorphic image sensors are discussed, emulating functional properties of synapses, neurons, and retinas and thereby enhancing accuracy and efficiency of robotic vision tasks. Next, integration examples of electronic eyes with mobile robotic/biological systems are introduced. Finally, a forward‐looking outlook on the development of bio‐inspired electronic eyes and neuromorphic image sensors is provided.

materials science, multidisciplinary,chemistry, physical,physics, applied, condensed matter,nanoscience & nanotechnology
Create Machine Vision Inspired by Eagle Eye

Haibin Duan,Xiaobin Xu

DOI: https://doi.org/10.34133/2022/9891728

2022-06-01

Abstract:Eagle, a representative species in the raptor world, has the sharpest visual acuity among all animals. The reputation of the "clairvoyance" is employed to describe an eagle. The excellent visual skills of eagles depend on their unique eye structures and special visual principles. The powerful vision perception mechanisms of the eagle bring abundant inspiration for traditional visual applications. Biological eagle eye vision technology provides a creative way to solve visual perception issues of "Knowing What is Where by Seeing." The theoretical research and practical works of eagle vision would contribute to the development of machine vision, or even artificial intelligence (AI) in the real world. Furthermore, eagle eye vision also provides feasible ideas for the popularization of new concepts in the virtual world in the future.
An optical biomimetic eyes with interested object imaging

Jun Li,Shimei Chen,Shangyuan Wang,Miao Lei,Xiaofang Dai,Chuangxue Liang,Kunyuan Xu,Shuxin Lin,Yuhui Li,Yuer Fan,Ting Zhong

DOI: https://doi.org/10.48550/arXiv.2108.04236

2021-08-08

Abstract:We presented an optical system to perform imaging interested objects in complex scenes, like the creature easy see the interested prey in the hunt for complex environments. It utilized Deep-learning network to learn the interested objects's vision features and designed the corresponding "imaging matrices", furthermore the learned matrixes act as the measurement matrix to complete compressive imaging with a single-pixel camera, finally we can using the compressed image data to only image the interested objects without the rest objects and backgrounds of the scenes with the previous Deep-learning network. Our results demonstrate that no matter interested object is single feature or rich details, the interference can be successfully filtered out and this idea can be applied in some common applications that effectively improve the performance. This bio-inspired optical system can act as the creature eye to achieve success on interested-based object imaging, object detection, object recognition and object tracking, etc.

Computer Vision and Pattern Recognition,Optics
Bioinspired Fabrication of High‐Quality 3D Artificial Compound Eyes by Voxel‐Modulation Femtosecond Laser Writing for Distortion‐Free Wide‐Field‐of‐View Imaging

Dong Wu,Jian-Nan Wang,Li-Gang Niu,Xu Lin Zhang,Si Zhu Wu,Qi-Dai Chen,Luke P. Lee,Hong Bo Sun

DOI: https://doi.org/10.1002/adom.201400175

IF: 9

2014-01-01

Advanced Optical Materials

Abstract:The small field‐of‐view (FOV) limits the range of vision in various detecting/imaging devices from biological microscopes to commercial cameras and military radar. To date, imaging with FOV over 90° has been realized with fish‐eye lenses, catadioptric lens, and rotating cameras. However, these devices suffer from inherent imaging distortion and require multiple bulky elements. Inspired by compound eyes found in nature, here a small‐size (84 μm), distortion‐free, wide‐FOV imaging system is presented via an advanced 3D artificial eye architecture. The 3D artificial eye structure is accomplished by exploiting an effective optical strategy — high‐speed voxel‐modulation laser scanning (HVLS). The eye features a hexagonal shape, high fill factor (FF) (100%), large numerical aperture (NA) (0.4), ultralow surface roughness (2.5 nm) and aspherical profile, which provides high uniformity optics (error < ±6%) and constant resolution (FWHM = 1.7 ± 0.1 μm) in all directions. Quantitative measurement shows the eye reduces imaging distortion by two/three times under 30°/45° incidence, compared with a single lens. The distortion‐free FOV can be controlled from 30° to 90°.
Bio-inspired Visual Systems Based on Curved Image Sensors and Synaptic Devices

Zhenghao Long,Yucheng Ding,Swapnadeep Poddar,Leilei Gu,Qianpeng Zhang,Zhiyong Fan

DOI: https://doi.org/10.1016/j.mtelec.2023.100071

2023-01-01

Materials Today Electronics

Abstract:Vision is our dominant sense and is also highly desired in artificial systems. In this article, we provide an overview of bio-inspired visual systems that utilize curved image sensors and/or photonic synapses. The use of curved detector geometry ensures clear image sensing abilities with fewer optical elements, which has the potential to lead to miniaturization. Additionally, photonic synapses that integrate light sensing and neuromorphic preprocessing can reduce redundant modules and signal communications. This results in decreased device size and energy consumption. In this review, we begin by summarizing the fabrication processes of curved image sensors, followed by a review of typical bionic eye systems. Next, we discuss the materials and device structures of typical photonic synapses and related imaging systems. We also review the combinations of curved image sensors and photonic synapses. Finally, we summarize the key advantages and challenges of current bio-inspired visual systems.
Recent advances in curved image sensor arrays for bioinspired vision system

Wenchao Gao,Zhangsheng Xu,Xun Han,Caofeng Pan

DOI: https://doi.org/10.1016/j.nantod.2021.101366

IF: 17.4

2022-02-01

Nano Today

Abstract:A conventional wide-angle camera consists of a planar image sensor array and multiple optic elements, which increases the camera’s volume, weight, and cost. In nature, most biological visual systems possess a curved retina, providing the capability of a wide field of view imaging with high sensitivity through a single lens. Inspired by the unique advantage of the biological eye, various curved image sensor arrays have been demonstrated, which enable a wide field of view, low aberration, and highly sensitive image acquisition with a simple lens design. Herein, various fabrication strategies for the curved image sensor arrays are summarized. In addition, the applications of the curved device in the artificial electronic eyes as well as the challenges and opportunities of the curved image sensor array are also discussed.

materials science, multidisciplinary,nanoscience & nanotechnology,chemistry
Biomimetic Compound Eyes with Gradient Ommatidium Arrays

Jian Wang,Wenna Zhou,Yantong Liu,Guoqing He,Yi Yang

DOI: https://doi.org/10.1021/acsami.3c08063

IF: 9.5

2023-09-08

ACS Applied Materials & Interfaces

Abstract:Compound eyes are high-performing natural optical perception systems with compact configurations, generating extensive research interest. Existing compound eye systems are often combinations of simple uniform microlens arrays; there are still challenges in making more ommatidia on the compound eye surface to focus to the same plane. Here, a biomimetic gradient compound eye is presented by artificially mimicking dragonflies. The multiple replication process efficiently endows compound eyes with...

materials science, multidisciplinary,nanoscience & nanotechnology
An ultrawide field-of-view pinhole compound eye using hemispherical nanowire array for robot vision

Yu Zhou,Zhibo Sun,Yucheng Ding,Zhengnan Yuan,Xiao Qiu,Yang Bryan Cao,Zhu'an Wan,Zhenghao Long,Swapnadeep Poddar,Shivam Kumar,Wenhao Ye,Chak Lam Jonathan Chan,Daquan Zhang,Beitao Ren,Qianpeng Zhang,Hoi-Sing Kwok,Mitch Guijun Li,Zhiyong Fan

DOI: https://doi.org/10.1126/scirobotics.adi8666

2024-05-15

Abstract:Garnering inspiration from biological compound eyes, artificial vision systems boasting a vivid range of diverse visual functional traits have come to the fore recently. However, most of these artificial systems rely on transformable electronics, which suffer from the complexity and constrained geometry of global deformation, as well as potential mismatches between optical and detector units. Here, we present a unique pinhole compound eye that combines a three-dimensionally printed honeycomb optical structure with a hemispherical, all-solid-state, high-density perovskite nanowire photodetector array. The lens-free pinhole structure can be designed and fabricated with an arbitrary layout to match the underlying image sensor. Optical simulations and imaging results matched well with each other and substantiated the key characteristics and capabilities of our system, which include an ultrawide field of view, accurate target positioning, and motion tracking function. We further demonstrate the potential of our unique compound eye for advanced robotic vision by successfully completing a moving target tracking mission.
Artificial Intelligence in Ophthalmic Surgery: Current Applications and Expectations

Maimaiti Nuliqiman,Mingyu Xu,Yiming Sun,Jing Cao,Pengjie Chen,Qi Gao,Peifang Xu,Juan Ye

DOI: https://doi.org/10.2147/OPTH.S438127

2023-01-01

Clinical Ophthalmology

Abstract:Artificial Intelligence (AI) has found rapidly growing applications in ophthalmology, achieving robust recognition and classification in most kind of ocular diseases. Ophthalmic surgery is one of the most delicate microsurgery, requiring high fineness and stability of surgeons. The massive demand of the AI assist ophthalmic surgery will constitute an important factor in boosting accelerate precision medicine. In clinical practice, it is instrumental to update and review the considerable evidence of the current AI technologies utilized in the investigation of ophthalmic surgery involved in both the progression and innovation of precision medicine. Bibliographic databases including PubMed and Google Scholar were searched using keywords such as "ophthalmic surgery", "surgical selection", "candidate screening", and "robot-assisted surgery" to find articles about AI technology published from 2018 to 2023. In addition to the Editorials and letters to the editor, all types of approaches are considered. In this paper, we will provide an up-to-date review of artificial intelligence in eye surgery, with a specific focus on its application to candidate screening, surgery selection, postoperative prediction, and real-time intraoperative guidance.
Review of bio-inspired image sensors for efficient machine vision

Xu Liu,Qing Yang,Chunfang Ouyang,Jiqiang Zhang,Wenhao Tang,Hang Xu,Yiyu Guo,Leixin Meng

DOI: https://doi.org/10.1117/1.AP.6.2.024001

IF: 13.582

2024-03-01

Advanced Photonics

Abstract:Abstract. With the rapid development of sensor networks, machine vision faces the problem of storing and computing massive data. The human visual system has a very efficient information sense and computation ability, which has enlightening significance for solving the above problems in machine vision. This review aims to comprehensively summarize the latest advances in bio-inspired image sensors that can be used to improve machine-vision processing efficiency. After briefly introducing the research background, the relevant mechanisms of visual information processing in human visual systems are briefly discussed, including layer-by-layer processing, sparse coding, and neural adaptation. Subsequently, the cases and performance of image sensors corresponding to various bio-inspired mechanisms are introduced. Finally, the challenges and perspectives of implementing bio-inspired image sensors for efficient machine vision are discussed.

Computer Science,Engineering
A neuromorphic bionic eye with filter-free color vision using hemispherical perovskite nanowire array retina

Zhenghao Long,Xiao Qiu,Chak Lam Jonathan Chan,Zhibo Sun,Zhengnan Yuan,Swapnadeep Poddar,Yuting Zhang,Yucheng Ding,Leilei Gu,Yu Zhou,Wenying Tang,Abhishek Kumar Srivastava,Cunjiang Yu,Xuming Zou,Guozhen Shen,Zhiyong Fan

DOI: https://doi.org/10.1038/s41467-023-37581-y

IF: 16.6

2023-04-08

Nature Communications

Abstract:Abstract Spherical geometry, adaptive optics, and highly dense network of neurons bridging the eye with the visual cortex, are the primary features of human eyes which enable wide field-of-view (FoV), low aberration, excellent adaptivity, and preprocessing of perceived visual information. Therefore, fabricating spherical artificial eyes has garnered enormous scientific interest. However, fusing color vision, in-device preprocessing and optical adaptivity into spherical artificial eyes has always been a tremendous challenge. Herein, we demonstrate a bionic eye comprising tunable liquid crystal optics, and a hemispherical neuromorphic retina with filter-free color vision, enabled by wavelength dependent bidirectional synaptic photo-response in a metal-oxide nanotube/perovskite nanowire hybrid structure. Moreover, by tuning the color selectivity with bias, the device can reconstruct full color images. This work demonstrates a unique approach to address the color vision and optical adaptivity issues associated with artificial eyes that can bring them to a new level approaching their biological counterparts.

multidisciplinary sciences

Avian eye–inspired artificial vision takes a step forward

Avian eye–inspired perovskite artificial vision system for foveated and multispectral imaging

Hyperspectral Imaging Bioinspired by Chromatic Blur Vision in Color Blind Animals

Bio-inspired hemispherical compound eye camera

Biomimetic Optoelectronics with Nanomaterials for Artificial Vision

Arthropod Eye-Inspired Digital Camera With Unique Imaging Characteristics

Feline eye–inspired artificial vision for enhanced camouflage breaking under diverse light conditions

Recent advances in bioinspired vision sensor arrays based on advanced optoelectronic materials

Birdlike broadband neuromorphic visual sensor arrays for fusion imaging

Recent Advances on Apposition Compound Eye Cameras

Inspiration from Visual Ecology for Advancing Multifunctional Robotic Vision Systems: Bio‐inspired Electronic Eyes and Neuromorphic Image Sensors

Create Machine Vision Inspired by Eagle Eye

An optical biomimetic eyes with interested object imaging

Bioinspired Fabrication of High‐Quality 3D Artificial Compound Eyes by Voxel‐Modulation Femtosecond Laser Writing for Distortion‐Free Wide‐Field‐of‐View Imaging

Bio-inspired Visual Systems Based on Curved Image Sensors and Synaptic Devices

Recent advances in curved image sensor arrays for bioinspired vision system

Biomimetic Compound Eyes with Gradient Ommatidium Arrays

An ultrawide field-of-view pinhole compound eye using hemispherical nanowire array for robot vision

Artificial Intelligence in Ophthalmic Surgery: Current Applications and Expectations

Review of bio-inspired image sensors for efficient machine vision

A neuromorphic bionic eye with filter-free color vision using hemispherical perovskite nanowire array retina