Vertically integrated spiking cone photoreceptor arrays for color perception

Xiangjing Wang,Chunsheng Chen,Li Zhu,Kailu Shi,Baocheng Peng,Yixin Zhu,Huiwu Mao,Haotian Long,Shuo Ke,Chuanyu Fu,Ying Zhu,Changjin Wan,Qing Wan

DOI: https://doi.org/10.1038/s41467-023-39143-8

IF: 16.6

2023-06-10

Nature Communications

Abstract:Abstract The cone photoreceptors in our eyes selectively transduce the natural light into spiking representations, which endows the brain with high energy-efficiency color vision. However, the cone-like device with color-selectivity and spike-encoding capability remains challenging. Here, we propose a metal oxide-based vertically integrated spiking cone photoreceptor array, which can directly transduce persistent lights into spike trains at a certain rate according to the input wavelengths. Such spiking cone photoreceptors have an ultralow power consumption of less than 400 picowatts per spike in visible light, which is very close to biological cones. In this work, lights with three wavelengths were exploited as pseudo-three-primary colors to form ‘colorful’ images for recognition tasks, and the device with the ability to discriminate mixed colors shows better accuracy. Our results would enable hardware spiking neural networks with biologically plausible visual perception and provide great potential for the development of dynamic vision sensors.

multidisciplinary sciences