Co-designed metaoptoelectronic deep learning

Carlos Mauricio Villegas Burgos,Pei Xiong,Liangyu Qiu,Yuhao Zhu,A Nickolas Vamivakas
DOI: https://doi.org/10.1364/OE.479038
2023-02-13
Abstract:A metaoptical system is co-designed with electronic hardware to implement deep learning image recognition. The optical convolution block includes a reflective metasurface to perform one layer of a deep neural network. The optical and digital components are jointly optimized to perform an image classification task attaining 65% accuracy, which is close to the 66% accuracy of a fully-digital network where the optical block is replaced by a digital convolution layer.
What problem does this paper attempt to address?