Synthesis of the 3′-thio-nucleosides and subsequent automated synthesis of oligodeoxynucleotides containing a 3′-S-phosphorothiolate linkage

J. Gaynor,J. Bentley,R. Cosstick

DOI: https://doi.org/10.1038/nprot.2007.451

IF: 14.8

2007-12-01

Nature Protocols

Abstract:

What problem does this paper attempt to address?

Integrated Photonic Encoder for Terapixel Image Processing

Xiao Wang,Brandon Redding,Nicholas Karl,Christopher Long,Zheyuan Zhu,Shuo Pang,David Brady,Raktim Sarma

2023-06-08

Abstract:Modern lens designs are capable of resolving >10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made Terapixel/s data acquisition a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compression using orders-of-magnitude lower power than digital electronics. Our approach relies on a silicon-photonics front-end to compress raw image data, foregoing energy-intensive image conditioning and reducing data storage requirements. The compression scheme uses a passive disordered photonic structure to perform kernel-type random projections of the raw image data with minimal power consumption and low latency. A back-end neural network can then reconstruct the original images with structural similarity exceeding 90%. This scheme has the potential to process Terapixel/s data streams using less than 100 fJ/pixel, providing a path to ultra-high-resolution data and image acquisition systems.

Optics,Image and Video Processing
A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

Ruibing Song,Kejie Huang,Zongsheng Wang,Haibin Shen

DOI: https://doi.org/10.1109/tcsvt.2022.3179370

IF: 5.859

2022-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:The separation of the data capture and analysis in modern vision systems has led to a massive amount of data transfer between the end devices and cloud computers, resulting in long latency, slow response, and high power consumption. Efficient hardware architectures are under focused development to enable Artificial Intelligence (AI) at the resource-limited sensing devices. One of the most promising solutions is to enable Processing-in-Pixel (PIP) scheme. However, the conventional schemes suffer from the low fill-factor issue. This paper proposes a PIP based Complementary Metal-Oxide-Semiconductor (CMOS) sensor architecture, which allows convolution operation before the column readout circuit to significantly reduce the overall power consumption while improving the resource utilization of the succeeding deep learning accelerator. The simulation results show that the proposed architecture could support the computing efficiency up to 3.37 TOPS/W at the 8-bit weight configuration, which is four times as high as the conventional schemes after normalization. The transistors required for each pixel are only 3.5T, significantly improving the fill-factor.
An Encoded Photodetector Array for High-frame-rate Compressed Sensing and Computational Imaging

Wen Pan,Zhaolong Yang,Zhibiao Hao,Changzheng Sun,Bing Xiong,Jian Wang,Yanjun Han,Hongtao Li,Lin Gan,Yi Luo,Lai Wang

DOI: https://doi.org/10.1109/jsen.2024.3506937

IF: 4.3

2024-01-01

IEEE Sensors Journal

Abstract:Modern imaging technology, by exposure and subsequent readout from image sensors, has limited the existing frame rate in real-time scenes. In this article, we present an architecture based on computing in sensor array that can achieve higher frame rates than conventional cameras. This approach fuses the architecture with neural network algorithms for compressed sensing and computational imaging. It achieves a mean squared error of 10 −2 with fewer weights and sampling numbers (10%~40% of original data). It samples lower data to reconstruct images through fast recovery with an elapsed time of hundred microseconds. The feasibility has been verified through the encoded photodetector array chip consisting of 16×16 dual-gate silicon photodiodes. This type of chips represents a highly promising technology for constructing image sensors that delivers high-speed imaging capability of >10000 fps, which may also show potential superiority in terms of noise resistance and dynamic range.
A Parallel Photonic Chip for Nano-Second End-to-end Image Processing, Transmission, and Reconstruction

Wei Wu,Tiankuang Zhou,Lu Fang

DOI: https://doi.org/10.1364/optica.516241

IF: 10.4

2024-01-01

Optica

Abstract:Image processing, transmission, and reconstruction constitute a major proportion of information technology. The rapid expansion of ubiquitous edge devices and data centers has led to substantial demands on the bandwidth and efficiency of image processing, transmission, and reconstruction. The frequent conversion of serial signals between the optical and electrical domains, coupled with the gradual saturation of electronic processors, has become the bottleneck of end -toend machine vision. Here, we present an optical parallel computational array chip (OPCA chip) for end -to -end processing, transmission, and reconstruction of optical intensity images. By proposing constructive and destructive computing modes on the large -bandwidth resonant optical channels, a parallel computational model is constructed to implement end -to -end optical neural network computing. The OPCA chip features a measured response time of 6 ns and an optical bandwidth of at least 160 nm. Optical image processing can be efficiently executed with minimal energy consumption and latency, liberated from the need for frequent optical-electronic and analog-digital conversions. The proposed optical computational sensor opens the door to extremely high-speed processing, transmission, and reconstruction of visible contents with nanoseconds response time and terahertz bandwidth. (c) 2024 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
Photonics-enabled Compressive Sensing with Spectral Encoding Using an Incoherent Broadband Source.

Zhijing Zhu,Hao Chi,Tao Jin,Shilie Zheng,Xianbin Yu,Xiaofeng Jin,Xianmin Zhang

DOI: https://doi.org/10.1364/ol.43.000330

IF: 3.6

2018-01-01

Optics Letters

Abstract:In this Letter, we propose an approach to achieving photonics-enabled compressive sensing of sparse wideband radio frequency signals in which an incoherent broadband source is applied, and the mixing and integration functions are realized in the optical domain. A spectrum shaper is employed to slice and encode the spectrum of the broadband light according to a predetermined random sequence. Because of the dispersion-induced group delay, the mixing between the incoming signal and the random bit sequence is achieved. At the output of the spectrum shaper, an array of photodetectors is employed to realize down-sampling, and the input sparse signal can be captured in a single-shot mode. Since no pulsed laser is employed, our scheme obviates the need for time-domain synchronization between the repetitive ultra-fast pulses and the random sequence. Experimental demonstrations and numerical results are presented to verify the feasibility and potential of the approach.
All-analog photoelectronic chip for high-speed vision tasks

Yitong Chen,Maimaiti Nazhamaiti,Han Xu,Yao Meng,Tiankuang Zhou,Guangpu Li,Jingtao Fan,Qi Wei,Jiamin Wu,Fei Qiao,Lu Fang,Qionghai Dai

DOI: https://doi.org/10.1038/s41586-023-06558-8

IF: 64.8

2023-10-26

Nature

Abstract:Photonic computing enables faster and more energy-efficient processing of vision data 1,2,3,4,5 . However, experimental superiority of deployable systems remains a challenge because of complicated optical nonlinearities, considerable power consumption of analog-to-digital converters (ADCs) for downstream digital processing and vulnerability to noises and system errors 1,6,7,8 . Here we propose an all-analog chip combining electronic and light computing (ACCEL). It has a systemic energy efficiency of 74.8 peta-operations per second per watt and a computing speed of 4.6 peta-operations per second (more than 99% implemented by optics), corresponding to more than three and one order of magnitude higher than state-of-the-art computing processors, respectively. After applying diffractive optical computing as an optical encoder for feature extraction, the light-induced photocurrents are directly used for further calculation in an integrated analog computing chip without the requirement of analog-to-digital converters, leading to a low computing latency of 72 ns for each frame. With joint optimizations of optoelectronic computing and adaptive training, ACCEL achieves competitive classification accuracies of 85.5%, 82.0% and 92.6%, respectively, for Fashion-MNIST, 3-class ImageNet classification and time-lapse video recognition task experimentally, while showing superior system robustness in low-light conditions (0.14 fJ μm −2 each frame). ACCEL can be used across a broad range of applications such as wearable devices, autonomous driving and industrial inspections.

multidisciplinary sciences
Integrated electro-optic digital-to-analog link for efficient computing and arbitrary waveform generation

Yunxiang Song,Yaowen Hu,Xinrui Zhu,Keith Powell,Letícia Magalhães,Fan Ye,Hana Warner,Shengyuan Lu,Xudong Li,Dylan Renaud,Norman Lippok,Di Zhu,Benjamin Vakoc,Mian Zhang,Neil Sinclair,Marko Lončar

2024-11-07

Abstract:The rapid growth in artificial intelligence and modern communication systems demands innovative solutions for increased computational power and advanced signaling capabilities. Integrated photonics, leveraging the analog nature of electromagnetic waves at the chip scale, offers a promising complement to approaches based on digital electronics. To fully unlock their potential as analog processors, establishing a common technological base between conventional digital electronic systems and analog photonics is imperative to building next-generation computing and communications hardware. However, the absence of an efficient interface has critically challenged comprehensive demonstrations of analog advantage thus far, with the scalability, speed, and energy consumption as primary bottlenecks. Here, we address this challenge and demonstrate a general electro-optic digital-to-analog link (EO-DiAL) enabled by foundry-based lithium niobate nanophotonics. Using purely digital inputs, we achieve on-demand generation of (i) optical and (ii) electronic waveforms at information rates up to 186 Gbit/s. The former addresses the digital-to-analog electro-optic conversion challenge in photonic computing, showcasing high-fidelity MNIST encoding while consuming 0.058 pJ/bit. The latter enables a pulse-shaping-free microwave arbitrary waveform generation method with ultrabroadband tunable delay and gain. Our results pave the way for efficient and compact digital-to-analog conversion paradigms enabled by integrated photonics and underscore the transformative impact analog photonic hardware may have on various applications, such as computing, optical interconnects, and high-speed ranging.

Optics
High-Speed Real-Time Image Compression Based on All-Optical Discrete Cosine Transformation

Qiang Guo,Hongwei Chen,Yuxi Wang,Minghua Chen,Sigang Yang,Shizhong Xie

DOI: https://doi.org/10.1117/12.2249538

2017-01-01

Abstract:In this paper, we present a high-speed single-pixel imaging (SPI) system based on all-optical discrete cosine transform (DCT) and demonstrate its capability to enable noninvasive imaging of flowing cells in a microfluidic channel. Through spectral shaping based on photonic time stretch (PTS) and wavelength-to-space conversion, structured illumination patterns are generated at a rate (tens of MHz) which is three orders of magnitude higher than the switching rate of a digital micromirror device (DMD) used in a conventional single-pixel camera. Using this pattern projector, high-speed image compression based on DCT can be achieved in the optical domain. In our proposed system, a high compression ratio (approximately 10: 1) and a fast image reconstruction procedure are both achieved, which implicates broad applications in industrial quality control and biomedical imaging.
Photonic real time video image signal processor at 17Tb/s based on a Kerr microcomb

Mengxi Tan,Xingyuan Xu,Andreas Boes,Bill Corcoran,Thach G. Nguyen,Sai T. Chu,Brent E. Little,Roberto Morandotti,Jiayang Wu,Arnan Mitchell,David J. Moss

DOI: https://doi.org/10.1038/s44172-023-00135-7

2024-01-14

Abstract:Signal processing has become central to many fields, from coherent optical telecommunications, where it is used to compensate signal impairments, to video image processing. Image processing is particularly important for observational astronomy, medical diagnosis, autonomous driving, big data and artificial intelligence. For these applications, signal processing traditionally has mainly been performed electronically. However these, as well as new applications, particularly those involving real time video image processing, are creating unprecedented demand for ultrahigh performance, including high bandwidth and reduced energy consumption. Here, we demonstrate a photonic signal processor operating at 17 Terabits/s and use it to process video image signals in real-time. The system processes 400,000 video signals concurrently, performing 34 functions simultaneously that are key to object edge detection, edge enhancement and motion blur. As compared with spatial-light devices used for image processing, our system is not only ultra-high speed but highly reconfigurable and programable, able to perform many different functions without any change to the physical hardware. Our approach is based on an integrated Kerr soliton crystal microcomb, and opens up new avenues for ultrafast robotic vision and machine learning.

Optics,Applied Physics
PIXEL: Photonic Neural Network Accelerator

Kyle Shiflett,Dylan Wright,Avinash Karanth,Ahmed Louri

DOI: https://doi.org/10.1109/hpca47549.2020.00046

2020-02-01

Abstract:Machine learning (ML) architectures such as Deep Neural Networks (DNNs) have achieved unprecedented accuracy on modern applications such as image classification and speech recognition. With power dissipation becoming a major concern in ML architectures, computer architects have focused on designing both energy-efficient hardware platforms as well as optimizing ML algorithms. To dramatically reduce power consumption and increase parallelism in neural network accelerators, disruptive technology such as silicon photonics has been proposed which can improve the performance-per-Watt when compared to electrical implementation. In this paper, we propose PIXEL - Photonic Neural Network Accelerator that efficiently implements the fundamental operation in neural computation, namely the multiply and accumulate (MAC) functionality using photonic components such as microring resonators (MRRs) and Mach-Zehnder interferometer (MZI). We design two versions of PIXEL - a hybrid version that multiplies optically and accumulates electrically and a fully optical version that multiplies and accumulates optically. We perform a detailed power, area and timing analysis of the different versions of photonic and electronic accelerators for different convolution neural networks (AlexNet, VGG16, and others). Our results indicate a significant improvement in the energy-delay product for both PIXEL designs over traditional electrical designs (48.4% for OE and 73.9% for OO) while minimizing latency, at the cost of increased area over electrical designs.
Photonic Advantage of Optical Encoders

Luocheng Huang,Quentin A. A. Tanguy,Johannes E. Froch,Saswata Mukherjee,Karl F. Bohringer,Arka Majumdar

2023-05-03

Abstract:Light's ability to perform massive linear operations parallelly has recently inspired numerous demonstrations of optics-assisted artificial neural networks (ANN). However, a clear advantage of optics over purely digital ANN in a system-level has not yet been established. While linear operations can indeed be optically performed very efficiently, the lack of nonlinearity and signal regeneration require high-power, low-latency signal transduction between optics and electronics. Additionally, a large power is needed for the lasers and photodetectors, which are often neglected in the calculation of energy consumption. Here, instead of mapping traditional digital operations to optics, we co-optimized a hybrid optical-digital ANN, that operates on incoherent light, and thus amenable to operations under ambient light. Keeping the latency and power constant between purely digital ANN and hybrid optical-digital ANN, we identified a low-power/ latency regime, where an optical encoder provides higher classification accuracy than a purely digital ANN. However, in that regime, the overall classification accuracy is lower than what is achievable with higher power and latency. Our results indicate that optics can be advantageous over digital ANN in applications, where the overall performance of the ANN can be relaxed to prioritize lower power and latency.

Optics,Computer Vision and Pattern Recognition
6.9 A 0.35V 0.367TOPS/W Image Sensor with 3-Layer Optical-Electronic Hybrid Convolutional Neural Network

Xuecheng Wang,Zheng Huang,Tianyi Liu,Wanxin Shi,Hongwei Chen,Milin Zhang

DOI: https://doi.org/10.1109/isscc49657.2024.10454479

2024-01-01

Abstract:Traditional computer-vision technology that relies on image sensors coupled with cloud processing or on-chip Artificial Intelligence (AI) processors have encountered significant challenges in terms of power consumption, delays arising from data transmission, and/or memory access. In-sensor and near-sensor computing have been reported to solve this issue by applying pixel or array level feature extraction [2–6]. In [2, 4], capacitors are utilized for analog-domain Haar filtering to reduce the processing power consumption, but sacrificing the Fill Factor (FF) due to the use of the capacitor array [2], or complicated pixel-level logic [4]. An image sensor in introduced in [3] with Hog feature-based object detection, achieving both low power and high accuracy for the detection of up to three object classes. However, it does not work on more complex tasks. Convolutional Neural Networks (CNNs) [5, 6] offer enhanced accuracy in practical applications, but increase the power consumption and circuit complexity. Optical-domain processing [7] is capable of parallel information processing through an optical architecture based on free space. However, in [7] this is based on diffraction and requires coherent light as input, which constrains the practicality for edge computing. This paper presents a Pulse Width Modulation (PWM) pixel-based image sensor array that integrates an optical-electronic hybrid 3-layer convolutional processing unit. The first layer of the convolution is performed in the optical domain without introducing extra power consumption. The integration of optical convolution with electrical convolution offers the potential to leverage the energy-efficient advantages of optical convolution, while simultaneously providing the essential programmability needed to address multiple use-cases through reprogramming within a single device. A dual-mode Processing Element (PE) is proposed enables both acquisition mode and calculation mode. The integration of a sum/differential dual-counter design and the incorporation of two different pixel reset methods are employed in the co-design of PWM pixels and PEs to effectively mitigate computational power consumption.
Neuromorphic encoding of image pixel data into rate-coded optical spike trains with a photonic VCSEL-neuron

Matěj Hejda,Joshua Robertson,Julián Bueno,Juan Arturo Alanis,Antonio Hurtado

DOI: https://doi.org/10.1063/5.0048674

IF: 5.6

2021-06-01

APL Photonics

Abstract:Driven by the increasing significance of artificial intelligence, the field of neuromorphic (brain-inspired) photonics is attracting increasing interest, promising new, high-speed, and energy-efficient computing hardware for key applications in information processing and computer vision. Widely available photonic devices, such as vertical-cavity surface emitting lasers (VCSELs), offer highly desirable properties for photonic implementations of neuromorphic systems, such as high-speed and low energy operation, neuron-like dynamical responses, and ease of integration into chip-scale systems. Here, we experimentally demonstrate encoding of digital image data into continuous, rate-coded, up to GHz-speed optical spike trains with a VCSEL-based photonic spiking neuron. Moreover, our solution makes use of off-the-shelf fiber-optic components with operation at telecom wavelengths, therefore making the system compatible with current optical network and data center technologies. This VCSEL-based spiking encoder paves the way toward optical spike-based data processing and ultrafast neuromorphic vision systems.

optics,physics, applied
Parallel convolutional processing using an integrated photonic tensor core

J. Feldmann,N. Youngblood,M. Karpov,H. Gehring,X. Li,M. Stappers,M. Le Gallo,X. Fu,A. Lukashchuk,A. S. Raja,J. Liu,C. D. Wright,A. Sebastian,T. J. Kippenberg,W. H. P. Pernice,H. Bhaskaran

DOI: https://doi.org/10.1038/s41586-020-03070-1

IF: 64.8

2021-01-06

Nature

Abstract:With the proliferation of ultrahigh-speed mobile networks and internet-connected devices, along with the rise of artificial intelligence (AI)<a href="/articles/s41586-020-03070-1#ref-CR1">1</a>, the world is generating exponentially increasing amounts of data that need to be processed in a fast and efficient way. Highly parallelized, fast and scalable hardware is therefore becoming progressively more important<a href="/articles/s41586-020-03070-1#ref-CR2">2</a>. Here we demonstrate a computationally specific integrated photonic hardware accelerator (tensor core) that is capable of operating at speeds of trillions of multiply-accumulate operations per second (1012 MAC operations per second or tera-MACs per second). The tensor core can be considered as the optical analogue of an application-specific integrated circuit (ASIC). It achieves parallelized photonic in-memory computing using phase-change-material memory arrays and photonic chip-based optical frequency combs (soliton microcombs<a href="/articles/s41586-020-03070-1#ref-CR3">3</a>). The computation is reduced to measuring the optical transmission of reconfigurable and non-resonant passive components and can operate at a bandwidth exceeding 14 gigahertz, limited only by the speed of the modulators and photodetectors. Given recent advances in hybrid integration of soliton microcombs at microwave line rates<a href="#ref-CR3">3</a>,<a href="#ref-CR4">4</a>,<a href="/articles/s41586-020-03070-1#ref-CR5">5</a>, ultralow-loss silicon nitride waveguides<a href="/articles/s41586-020-03070-1#ref-CR6">6</a>,<a href="/articles/s41586-020-03070-1#ref-CR7">7</a>, and high-speed on-chip detectors and modulators, our approach provides a path towards full complementary metal–oxide–semiconductor (CMOS) wafer-scale integration of the photonic tensor core. Although we focus on convolutional processing, more generally our results indicate the potential of integrated photonics for parallel, fast, and efficient computational hardware in data-heavy AI applications such as autonomous driving, live video processing, and next-generation cloud computing services.

multidisciplinary sciences
Nonlinear optical encoding enabled by recurrent linear scattering

Fei Xia,Kyungduk Kim,Yaniv Eliezer,SeungYun Han,Liam Shaughnessy,Sylvain Gigan,Hui Cao

DOI: https://doi.org/10.1038/s41566-024-01493-0

Abstract:Optical information processing and computing can potentially offer enhanced performance, scalability and energy efficiency. However, achieving nonlinearity-a critical component of computation-remains challenging in the optical domain. Here we introduce a design that leverages a multiple-scattering cavity to passively induce optical nonlinear random mapping with a continuous-wave laser at a low power. Each scattering event effectively mixes information from different areas of a spatial light modulator, resulting in a highly nonlinear mapping between the input data and output pattern. We demonstrate that our design retains vital information even when the readout dimensionality is reduced, thereby enabling optical data compression. This capability allows our optical platforms to offer efficient optical information processing solutions across applications. We demonstrate our design's efficacy across tasks, including classification, image reconstruction, keypoint detection and object detection, all of which are achieved through optical data compression combined with a digital decoder. In particular, high performance at extreme compression ratios is observed in real-time pedestrian detection. Our findings open pathways for novel algorithms and unconventional architectural designs for optical computing.
An Always-on 4× Compressive VGA CMOS Imager with 51pj/pixel and >32db PSNR

Wenda Zhao,Chanmin Park,Injun Park,Nan Sun,Youngcheol Chae

DOI: https://doi.org/10.1109/vlsicircuits18222.2020.9162897

2020-01-01

Abstract:This paper presents a 4× compressive CMOS imager for always-on operation that achieves an energy efficiency of 51pJ/pixel, while maintaining high image quality of PSNR>32dB and SSIM>0.84. This is enabled by an energy-efficient compressive-sensing (CS) encoder, which replaces a densely populated CS encoding method with a highly sparse pseudo-diagonal one. Since the proposed CS encoder can be implemented with an energy-efficient switched-capacitor matrix multiplier at pixel outputs, data compression is achieved prior to pixel digitization, thereby greatly reducing ADC power, data size, and I/O power. The energy efficiency of the imager is further improved by incorporating it into dynamic single-slope ADCs. A prototype VGA imager consumes only 0.7mW at 45 fps. The corresponding energy per pixel (51pJ/pixel) amounts to a 20× improvement over the previous low-energy benchmark on CS imagers.
Lightator: An Optical Near-Sensor Accelerator with Compressive Acquisition Enabling Versatile Image Processing

Mehrdad Morsali,Brendan Reidy,Deniz Najafi,Sepehr Tabrizchi,Mohsen Imani,Mahdi Nikdast,Arman Roohi,Ramtin Zand,Shaahin Angizi

2024-03-08

Abstract:This paper proposes a high-performance and energy-efficient optical near-sensor accelerator for vision applications, called Lightator. Harnessing the promising efficiency offered by photonic devices, Lightator features innovative compressive acquisition of input frames and fine-grained convolution operations for low-power and versatile image processing at the edge for the first time. This will substantially diminish the energy consumption and latency of conversion, transmission, and processing within the established cloud-centric architecture as well as recently designed edge accelerators. Our device-to-architecture simulation results show that with favorable accuracy, Lightator achieves 84.4 Kilo FPS/W and reduces power consumption by a factor of ~24x and 73x on average compared with existing photonic accelerators and GPU baseline.

Hardware Architecture,Signal Processing
Comprehensively Modulated Sub-Attojoule Operated Optoelectronic Synapses for Image Encryption and Inpainting

Hui Yang,Yifei Zhang,Fangzhen Hu,Ziqing Li,Dongping Wu,Xi Chen

DOI: https://doi.org/10.1021/acsami.4c08070

2024-08-29

Abstract:High-performance optoelectronic synaptic transistors play a crucial role in developing and emulating artificial visual systems. However, due to the predominant use of single-structure material modulation in optimizing optoelectronic synapses, their energy consumption significantly trails behind that of electronic synapses by several orders of magnitude. Herein, polymer dielectric layers and optimized contact strategies are adopted to realize the ultralow consumption optoelectronic synapses. Integration of polyimide dielectric significantly enhances photogenerated charge carrier dissociation, leading to substantial improvements in photoresponsivity (1.5 × 106 A·W-1), photodetectivity (6.9 × 1012 Jones), and external quantum efficiency (4.0 × 108%). Additionally, optimized contact properties augment their appeal for ultralow energy consumption in optoelectronic synapse applications. Excitatory postsynaptic current is triggered at an incredibly low voltage of 5 μV and boosts an impressively low energy consumption of 0.05 aJ, ranking among the best-reported results in this field. Next, we demonstrate an integrated system combining the MoS2 optoelectronic synapses with a recurrent neural network enabling 100% accurate recognition of optical signals, particularly in scenarios with aJ-leveled energy consumption. Finally, an image encryption system has been developed, in which images are encrypted by photoelectronic conversion of synapse arrays with random voltage settings and decrypted according to the recurrent neural network-based accuracy. More importantly, once partially damaged images are encrypted, through the decryption image inpainting can be realized due to the high accuracy. The proposed innovative approach holds promise for advancing artificial intelligence applications with improved energy efficiency, information security, and computational capabilities.
Optical synaptic devices with ultra-low power consumption for neuromorphic computing

Chenguang Zhu,Huawei Liu,Wenqiang Wang,Li Xiang,Jie Jiang,Qin Shuai,Xin Yang,Tian Zhang,Biyuan Zheng,Hui Wang,Dong Li,Anlian Pan

DOI: https://doi.org/10.1038/s41377-022-01031-z

2022-11-29

Light: Science and Applications

Abstract:Brain-inspired neuromorphic computing, featured by parallel computing, is considered as one of the most energy-efficient and time-saving architectures for massive data computing. However, photonic synapse, one of the key components, is still suffering high power consumption, potentially limiting its applications in artificial neural system. In this study, we present a BP/CdS heterostructure-based artificial photonic synapse with ultra-low power consumption. The device shows remarkable negative light response with maximum responsivity up to 4.1 × 10 8 A W −1 at V D = 0.5 V and light power intensity of 0.16 μW cm −2 (1.78 × 10 8 A W −1 on average), which further enables artificial synaptic applications with average power consumption as low as 4.78 fJ for each training process, representing the lowest among the reported results. Finally, a fully-connected optoelectronic neural network (FONN) is simulated with maximum image recognition accuracy up to 94.1%. This study provides new concept towards the designing of energy-efficient artificial photonic synapse and shows great potential in high-performance neuromorphic vision systems.
Integrated lithium niobate photonic computing circuit based on efficient and high-speed electro-optic conversion

Yaowen Hu,Yunxiang Song,Xinrui Zhu,Xiangwen Guo,Shengyuan Lu,Qihang Zhang,Lingyan He,C. A. A. Franken,Keith Powell,Hana Warner,Daniel Assumpcao,Dylan Renaud,Ying Wang,Letícia Magalhães,Victoria Rosborough,Amirhassan Shams-Ansari,Xudong Li,Rebecca Cheng,Kevin Luke,Kiyoul Yang,George Barbastathis,Mian Zhang,Di Zhu,Leif Johansson,Andreas Beling,Neil Sinclair,Marko Loncar

2024-11-05

Abstract:Here we show a photonic computing accelerator utilizing a system-level thin-film lithium niobate circuit which overcomes this limitation. Leveraging the strong electro-optic (Pockels) effect and the scalability of this platform, we demonstrate photonic computation at speeds up to 1.36 TOPS while consuming 0.057 pJ/OP. Our system features more than 100 thin-film lithium niobate high-performance components working synergistically, surpassing state-of-the-art systems on this platform. We further demonstrate binary-classification, handwritten-digit classification, and image classification with remarkable accuracy, showcasing our system's capability of executing real algorithms. Finally, we investigate the opportunities offered by combining our system with a hybrid-integrated distributed feedback laser source and a heterogeneous-integrated modified uni-traveling carrier photodiode. Our results illustrate the promise of thin-film lithium niobate as a computational platform, addressing current bottlenecks in both electronic and photonic computation. Its unique properties of high-performance electro-optic weight encoding and conversion, wafer-scale scalability, and compatibility with integrated lasers and detectors, position thin-film lithium niobate photonics as a valuable complement to silicon photonics, with extensions to applications in ultrafast and power-efficient signal processing and ranging.

Optics,Applied Physics

Synthesis of the 3′-thio-nucleosides and subsequent automated synthesis of oligodeoxynucleotides containing a 3′-S-phosphorothiolate linkage

Integrated Photonic Encoder for Terapixel Image Processing

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

An Encoded Photodetector Array for High-frame-rate Compressed Sensing and Computational Imaging

A Parallel Photonic Chip for Nano-Second End-to-end Image Processing, Transmission, and Reconstruction

Photonics-enabled Compressive Sensing with Spectral Encoding Using an Incoherent Broadband Source.

All-analog photoelectronic chip for high-speed vision tasks

Integrated electro-optic digital-to-analog link for efficient computing and arbitrary waveform generation

High-Speed Real-Time Image Compression Based on All-Optical Discrete Cosine Transformation

Photonic real time video image signal processor at 17Tb/s based on a Kerr microcomb

PIXEL: Photonic Neural Network Accelerator

Photonic Advantage of Optical Encoders

6.9 A 0.35V 0.367TOPS/W Image Sensor with 3-Layer Optical-Electronic Hybrid Convolutional Neural Network

Neuromorphic encoding of image pixel data into rate-coded optical spike trains with a photonic VCSEL-neuron

Parallel convolutional processing using an integrated photonic tensor core

Nonlinear optical encoding enabled by recurrent linear scattering

An Always-on 4× Compressive VGA CMOS Imager with 51pj/pixel and >32db PSNR

Lightator: An Optical Near-Sensor Accelerator with Compressive Acquisition Enabling Versatile Image Processing

Comprehensively Modulated Sub-Attojoule Operated Optoelectronic Synapses for Image Encryption and Inpainting

Optical synaptic devices with ultra-low power consumption for neuromorphic computing

Integrated lithium niobate photonic computing circuit based on efficient and high-speed electro-optic conversion