Abstract:In this work we demonstrate a miniaturised imaging system based around a time-gated SPAD array operating in a "chip-on-tip" manner. Two versions of the system are demonstrated, each measuring 23 mm × 23 mm × 28 mm with differing fields of view and working distances. Initial tests demonstrate contrast between materials in widefield fluorescence imaging (WFLIm) mode, with frame rates of > 2 Hz achievable. Following this, WFLIm images of autofluorescence in ovine lung tissue are obtained at frame rates of ~ 1 Hz. Finally, the ability of the second system to perform simultaneous WFLIm and time of flight (aka Flourescence Lifetime Imaging Distance and Ranging, FLImDAR) is also tested. This shows that the system is capable of 4 mm resolution of object separation when tested on 3D printed samples. It is further demonstrated as being able to perform scene reconstruction on autofluorescent lung tissue. This system is, to date, the smallest chip on tip WFLIm system published, and is the first demonstration of the FLImDAR technique in a compact, portable system.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is to develop a miniaturized imaging system. This system is based on time - gated single - photon avalanche diode (SPAD) arrays and can operate in a "chip - on - tip" manner. Specifically, the paper presents two versions of the system, each with a size of 23 mm × 23 mm × 28 mm but having different fields of view and working distances. These systems are designed to achieve wide - field fluorescence lifetime imaging (WFLIm) and fluorescence lifetime imaging and ranging (FLImDAR), that is, to simultaneously acquire fluorescence lifetime and distance information, to provide additional contrast for materials or tissues, and to be able to perform 3D scene reconstruction. ### Main problems and objectives: 1. **Miniaturized imaging system**: Develop a smaller and more portable WFLIm system for in - vivo applications (such as endoscopy). 2. **Fluorescence lifetime imaging**: Improve the contrast between different materials or tissues through fluorescence lifetime imaging technology, especially using autofluorescence for imaging in sheep lung tissues. 3. **Fluorescence lifetime imaging and ranging (FLImDAR)**: Implement FLImDAR technology for the first time in a compact handheld system, that is, simultaneously acquire fluorescence lifetime and distance information for 3D scene reconstruction and surface mapping. 4. **Application scenarios**: Explore the potential applications of this system in biomedical imaging (such as endoscopy, surgical navigation, diagnostic imaging), agriculture (such as plant health monitoring) and other fields. ### Technical highlights: - **Time - gated SPAD arrays**: Using time - gated SPAD arrays, the fluorescence decay curve can be captured at a fine time resolution, thereby calculating the fluorescence lifetime. - **Rapid lifetime determination (RLD) method**: The fluorescence lifetime is approximately calculated by comparing the intensity ratios at two different time - gate positions. The formula is as follows: \[ \tau = -\frac{\Delta t}{\ln\left(\frac{I_1}{I_2}\right)} \] where \(\tau\) is the calculated fluorescence lifetime, \(\Delta t\) is the size of the time gate, and \(I_1\) and \(I_2\) are the intensities at the first and second time - gate positions respectively. - **Multi - mode imaging**: Combine WFLIm and ToF data to achieve 3D scene reconstruction and surface mapping. ### Experimental results: - **WFLIm test**: Preliminary tests were carried out on 3D - printed fluorescent samples, and the results showed good contrast between different materials. - **Sheep lung tissue imaging**: WFLIm and FLImDAR imaging were successfully performed on sheep lung tissues, showing the differences in fluorescence lifetimes of different tissue types. - **3D point cloud generation**: A 3D point cloud of sheep lung tissue was generated through FLImDAR technology, demonstrating the ability to simultaneously measure distance and fluorescence lifetime. ### Conclusion: This study shows the potential of miniaturized time - resolved imaging sensors in in - vivo applications, especially in the field of biomedical imaging. Although the current system is still slow in acquisition time, its spatial resolution on bright samples is about 4 mm, and it can simultaneously acquire distance and fluorescence lifetime information, indicating that FLImDAR technology has broad application prospects in micro - endoscopy imaging.

Fluorescence lifetime imaging with distance and ranging using a miniaturised SPAD system

Parallelized Fluorescence Lifetime Imaging Microscopy (FLIM) Based on Photon Reassignment

A time-correlated single photon counting SPAD array camera with a bespoke data-processing algorithm for lightsheet fluorescence lifetime imaging (FLIM) and FLIM videos

Fluorescence lifetime imaging with a megapixel SPAD camera and neural network lifetime estimation

Smart Wide-field Fluorescence Lifetime Imaging System with CMOS Single-photon Avalanche Diode Arrays

Super-Resolution Time-Resolved Imaging using Computational Sensor Fusion

A Full Parallel Event Driven Readout Technique for Area Array SPAD FLIM Image Sensors.

Coupling a Recurrent Neural Network to SPAD TCSPC Systems for Real-time Fluorescence Lifetime Imaging

Light-field tomographic fluorescence lifetime imaging microscopy

Single-Shot 3D Widefield Fluorescence Imaging with a Computational Miniature Mesoscope

Fluorescence lifetime imaging via spatio-temporal speckle patterns in single-pixel camera configuration

Efficient wide-field FLIM

Fast volumetric fluorescence lifetime imaging of multicellular systems using single-objective light-sheet microscopy

Subsurface fluorescence time-of-flight imaging using a large-format single-photon avalanche diode sensor for tumor depth assessment

High-speed multispectral fluorescence lifetime imaging implementation for in vivo applications.

A time domain fluorescence tomography system for small animal imaging

Autofluorescence lifetime flow cytometry with time-correlated single photon counting

High-Resolution Single-Photon Imaging with a Low-Fill-Factor 32 × 32 SPAD Array by Scanning in the Photosensitive Area

Fast single-photon avalanche diode arrays for laser Raman spectroscopy

SPAD-based asynchronous-readout array detectors for image-scanning microscopy