Event-based vision sensor enables fast and dense single-molecule localization microscopy

Cabriel,C.,Specht,C. G.,Izeddin,I.
DOI: https://doi.org/10.1101/2022.07.22.501162
2022-07-24
bioRxiv
Abstract:Single-molecule localization microscopy (SMLM) applications are often hampered by the fixed frame rate at which data acquisition is performed. Here, we present an alternative new approach of acquiring and processing SMLM data based on an event-based (or neuromorphic vision) sensor. This type of sensor reacts to light intensity changes rather than integrating the number of photons during each frame exposure time. This makes them particularly suited to SMLM, where the ability to surpass the diffraction-limited resolution is provided by blinking events. Each pixel works independently and returns a signal only when an intensity change is detected; intensity changes are returned as a list with pixel positions and timestamps rather than frames with a fixed frame rate. Since the output is a sparse list containing only useful data (for example a molecule turning on or off), the temporal resolution is significantly faster than typical speeds of EMCCD and sCMOS cameras. Here we demonstrate the feasibility of SMLM super-resolution imaging with this type of event-based sensors which, in addition, are more affordable than EMCCD or sCMOS cameras. We characterize the localization precision and show that it is equivalent to that of frame-based scientific cameras, including on fluorescently labelled biological samples. Furthermore, taking advantage of the unique properties of the sensor, we use event-based SMLM to perform very dense single-molecule acquisitions, where frame-based cameras experience significant limitations. All the data processing codes are made available.
What problem does this paper attempt to address?