Deep Learning-enabled Detection and Classification of Bacterial Colonies using a Thin Film Transistor (TFT) Image Sensor

Yuzhu Li,Tairan Liu,Hatice Ceylan Koydemir,Hongda Wang,Keelan O'Riordan,Bijie Bai,Yuta Haga,Junji Kobashi,Hitoshi Tanaka,Takaya Tamaru,Kazunori Yamaguchi,Aydogan Ozcan
DOI: https://doi.org/10.1021/acsphotonics.2c00572
2022-05-07
Abstract:Early detection and identification of pathogenic bacteria such as Escherichia coli (E. coli) is an essential task for public health. The conventional culture-based methods for bacterial colony detection usually take >24 hours to get the final read-out. Here, we demonstrate a bacterial colony-forming-unit (CFU) detection system exploiting a thin-film-transistor (TFT)-based image sensor array that saves ~12 hours compared to the Environmental Protection Agency (EPA)-approved methods. To demonstrate the efficacy of this CFU detection system, a lensfree imaging modality was built using the TFT image sensor with a sample field-of-view of ~10 cm^2. Time-lapse images of bacterial colonies cultured on chromogenic agar plates were automatically collected at 5-minute intervals. Two deep neural networks were used to detect and count the growing colonies and identify their species. When blindly tested with 265 colonies of E. coli and other coliform bacteria (i.e., Citrobacter and Klebsiella pneumoniae), our system reached an average CFU detection rate of 97.3% at 9 hours of incubation and an average recovery rate of 91.6% at ~12 hours. This TFT-based sensor can be applied to various microbiological detection methods. Due to the large scalability, ultra-large field-of-view, and low cost of the TFT-based image sensors, this platform can be integrated with each agar plate to be tested and disposed of after the automated CFU count. The imaging field-of-view of this platform can be cost-effectively increased to >100 cm^2 to provide a massive throughput for CFU detection using, e.g., roll-to-roll manufacturing of TFTs as used in the flexible display industry.
Instrumentation and Detectors,Computer Vision and Pattern Recognition,Image and Video Processing,Applied Physics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: **How to detect and identify bacterial colonies, especially Escherichia coli (E. coli) and other gut microbiota (such as Citrobacter and Klebsiella pneumoniae), quickly and accurately in order to improve the efficiency of public health surveillance and food safety testing**. Traditional culture - based methods usually take 24 hours or more to obtain the final results, which limits their application in emergency situations. This paper proposes a bacterial colony - forming unit (CFU) detection system using thin - film transistor (TFT) image sensor arrays, which can save about 12 hours compared to the method approved by the United States Environmental Protection Agency (EPA). ### Specific objectives: 1. **Reduce detection time**: By using TFT image sensors, achieve early detection of bacterial colonies, thereby significantly reducing the time from sample collection to result reporting. 2. **Improve detection accuracy**: Utilize deep - learning techniques to improve the accuracy of colony detection and classification, especially in the early growth stage of colonies. 3. **Expand the detection range**: Through the large field - of - view (FOV) of TFT image sensors, achieve efficient detection of large - area samples without the need for mechanical scanning. 4. **Reduce costs**: Take advantage of the large - scale production of TFT technology to reduce the cost of the system, making it more suitable for large - scale applications. ### Method overview: - **Hardware design**: A lensless imaging system was constructed, using a TFT image sensor array, combined with red, green, and blue LED light sources, to automatically collect time - series images at 5 - minute intervals. - **Data processing**: A set of workflows for image pre - processing and candidate colony selection was developed, including steps such as background correction, differential analysis, and binarization segmentation. - **Deep - learning model**: Two deep neural networks (DNN) were trained, one for detecting colonies and the other for classifying colony species. ### Experimental results: - **Detection performance**: In blind tests, the system achieved a 97.3% CFU detection rate within 9 hours of incubation time and an average recovery rate of 91.6% within about 12 hours of incubation time. - **Time savings**: Compared to the EPA - approved method, the system can save more than 12 hours of detection time. - **Applicability**: Due to the cost - effectiveness and extremely large field - of - view of TFT image sensors, the system can be further expanded and is suitable for various microbiological detection tasks in laboratories and in the field. ### Conclusion: This research demonstrates a high - throughput, low - cost, and easy - to - use CFU detection system based on TFT image sensors, which can quickly and accurately detect and classify bacterial colonies in the early stage and has broad application prospects.