Abstract:Artificial intelligence (AI) has been widely used in bioimage image analysis nowadays, but the efficiency of AI models, like the energy consumption and latency is not ignorable due to the growing model size and complexity, as well as the fast-growing analysis needs in modern biomedical studies. Like we can compress large images for efficient storage and sharing, we can also compress the AI models for efficient applications and deployment. In this work, we present EfficientBioAI, a plug-and-play toolbox that can compress given bioimaging AI models for them to run with significantly reduced energy cost and inference time on both CPU and GPU, without compromise on accuracy. In some cases, the prediction accuracy could even increase after compression, since the compression procedure could remove redundant information in the model representation and therefore reduce over-fitting. From four different bioimage analysis applications, we observed around 2-5 times speed-up during inference and 30-80$\%$ saving in energy. Cutting the runtime of large scale bioimage analysis from days to hours or getting a two-minutes bioimaging AI model inference done in near real-time will open new doors for method development and biomedical discoveries. We hope our toolbox will facilitate resource-constrained bioimaging AI and accelerate large-scale AI-based quantitative biological studies in an eco-friendly way, as well as stimulate further research on the efficiency of bioimaging AI.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is the efficiency of AI models in biomedical image analysis, specifically including the following aspects: 1. **Energy Consumption**: As the complexity and scale of AI models grow, the energy required for the models during the inference process increases significantly. For example, from 2012 to 2021, the energy consumption for one forward propagation of the state - of - the - art AI models increased from 0.1 joules to approximately 30 joules. 2. **Inference Latency**: When complex AI models run on CPUs or edge devices, the inference time may increase significantly, especially when processing very large images. This not only affects real - time performance but also limits the efficiency of large - scale biomedical research. 3. **Representation Efficiency**: Since the growth rate of training data cannot keep up with the growth of model complexity, the models may become inefficient in training and more prone to overfitting. To solve these problems, the authors proposed a toolkit named EfficientBioAI, aiming to improve the efficiency of AI models in terms of energy, latency, and representation by compressing them. Specific methods include: - **Quantization**: Quantize the weights and activations of the model from commonly used floating - point numbers (such as 32 - bit or 16 - bit) to lower precision (such as 8 - bit integers), thereby reducing energy consumption and inference latency. - **Pruning**: Reduce the model complexity by removing unimportant weights or neurons in the neural network, thereby reducing the computational overhead. - **Knowledge Distillation**: Transfer the knowledge of complex models to simpler and faster models to improve the inference speed and energy efficiency. Through these techniques, EfficientBioAI can significantly improve the efficiency of biomedical image analysis tasks without affecting the accuracy of the models. Experimental results show that in multiple biomedical image analysis tasks, EfficientBioAI can achieve 2 - 5 times of inference acceleration and save 30% - 80% of energy consumption. In addition, EfficientBioAI also has good compatibility and ease of use, supports multiple hardware platforms, and can be seamlessly integrated with existing biomedical image analysis tools, thereby promoting efficient biomedical research in resource - constrained environments.

EfficientBioAI: Making Bioimaging AI Models Efficient in Energy, Latency and Representation

EfficientBioAI: making bioimaging AI models efficient in energy and latency

Survey on Energy-Efficient Deep Neural Networks for Computer Vision

Investigation of Energy-efficient AI Model Architectures and Compression Techniques for "Green" Fetal Brain Segmentation

Sharing Massive Biomedical Data at Magnitudes Lower Bandwidth Using Implicit Neural Function

Deep learning based Image Compression for Microscopy Images: An Empirical Study

On the effectiveness of compact biomedical transformers

Workflow Integration of Research AI Tools into a Hospital Radiology Rapid Prototyping Environment

Multi-Component Optimization and Efficient Deployment of Neural-Networks on Resource-Constrained IoT Hardware

Structured Model Pruning for Efficient Inference in Computational Pathology

Implicit Neural Image Field for Biological Microscopy Image Compression

Safety and Performance, Why not Both? Bi-Objective Optimized Model Compression toward AI Software Deployment

Leveraging Computational Pathology AI for Noninvasive Optical Imaging Analysis Without Retraining

SCI: A Spectrum Concentrated Implicit Neural Compression for Biomedical Data

Safety and Performance, Why Not Both? Bi-Objective Optimized Model Compression against Heterogeneous Attacks Toward AI Software Deployment

Model Compression Techniques in Biometrics Applications: A Survey

Post-Training Network Compression for 3D Medical Image Segmentation: Reducing Computational Efforts via Tucker Decomposition

Adaptive Resolution Inference (ARI): Energy-Efficient Machine Learning for Internet of Things

On the inference speed and video-compression robustness of DeepLabCut

AMC: AutoML for Model Compression and Acceleration on Mobile Devices