Abstract:Instance segmentation is a challenging task in computer vision, as it requires distinguishing objects and predicting dense areas. Currently, segmentation models based on complex designs and large parameters have achieved remarkable accuracy. However, from a practical standpoint, achieving a balance between accuracy and speed is even more desirable. To address this need, this paper presents ESAMask, a real-time segmentation model fused with efficient sparse attention, which adheres to the principles of lightweight design and efficiency. In this work, we propose several key contributions. Firstly, we introduce a dynamic and sparse Related Semantic Perceived Attention mechanism (RSPA) for adaptive perception of different semantic information of various targets during feature extraction. RSPA uses the adjacency matrix to search for regions with high semantic correlation of the same target, which reduces computational cost. Additionally, we design the GSInvSAM structure to reduce redundant calculations of spliced features while enhancing interaction between channels when merging feature layers of different scales. Lastly, we introduce the Mixed Receptive Field Context Perception Module (MRFCPM) in the prototype branch to enable targets of different scales to capture the feature representation of the corresponding area during mask generation. MRFCPM fuses information from three branches of global content awareness, large kernel region awareness, and convolutional channel attention to explicitly model features at different scales. Through extensive experimental evaluation, ESAMask achieves a mask AP of 45.4 at a frame rate of 45.2 FPS on the COCO dataset, surpassing current instance segmentation methods in terms of the accuracy–speed trade-off, as demonstrated by our comprehensive experimental results. In addition, the high-quality segmentation results of our proposed method for objects of various classes and scales can be intuitively observed from the visualized segmentation outputs.

ES-Mask: Evolutionary Strip Mask for Explaining Time Series Prediction (student Abstract).

CGS-Mask: Making Time Series Predictions Intuitive for All

An Interpretable Multivariate Time-series Anomaly Detection Method in Cyber-Physical Systems Based on Adaptive Mask

EMIT- Event-Based Masked Auto Encoding for Irregular Time Series

Unveiling the Secrets: How Masking Strategies Shape Time Series Imputation

Time-Series Representation Feature Refinement with a Learnable Masking Augmentation Framework in Contrastive Learning

Evolved Part Masking for Self-Supervised Learning

MSTEM: Masked Spatiotemporal Event Series Modeling for Urban Undisciplined Events Forecasting

TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoders

Demonstration of MaskSearch: Efficiently Querying Image Masks for Machine Learning Workflows

ESAMask: Real-Time Instance Segmentation Fused with Efficient Sparse Attention

How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders

Why the Agent Made that Decision: Explaining Deep Reinforcement Learning with Vision Masks

Spatio-Temporal Encoding of Brain Dynamics with Surface Masked Autoencoders

Wearing a MASK: Compressed Representations of Variable-Length Sequences Using Recurrent Neural Tangent Kernels

Hierarchical Dynamic Masks for Visual Explanation of Neural Networks

An Unsupervised Short- and Long-Term Mask Representation for Multivariate Time Series Anomaly Detection

Two Birds with One Stone: Series Saliency for Accurate and Interpretable Multivariate Time Series Forecasting.

Stare at What You See: Masked Image Modeling Without Reconstruction

Rethinking Remote Sensing Change Detection With A Mask View

SSET: Swapping-Sliding Explanation for Time Series Classifiers in Affect Detection