Abstract:Overhead fisheye images can be used for person detection in intelligent monitoring systems. Unlike horizontal images, people in fisheye cameras are generally distributed in any orientation. When the object is rotated, the feature maps from convolutional neural networks have nonlinear variations and lose many orientation features. Transformer can learn the orientation relationship between features. However, a transformer cannot directly extract orientation features and the effectiveness of detecting small objects needs to be improved. In this paper, We propose a novel rotation-equivariant transformer backbone network, which combines group-equivariant convolution with swin transformer to solve these problems. In our proposed model, the rotation-equivariant feature map extracted by group-equivariant convolution contains a large number of orientation features in multiple directions. Aggregates feature in different directions to enhance the communication of orientation features before computing window self-attention. We propose the equivariant-group relation module for evaluating the similarity of the equivariant-group and calculating the aggregation weights. Our network architecture for multi-level receptive field structure can expand the local receptive field to enhance the detection of small objects. The experiments validate that our model achieves state-of-the-art performance on fisheye image datasets MW-R, HABBOF, and CEPDOF. Compared with the swin transformer, the accuracy of our model is improved by 0.3 % , 0.5 % , and 1.3 % , and the accuracy of small object detection in the CEPDOF dataset is improved by 0.73 % .

Orientation-aware People Detection and Counting Method Based on Overhead Fisheye Camera

Object Detection and Localization in 3D Environment by Fusing Raw Fisheye Image and Attitude Data

Downside Hemisphere Object Detection and Localization of MAV by Fisheye Camera

Fish Keypoints Detection for Ecology Monitoring Based on Underwater Visual Intelligence

An Automatic Detection and Statistical Method for Underwater Fish Based on Foreground Region Convolution Network (FR-CNN)

OARPD: occlusion-aware rotated people detection in overhead fisheye images

Omnidirectional Dense SLAM for Back-to-back Fisheye Cameras

Large-Scale Person Detection and Localization Using Overhead Fisheye Cameras.

RAPiD: Rotation-Aware People Detection in Overhead Fisheye Images

Improved Face Detector on Fisheye Images Via Spherical-Domain Attention

Estimating Distances Between People using a Single Overhead Fisheye Camera with Application to Social-Distancing Oversight

High-Accuracy People Counting in Large Spaces Using Overhead Fisheye Cameras

Improving Passenger Detection With Overhead Fisheye Imaging

Rotation-equivariant Transformer for Oriented Person Detection of Overhead Fisheye Images

Spatio-Visual Fusion-Based Person Re-Identification for Overhead Fisheye Images

Automatic Surveillance System Using Fish-Eye Lens Camera

Moving Object Detection Using an In-Vehicle Fish-Eye Camera

ARPD: Anchor-free Rotation-aware People Detection using Topview Fisheye Camera

Streaming Object Detection on Fisheye Cameras for Automatic Parking

Oriented Spatial Transformer Network for Pedestrian Detection Using Fish-Eye Camera

GET: Group Equivariant Transformer for Person Detection of Overhead Fisheye Images