U2-Net: Going deeper with nested U-structure for salient object detection

Xuebin Qin,Zichen Zhang,Chenyang Huang,Masood Dehghan,Osmar R. Zaiane,Martin Jagersand
DOI: https://doi.org/10.1016/j.patcog.2020.107404
IF: 8
2020-10-01
Pattern Recognition
Abstract:In this paper, we design a simple yet powerful deep network architecture, U2-Net, for salient object detection (SOD). The architecture of our U2-Net is a two-level nested U-structure. The design has the following advantages: (1) it is able to capture more contextual information from different scales thanks to the mixture of receptive fields of different sizes in our proposed ReSidual U-blocks (RSU), (2) it increases the depth of the whole architecture without significantly increasing the computational cost because of the pooling operations used in these RSU blocks. This architecture enables us to train a deep network from scratch without using backbones from image classification tasks. We instantiate two models of the proposed architecture, U2-Net (176.3 MB, 30 FPS on GTX 1080Ti GPU) and U2-Net† (4.7 MB, 40 FPS), to facilitate the usage in different environments. Both models achieve competitive performance on six SOD datasets. The code is available: https://github.com/NathanUA/U-2-Net.
computer science, artificial intelligence,engineering, electrical & electronic
What problem does this paper attempt to address?