Scribble-based boundary-aware network for weakly supervised salient object detection in remote sensing images

Authors

Zhou Huang, School of Resources and Environment, University of Electronic Science and Technology of China, Chengdu, China & Inception Institute of Artificial Intelligence (IIAI), Abu Dhabi, United Arab Emirates
Tian-Zhu Xiang, Inception Institute of Artificial Intelligence (IIAI), Abu Dhabi, United Arab Emirates
Huai-Xin Chen, School of Resources and Environment, University of Electronic Science and Technology of China, Chengdu, China
Hang Dai, Mohamed bin Zayed University of Artificial IntelligenceFollow

Document Type

Article

Publication Title

ISPRS Journal of Photogrammetry and Remote Sensing

Abstract

Existing CNN-based salient object detection (SOD) models rely heavily on large-scale pixel-level annotations, which are labor-intensive, time-consuming, and expensive. In contrast, sparse annotations (e.g., image-level or scribble) are gradually entering the SOD community. However, few efforts have been devoted to studying SOD from sparse annotations, especially in remote sensing. Moreover, sparse annotations usually contain a small amount of information, making it challenging to train a well-performing model, thereby causing its performance to lag largely behind fully-supervised models. Although some SOD methods adopt prior cues (e.g., edges) to improve performance, they usually lack targeted discrimination of object boundaries and thus provide saliency maps with poor boundary localization. To this end, in this paper, we propose a novel weakly-supervised SOD framework to predict the saliency of remote sensing images from sparse scribble annotations. To achieve it, we first construct the scribble-based remote sensing saliency dataset by relabeling an existing large-scale SOD dataset with scribbles, namely S-EOR dataset. After that, we present a novel scribble-based boundary-aware network (SBA-Net) for remote sensing saliency detection. Specifically, we design a boundary-aware module (BAM) to explore object boundary semantics, which is explicitly supervised by high-confidence object boundary (pseudo) labels generated by the boundary label generation (BLG) module, forcing the model to learn features that highlight object structures and thus boosting object boundary localization. Extensive quantitative and qualitative comparisons of two public remote sensing SOD datasets show that the proposed method outperforms current weakly supervised and unsupervised SOD methods and is highly competitive with existing fully supervised methods. Numerous ablation experiments demonstrate the effectiveness and generalization of the proposed model. The dataset and code will be publicly available at: https://github.com/ZhouHuang23/SBA-Net. © 2022 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS)

First Page

290

Last Page

301

DOI

10.1016/j.isprsjprs.2022.07.014

Publication Date

8-9-2022

Keywords

Remote sensing dataset, Saliency detection, Salient object detection, Scribble annotation, Weakly supervised, Large dataset, Object detection, Object recognition, Semantics

Comments

IR Deposit conditions:

OA version (pathway a) Accepted version

12 month embargo

Must link to publisher version with DOI

Recommended Citation

Z. Huang, T.Z. Xiang, H.X. Chen and H. Dai, "Scribble-based boundary-aware network for weakly supervised salient object detection in remote sensing images", ISPRS Journal of Photogrammetry and Remote Sensing, vol. 191, pp. 290-301, Sept 2022, doi: 10.1016/j.isprsjprs.2022.07.014