Learning discriminative foreground-and-background features for few-shot segmentation


    Background

    Few-shot Semantic Segmentation (FSS) endeavors to segment novel categories in a query image by referring to a support set comprising only a few annotated examples. Presently, many existing FSS methodologies primarily embrace the prototype learning paradigm and concentrate on optimizing the matching mechanism.


    Motivation

    However, these approaches tend to overlook the discrimination between the features of foreground background. Consequently, the segmentation results are often imprecise when it comes to capturing intricate structures, such as boundaries and small objects.


    RL pic
    RL pic


    Our Contributions

    In summary, our main contribution can be concluded as follows:

    • We introduce the Discriminative Foreground and Background feature learning Network (DFBNet) specifically for the FSS problem. To the best of our knowledge, DFBNet is the first model to prioritize the improvement of distinguishability between foreground and background features, leading to more accurate segmentation.
    • We propose two novel modules: the feature separation module (FSM) and the semantic alignment module (SAM). These modules enable the extraction of more discriminative foreground and background information from query images.
    • Our proposed FSS method, DFBNet, achieves state-of-the-art results on both the PASCAL-5i and COCO-20i benchmarks, demonstrating its superiority over existing approaches in the field.
    order

    Experiments

    To showcase the effectiveness and competitiveness of our proposed method, DFBNet, we provide the mean intersection-over-union (mIoU) results for each fold as well as the average mIoU across all folds for both the 1-shot and 5-shot settings on the PASCAL-5i and COCO20i and FSS-1000 datasets. We compare our approach, DFBNet, with the existing state-ofthe-art (SOTA) few-shot segmentation models.



    order

    order

    order


    Sources
    • More detials please see our paper.
    • The code is available at DFBNet.

    Citation

    @article{jiang2023learning, title={Learning discriminative foreground-and-background features for few-shot segmentation}, author={Jiang, Cong and Zhou, Yange and Liu, Zhaoshuo and Feng, Chaolu and Li, Wei and Yang, Jinzhu}, journal={Multimedia Tools and Applications}, pages={1--21}, year={2023}, publisher={Springer} }