论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

摘要

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation
弱监督语义分割,现有的目标区域挖掘方法,通常不考虑对象的大小,并且是一个单调的挖掘所有的对象区域的过程。

而大目标的挖掘区域的数量和规模不足,小目标的挖掘区域容易受到周围背景的污染。

本文针对此问题,提出一个 multi-miner 框架来执行区域挖掘过程,该过程能够自适应不同的目标大小,从而能够挖掘出更完整、更精细的目标区域

Intruduction

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

该方法自适应地对不同对象,采取不同区域的挖掘步数,大目标挖掘步数多,小目标挖掘步数少。因此该方法比现有的方法挖掘的目标区域更完整、更精细。

自适应挖掘的关键在于何时停止或继续挖掘。这里利用了一个 parallel modulator,它可以简单地实现为 multi-label 分类器,通过检查每个对象是否含有剩余对象区域来控制挖掘过程。然后,modulator 指导 category-aware generator 去继续或停止对每个对象的区域挖掘。所以,每个对象的挖掘步数可以自适应它的大小。

区域挖掘过程中,由于叠加卷积层,使得输入图像的空间分辨率不能保持,因此在区域挖掘过程中不可避免地会包含一些背景。为了缓解这个问题,提出一个 multi-scale 训练策略。小尺寸的输入可以提供关于整个对象的全局信息,而大尺寸的输入提供关于细节的信息。

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation
对上述的内容概况一下:

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

方法

object-adaptive region mining

![在这里插入图片描述](https://img-blog.****img.cn/20200910164649688.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM2MjI0Mj
I1,size_16,color_FFFFFF,t_70#pic_center)论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation
论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation
论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

multi-scale training strategy

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

connection with distribution mapping

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

实验

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation
论文阅读:Multi-Miner: Object-Adaptive Region Mining for Weakly-Supervised Semantic Segmentation

原文下载

点击下载