Mask R-CNN
Kaiming He Georgia Gkioxari Piotr Doll
´
ar Ross Girshick
Facebook AI Research (FAIR)
Abstract
We present a conceptually simple, flexible, and general
framework for object instance segmentation. Our approach
efficiently detects objects in an image while simultaneously
generating a high-quality segmentation mask for each in-
stance. The method, called Mask R-CNN, extends Faster
R-CNN by adding a branch for predicting an object mask in
parallel with the existing branch for bounding box recogni-
tion. Mask R-CNN is simple to train and adds only a small
overhead to Faster R-CNN, running at 5 fps. Moreover,
Mask R-CNN is easy to generalize to other tasks, e.g., al-
lowing us to estimate human poses in the same framework.
We show top results in all three tracks of the COCO suite of
challenges, including instance segmentation, bounding-box
object detection, and person keypoint detection. Without
tricks, Mask R-CNN outperforms all existing, single-model
entries on every task, including the COCO 2016 challenge
winners. We hope our simple and effective approach will
serve as a solid baseline and help ease future research in
instance-level recognition. Code will be made available.
1. Introduction
The vision community has rapidly improved object de-
tection and semantic segmentation results over a short pe-
riod of time. In large part, these advances have been driven
by powerful baseline systems, such as the Fast/Faster R-
CNN [12, 34] and Fully Convolutional Network (FCN) [29]
frameworks for object detection and semantic segmenta-
tion, respectively. These methods are conceptually intuitive
and offer flexibility and robustness, together with fast train-
ing and inference time. Our goal in this work is to develop a
comparably enabling framework for instance segmentation.
Instance segmentation is challenging because it requires
the correct detection of all objects in an image while also
precisely segmenting each instance. It therefore combines
elements from the classical computer vision tasks of ob-
ject detection, where the goal is to classify individual ob-
jects and localize each using a bounding box, and semantic
segmentation, where the goal is to classify each pixel into
RoIAlignRoIAlign
class
box
convconv
convconv
Figure 1. The Mask R-CNN framework for instance segmentation.
a fixed set of categories without differentiating object in-
stances.
1
Given this, one might expect a complex method
is required to achieve good results. However, we show that
a surprisingly simple, flexible, and fast system can surpass
prior state-of-the-art instance segmentation results.
Our method, called Mask R-CNN, extends Faster R-CNN
[34] by adding a branch for predicting segmentation masks
on each Region of Interest (RoI), in parallel with the ex-
isting branch for classification and bounding box regres-
sion (Figure 1). The mask branch is a small FCN applied
to each RoI, predicting a segmentation mask in a pixel-to-
pixel manner. Mask R-CNN is simple to implement and
train given the Faster R-CNN framework, which facilitates
a wide range of flexible architecture designs. Additionally,
the mask branch only adds a small computational overhead,
enabling a fast system and rapid experimentation.
In principle Mask R-CNN is an intuitive extension of
Faster R-CNN, yet constructing the mask branch properly
is critical for good results. Most importantly, Faster R-
CNN was not designed for pixel-to-pixel alignment be-
tween network inputs and outputs. This is most evident in
how RoIPool [18, 12], the de facto core operation for at-
tending to instances, performs coarse spatial quantization
for feature extraction. To fix the misalignment, we pro-
pose a simple, quantization-free layer, called RoIAlign, that
faithfully preserves exact spatial locations. Despite being
1
Following common terminology, we use object detection to denote
detection via bounding boxes, not masks, and semantic segmentation to
denote per-pixel classification without differentiating instances. Yet we
note that instance segmentation is both semantic and a form of detection.
1
arXiv:1703.06870v2 [cs.CV] 5 Apr 2017
下载后可阅读完整内容，剩余9页未读，立即下载
weixin_40925399
- 粉丝: 0
- 资源: 1
我的内容管理
展开
最新资源
- C++标准程序库：权威指南
- Java解惑：奇数判断误区与改进方法
- C++编程必读：20种设计模式详解与实战
- LM3S8962微控制器数据手册
- 51单片机C语言实战教程：从入门到精通
- Spring3.0权威指南：JavaEE6实战
- Win32多线程程序设计详解
- Lucene2.9.1开发全攻略：从环境配置到索引创建
- 内存虚拟硬盘技术：提升电脑速度的秘密武器
- Java操作数据库：保存与显示图片到数据库及页面
- ISO14001：2004环境管理体系要求详解
- ShopExV4.8二次开发详解
- 企业形象与产品推广一站式网站建设技术方案揭秘
- Shopex二次开发：触发器与控制器重定向技术详解
- FPGA开发实战指南：创新设计与进阶技巧
- ShopExV4.8二次开发入门：解决升级问题与功能扩展
资源上传下载、课程学习等过程中有任何疑问或建议，欢迎提出宝贵意见哦~我们会及时处理！
点击此处反馈
