Journal of Chinese Computer Systems
Vol. No.
-- --
. 魏 赟, 孙 硕,
.
生成对抗网络进行感知遮挡人脸还原的算法研究
魏 赟,孙 硕
E-mail qq. com
摘 要: 有遮挡人脸图像还原是指通过对遮挡区域的图像进行估计,尽可能使用语义上合理的内容来填补. 现有的人脸图像还
原算法大多使用预先定义的掩模来模拟遮挡,并未考虑真实场景下的遮挡( 如眼镜、口罩等) 大小和位置对图像还原的影响. 提
出了一种基于深度卷积生成对抗网络的遮挡感知人脸还原方法,通过学习最接近遮挡图像的编码,来推断缺失的内容,并在生
成的过程中自动检测出遮挡的区域,此外,为了减少面部信息丢失,保证恢复后的人脸的真实性,引入语义感知网络,以此进一
步优化所提模型. 对所选数据集的实验表明,所提出的模型效果较好.
关 键 词:
中图分类号: TP 文献标识码:A 文 章 编 号:-()--
Research on Perceptual Occlusion Face Restoration Algorithms Based on Generative Adver-
sarial Networks
WEI Yun,SUN Shuo
(School of Optical-Electrical and Computer Engineering,University of Shanghai for Science and Technology,Shanghai ,China)
Abstract:The occlusion of the face image is determined by estimating the image of the occlusion area and filling it with semantically
reasonable content. Most of the existing face image restoration algorithms use pre-defined mask to simulate occlusion,without consid-
ering the influence of size and position of occlusion(such as glasses,masks,etc. )in the real scene. An occlusion-aware face restoration
method based on deep convolution generation against network is proposed. By learning the encoding closest to the occlusion image,the
missing content is inferred,and the occlusion area is automatically detected during the generation process. In addition,for reduce the
loss of facial information,ensuring the authenticity of the restored face,a semantic-aware network is introduced to optimize the pro-
posed model. Experiment shows that the proposed model works well.
Key words:occlusion detection;generative adversarial networks;semantic perception;face restoration
1 引 言
.
.
.
.
-
.
Park PCA . Robust-PCA
.
.
Boltzmann
.
.
.
.
.
.
.
Generative Adversarial NetworksGANs
.
GAN . Pathak
- Context Encoder
.
万方数据