[论文解读] Face Morphing Attack Generation & Detection: A Comprehensive Survey

Sushma Venkatesh, Raghavendra Ramachandra+2 more|arXiv (Cornell University)|Nov 3, 2020

Face recognition and analysis参考文献 94被引用 17

一句话总结

本篇全面综述系统性地回顾了人脸融合攻击的生成与检测技术，分析了融合方法、检测算法、基准数据集及性能指标。文章识别出图像质量、衰老效应和用户友好性等关键挑战，并呼吁建立标准化评估框架，以提升真实生物识别系统中的鲁棒性。

ABSTRACT

The vulnerability of Face Recognition System (FRS) to various kind of attacks (both direct and in-direct attacks) and face morphing attacks has received a great interest from the biometric community. The goal of a morphing attack is to subvert the FRS at Automatic Border Control (ABC) gates by presenting the Electronic Machine Readable Travel Document (eMRTD) or e-passport that is obtained based on the morphed face image. Since the application process for the e-passport in the majority countries requires a passport photo to be presented by the applicant, a malicious actor and the accomplice can generate the morphed face image and to obtain the e-passport. An e-passport with a morphed face images can be used by both the malicious actor and the accomplice to cross the border as the morphed face image can be verified against both of them. This can result in a significant threat as a malicious actor can cross the border without revealing the track of his/her criminal background while the details of accomplice are recorded in the log of the access control system. This survey aims to present a systematic overview of the progress made in the area of face morphing in terms of both morph generation and morph detection. In this paper, we describe and illustrate various aspects of face morphing attacks, including different techniques for generating morphed face images but also the state-of-the-art regarding Morph Attack Detection (MAD) algorithms based on a stringent taxonomy and finally the availability of public databases, which allow to benchmark new MAD algorithms in a reproducible manner. The outcomes of competitions/benchmarking, vulnerability assessments and performance evaluation metrics are also provided in a comprehensive manner. Furthermore, we discuss the open challenges and potential future works that need to be addressed in this evolving field of biometrics.

研究动机与目标

• 提供人脸融合攻击生成与检测技术的系统性概述。
• 为融合攻击检测（MAD）算法建立严格的分类体系。
• 评估公开数据库及基准测试结果，以支持MAD算法的可复现性测试。
• 识别融合漏洞、检测鲁棒性及标准化方面的开放挑战。
• 通过阐明衰老、图像质量及实际部署中用户便利性等关键问题，为未来研究提供指导。

提出的方法

• 本文对人脸融合技术进行了全面综述，涵盖整体性与局部性人脸融合。
• 将融合攻击检测（MAD）方法划分为两类：静态融合攻击检测（S-MAD）与动态融合攻击检测（D-MAD）。
• 采用ISO/IEC标准指标评估性能，并分析来自公开竞赛与基准测试工作的结果。
• 研究了年龄、性别、种族、图像质量及后期处理等协变量对融合攻击脆弱性与检测的影响。
• 作者分析了现有公开数据库，并评估其在MAD算法基准测试中的适用性。
• 提出一种面向未来评估的结构化框架，强调实际部署约束与标准化需求。

实验结果

研究问题

• RQ1 不同融合技术如何生成高质量、难以区分的融合人脸图像？
• RQ2 S-MAD与D-MAD检测技术之间的关键差异及性能权衡是什么？
• RQ3 图像质量、衰老效应及后期处理如何影响人脸识别系统对融合攻击的脆弱性？
• RQ4 MAD算法基准测试与标准化当前存在哪些局限性？
• RQ5 如何设计用户友好、可部署的MAD系统以适用于ABC闸机等实时应用场景？

主要发现

• 本文指出，融合攻击对电子护照和eMRTD系统构成严重威胁，可通过单张融合图像实现双重验证。
• 通过深度学习技术生成的高质量融合图像日益难以检测，尤其当目标区域为眼部、鼻部等局部区域时更为显著。
• D-MAD技术对光照条件及遮挡（如眼镜、头发）更为敏感，而S-MAD则更受年龄与种族等面部协变量影响。
• 尽管已有进展，但目前尚无标准化的脆弱性指标用于评估人脸识别系统对融合攻击的易感性，凸显了关键的研究空白。
• 研究发现，人脸美化处理与数字图像提交流程会显著增加融合攻击风险，尤其在允许在线申请护照的国家更为突出。
• 当前基准测试依赖ISO/IEC指标，但跨多样化协变量的统一化与真实世界验证仍是未来标准化的关键需求。