[論文レビュー] A Richly Annotated Dataset for Pedestrian Attribute Recognition

Dangwei Li, Zhang Zhang+3 more|arXiv (Cornell University)|Mar 23, 2016

Video Surveillance and Tracking Methods参考文献 22被引用数 180

ひとこと要約

この論文は、RAPデータセットを41,585個の歩行者サンプルと72属性、視点・遮蔽・体の部位の注釈とともに提示し、マルチラベルのベースラインと評価指標を用いて環境要因が属性認識に与える影響を分析する。

ABSTRACT

In this paper, we aim to improve the dataset foundation for pedestrian attribute recognition in real surveillance scenarios. Recognition of human attributes, such as gender, and clothes types, has great prospects in real applications. However, the development of suitable benchmark datasets for attribute recognition remains lagged behind. Existing human attribute datasets are collected from various sources or an integration of pedestrian re-identification datasets. Such heterogeneous collection poses a big challenge on developing high quality fine-grained attribute recognition algorithms. Furthermore, human attribute recognition are generally severely affected by environmental or contextual factors, such as viewpoints, occlusions and body parts, while existing attribute datasets barely care about them. To tackle these problems, we build a Richly Annotated Pedestrian (RAP) dataset from real multi-camera surveillance scenarios with long term collection, where data samples are annotated with not only fine-grained human attributes but also environmental and contextual factors. RAP has in total 41,585 pedestrian samples, each of which is annotated with 72 attributes as well as viewpoints, occlusions, body parts information. To our knowledge, the RAP dataset is the largest pedestrian attribute dataset, which is expected to greatly promote the study of large-scale attribute recognition systems. Furthermore, we empirically analyze the effects of different environmental and contextual factors on pedestrian attribute recognition. Experimental results demonstrate that viewpoints, occlusions and body parts information could assist attribute recognition a lot in real applications.

研究の動機と目的

• 大規模で豊富に注釈された歩行者属性データセットを実世界の監視シーンから作成する。
• サンプルに72の細かい属性と環境/文脈要因（視点、遮蔽、体の部位）を注釈付けする。
• ベースラインモデルとマルチラベルモデルを評価し、文脈が属性認識に与える影響を理解する。
• 実世界のシナリオにおける属性間の依存関係をより適切に捉えるためのマルチラベル評価指標を導入する。

提案手法

• 3か月にわたり26のカメラシーンから実際の監視映像を収集する。
• 41,585人の歩行者サンプルを72属性と文脈要因（視点、遮蔽、部位）を用いて注釈付けする。
• ELFとCNN特徴（FC6/FC7）を用いたSVMベースラインと、2つのマルチラベルCNNモデル（ACN, DeepMAR）を評価する。
• 2つの特徴タイプ（ELFとCaffeNet由来のCNNベース特徴）を使用し、単一属性学習とマルチ属性結合学習を比較する。
• 従来のmean Accuracy (mA)に加えて、マルチラベル評価指標（正確さ、適合率、再現率、F1）を提案・適用する。
• 部分の影響を、頭肩領域、上半身、下半身領域の属性認識への影響を分析して調査する。

実験結果

リサーチクエスチョン

• RQ1 viewpoints, occlusions, and body-part visibility influence pedestrian attribute recognition performance?
• RQ2 Do multi-label learning approaches (ACN, DeepMAR) outperform single-attribute classifiers on RAP?
• RQ3 Can part-based representations improve attribute recognition under real surveillance conditions?
• RQ4 What evaluation metrics best capture the dependencies among multiple attributes in this context?

主な発見

• RAP is the largest pedestrian attribute dataset to date, with 41,585 samples and 72 attributes plus contextual annotations.
• Viewpoints, occlusions, and body-part information significantly affect attribute recognition performance.
• CNN-based features (FC6/FC7) generally outperform ELF features for this task, with FC6 showing strong generalization.
• Example-based (multi-label) evaluation reveals meaningful inter-attribute dependencies and substantial gains for multi-attribute joint learning over single-attribute SVM approaches.
• Part-based analysis shows that attributes linked to specific body regions benefit from using head-shoulder, upper-body, or lower-body features, and incorporating parts can improve recognition.