[论文解读] Dense v.s. Sparse: A Comparative Study of Sampling Analysis in Scene Classification of High-Resolution Remote Sensing Imagery

Jingwen Hu, Gui-Song Xia+2 more|arXiv (Cornell University)|Feb 4, 2015

Advanced Image and Video Retrieval Techniques参考文献 34被引用 4

一句话总结

本文采用标准的词袋视觉词汇模型，对比了高分辨率遥感影像场景分类中密集采样与稀疏采样策略的性能。结果表明，密集采样性能最佳，但计算成本较高；而随机采样在性能上可与多尺度关键点检测和基于显著性的先进稀疏方法相媲美。

ABSTRACT

Scene classification is a key problem in the interpretation of high-resolution remote sensing imagery. Many state-of-the-art methods, e.g. bag-of-visual-words model and its variants, the topic models as well as deep learning-based approaches, share similar procedures: patch sampling, feature description/learning and classification. Patch sampling is the first and a key procedure which has a great influence on the results. In the literature, many different sampling strategies have been used, {e.g. dense sampling, random sampling, keypoint-based sampling and saliency-based sampling, etc. However, it is still not clear which sampling strategy is suitable for the scene classification of high-resolution remote sensing images. In this paper, we comparatively study the effects of different sampling strategies under the scenario of scene classification of high-resolution remote sensing images. We divide the existing sampling methods into two types: dense sampling and sparse sampling, the later of which includes random sampling, keypoint-based sampling and various saliency-based sampling proposed recently. In order to compare their performances, we rely on a standard bag-of-visual-words model to construct our testing scheme, owing to their simplicity, robustness and efficiency. The experimental results on two commonly used datasets show that dense sampling has the best performance among all the strategies but with high spatial and computational complexity, random sampling gives better or comparable results than other sparse sampling methods, like the sophisticated multi-scale key-point operators and the saliency-based methods which are intensively studied and commonly used recently.

研究动机与目标

• 研究不同图像块采样策略对高分辨率遥感影像场景分类准确率的影响。
• 明确在场景分类任务中，密集采样与稀疏采样哪种方法更为有效。
• 评估不同采样策略在性能与计算复杂度之间的权衡。
• 为随机采样与先进稀疏方法（如基于关键点和基于显著性的采样）的相对有效性提供实证证据。

提出的方法

• 本研究采用标准的词袋视觉词汇模型作为基线分类框架，以确保比较的一致性与公平性。
• 采用四类采样方式：密集采样、随机采样、基于关键点的采样（如SIFT），以及基于显著性的采样。
• 使用固定描述子（如SIFT或类似方法）从采样图像块中提取特征，随后通过k-means聚类生成词袋。
• 使用标准SVM或类似线性分类器对视觉词汇直方图进行分类。
• 整个流程在两个广泛使用的高分辨率遥感影像数据集上进行评估。
• 性能通过标准分类准确率指标进行衡量，同时分析各采样策略的计算成本。

实验结果

研究问题

• RQ1 在高分辨率遥感影像场景分类中，密集采样与稀疏采样策略在分类准确率方面有何差异？
• RQ2 随机采样是否能达到与多尺度关键点检测或基于显著性的复杂稀疏采样方法相当的性能？
• RQ3 不同采样策略在分类准确率与计算复杂度之间存在何种权衡？
• RQ4 在此背景下，基于显著性的先进稀疏方法是否显著优于简单的随机采样？

主要发现

• 在两个基准数据集上，密集采样在所有测试采样策略中取得了最高的分类准确率。
• 尽管性能优越，密集采样在空间与计算复杂度方面显著高于稀疏方法。
• 随机采样在性能上优于或可与多尺度关键点算子和基于显著性的稀疏方法相媲美。
• 基于显著性的采样与基于关键点的方法并未始终优于随机采样，表明复杂度提升带来的收益递减。
• 密集采样与稀疏采样之间的性能差距显著，但密集采样的高计算成本限制了其在大规模应用中的实用性。
• 由于其简单性与优异的性能，随机采样成为强有力的基线方法，挑战了采用复杂稀疏采样启发式方法的必要性。