[论文解读] Applications of Deep Learning in Fish Habitat Monitoring: A Tutorial and Survey

Alzayat Saleh, Marcus Sheaves+2 more|arXiv (Cornell University)|Jun 11, 2022

Water Quality Monitoring Technologies被引用 4

一句话总结

本文全面介绍了将深度学习（DL）应用于水下鱼类栖息地监测的教程与综述，涵盖关键的深度学习概念、逐步的模型开发流程，以及分类、计数、定位和分割的最先进技术。文章突出了深度学习在自动化处理水下摄像机获取的视觉数据方面的潜力，同时探讨了数据稀缺、图像质量差以及海洋环境中模型优化等挑战。

ABSTRACT

Marine ecosystems and their fish habitats are becoming increasingly important due to their integral role in providing a valuable food source and conservation outcomes. Due to their remote and difficult to access nature, marine environments and fish habitats are often monitored using underwater cameras. These cameras generate a massive volume of digital data, which cannot be efficiently analysed by current manual processing methods, which involve a human observer. DL is a cutting-edge AI technology that has demonstrated unprecedented performance in analysing visual data. Despite its application to a myriad of domains, its use in underwater fish habitat monitoring remains under explored. In this paper, we provide a tutorial that covers the key concepts of DL, which help the reader grasp a high-level understanding of how DL works. The tutorial also explains a step-by-step procedure on how DL algorithms should be developed for challenging applications such as underwater fish monitoring. In addition, we provide a comprehensive survey of key deep learning techniques for fish habitat monitoring including classification, counting, localization, and segmentation. Furthermore, we survey publicly available underwater fish datasets, and compare various DL techniques in the underwater fish monitoring domains. We also discuss some challenges and opportunities in the emerging field of deep learning for fish habitat processing. This paper is written to serve as a tutorial for marine scientists who would like to grasp a high-level understanding of DL, develop it for their applications by following our step-by-step tutorial, and see how it is evolving to facilitate their research efforts. At the same time, it is suitable for computer scientists who would like to survey state-of-the-art DL-based methodologies for fish habitat monitoring.

研究动机与目标

• 为海洋科学家和计算机科学家提供一份实用的、分步式的教程，介绍如何将深度学习应用于水下鱼类栖息地监测。
• 综述并比较最先进的深度学习技术，包括分类、计数、定位和语义分割，用于分析水下鱼类图像。
• 整理并审查公开可用的水下鱼类数据集，以支持可复现的研究和模型基准测试。
• 识别在水下监测中部署深度学习的关键挑战，如能见度差、图像失真以及标注数据有限。
• 概述未来研究方向，包括自监督学习、自动鱼类表型分析，以及使用低功耗深度学习系统实现实时行为追踪。

提出的方法

• 介绍深度学习的基础概念，重点聚焦于卷积神经网络（CNNs）及其用于视觉特征学习的架构。
• 概述一个系统化、分步的流程，用于开发针对水下鱼类监测任务量身定制的深度学习模型。
• 回顾关键的深度学习技术：实例分割（如Mask R-CNN）、目标检测（如YOLO、Faster R-CNN）和图像分类（如ResNets）。
• 评估模型训练策略，如数据增强、迁移学习、Dropout和正则化，以提升在小样本或噪声数据集上的鲁棒性。
• 提出在深度学习推理前，结合图像增强技术（如色彩校正、降噪）以提升输入质量。
• 讨论弱监督学习和自监督学习的使用，以减少对昂贵人工标注数据的依赖。

实验结果

研究问题

• RQ1 如何系统性地应用深度学习，以自动化处理通过永久或临时摄像系统采集的水下鱼类栖息地图像？
• RQ2 在复杂水下环境中，针对鱼类检测、计数和分割等任务，最有效的深度学习架构和训练策略是什么？
• RQ3 数据质量问题（如能见度低、色彩失真和噪声）如何影响深度学习模型在鱼类监测中的性能？
• RQ4 目前有哪些公开可用的数据集可用于训练和基准测试水下鱼类监测的深度学习模型？
• RQ5 在部署实时、低功耗且高精度的深度学习系统以实现鱼类行为追踪和表型分析方面，存在哪些关键挑战和未来研究机遇？

主要发现

• 深度学习在处理大规模水下视觉数据方面显著优于人工分析，可实现可扩展且高效的鱼类栖息地监测。
• 迁移学习和数据增强在有限或特定领域的水下鱼类数据集上显著提升了模型性能。
• 当与深度学习结合时，图像增强技术可减轻水下视觉退化，从而提高检测和分割的准确性。
• 当前公开的水下鱼类监测数据集在规模和标注质量方面均有限，成为模型泛化能力的瓶颈。
• 自监督学习和弱监督学习方法在减少水下应用中对昂贵人工标注数据的依赖方面展现出巨大潜力。
• 实时、低功耗鱼类追踪系统仍是关键挑战，亟需在模型效率和软硬件集成方面进一步创新。