[论文解读] Deep Learning Enhanced Extended Depth-of-Field for Thick Blood-Film Malaria High-Throughput Microscopy

Petru Manescu, Lydia Neary‐Zajiczek+11 more|arXiv (Cornell University)|Jun 18, 2019

Digital Imaging for Blood Diseases参考文献 12被引用 5

一句话总结

本文提出EDoF-CNN，一种使用卷积神经网络的深度学习方法，可从厚血涂片显微镜的z-堆栈中快速生成高质量的扩展景深（EDoF）图像，相较于传统的多尺度分解技术，显著提升了速度和分辨率。在恶性疟原虫疟疾病例中评估，EDoF-CNN增强了自动化诊断系统中的寄生虫检测准确率，使低资源环境下的可扩展、高通量数字病理学成为可能。

ABSTRACT

Fast accurate diagnosis of malaria is still a global health challenge for which automated digital-pathology approaches could provide scalable solutions amenable to be deployed in low-to-middle income countries. Here we address the problem of Extended Depth-of-Field (EDoF) in thick blood film microscopy for rapid automated malaria diagnosis. High magnification oil-objectives (100x) with large numerical aperture are usually preferred to resolve the fine structural details that help separate true parasites from distractors. However, such objectives have a very limited depth-of-field requiring the acquisition of a series of images at different focal planes per field of view (FOV). Current EDoF techniques based on multi-scale decompositions are time consuming and therefore not suited for high-throughput analysis of specimens. To overcome this challenge, we developed a new deep learning method based on Convolutional Neural Networks (EDoF-CNN) that is able to rapidly perform the extended depth-of-field while also enhancing the spatial resolution of the resulting fused image. We evaluated our approach using simulated low-resolution z-stacks from Giemsa-stained thick blood smears from patients presenting with Plasmodium falciparum malaria. The EDoF-CNN allows speed-up of our digital-pathology acquisition platform and significantly improves the quality of the EDoF compared to the traditional multi-scaled approaches when applied to lower resolution stacks corresponding to acquisitions with fewer focal planes, large camera pixel binning or lower magnification objectives (larger FOV). We use the parasite detection accuracy of a deep learning model on the EDoFs as a concrete, task-specific measure of performance of this approach.

研究动机与目标

• 为解决在厚血涂片疟疾显微镜检查中使用高倍率（100倍）油镜时景深有限的挑战。
• 克服传统多尺度分解方法在高通量数字病理学中EDoF重建过程耗时的问题。
• 开发一种基于深度学习的方法，同时提升景深扩展和空间分辨率。
• 通过将EDoF图像作为下游寄生虫检测模型的输入，提升自动化疟疾诊断的性能。

提出的方法

• 该方法采用卷积神经网络（EDoF-CNN），通过端到端训练，将低分辨率图像的z-堆栈融合为单张高质量EDoF图像。
• 网络在基于吉姆萨染色厚血涂片并含有恶性疟原虫寄生虫的模拟z-堆栈上进行端到端训练。
• EDoF-CNN学习在多个焦平面间重建清晰、对焦的图像，同时将空间分辨率提升至超过输入分辨率。
• 该方法在效率方面进行了优化，支持实时或近实时处理，适用于高通量筛查。
• 通过寄生虫检测准确率作为任务特定指标，将EDoF-CNN输出与传统EDoF方法进行对比评估。

实验结果

研究问题

• RQ1 深度学习模型在厚血涂片显微镜EDoF重建中，是否能在速度和图像质量方面超越传统的多尺度分解技术？
• RQ2 与基线方法相比，EDoF-CNN在重建EDoF图像中的空间分辨率提升程度如何？
• RQ3 EDoF-CNN的使用对自动化疟疾诊断系统中下游寄生虫检测准确率有何影响？
• RQ4 EDoF-CNN能否有效处理来自较少焦平面、更大像素合并或较低倍率物镜的低分辨率z-堆栈？

主要发现

• 与传统的多尺度分解技术相比，EDoF-CNN在EDoF重建中实现了显著的速度提升，支持更快的高通量成像。
• 该方法生成的EDoF图像质量更高，锐度和分辨率更优，尤其在低分辨率输入堆栈中表现更佳。
• 当使用EDoF-CNN生成的图像作为输入时，下游深度学习模型的寄生虫检测准确率显著优于传统EDoF方法。
• 在成像条件较困难的情况下（如焦平面数量减少、像素合并增大或物镜倍率降低），性能提升最为显著。