[Paper Review] An Experimental-based Review of Image Enhancement and Image Restoration Methods for Underwater Imaging

Yan Wang, Wei Song+4 more|arXiv (Cornell University)|Jul 7, 2019

Image Enhancement Techniques115 references14 citations

TL;DR

This paper presents a comprehensive experimental evaluation of state-of-the-art image enhancement and restoration methods for underwater images, comparing IFM-free and IFM-based approaches using both subjective and objective metrics. It identifies key limitations in existing methods and provides actionable recommendations for future research in underwater image quality improvement.

ABSTRACT

Underwater images play a key role in ocean exploration, but often suffer from severe quality degradation due to light absorption and scattering in water medium. Although major breakthroughs have been made recently in the general area of image enhancement and restoration, the applicability of new methods for improving the quality of underwater images has not specifically been captured. In this paper, we review the image enhancement and restoration methods that tackle typical underwater image impairments, including some extreme degradations and distortions. Firstly, we introduce the key causes of quality reduction in underwater images, in terms of the underwater image formation model (IFM). Then, we review underwater restoration methods, considering both the IFM-free and the IFM-based approaches. Next, we present an experimental-based comparative evaluation of state-of-the-art IFM-free and IFM-based methods, considering also the prior-based parameter estimation algorithms of the IFM-based methods, using both subjective and objective analysis (the used code is freely available at https://github.com/wangyanckxx/Single-Underwater-Image-Enhancement-and-Color-Restoration). Starting from this study, we pinpoint the key shortcomings of existing methods, drawing recommendations for future research in this area. Our review of underwater image enhancement and restoration provides researchers with the necessary background to appreciate challenges and opportunities in this important field.

Motivation & Objective

• To analyze the root causes of underwater image degradation using the underwater image formation model (IFM).
• To systematically review existing image enhancement and restoration methods targeting underwater-specific impairments such as color distortion and reduced contrast.
• To conduct a comparative evaluation of state-of-the-art IFM-free and IFM-based methods using both subjective and objective assessment criteria.
• To evaluate prior-based parameter estimation techniques within IFM-based methods for improved restoration performance.
• To identify key shortcomings in current approaches and provide evidence-based recommendations for future research directions.

Proposed method

• The authors employ the underwater image formation model (IFM) to model light absorption and scattering effects as the primary causes of image degradation.
• They categorize existing methods into IFM-free (e.g., histogram equalization, Retinex-based methods) and IFM-based (e.g., methods solving for transmission and illumination parameters).
• For IFM-based methods, they evaluate prior-based parameter estimation techniques that use statistical or physical priors to estimate transmission and illumination maps.
• A comprehensive experimental setup is conducted using real underwater image datasets, with both qualitative (subjective) and quantitative (objective) evaluation metrics.
• The evaluation includes publicly available code, enabling reproducibility and benchmarking of the reviewed methods.
• Performance is assessed using standard image quality metrics such as PSNR, SSIM, and visual inspection by human observers.

Experimental results

Research questions

• RQ1 What are the primary physical causes of image degradation in underwater environments according to the IFM?
• RQ2 How do IFM-free methods compare to IFM-based methods in restoring underwater image quality across different degradation levels?
• RQ3 To what extent do prior-based parameter estimation techniques improve the performance of IFM-based restoration methods?
• RQ4 What are the key limitations of current state-of-the-art methods when applied to extreme underwater image degradations?
• RQ5 What recommendations can be derived from empirical results to guide future research in underwater image restoration?

Key findings

• IFM-based methods generally outperform IFM-free methods in terms of objective image quality metrics like PSNR and SSIM, especially under severe degradation.
• Prior-based parameter estimation in IFM-based methods significantly improves restoration accuracy by better modeling transmission and illumination maps.
• Subjective evaluations reveal that while some IFM-free methods produce visually appealing results, they often introduce color distortions and halos.
• IFM-free methods are more sensitive to extreme degradations and fail to preserve structural details under high turbidity.
• The study identifies a lack of generalization across diverse underwater conditions as a major limitation in current methods.
• The authors conclude that future research should focus on robust, data-driven IFM-based models with improved physical consistency and generalization capabilities.