[论文解读] Handwritten Bangla Digit Recognition Using Deep Learning

Md Zahangir Alom, Paheding Sidike+2 more|arXiv (Cornell University)|May 7, 2017

Handwritten Text Recognition Techniques参考文献 1被引用 80

一句话总结

本文评估多种深度学习模型用于 CMATERdb 3.1.1 的 Handwritten Bangla Digit Recognition，结果表明具有 Gabor 特征和 dropout 的 CNN 能达到最佳准确率 98.78%。

ABSTRACT

In spite of the advances in pattern recognition technology, Handwritten Bangla Character Recognition (HBCR) (such as alpha-numeric and special characters) remains largely unsolved due to the presence of many perplexing characters and excessive cursive in Bangla handwriting. Even the best existing recognizers do not lead to satisfactory performance for practical applications. To improve the performance of Handwritten Bangla Digit Recognition (HBDR), we herein present a new approach based on deep neural networks which have recently shown excellent performance in many pattern recognition and machine learning applications, but has not been throughly attempted for HBDR. We introduce Bangla digit recognition techniques based on Deep Belief Network (DBN), Convolutional Neural Networks (CNN), CNN with dropout, CNN with dropout and Gaussian filters, and CNN with dropout and Gabor filters. These networks have the advantage of extracting and using feature information, improving the recognition of two dimensional shapes with a high degree of invariance to translation, scaling and other pattern distortions. We systematically evaluated the performance of our method on publicly available Bangla numeral image database named CMATERdb 3.1.1. From experiments, we achieved 98.78% recognition rate using the proposed method: CNN with Gabor features and dropout, which outperforms the state-of-the-art algorithms for HDBR.

研究动机与目标

• Motivate improved recognition of handwritten Bangla digits due to variability in writing styles.
• Compare deep learning approaches (DBN, CNN variants) for HBDR without extensive feature engineering.
• Assess the impact of dropout and Gabor/filter features on recognition performance.
• Benchmark against state-of-the-art methods on CMATERdb 3.1.1 to establish a strong baseline.

提出的方法

• Evaluate Deep Belief Networks (DBN) and Convolutional Neural Networks (CNN) on CMATERdb 3.1.1.
• Explore CNN variants including dropout, Gaussian filters, and Gabor filters.
• Describe CNN architecture: two convolution layers, two subsampling layers, and one fully connected classification layer.
• Use RBM-based pretraining for DBN with contractive divergence learning.
• Train and test across multiple iterations to compare performance with SVM and other methods.

实验结果

研究问题

• RQ1 How do different deep learning architectures (DBN vs CNN) perform on HBDR for Bangla digits?
• RQ2 Does applying dropout and using Gabor or Gaussian filters improve CNN-based HBDR performance?
• RQ3 How does the best DL approach compare to state-of-the-art methods on CMATERdb 3.1.1?

主要发现

方法	准确率
SVM	95.50%
DBN	97.20%
CNN + Gaussian	97.70%
CNN + Gabor	98.30%
CNN + Gaussian + Dropout	98.64%
CNN + Gabor + Dropout	98.78%

• CNN with Gabor features and dropout achieves the highest reported accuracy of 98.78%.
• CNN with random Gaussian filters yields 97.70% accuracy, and CNN with Gabor yields 98.30%.
• CNN with dropout and Gaussian filters achieves 98.64% accuracy, outperforming standard CNNs.
• DBN achieves 97.20% accuracy, outperforming SVM at 95.50%.
• Among evaluated methods, CNN with Gabor + Dropout outperforms state-of-the-art approaches on the same dataset.
• CNN-based approaches outperform previous non-DL methods on CMATERdb 3.1.1 for HBDR.