Hybrid CNN and RNN Model for Histopathological Sub-Image Classification in Breast Cancer Analysis Using Self-Learning
DOI:
https://doi.org/10.31272/jeasd.2746Keywords:
Breast Cancer, Convolutional Neural Network, Deep Learning, Histopathology, Long short-term memoryAbstract
Breast cancer, a pervasive and life-threatening disease, necessitates the development of advanced classification techniques. This paper introduces a model that combines Convolutional Neural Networks with Recurrent Neural Networks to classify sub-images in breast cancer. By leveraging localized features from a pre-trained CNN and insights from the RNN, this innovative approach aims to enhance accuracy. A sub-image-based strategy is employed to capture localized characteristics more effectively. A hierarchical self-learning approach is implemented to gradually correct mislabeled images, utilizing an invariant rule informed by prior knowledge of potential labeling errors. The model incorporates VGG19, Google Net, and ResNet101 for classifying breast cancer sub-images at various magnifications (40X, 100X, 200X, and 400X) from the BreaKHis dataset. Among these, ResNet101 demonstrates a notable classification accuracy of 98.58% with CNN techniques. However, the hybrid model achieves an impressive accuracy of 99.76%. This approach is promising for advancing medical image classification, offering potential diagnosis and patient care improvements.
References
E. I. Obeagu and G. U. Obeagu, “Breast cancer: a Review of Risk Factors and Diagnosis,” Medicine, vol. 103, no. 3, pp. e36905–e36905, Jan. 2024, doi: https://doi.org/10.1097/md.0000000000036905.
E. G. Fischer, “Nuclear Morphology and the Biology of Cancer Cells,” Acta Cytologica, vol. 64, no. 6, pp. 511–519, 2020, doi: https://doi.org/10.1159/000508780.
F. Bray, J. Ferlay, I. Soerjomataram, R. L. Siegel, L. A. Torre, and A. Jemal, “Global Cancer Statistics 2018: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries,” CA: a Cancer Journal for Clinicians, vol. 68, no. 6, pp. 394–424, Sep. 2018, doi: https://doi.org/10.3322/caac.21492.
F. A. Spanhol, L. S. Oliveira, P. R. Cavalin, C. Petitjean, and L. Heutte, “Deep Features for Breast Cancer Histopathological Image Classification,” 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1868–1873, Oct. 2017, doi: https://doi.org/10.1109/smc.2017.8122889.
K. Rautela, D. Kumar, and V. Kumar, “A Comprehensive Review on Computational Techniques for Breast Cancer: past, present, and Future,” Multimedia Tools and Applications, pp. 1–34, Feb. 2024, doi: https://doi.org/10.1007/s11042-024-18523-2.
S. Katuwal, P. Jousilahti, and E. Pukkala, “Causes of Death among Women with Breast cancer: a Follow‐up Study of 50 481 Women with Breast Cancer in Finland,” International Journal of Cancer, vol. 149, no. 4, pp. 839–845, May 2021, doi: https://doi.org/10.1002/ijc.33607.
W. Ikezogwo et al., “Quilt-1M: One Million Image-Text Pairs for Histopathology,” Advances in Neural Information Processing Systems, vol. 36, pp. 37995–38017, Dec. 2023, doi: https://doi.org/10.48550/arXiv.2306.11207.
E. Balaur et al., “Colorimetric Histology Using Plasmonically Active Microscope Slides,” Nature, vol. 598, no. 7879, pp. 65–71, Oct. 2021, doi: https://doi.org/10.1038/s41586-021-03835-2.
M. G. Hanna et al., “Integrating Digital Pathology into Clinical Practice,” Modern Pathology, vol. 35, no. 2, pp. 152–164, Feb. 2022, doi: https://doi.org/10.1038/s41379-021-00929-0.
Z. Hameed, S. Zahia, B. Garcia-Zapirain, J. Javier Aguirre, and A. María Vanegas, “Breast Cancer Histopathology Image Classification Using an Ensemble of Deep Learning Models,” Sensors, vol. 20, no. 16, p. 4373, Aug. 2020, doi: https://doi.org/10.3390/s20164373.
K. Gupta and N. Chawla, “Analysis of Histopathological Images for Prediction of Breast Cancer Using Traditional Classifiers with Pre-Trained CNN,” Procedia Computer Science, vol. 167, pp. 878–889, 2020, doi: https://doi.org/10.1016/j.procs.2020.03.427.
Y. Jiang, L. Chen, H. Zhang, and X. Xiao, “Breast Cancer Histopathological Image Classification Using Convolutional Neural Networks with Small SE-ResNet Module,” PLOS ONE, vol. 14, no. 3, p. e0214587, Mar. 2019, doi: https://doi.org/10.1371/journal.pone.0214587.
Q. A. Al-Haija and A. Adebanjo, “Breast Cancer Diagnosis in Histopathological Images Using ResNet-50 Convolutional Neural Network,” 2020 IEEE International IOT, Electronics and Mechatronics Conference (IEMTRONICS), Sep. 2020, doi: https://doi.org/10.1109/iemtronics51293.2020.9216455.
M. Z. Alom, C. Yakopcic, Mst. S. Nasrin, T. M. Taha, and V. K. Asari, “Breast Cancer Classification from Histopathological Images with Inception Recurrent Residual Convolutional Neural Network,” Journal of Digital Imaging, vol. 32, no. 4, pp. 605–617, Feb. 2019, doi: https://doi.org/10.1007/s10278-019-00182-7.
M. M. Srikantamurthy, V. P. S. Rallabandi, D. B. Dudekula, S. Natarajan, and J. Park, “Classification of Benign and Malignant Subtypes of Breast Cancer Histopathology Imaging Using Hybrid CNN-LSTM Based Transfer Learning,” BMC Medical Imaging, vol. 23, no. 1, Jan. 2023, doi: https://doi.org/10.1186/s12880-023-00964-0.
C. Guo, B. Fan, Q. Zhang, S. Xiang, and C. Pan, “AugFPN: Improving Multi-scale Feature Learning for Object Detection,” ArXiv (Cornell University), pp. 12595–12604, Dec. 2019, doi: https://doi.org/10.48550/arxiv.1912.05384.
S. K. Pal, A. Pramanik, J. Maiti, and P. Mitra, “Deep Learning in multi-object Detection and tracking: State of the Art,” Applied Intelligence, vol. 51, no. 9, pp. 6400–6429, Apr. 2021, doi: https://doi.org/10.1007/s10489-021-02293-7.
N. Prakash, A. Manconi, and S. Loew, “Mapping Landslides on EO Data: Performance of Deep Learning Models vs. Traditional Machine Learning Models,” Remote Sensing, vol. 12, no. 3, p. 346, Jan. 2020, doi: https://doi.org/10.3390/rs12030346.
X. Wang, Y. Zhao, and F. Pourpanah, “Recent Advances in Deep Learning,” International Journal of Machine Learning and Cybernetics, vol. 11, no. 4, pp. 747–750, Feb. 2020, doi: https://doi.org/10.1007/s13042-020-01096-5.
S. Azizi, S. Kornblith, C. Saharia, M. Norouzi, and D. J. Fleet, “Synthetic Data from Diffusion Models Improves ImageNet Classification,” arXiv.org, vol. 2304, no. 8466, Apr. 2023, doi: https://doi.org/10.48550/arXiv.2304.08466.
M. Doostmohammadian, M. I. Qureshi, M. H. Khalesi, Rabiee, Hamid R, and U. A. Khan, “Log-Scale Quantization in Distributed First-Order Methods: Gradient-based Learning from Distributed Data,” arXiv.org, vol. 2406, no. 621, 2024, doi: https://doi.org/10.48550/arXiv.2406.00621
G. Liang, H. Hong, W. Xie, and L. Zheng, “Combining Convolutional Neural Network with Recursive Neural Network for Blood Cell Image Classification,” IEEE Access, vol. 6, pp. 36188–36197, 2018, doi: https://doi.org/10.1109/access.2018.2846685.
S. Li, Z. Song, Y. Xia, T. Yu, and T. Zhou, “The Closeness of In-Context Learning and Weight Shifting for Softmax Regression,” arXiv.org, vol. 2304, no. 13276, 2023, doi: https://doi.org/10.48550/arXiv.2304.13276.
F. A. Spanhol, L. S. Oliveira, C. Petitjean, and L. Heutte, “A Dataset for Breast Cancer Histopathological Image Classification,” IEEE Transactions on Biomedical Engineering, vol. 63, no. 7, pp. 1455–1462, Jul. 2016, doi: https://doi.org/10.1109/tbme.2015.2496264.
A. H. Abdulaal, M. Valizadeh, B. M. AlBaker, R. A. Yassin, M. C. Amirani, and A. F. M. S. Shah, “Enhancing Breast Cancer Classification Using a Modified GoogLeNet Architecture with Attention Mechanism,” Al-Iraqia Journal of Scientific Engineering Research, vol. 3, no. 1, Mar. 2024, doi: https://doi.org/10.58564/ijser.3.1.2024.145.
S. Sharma, R. Mehra, and S. Kumar, “Optimised CNN in Conjunction with Efficient Pooling Strategy for the Multi‐classification of Breast Cancer,” IET Image Processing, vol. 15, no. 4, pp. 936–946, Dec. 2020, doi: https://doi.org/10.1049/ipr2.12074.
A. H. Abdulaal, M. Valizadeh, M. C. Amirani, and A. F. M. Shahen Shah, “A self-learning Deep Neural Network for Classification of Breast Histopathological Images,” Biomedical Signal Processing and Control, vol. 87, no. Part B, p. 105418, Jan. 2024, doi: https://doi.org/10.1016/j.bspc.2023.105418.
S. Liu and W. Deng, “Very Deep Convolutional Neural Network Based Image Classification Using Small Training Sample Size,” 015 3rd IAPR Asian Conference on Pattern Recognition (ACPR). IEEE, pp. 730–734, Nov. 2015, doi: https://doi.org/10.1109/ACPR.2015.7486599.
S. Sukegawa et al., “Deep Neural Networks for Dental Implant System Classification,” Biomolecules, vol. 10, no. 7, p. 984, Jul. 2020, doi: https://doi.org/10.3390/biom10070984.
X. Wan, X. Zhang, and L. Liu, “An Improved VGG19 Transfer Learning Strip Steel Surface Defect Recognition Deep Neural Network Based on Few Samples and Imbalanced Datasets,” Applied Sciences, vol. 11, no. 6, p. 2606, Mar. 2021, doi: https://doi.org/10.3390/app11062606.
H. Arshad et al., “A Multilevel Paradigm for Deep Convolutional Neural Network Features Selection with an Application to Human Gait Recognition,” Expert Systems, vol. 39, no. 7, p. e12541, Mar. 2020, doi: https://doi.org/10.1111/exsy.12541.
J. Bai, H. Jiang, S. Li, and X. Ma, “NHL Pathological Image Classification Based on Hierarchical Local Information and GoogLeNet-Based Representations,” BioMed Research International, vol. 2019, no. 1, pp. 1–13, Mar. 2019, doi: https://doi.org/10.1155/2019/1065652.
J. Zhang, X. Wei, C. Che, Q. Zhang, and X. Wei, “Breast Cancer Histopathological Image Classification Based on Convolutional Neural Networks,” Journal of Medical Imaging and Health Informatics, vol. 9, no. 4, pp. 735–743, May 2019, doi: https://doi.org/10.1166/jmihi.2019.2648.
M. Gour, S. Jain, and T. Sunil Kumar, “Residual Learning Based CNN for Breast Cancer Histopathological Image Classification,” International Journal of Imaging Systems and Technology, vol. 30, no. 3, pp. 621–635, Feb. 2020, doi: https://doi.org/10.1002/ima.22403.
R. Anand, T. Shanthi, M. S. Nithish, and S. Lakshman, “Face Recognition and Classification Using GoogleNET Architecture,” Advances in Intelligent Systems and Computing, vol. 1, pp. 261–269, Nov. 2019, doi: https://doi.org/10.1007/978-981-15-0035-0_20.
R. Pandian, V. Vedanarayanan, D. N. S. Ravi Kumar, and R. Rajakumar, “Detection and Classification of Lung Cancer Using CNN and Google Net,” Measurement: Sensors, vol. 24, p. 100588, Dec. 2022, doi: https://doi.org/10.1016/j.measen.2022.100588.
M. Shafiq and Z. Gu, “Deep Residual Learning for Image Recognition: a Survey,” Applied Sciences, vol. 12, no. 18, p. 8972, Sep. 2022, doi: https://doi.org/10.3390/app12188972.
C. Sun, A. Shrivastava, S. Singh, and A. Gupta, “Revisiting Unreasonable Effectiveness of Data in Deep Learning Era,” Proceedings of the IEEE International Conference on Computer Vision, pp. 843–852, Jul. 2017, doi: https://doi.org/10.48550/arxiv.1707.02968.
Y. Gu and J. Yang, “Densely-Connected Multi-Magnification Hashing for Histopathological Image Retrieval,” IEEE Journal of Biomedical and Health Informatics, vol. 23, no. 4, pp. 1683–1691, Jul. 2019, doi: https://doi.org/10.1109/jbhi.2018.2882647.
D. Sabari Nathan, R. Saravanan, J. Anbazhagan, and P. Koduganty, “Comparison of Deep Feature Classification and Fine Tuning for Breast Cancer Histopathology Image Classification,” Communications in Computer and Information Science, no. Part II, pp. 58–68, 2019, doi: https://doi.org/10.1007/978-981-13-9184-2_5.
S. Sharma and R. Mehra, “Effect of layer-wise fine-tuning in magnification-dependent Classification of Breast Cancer Histopathological Image,” The Visual Computer, vol. 36, no. 9, pp. 1755–1769, Oct. 2019, doi: https://doi.org/10.1007/s00371-019-01768-6.
P. Xue et al., "Deep Learning in Image-based Breast and Cervical Cancer Detection: a Systematic Review and Meta-analysis," Npj Digital Medicine, vol. 5, no. 1, p. 19, Feb. 2022, doi: https://doi.org/10.1038/s41746-022-00559-z.
K. Muhannad and B. M. AlBaker, “Efficient Classification Model of Pneumonia Infection Based on Deep Transfer Learning and Chest X-Ray Images,” Al-Iraqia Journal of Scientific Engineering Research, vol. 1, no. 1, Sep. 2022, doi: https://doi.org/10.33193/ijser.1.1.2022.37.
A. Barakat and P. Bianchi, “Convergence and Dynamical Behavior of the ADAM Algorithm for Nonconvex Stochastic Optimization,” SIAM Journal on Optimization, vol. 31, no. 1, pp. 244–274, Jan. 2021, doi: https://doi.org/10.1137/19m1263443.
A. H. Abdulwahhab, A. H. Abdulaal, Assad, A. A. Mohammed, and M. Valizadeh, “Detection of Epileptic Seizure Using EEG Signals Analysis Based on Deep Learning Techniques,” Chaos, Solitons & fractals/Chaos, Solitons and Fractals, vol. 181, pp. 114700–114700, Apr. 2024, doi: https://doi.org/10.1016/j.chaos.2024.114700
A. H. Abdulaal et al., “Unsupervised Histopathological Sub-Image Analysis for Breast Cancer Diagnosis Using Variational Autoencoders, Clustering, and Supervised Learning,” Journal of Engineering and Sustainable Development, vol. 28, no. 6, pp. 729–744, Nov. 2024, doi: https://doi.org/10.31272/jeasd.28.6.6.
A. H. Abdulaal et al., “Cutting-Edge CNN Approaches for Breast Histopathological Classification: the Impact of Spatial Attention Mechanisms,” ShodhAI: Journal of Artificial Intelligence, vol. 1, no. 1, pp. 109–130, Oct. 2024, doi: https://doi.org/10.29121/shodhai.v1.i1.2024.14.
A. H. Abdulaal et al., “Deep Learning-based Signal Identification in Wireless Communication Systems: a Comparative Analysis on 3G, LTE, and 5G Standards,” Al-Iraqia Journal for Scientific Engineering Research, vol. 3, no. 3, pp. 66–70, Sep. 2024, doi: https://doi.org/10.58564/IJSER.3.3.2024.224.
Downloads
Key Dates
Received
Revised
Accepted
Published Online First
Issue
Section
License
