Open Access Open Access  Restricted Access Subscription or Fee Access

A Deep System for Breast Tumor Classification from Mammograms

(*) Corresponding author

Authors' affiliations



Medical imaging has continued to evolve and uses increasingly precise and efficient technologies for processing medical images and extracting relevant information. However, in contrast to this development, the analysis of breast cancer remains topical research that is very delicate to address despite the various screening techniques available to predict this disease. In this paper, a novel system based on deep learning is proposed to detect and classify breast tumors in mammograms into benign and malignant. Two approaches have been adopted in this study according to two publicly available mammographic datasets for research of different sizes. In the first approach, we have built a model on the Mammographic Image Analysis Society (MIAS) dataset which is a small set. To make this dataset sufficient to build a predictive model over, the first approach is passed through three steps, which are as follows: First, the Regions Of Interest (ROI) are extracted from each abnormal region of mammographic images of MIAS set, then, Roi-patches are generated from each ROI obtained in the first step, finally, ROI-patches are classified as benign or malignant using a pre-trained Convolutional Neural Network (CNN) architectures. While the second approach uses the cropped images extracted from the Curated Breast Imaging Subset of Digital Database for Screening Mammography (CBIS-DDSM) which are considered sufficient to build a model over it. Data preprocessing as well as Data augmentation has been applied on both MIAS and CBIS-DDSM datasets. Experiments are evaluated through transfer learning techniques based on Convolutional Neural Networks (CNNs) architectures: Dense-Net121, ResNet50, VGG16, and mobileNetV2 to check their accuracy scores. Experimental results are satisfactory showing the proposed approaches’ ability to distinguish between breast tumor benign and malignant from Mammograms with an overall sensitivity of 91% and accuracy of 90%.
Copyright © 2022 Praise Worthy Prize - All rights reserved.


Classification; Breast Cancer; ROIs Patches; Deep Learning; Transfer Learning; Mammogram

Full Text:



Ferlay J, Ervik M, Lam F, Colombet M, Mery L, Piñeros M, et al. Global Cancer Observatory: Cancer Today. Lyon: International Agency for Research on Cancer; 2020, accessed February 2021. Available:

de Martel C, Georges D, Bray F, Ferlay J, Clifford GM. Global burden of cancer attributable to infections in 2018: a worldwide incidence analysis. Lancet Glob Health. 2020;8(2):e180-e190.

American Cancer Society. Cancer Facts & Figures 2022. Atlanta: American Cancer Society; 2022.

Koma'rudin, N., Zakaria, Z., Soh, P., Lago, H., Alsariera, H., Hassan, N., A Review of Recent Microwave Breast Imaging, (2020) International Journal on Communications Antenna and Propagation (IRECAP), 10 (4), pp. 257-267.

Siu AL; U.S. Preventive Services Task Force. Screening for breast cancer: U.S. Preventive Services Task Force recommendation statement. Annals of Internal Medicine 2016; 164(4):279-296.

Nelson HD, Fu R, Cantor A, et al. Effectiveness of breast cancer screening: Systematic review and meta-analysis to update the 2009 U.S. Preventive Services Task Force recommendation. Annals of Internal Medicine 2016; 164(4):244-255.

Løberg, M., Lousdal, M.L., Bretthauer, M. et al. Benefits and harms of mammography screening. Breast Cancer Res 17, 63 (2015).

N.I.R. Yassin, S. Omran, E.M.F. El Houby, H. Allam, Machine learning techniques for breast cancer computer aided diagnosis using different image modalities: a systematic review, Comput. Methods Programs Biomed. 156 (2018) 25-45.

P. Kharazmi, J. Zheng, H. Lui, Z.J. Wang, T.K. Lee, A computer-aided decision support system for detection and localization of cutaneous vasculature in dermoscopy images via deep feature learning, J. Med. Syst. 42 (2) (2018) 33.

Asharul Islam Khan, Salim Al-Habsi, Machine Learning in Computer Vision, Procedia Computer Science, Volume 167, 2020, Pages 1444-1451, ISSN 1877-0509.

Zhang Fan, Wei Li, Yifan Zhang, Zhiyong Feng. Data Driven Feature Selection for Machine Learning Algorithms in Computer Vision IEEE Internet of Things Journal, 5 (6) (2018), pp. 4262-4272.

M. N. Wernick, Y. Yang, J. G. Brankov, G. Yourganov and S. C. Strother, Machine Learning in Medical Imaging, in IEEE Signal Processing Magazine, vol. 27, no. 4, pp. 25-38, July 2010.

N.I.R. Yassin, S. Omran, E.M.F. El Houby, H. Allam, Machine learning techniques for breast cancer computer aided diagnosis using different image modalities: a systematic review, Comput. Methods Programs Biomed. 156 (2018) 25-45.

Bataineh, A., Batayneh, W., Harahsheh, T., Hijazi, K., Alrayes, A., Olimat, M., Bataineh, A., Early Detection of Cardiac Diseases from Electrocardiogram Using Artificial Intelligence Techniques, (2021) International Review on Modelling and Simulations (IREMOS), 14 (2), pp. 128-136.

A. Shrestha, A. Mahmood, Review of deep learning algorithms and architectures, IEEE Access 7 (2019) 53040-53065.

Chen H, Dou Q, Ni D, Cheng JZ, Qin J, Li S, Heng PA (2015) Automatic fetal ultrasound standard plane detection using knowledge transferred recurrent neural networks. In: International conference on medical image computing and computer-assisted intervention, Springer, pp 507-514.

Zhang W, Li R, Deng H, Wang L, Lin W, Ji S, Shen D (2015) Deep convolutional neural networks for multi-modality isointense infant brain image segmentation. NeuroImage 108:214-224.

Guo W, Wu R, Chen Y, Zhu X (2018) Deep learning scene recognition method based on localization enhancement. Sensors 18(10):3376.

S.-H. Wang, P. Phillips, Y. Sui, B. Liu, M. Yang, H. Cheng, Classification of Alzheimer's disease based on eight-layer convolutional neural network with leaky rectified linear unit and max pooling, J. Med. Syst. 42 (5) (2018) 85.

S. Kwok, Multiclass classification of breast cancer in whole-slide images, International conference image analysis and recognition, 10882, Springer, Cham, 2018, pp. 931-940.

L. Tsochatzidis, L. Costaridou, I. Pratikakis, Deep learning for breast cancer diagnosis from mammograms - a comparative study, J. Imaging 5 (37) (2019) 1-11.

J. Anitha, S.I.A. Pandian, J.D. Peter, Classification of mammogram images using multiscale all convolutional neural network (MA-CNN), J. Med. Syst. 44 (1) (2020) 1-9..

Berraho, S., Ait Kerroum, M., Fakhri, Y., A Hybrid Feature Extraction Scheme Based on DWT and Uniform LBP for Digital Mammograms Classification, (2015) International Review on Computers and Software (IRECOS), 10 (1), pp. 102-110.

Rampun, A., Scotney, B.W., Morrow, P.J., et al.: Breast mass classification in mammograms using ensemble convolutional neural networks. 2018 IEEE 20th Int. Conf. on e-Health Networking, Applications and Services (Healthcom), Ostrava, Czach Republic, 2018, pp. 1-6.

N. Dhungel, G. Carneiro, A.P. Bradley. A deep learning approach for the analysis of masses in mammograms with minimal user intervention. Medical Image Analysis, vol.37, pp. 114-128, 2017.

Linlin Zhang, Yanfeng Li, Houjin Chen, Wen Wu, Kuan Chen, Shaokang Wang, Anchor-free YOLOv3 for mass detection in mammogram, Expert Systems with Applications, Volume 191, 2022, 116273,ISSN 0957-4174.

Zahra Assari, Ali Mahloojifar, Nasrin Ahmadinejad, Discrimination of benign and malignant solid breast masses using deep residual learning-based bimodal computer-aided diagnosis system, Biomedical Signal Processing and Control, Volume 73, 2022, 103453, ISSN 1746-8094.

Arora, R., Rai, P.K. & Raman, B. Deep feature-based automatic classification of mammograms. Med Biol Eng Comput 58, 1199-1211 (2020).

Al-Antari MA, Al-Masni MA, Kim TS. Deep Learning Computer-Aided Diagnosis for Breast Lesion in Digital Mammogram. Adv Exp Med Biol. 2020;1213:59-72 PMID: 32030663.

Enas M.F. El Houby, Nisreen I.R. Yassin, Malignant and nonmalignant classification of breast lesions in mammograms using convolutional neural networks, Biomedical Signal Processing and Control, Volume 70, 2021, 102954, ISSN 1746-8094.

L. Shen, L.R. Margolies, J.H. Rothstein, E. Fluder, R. McBride, W. Sieh, Deep learning to improve breast cancer detection on screening mammography, Sci. Rep. 9 (1) (2019) 1-12.

Park J, Choe SW. Patchless Multi-Stage Transfer Learning for Improved Mammographic Breast Mass Classification. Cancers (Basel). 2022 Mar 1;14(5):1280. PMID: 35267587; PMCID: PMC8909211.

Suhail, Z., Hamidinekoo, A., Zwiggelaar, R.: Mammographic mass classification using filter response patches, IET Comput. Vis., 2018, 12, (8), pp. 1060-1066.

J. Suckling et al. (1994): The Mammographic Image Analysis Society Digital Mammogram Database Exerpta Medica. International Congress Series 1069 pp375-378.

Lee RS, Gimenez F, Hoogi A, et al. A curated mammography data set for use in computer-aided detection and diagnosis research. Scientific Data. 2017 Dec;4:170177. PMID: 29257132; PMCID: PMC5735920.

M Heath, K. Bowyer, D. Kopans, R. Moore, and W. P. Kegelmeyer, The digital database for screening mammography, in: Proceedings of the 5th international workshop on digital mammography, 2000, pp. 212-218: Medical Physics Publishing.

Perona P, Malik J. Scale-space and edge detection using anisotropic diffusion. IEEE Trans PAMI 1990;12:629-39.

Weickert J. Anisotropic Diffusion in Image Processing, Ph.D. thesis, Dept.of Mathematics, University of Kaiserslautern, Germany, 1996.

Furman-Haran E, Grobgeld D, Nissan N, Shapiro-Feinberg M, Degani H. Can diffusion tensor anisotropy indices assist in breast cancer detection? J Magn Reson Imaging. 2016 Dec;44(6):1624-1632. Epub 2016 Apr 19. PMID: 27092546.

Rejintal, A. and Aswini, N., 2016, May. Image processing-based leukemia cancer cell detection. In 2016 IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT) (pp. 471-474). IEEE.

Irshad, H., Veillard, A., Roux, L. and Racoceanu, D.,2014. Methods for nuclei detection, segmentation, and classification in digital histopathology: a review current status and future potential. IEEE reviews in biomedical engineering, 7, pp.97-114.

Nikesh Krishnan, Saji Joseph Shone, Chittoori Sai Sashank, Tumu Sai Ajay, P.V. Sudeep, A hybrid low-light image enhancement method using Retinex decomposition and deep light curve estimation, Optik, Volume 260,2022,169023,ISSN 0030-4026.

Rahman Z., Woodell G.A., and Jobson D.J. 2001. Retinex Image Enhancement: Applications to Medical Images. NASA Langley Research Center.

Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2015. p. 1-9.

Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. 2014. arXiv preprint. arXiv:14091556.

He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. p. 770-8.

Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems; 2012. p. 1097-105.

L. Shen, M. He, N. Shen, N. Yousefi, C. Wang, G. Liu, Optimal breast tumor diagnosis using discrete wavelet transform and deep belief network based on improved sunflower optimization method, Biomed. Signal Process. Control 60 (2020), 101953.

Y. Tan, K. Sim, F. Ting, Breast cancer detection using convolutional neural networks for mammogram imaging system, in: 2017 International Conference on Robotics, Automation and Sciences (ICORAS), IEEE, 2017, pp. 1-5.


  • There are currently no refbacks.

Please send any question about this web site to
Copyright © 2005-2023 Praise Worthy Prize