Towards a transparent and interpretable AI model for medical image classifications

Adilakshmi J, Reddy GV, Nidumolu KD, Pecho RDC, Pasha MJ (2023) A medical diagnosis system based on explainable artificial intelligence: Autism spectrum disorder diagnosis. Int J Intell Syst Appl Eng 11(6s):385–402

Google Scholar 

Aghaei A, Moghaddam ME (2023) Smart ROI detection for Alzheimer’s disease prediction using explainable AI. arXiv preprint. arXiv:2303.10401

Ahmed F, Asif M, Saleem M, Mushtaq UF, Imran M (2023) Identification and prediction of brain tumor using VGG-16 empowered with explainable artificial intelligence. Int J Comput Innov Sci 2(2):24–33

Google Scholar 

Albahri AS, Duhaim AM, Fadhel MA, Alnoor A, Baqer NS, Alzubaidi L, Albahri OS, Alamoodi AH, Bai J, Salhi A et al (2023a) A systematic review of trustworthy and explainable artificial intelligence in healthcare: assessment of quality, bias risk, and data fusion. Inf Fus 96:156–191

Article  Google Scholar 

Albahri AS, Joudar SS, Hamid RA, Zahid IA, Alqaysi ME, Albahri OS, Alamoodi AH, Kou G, Sharaf IM (2023b) Explainable artificial intelligence multimodal of autism triage levels using fuzzy approach-based multi-criteria decision-making and lime. Int J Fuzzy Syst 26(6):1–30

Google Scholar 

Alizadehsani R, Oyelere SS, Hussain S, Jagatheesaperumal SK, Calixto RR, Rahouti M (2024) Explainable artificial intelligence for drug discovery and development—a comprehensive survey. IEEE Access 12:35796–35812

Article  Google Scholar 

Antwarg L, Miller RM, Shapira B, Rokach L (2021) Explaining anomalies detected by autoencoders using Shapley additive explanations. Expert Syst Appl 186:115736

Article  Google Scholar 

Arreche O, Guntur TR, Roberts JW, Abdallah M (2024) E-XAI: evaluating black-box explainable AI frameworks for network intrusion detection. IEEE Access 12:23954–23988

Article  Google Scholar 

Arrieta AB, Díaz-Rodríguez N, Ser J, Bennetot A, Tabik S, Barbado A, García S, Gil-López S, Molina D, Benjamins R et al (2020) Explainable artificial intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI. Inf Fus 58:82–115

Article  Google Scholar 

Arrieta AB, Díaz-Rodríguez N, Ser J, Bennetot A, Tabik S, Barbado A, García S, Gil-López S, Molina D, Benjamins R et al (2020) Explainable artificial intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI. Inf Fusion 58:82–115

Article  Google Scholar 

Auzine MM, Khan MH-M, Baichoo S, Sahib NG, Gao X, Bissoonauth-Daiboo P (2023) Classification of gastrointestinal cancer through explainable ai and ensemble learning. In 2023 Sixth International conference of women in data science at Prince Sultan University (WiDS PSU), pp 195–200. IEEE

Bach S, Binder A, Montavon G, Klauschen F, Müller K-R, Samek W (2015) On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS ONE 10(7):e0130140

Article  PubMed  PubMed Central  Google Scholar 

Basahel AM, Yamin M (2023) Quantum inspired differential evolution with explainable artificial intelligence-based covid-19 detection. Comput Syst Sci Eng 46(1):209–224

Brahimi M, Arsenovic M, Laraba S, Sladojevic S, Boukhalfa K, Moussaoui A (2018) Deep learning for plant diseases: detection and saliency map visualisation. In: Human and machine learning: visible, explainable, trustworthy and transparent. Springer, pp 93–117

Cai CJ, Winter S, Steiner D, Wilcox L, Terry M (2019) “hello ai”: uncovering the onboarding needs of medical practitioners for human-ai collaborative decision-making. In: Proceedings of the ACM on human–computer interaction, vol 3(CSCW), pp 1–24

Chadaga K, Prabhu S, Bhat V, Sampathila N, Umakanth S, Chadaga R (2023) A decision support system for diagnosis of covid-19 from non-covid-19 influenza-like illness using explainable artificial intelligence. Bioengineering 10(4):439

Article  CAS  PubMed  PubMed Central  Google Scholar 

Chaddad A, Wu Y (2023) Enhancing classification tasks through domain adaptation strategies. In 2023 IEEE international conference on bioinformatics and biomedicine (BIBM). IEEE, pp 1832–1835

Chaddad A, Peng J, Jian X, Bouridane A (2023a) Survey of explainable ai techniques in healthcare. Sensors 23(2):634

Article  PubMed  PubMed Central  Google Scholar 

Chaddad A, Qizong L, Li J, Katib Y, Kateb R, Tanougast C, Bouridane A, Abdulkadir A (2023b) Explainable, domain-adaptive, and federated artificial intelligence in medicine. IEEE/CAA J Autom Sin 10(4):859–876

Article  Google Scholar 

Chaddad A, Hassan L, Katib Y (2023c) A texture-based method for predicting molecular markers and survival outcome in lower grade glioma. Applied Intelligence, pp 1–15

Chaddad A, Hu Y, Wu Y, Wen B, Kateb R (2024) Generalizable and explainable deep learning for medical image computing: an overview. Curr Opin Biomed Eng. https://doi.org/10.48550/arXiv.2503.08420

Chaddad A, Jiang Y, Daqqaq TS, Kateb R (2025) EAMAPG: explainable adversarial model analysis via projected gradient descent. Comput Biol Med 188:109788

Article  PubMed  Google Scholar 

Chen T-CT, Wu H-C, Chiu M-C (2024) A deep neural network with modified random forest incremental interpretation approach for diagnosing diabetes in smart healthcare. Appl Soft Comput 152:111183

Article  Google Scholar 

Croatti A, Montagna S, Ricci A, Gamberini E, Albarello V, Agnoletti V (2019) Bdi personal medical assistant agents: the case of trauma tracking and alerting. Artif Intell Med 96:187–197

Article  PubMed  Google Scholar 

Das S, Sultana M, Bhattacharya S, Sengupta D, De D (2023) XAI-reduct: accuracy preservation despite dimensionality reduction for heart disease classification using explainable AI. J Supercomput. https://doi.org/10.1007/s11227-023-05356-3

Daudt F, Cinalli D, Garcia ACB (2021) Research on explainable artificial intelligence techniques: an user perspective. In: 2021 IEEE 24th international conference on computer supported cooperative work in design (CSCWD). IEEE, pp 144–149

Dey S, Chakraborty P, Kwon BC, Dhurandhar A, Ghalwash M, Saiz FJS, Ng K, Sow D, Varshney KR, Meyer P (2022) Human-centered explainability for life sciences, healthcare, and medical informatics. Patterns 3(5):100493

Article  PubMed  PubMed Central  Google Scholar 

Dhar T, Dey N, Borra S, Sherratt RS (2023) Challenges of deep learning in medical image analysis–improving explainability and trust. IEEE Trans Technol Soc 4(1):68–75

Article  Google Scholar 

Dharmarathne G, Jayasinghe TN, Bogahawaththa M, Meddage DPP, Rathnayake U (2024) A novel machine learning approach for diagnosing diabetes with a self-explainable interface. Healthcare Anal 5:100301

Article  Google Scholar 

Ding W, Abdel-Basset M, Hawash H, Ali AM (2022) Explainability of artificial intelligence methods, applications and challenges: a comprehensive survey. Inf Sci 615:238–292

Article  Google Scholar 

Doddi GV (2022) eye diseases classification. https://www.kaggle.com/datasets/gunavenkatdoddi/eye-diseases-classification

Dong Z, Wang J, Li Y, Deng Y, Zhou W, Zeng X, Gong D, Liu J, Pan J, Shang R et al (2023) Explainable artificial intelligence incorporated with domain knowledge diagnosing early gastric neoplasms under white light endoscopy. NPJ Digital Med 6(1):64

Article  Google Scholar 

Duell, J Fan X, Burnett B, Aarts G, Zhou S-M (2021) A comparison of explanations given by explainable artificial intelligence methods on analysing electronic health records. In: 2021 IEEE EMBS international conference on biomedical and health informatics (BHI). IEEE, pp 1–4

Dwivedi R, Dave D, Naik H, Singhal S, Omer R, Patel P, Qian B, Wen Z, Shah T, Morgan G et al (2023) Explainable ai (xai): core ideas, techniques, and solutions. ACM Comput Surv 55(9):1–33

Article  Google Scholar 

Dwivedi R, Kothari P, Chopra D, Singh M, Kumar R (2024) An efficient ensemble explainable AI (XAI) approach for morphed face detection. Pattern Recogn Lett 184:197–204

Article  Google Scholar 

Eiband M, Schneider H, Bilandzic M, Fazekas-Con J, Haug M, Hussmann H (2018) Bringing transparency design into practice. In: 23rd international conference on intelligent user interfaces, pp 211–223

Elmannai H, El-Rashidy N, Mashal I, Alohali MA, Farag S, El-Sappagh S, Saleh H (2023) Polycystic ovary syndrome detection machine learning model based on optimized feature selection and explainable artificial intelligence. Diagnostics 13(8):1506

Article  PubMed  PubMed Central  Google Scholar 

El-SA El-Dahshan, Bassiouni MM, Khare SK, Tan R-S, Acharya UR (2024) ExHyptNet: An explainable diagnosis of hypertension using EfficientNet with PPG signals. Expert Syst Appl 239:122388

Article  Google Scholar 

El-Rashidy N, ElSayed NE, El-Ghamry A, Talaat FM (2023) Utilizing fog computing and explainable deep learning techniques for gestational diabetes prediction. Neural Comput Appl 35(10):7423–7442

Article  Google Scholar 

England JR, Cheng PM (2019) Artificial intelligence for medical image analysis: a guide for authors and reviewers. Am J Roentgenol 212(3):513–519

Article  Google Scholar 

Fan F-L, Xiong J, Li M, Wang G (2021) On interpretability of artificial neural networks: a survey. IEEE Trans Radiat Plasma Med Sci 5(6):741–760

Article  PubMed  PubMed Central  Google Scholar 

Farrag A, Gad G, Md Fadlullah Z, Fouda MM, Alsabaan M (2023) An explainable AI system for medical image segmentation with preserved local resolution: mammogram tumor segmentation. IEEE Access 11:125543–125561

Feng L, Shu S, Lin Z, Lv F, Li L, An B (2021) Can cross entropy loss be robust to label noise? In: Proceedings of the twenty-ninth international conference on international joint conferences on artificial intelligence, pp 2206–2212

Fix E (1985) Discriminatory analysis: nonparametric discrimination, consistency properties, vol 1. USAF School of Aviation Medicine

Fontes M, Almeida JDSD, Cunha A (2024) Application of example-based explainable artificial intelligence (XAI) for analysis and interpretation of medical imaging: a systematic review. IEEE Access 12:26419–26427

Article  Google Scholar 

Ghnemat R, Alodibat S, Al-Haija QA (2023) Explainable artificial intelligence (XAI) for deep learning based medical imaging classification. J Imaging 9(9):177

Article  PubMed  PubMed Central  Google Scholar 

Goldstein A, Kapelner A, Bleich J, Pitkin E (2015) Peeking inside the black box: visualizing statistical learning with plots of individual conditional expectation. J Comput Graph Stat 24(1):44–65

Article  Google Scholar 

Han K, Wang Y, Chen H, Chen X, Guo J, Liu Z, Tang Y, Xiao A, Chunjing X, Yixing X et al (2022) A survey on vision transformer. IEEE Trans Pattern Anal Mach Intell 45(1):87–110

Article  PubMed  Google Scholar 

Hany M (2020) Chest CT-SCAN images dataset. https://www.kaggle.com/datasets/mohamedhanyyy/chest-ctscan-images

Haque AKMB, Islam AKMN, Mikalef P (2023) Explainable artificial intelligence (XAI) from a user perspective: a synthesis of prior literature and problematizing avenues for future research. Technol Forecast Soc Change 186:122120

Hassan MM, AlQahtani SA, Alelaiwi A, Papa JP (2023) Explaining covid-19 diagnosis with taylor decompositions. Neural Comput Appl 35(30):22087–22100

Article  Google Scholar 

Hassija V, Chamola V, Mahapatra A, Singal A, Goel D, Huang K, Scardapane S, Spinelli I, Mahmud M, Hussain A (2024) Interpreting black-box models: a review on explainable artificial intelligence. Cogn Comput 16(1):45–74

Article  Google Scholar 

He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

Hehr M, Sadafi A, Matek C, Lienemann P, Pohlkamp C, Haferlach T, Spiekermann K, Marr C (2023) Explainable AI identifies diagnostic cells of genetic AML subtypes. PLOS Digital Health 2(3):e0000187

Comments (0)

No login
gif