Artificial intelligence in digital pathology — time for a reality check

Rajpurkar, P., Chen, E., Banerjee, O. & Topol, E. J. AI in health and medicine. Nat. Med. 28, 31–38 (2022).

Article  CAS  PubMed  Google Scholar 

Topol, E. J. High-performance medicine: the convergence of human and artificial intelligence. Nat. Med. 25, 44–56 (2019).

Article  CAS  PubMed  Google Scholar 

Aeffner, F. et al. Introduction to digital image analysis in whole-slide imaging: a white paper from the Digital Pathology Association. J. Pathol. Inform. 10, 9 (2019).

Article  PubMed  PubMed Central  Google Scholar 

van der Laak, J., Litjens, G. & Ciompi, F. Deep learning in histopathology: the path to the clinic. Nat. Med. 27, 775–784 (2021).

Article  PubMed  Google Scholar 

Shafi, S. & Parwani, A. V. Artificial intelligence in diagnostic pathology. Diagn. Pathol. 18, 109 (2023).

Article  PubMed  PubMed Central  Google Scholar 

Baxi, V., Edwards, R., Montalto, M. & Saha, S. Digital pathology and artificial intelligence in translational medicine and clinical practice. Mod. Pathol. 35, 23–32 (2022).

Article  CAS  PubMed  Google Scholar 

Bera, K., Schalper, K. A., Rimm, D. L., Velcheti, V. & Madabhushi, A. Artificial intelligence in digital pathology – new tools for diagnosis and precision oncology. Nat. Rev. Clin. Oncol. 16, 703–715 (2019).

Article  PubMed  PubMed Central  Google Scholar 

O’Shea, K. & Nash, R. An introduction to convolutional neural networks. Preprint at arXiv https://doi.org/10.48550/arXiv.1511.08458 (2015).

Coudray, N. et al. Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning. Nat. Med. 24, 1559–1567 (2018).

Article  CAS  PubMed  PubMed Central  Google Scholar 

Dosovitskiy, A. et al. An image is worth 16x16 words: transformers for image recognition at scale. Preprint at arXiv https://doi.org/10.48550/arXiv.2010.11929 (2020).

Chen, R. J. et al. Towards a general-purpose foundation model for computational pathology. Nat. Med. 30, 850–862 (2024).

Article  CAS  PubMed  PubMed Central  Google Scholar 

Xu, H. et al. A whole-slide foundation model for digital pathology from real-world data. Nature 630, 181–188 (2024).

Article  CAS  PubMed  PubMed Central  Google Scholar 

Vorontsov, E. A foundation model for clinical-grade computational pathology and rare cancers detection. Nat. Med. 30, 2924–2935 (2024).

Article  CAS  PubMed  PubMed Central  Google Scholar 

Dippel, J. et al. RudolfV: a foundation model by pathologists for pathologists. Preprint at arXiv https://doi.org/10.48550/arXiv.2401.04079 (2024).

Wang, X. et al. A pathology foundation model for cancer diagnosis and prognosis prediction. Nature 634, 970–978 (2024).

Article  CAS  PubMed  Google Scholar 

Ma, J. et al. Towards a generalizable pathology foundation model via unified knowledge distillation. Preprint at arXiv https://doi.org/10.48550/arXiv.2407.18449 (2024).

Yang, Z. et al. A foundation model for generalizable cancer diagnosis and survival prediction from histopathological images. Preprint at bioRxiv https://doi.org/10.1101/2024.05.16.594499 (2024).

Hua, S., Yan, F., Shen, T., Ma, L. & Zhang, X. PathoDuet: foundation models for pathological slide analysis of H&E and IHC stains. Med. Image Anal. 97, 103289 (2024).

Article  PubMed  Google Scholar 

Nechaev, D., Pchelnikov, A. & Ivanova, E. Hibou: a family of foundational vision transformers for pathology. Preprint at arXiv https://doi.org/10.48550/arXiv.2406.05074 (2024).

Lu, M. Y. et al. A visual-language foundation model for computational pathology. Nat. Med. 30, 863–874 (2024).

Article  CAS  PubMed  PubMed Central  Google Scholar 

Zimmermann, E. et al. Virchow2: scaling self-supervised mixed magnification models in pathology. Preprint at arXiv https://doi.org/10.48550/arXiv.2408.00738 (2024).

Juyal, D. et al. PLUTO: pathology-universal transformer. Preprint at arXiv https://doi.org/10.48550/arXiv.2405.07905 (2024).

Li, H. et al. A prognostic and predictive computational pathology immune signature for ductal carcinoma in situ: retrospective results from a cohort within the UK/ANZ DCIS trial. Lancet Digital Health 6, e562–e569 (2024).

Article  CAS  PubMed  Google Scholar 

Lu, M. Y. et al. AI-based pathology predicts origins for cancers of unknown primary. Nature 594, 106–110 (2021).

Article  CAS  PubMed  Google Scholar 

Bulten, W. et al. Artificial intelligence for diagnosis and Gleason grading of prostate cancer: the PANDA challenge. Nat. Med. 28, 154–163 (2022).

Article  CAS  PubMed  PubMed Central  Google Scholar 

Bulten, W. et al. Automated deep-learning system for Gleason grading of prostate cancer using biopsies: a diagnostic study. Lancet Oncol. 21, 233–241 (2020).

Article  PubMed  Google Scholar 

Aggarwal, A. et al. Computational pathology identifies immune-mediated collagen disruption to predict clinical outcomes in gynecologic malignancies. Commun. Med. 4, 2 (2024).

Article  CAS  PubMed  PubMed Central  Google Scholar 

Li, H. et al. Collagen fiber orientation disorder from H&E images is prognostic for early stage breast cancer: clinical trial validation. NPJ Breast Cancer 7, 104 (2021).

Article  CAS  PubMed  PubMed Central  Google Scholar 

Bilal, M. et al. Development and validation of a weakly supervised deep learning framework to predict the status of molecular pathways and key mutations in colorectal cancer from routine histology images: a retrospective study. Lancet Digital Health 3, e763–e772 (2021).

Article  CAS  PubMed  Google Scholar 

Lugli, A., Zlobec, I., Berger, M. D., Kirsch, R. & Nagtegaal, I. D. Tumour budding in solid cancers. Nat. Rev. Clin. Oncol. 18, 101–115 (2021).

Article  PubMed  Google Scholar 

Neppl, C., Zlobec, I., Schmid, R. A. & Berezowska, S. Validation of the International Tumor Budding Consensus Conference (ITBCC) 2016 recommendation in squamous cell carcinoma of the lung – a single-center analysis of 354 cases. Mod. Pathol. 33, 802–811 (2020).

Article  CAS  PubMed  Google Scholar 

Dawson, H. et al. Tumour budding/T cell infiltrates in colorectal cancer: proposal of a novel combined score. Histopathology 76, 572–580 (2020).

Article  PubMed  Google Scholar 

Xie, W. et al. Prostate cancer risk stratification via nondestructive 3D pathology with deep learning-assisted gland analysis. Cancer Res. 82, 334–345 (2022).

Article  CAS  PubMed  Google Scholar 

Lu, C. et al. A prognostic model for overall survival of patients with early-stage non-small cell lung cancer: a multicentre, retrospective study. Lancet Digital Health 2, e594–e606 (2020).

Article  PubMed  Google Scholar 

Lu, C. et al. Feature-driven local cell graph (FLocK): new computational pathology-based descriptors for prognosis of lung cancer and HPV status of oropharyngeal cancers. Med. Image Anal. 68, 101903 (2021).

Article  PubMed  Google Scholar 

Fashi, P. A., Hemati, S., Babaie, M., Gonzalez, R. & Tizhoosh, H. R. A self-supervised contrastive learning approach for whole slide image representation in digital pathology. J. Pathol. Inf. 13, 100133 (2022).

Article  Google Scholar 

Tsai, P.-C. et al. Histopathology images predict multi-omics aberrations and prognoses in colorectal cancer patients. Nat. Commun. 14, 2102 (2023).

Article  CAS  PubMed  PubMed Central  Google Scholar 

Marostica, E. et al. Development of a histopathology informatics pipeline for classification and prediction of clinical outcomes in subtypes of renal cell carcinoma. Clin. Cancer Res. 27, 2868–2878 (2021).

Comments (0)

No login
gif