Entropy and expertise: assessing changes in pathologists' language over time using the UK Liver Pathology External Quality Assessment scheme

Abstract External Quality Assessment (EQA) schemes are an important quality assurance tool and aim to ensure consistency among histopathologists. In this study, we use Shannon entropy as a novel metric to evaluate linguistic variability in the UK Liver Pathology EQA scheme. Analysing free‐text respo...

Full description

Saved in:
Bibliographic Details
Main Authors: Jonathan P Callaghan, Katrina Z Freimane, Rachel M Brown, Alyn L Cratchley, Timothy J Kendall
Format: Article
Language:English
Published: Wiley 2025-07-01
Series:The Journal of Pathology: Clinical Research
Subjects:
Online Access:https://doi.org/10.1002/2056-4538.70032
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849245897895968768
author Jonathan P Callaghan
Katrina Z Freimane
Rachel M Brown
Alyn L Cratchley
Timothy J Kendall
author_facet Jonathan P Callaghan
Katrina Z Freimane
Rachel M Brown
Alyn L Cratchley
Timothy J Kendall
author_sort Jonathan P Callaghan
collection DOAJ
description Abstract External Quality Assessment (EQA) schemes are an important quality assurance tool and aim to ensure consistency among histopathologists. In this study, we use Shannon entropy as a novel metric to evaluate linguistic variability in the UK Liver Pathology EQA scheme. Analysing free‐text responses by participants over a decade, we aimed to quantify language trends in morphological assessments and clinicopathological diagnoses. Accounting for an increasing word count and when pathologists joined the scheme, our findings reveal a significant increase in entropy of morphological assessments over time, indicating growing linguistic diversity that may reflect the increasing complexity of liver pathology. Entropy of clinicopathological diagnoses over the same period did not provide clear evidence for convergent diagnostic language. High entropy corresponded to cases that elicited more diverse responses and could be considered more challenging, highlighting the utility of this method to identify potential areas for targeted education. We demonstrate entropy as a novel tool to analyse pathologist language and enhance quality assurance in the evolving pathology landscape.
format Article
id doaj-art-e7de5d412d784a3b841fb661cf20c27a
institution Kabale University
issn 2056-4538
language English
publishDate 2025-07-01
publisher Wiley
record_format Article
series The Journal of Pathology: Clinical Research
spelling doaj-art-e7de5d412d784a3b841fb661cf20c27a2025-08-20T03:58:40ZengWileyThe Journal of Pathology: Clinical Research2056-45382025-07-01114n/an/a10.1002/2056-4538.70032Entropy and expertise: assessing changes in pathologists' language over time using the UK Liver Pathology External Quality Assessment schemeJonathan P Callaghan0Katrina Z Freimane1Rachel M Brown2Alyn L Cratchley3Timothy J Kendall4Pathology and Data Analytics University of Leeds Leeds UKPathology and Data Analytics University of Leeds Leeds UKDepartment of Cellular Pathology University Hospitals Birmingham NHS Foundation Trust Birmingham UKDepartment of Cellular Pathology Leeds Teaching Hospitals NHS Trust Leeds UKCentre for Inflammation Research Institute for Regeneration and Repair, University of Edinburgh Edinburgh UKAbstract External Quality Assessment (EQA) schemes are an important quality assurance tool and aim to ensure consistency among histopathologists. In this study, we use Shannon entropy as a novel metric to evaluate linguistic variability in the UK Liver Pathology EQA scheme. Analysing free‐text responses by participants over a decade, we aimed to quantify language trends in morphological assessments and clinicopathological diagnoses. Accounting for an increasing word count and when pathologists joined the scheme, our findings reveal a significant increase in entropy of morphological assessments over time, indicating growing linguistic diversity that may reflect the increasing complexity of liver pathology. Entropy of clinicopathological diagnoses over the same period did not provide clear evidence for convergent diagnostic language. High entropy corresponded to cases that elicited more diverse responses and could be considered more challenging, highlighting the utility of this method to identify potential areas for targeted education. We demonstrate entropy as a novel tool to analyse pathologist language and enhance quality assurance in the evolving pathology landscape.https://doi.org/10.1002/2056-4538.70032entropylanguageEQA schemeExternal Quality Assessmentliver pathology
spellingShingle Jonathan P Callaghan
Katrina Z Freimane
Rachel M Brown
Alyn L Cratchley
Timothy J Kendall
Entropy and expertise: assessing changes in pathologists' language over time using the UK Liver Pathology External Quality Assessment scheme
The Journal of Pathology: Clinical Research
entropy
language
EQA scheme
External Quality Assessment
liver pathology
title Entropy and expertise: assessing changes in pathologists' language over time using the UK Liver Pathology External Quality Assessment scheme
title_full Entropy and expertise: assessing changes in pathologists' language over time using the UK Liver Pathology External Quality Assessment scheme
title_fullStr Entropy and expertise: assessing changes in pathologists' language over time using the UK Liver Pathology External Quality Assessment scheme
title_full_unstemmed Entropy and expertise: assessing changes in pathologists' language over time using the UK Liver Pathology External Quality Assessment scheme
title_short Entropy and expertise: assessing changes in pathologists' language over time using the UK Liver Pathology External Quality Assessment scheme
title_sort entropy and expertise assessing changes in pathologists language over time using the uk liver pathology external quality assessment scheme
topic entropy
language
EQA scheme
External Quality Assessment
liver pathology
url https://doi.org/10.1002/2056-4538.70032
work_keys_str_mv AT jonathanpcallaghan entropyandexpertiseassessingchangesinpathologistslanguageovertimeusingtheukliverpathologyexternalqualityassessmentscheme
AT katrinazfreimane entropyandexpertiseassessingchangesinpathologistslanguageovertimeusingtheukliverpathologyexternalqualityassessmentscheme
AT rachelmbrown entropyandexpertiseassessingchangesinpathologistslanguageovertimeusingtheukliverpathologyexternalqualityassessmentscheme
AT alynlcratchley entropyandexpertiseassessingchangesinpathologistslanguageovertimeusingtheukliverpathologyexternalqualityassessmentscheme
AT timothyjkendall entropyandexpertiseassessingchangesinpathologistslanguageovertimeusingtheukliverpathologyexternalqualityassessmentscheme