Assessing Physician and Patient Agreement on Whether Patient Outcomes Captured in Clinical Progress Notes Reflect Treatment Success: Cross-Sectional Study
BackgroundIt remains unclear if there is agreement between physicians and patients on the definition of treatment success following orthopedic treatment. Clinical progress notes are generated during each health care encounter and include information on current disease symptom...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-01-01
|
| Series: | Journal of Participatory Medicine |
| Online Access: | https://jopm.jmir.org/2025/1/e60263 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832590407630848000 |
|---|---|
| author | Sarah B Floyd Jordyn C Sutton Marvin Okon Mary McCarthy Liza Fisher Benjamin Judkins Zachary Cole Reynolds Ann Blair Kennedy |
| author_facet | Sarah B Floyd Jordyn C Sutton Marvin Okon Mary McCarthy Liza Fisher Benjamin Judkins Zachary Cole Reynolds Ann Blair Kennedy |
| author_sort | Sarah B Floyd |
| collection | DOAJ |
| description |
BackgroundIt remains unclear if there is agreement between physicians and patients on the definition of treatment success following orthopedic treatment. Clinical progress notes are generated during each health care encounter and include information on current disease symptoms, rehabilitation progress, and treatment outcomes.
ObjectiveThis study aims to assess if physicians and patients agree on whether patient outcomes captured in clinical progress notes reflect a successful treatment outcome following orthopedic care.
MethodsWe performed a cross-sectional analysis of a subset of clinical notes for patients presenting to a Level-1 Trauma Center and Regional Health System for follow-up for an acute proximal humerus fracture (PHF). This study was part of a larger study of 1000 patients with PHF receiving initial treatment between 2019 and 2021. From the full dataset of 1000 physician-labeled notes, a stratified random sample of 25 notes from each outcome label group was identified for this study. A group of 2 patients then reviewed the sample of 100 clinical notes and labeled each note as reflecting treatment success or failure. Cohen κ statistics were used to assess the degree of agreement between physicians and patients on clinical note content.
ResultsThe average age of the patients in the sample was 67 (SD 13) years and 82% of the notes came from female patients. Patients were primarily White (91%) and had Medicare insurance coverage (65%). The note sample came from fracture-related encounters ranging from the second to the tenth encounter after the index PHF visit. There were no significant differences in patient or visit characteristics across concordant and discordant notes labeled by physicians and patients. Among agreement levels ranging from poor to perfect agreement, physician and patient evaluators exhibited only a fair level of agreement in what they deemed as treatment success based on a Cohen κ of 0.32 (95% CI 0.10-0.55; P=.01). Furthermore, interpatient and interphysician agreement also demonstrated relatively low levels of agreement.
ConclusionsThe findings suggest that physicians and patients demonstrated low levels of agreement when assessing whether a patient’s clinical note reflected a successful outcome following treatment for a PHF. As low levels of agreement were also observed within physician and patient groups, it is clear the definition of success varied highly across both physicians and patients. Further research is needed to elucidate physician and patient perceptions of treatment success. As outcome measurement and demonstrating the value of orthopedic treatment remain important priorities, it is important to better define and reach a consensus on what treatment success means in orthopedic medicine. |
| format | Article |
| id | doaj-art-94b41d08ec014840bb2b7d3ecb343242 |
| institution | Kabale University |
| issn | 2152-7202 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Participatory Medicine |
| spelling | doaj-art-94b41d08ec014840bb2b7d3ecb3432422025-01-23T21:30:31ZengJMIR PublicationsJournal of Participatory Medicine2152-72022025-01-0117e6026310.2196/60263Assessing Physician and Patient Agreement on Whether Patient Outcomes Captured in Clinical Progress Notes Reflect Treatment Success: Cross-Sectional StudySarah B Floydhttps://orcid.org/0000-0001-7412-8136Jordyn C Suttonhttps://orcid.org/0009-0005-4835-0944Marvin Okonhttps://orcid.org/0000-0001-7429-3713Mary McCarthyhttps://orcid.org/0009-0005-7828-5709Liza Fisherhttps://orcid.org/0000-0002-7222-5693Benjamin Judkinshttps://orcid.org/0000-0002-1119-116XZachary Cole Reynoldshttps://orcid.org/0009-0009-2938-6924Ann Blair Kennedyhttps://orcid.org/0000-0002-3518-6314 BackgroundIt remains unclear if there is agreement between physicians and patients on the definition of treatment success following orthopedic treatment. Clinical progress notes are generated during each health care encounter and include information on current disease symptoms, rehabilitation progress, and treatment outcomes. ObjectiveThis study aims to assess if physicians and patients agree on whether patient outcomes captured in clinical progress notes reflect a successful treatment outcome following orthopedic care. MethodsWe performed a cross-sectional analysis of a subset of clinical notes for patients presenting to a Level-1 Trauma Center and Regional Health System for follow-up for an acute proximal humerus fracture (PHF). This study was part of a larger study of 1000 patients with PHF receiving initial treatment between 2019 and 2021. From the full dataset of 1000 physician-labeled notes, a stratified random sample of 25 notes from each outcome label group was identified for this study. A group of 2 patients then reviewed the sample of 100 clinical notes and labeled each note as reflecting treatment success or failure. Cohen κ statistics were used to assess the degree of agreement between physicians and patients on clinical note content. ResultsThe average age of the patients in the sample was 67 (SD 13) years and 82% of the notes came from female patients. Patients were primarily White (91%) and had Medicare insurance coverage (65%). The note sample came from fracture-related encounters ranging from the second to the tenth encounter after the index PHF visit. There were no significant differences in patient or visit characteristics across concordant and discordant notes labeled by physicians and patients. Among agreement levels ranging from poor to perfect agreement, physician and patient evaluators exhibited only a fair level of agreement in what they deemed as treatment success based on a Cohen κ of 0.32 (95% CI 0.10-0.55; P=.01). Furthermore, interpatient and interphysician agreement also demonstrated relatively low levels of agreement. ConclusionsThe findings suggest that physicians and patients demonstrated low levels of agreement when assessing whether a patient’s clinical note reflected a successful outcome following treatment for a PHF. As low levels of agreement were also observed within physician and patient groups, it is clear the definition of success varied highly across both physicians and patients. Further research is needed to elucidate physician and patient perceptions of treatment success. As outcome measurement and demonstrating the value of orthopedic treatment remain important priorities, it is important to better define and reach a consensus on what treatment success means in orthopedic medicine.https://jopm.jmir.org/2025/1/e60263 |
| spellingShingle | Sarah B Floyd Jordyn C Sutton Marvin Okon Mary McCarthy Liza Fisher Benjamin Judkins Zachary Cole Reynolds Ann Blair Kennedy Assessing Physician and Patient Agreement on Whether Patient Outcomes Captured in Clinical Progress Notes Reflect Treatment Success: Cross-Sectional Study Journal of Participatory Medicine |
| title | Assessing Physician and Patient Agreement on Whether Patient Outcomes Captured in Clinical Progress Notes Reflect Treatment Success: Cross-Sectional Study |
| title_full | Assessing Physician and Patient Agreement on Whether Patient Outcomes Captured in Clinical Progress Notes Reflect Treatment Success: Cross-Sectional Study |
| title_fullStr | Assessing Physician and Patient Agreement on Whether Patient Outcomes Captured in Clinical Progress Notes Reflect Treatment Success: Cross-Sectional Study |
| title_full_unstemmed | Assessing Physician and Patient Agreement on Whether Patient Outcomes Captured in Clinical Progress Notes Reflect Treatment Success: Cross-Sectional Study |
| title_short | Assessing Physician and Patient Agreement on Whether Patient Outcomes Captured in Clinical Progress Notes Reflect Treatment Success: Cross-Sectional Study |
| title_sort | assessing physician and patient agreement on whether patient outcomes captured in clinical progress notes reflect treatment success cross sectional study |
| url | https://jopm.jmir.org/2025/1/e60263 |
| work_keys_str_mv | AT sarahbfloyd assessingphysicianandpatientagreementonwhetherpatientoutcomescapturedinclinicalprogressnotesreflecttreatmentsuccesscrosssectionalstudy AT jordyncsutton assessingphysicianandpatientagreementonwhetherpatientoutcomescapturedinclinicalprogressnotesreflecttreatmentsuccesscrosssectionalstudy AT marvinokon assessingphysicianandpatientagreementonwhetherpatientoutcomescapturedinclinicalprogressnotesreflecttreatmentsuccesscrosssectionalstudy AT marymccarthy assessingphysicianandpatientagreementonwhetherpatientoutcomescapturedinclinicalprogressnotesreflecttreatmentsuccesscrosssectionalstudy AT lizafisher assessingphysicianandpatientagreementonwhetherpatientoutcomescapturedinclinicalprogressnotesreflecttreatmentsuccesscrosssectionalstudy AT benjaminjudkins assessingphysicianandpatientagreementonwhetherpatientoutcomescapturedinclinicalprogressnotesreflecttreatmentsuccesscrosssectionalstudy AT zacharycolereynolds assessingphysicianandpatientagreementonwhetherpatientoutcomescapturedinclinicalprogressnotesreflecttreatmentsuccesscrosssectionalstudy AT annblairkennedy assessingphysicianandpatientagreementonwhetherpatientoutcomescapturedinclinicalprogressnotesreflecttreatmentsuccesscrosssectionalstudy |