Think FAST: a novel framework to evaluate fidelity, accuracy, safety, and tone in conversational AI health coach dialogues

Think FAST: a novel framework to evaluate fidelity, accuracy, safety, and tone in conversational AI health coach dialogues

Developments in Machine Learning based Conversational and Generative Artificial Intelligence (GenAI) have created opportunities for sophisticated Conversational Agents to augment elements of healthcare. While not a replacement for professional care, AI offers opportunities for scalability, cost effe...

Full description

Saved in:

Bibliographic Details
Main Authors:	Martha Neary, Emily Fulton, Victoria Rogers, Julia Wilson, Zoe Griffiths, Ram Chuttani, Paul M. Sacher
Format:	Article
Language:	English
Published:	Frontiers Media S.A. 2025-06-01
Series:	Frontiers in Digital Health
Subjects:	GenAI AI health coach weight-loss coach AI evaluation conversational generative AI evaluation
Online Access:	https://www.frontiersin.org/articles/10.3389/fdgth.2025.1460236/full
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Is AI Chatbot Coaching Actually ‘Coaching’? Exploring Relationship and Reflection in AI-Human Conversations
by: Andy Nobes
Published: (2025-06-01)

Towards Designing a Set of Usability and Accessibility Heuristics Focused on Cognitive Diversity: An Exploratory Case Study with Generative Artificial Intelligence
by: Afra Pascual Almenara, et al.
Published: (2024-12-01)

The developing landscape of coaching in the 2020s : exploring coach attitudes towards digital, AI, team coaching, CPD, supervision, risk taking and fee rates
by: Passmore, Jonathan, et al.
Published: (2025-08-01)

The role of generative AI in writing doctoral dissertation: perceived opportunities, challenges, and facilitating strategies to promote human agency
by: Muhammad Shaban Rafi, et al.
Published: (2025-06-01)

AI for social good
by: Philip Treleaven, et al.
Published: (2025-06-01)

Editorial: Advancing coaching scholarship
by: Sewon Kim, et al.
Published: (2025-03-01)

Generative AI in Healthcare: Insights from Health Professions Educators and Students
by: Chaoyan Dong, et al.
Published: (2025-04-01)

Generative artificial intelligence and university study: a guide for students by the study advice team at the University of Reading
by: Georgia Koromila
Published: (2024-10-01)

Assessing the ability of generative AI in English literary analysis through Bloom’s Taxonomy
by: Cecilia Ka Yuk Chan, et al.
Published: (2025-06-01)

AI: An <i>Active</i> and <i>Innovative</i> Tool for Artistic Creation
by: Charis Avlonitou, et al.
Published: (2025-05-01)

The Mediating Role of Generative AI Self-Regulation on Students’ Critical Thinking and Problem-Solving
by: Xue Zhou, et al.
Published: (2024-11-01)

Generative AI in Engineering and Computing Education: A Scoping Review of Empirical Studies and Educational Practices
by: Jonathan Alvarez Ariza, et al.
Published: (2025-01-01)

Implementing generative AI (GenAI) in higher education: A systematic review of case studies
by: Marina Belkina, et al.
Published: (2025-06-01)

Impacts of generative artificial intelligence on the future of labor market: A systematic review
by: Nader Salari, et al.
Published: (2025-05-01)

Adoption and Impact of ChatGPT in Computer Science Education: A Case Study on a Database Administration Course
by: Daniel López-Fernández, et al.
Published: (2024-11-01)

GAIL: Enhancing Student Engagement and Productivity
by: Maikel Leon
Published: (2025-05-01)

Beyond the prompt: The Role of User Behavior in Shaping AI-misalignment and Societal Knowledge
by: Morraya Benhammou
Published: (2025-06-01)

Emerging Drivers of Adoption of Generative AI Technology in Education: A Review
by: Andrina Granić
Published: (2025-06-01)

Developing pre-service language teachers’ GenAI literacy: an interventional study in an English language teacher education course
by: Ting Huang, et al.
Published: (2025-07-01)

Cómo Entrenar tu Dragón: A European Credit Transfer System Module to Develop Critical Artificial Intelligence Literacy in a PGCERT Programme for New Higher Education Lecturers
by: Mari Cruz García Vallejo
Published: (2025-02-01)

Influence of Generative Artificial Intelligence (GenAI) in Nigerian Higher Education
by: Olufemi PETERS, et al.
Published: (2025-06-01)

If ChatGPT can do it, where is my creativity? generative AI boosts performance but diminishes experience in creative writing
by: Peidong Mei, et al.
Published: (2025-05-01)

Generative AI and the Metaverse: A Scoping Review of Ethical and Legal Challenges
by: Aliya Tabassum, et al.
Published: (2025-01-01)

A conceptual exploration of generative AI-induced cognitive dissonance and its emergence in university-level academic writing
by: Carl Errol Seran, et al.
Published: (2025-06-01)

A Review of the Applications, Benefits, and Challenges of Generative AI for Sustainable Toxicology
by: Furqan Alam, et al.
Published: (2025-01-01)

Moving LLM evaluation forward: lessons from human judgment research
by: Andrea Polonioli
Published: (2025-05-01)

Generative AI for Culturally Responsive Science Assessment: A Conceptual Framework
by: Matthew Nyaaba, et al.
Published: (2024-11-01)

Enhancing Critical Thinking Skills in ChatGPT-Human Interaction: A Scoping Review
by: Lilia Raitskaya, et al.
Published: (2025-06-01)

Faculty perspectives on generative artificial intelligence: insights into awareness, benefits, concerns, and uses
by: Budour Almisad, et al.
Published: (2025-07-01)

La inteligencia artificial generativa de imágenes como colaboradora para la creatividad: un estudio de caso grupal
by: Paula Gil-Ruiz, et al.
Published: (2024-12-01)

From Prompt to Polished: Exploring Student–Chatbot Interactions for Academic Writing Assistance
by: Maya Usher, et al.
Published: (2025-03-01)

Modeling Teachers’ Acceptance of Generative Artificial Intelligence Use in Higher Education: The Role of AI Literacy, Intelligent TPACK, and Perceived Trust
by: Ahlam Mohammed Al-Abdullatif
Published: (2024-11-01)

Book review: Beckingham, S., Lawrence, J., Powell, S. and Hartley, P. (eds) (2024) Using generative AI effectively in higher education: sustainable and ethical practices for learning, teaching and assessment. London: Routledge.
by: Pasan Athapaththu
Published: (2025-06-01)

Building responsible AI chatbot platforms in higher education: an evidence-based framework from design to implementation
by: Julie Schell, et al.
Published: (2025-07-01)

AI as the Therapist: Student Insights on the Challenges of Using Generative AI for School Mental Health Frameworks
by: Cecilia Ka Yuk Chan
Published: (2025-02-01)

Appliances of Generative AI-Powered Language Tools in Academic Writing: A Scoping Review
by: Lilia Raitskaya, et al.
Published: (2024-12-01)

EFL Students’ Perceptions of Language Learning and Assessment: Pre and in Generative AI (GenAI) Era
by: Huan Zhao
Published: (2025-06-01)

Artificial intelligence in South African higher education: Survey data of master’s level studentsMendeley Data
by: Michelle Smit, et al.
Published: (2025-08-01)

Ethical and effortful: workshopping human and generative AI academic writing collaborations
by: Johanna Amos
Published: (2024-10-01)

An exploration of the role of visuals and users’ imagery and verbal preferences on goal attainment and coaching chatbot adoption
by: Nicky Terblanche, et al.
Published: (2025-02-01)