Technical Customer Service Support with RAG Fine Tuned LLaMA 3

Providing effective technical customer service support is a critical challenge for organizations managing complex product ecosystems. This paper explores the application of Retrieval-Augmented Generation (RAG) using a fine-tuned LLaMA 3 model to enhance customer support workflows for Bogen’s E7000...

Full description

Saved in:
Bibliographic Details
Main Author: Jose Della Sala
Format: Article
Language:English
Published: LibraryPress@UF 2025-05-01
Series:Proceedings of the International Florida Artificial Intelligence Research Society Conference
Online Access:https://journals.flvc.org/FLAIRS/article/view/138954
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849322593530675200
author Jose Della Sala
author_facet Jose Della Sala
author_sort Jose Della Sala
collection DOAJ
description Providing effective technical customer service support is a critical challenge for organizations managing complex product ecosystems. This paper explores the application of Retrieval-Augmented Generation (RAG) using a fine-tuned LLaMA 3 model to enhance customer support workflows for Bogen’s E7000 system. The project involves creating a custom dataset derived from Bogen’s documentation manuals to train the model with domain-specific knowledge of the E7000 system. The objective is to assist customer service representatives by developing an LLM capable of processing technical queries, identifying potential issues within the E7000 system, and proposing solutions or troubleshooting tips. By leveraging the RAG framework, the system dynamically retrieves relevant context from an external knowledge base to augment the model’s responses, ensuring scalability and precision. Results demonstrate the feasibility of deploying a fine-tuned LLM to improve query processing efficiency and response accuracy. This work highlights the transformative potential of advanced LLMs in delivering technical customer support in specialized domains.
format Article
id doaj-art-4f4e49f0123543e3bdd33cdc28d14e85
institution Kabale University
issn 2334-0754
2334-0762
language English
publishDate 2025-05-01
publisher LibraryPress@UF
record_format Article
series Proceedings of the International Florida Artificial Intelligence Research Society Conference
spelling doaj-art-4f4e49f0123543e3bdd33cdc28d14e852025-08-20T03:49:18ZengLibraryPress@UFProceedings of the International Florida Artificial Intelligence Research Society Conference2334-07542334-07622025-05-0138110.32473/flairs.38.1.138954Technical Customer Service Support with RAG Fine Tuned LLaMA 3Jose Della Sala0UCF Graduate Student Providing effective technical customer service support is a critical challenge for organizations managing complex product ecosystems. This paper explores the application of Retrieval-Augmented Generation (RAG) using a fine-tuned LLaMA 3 model to enhance customer support workflows for Bogen’s E7000 system. The project involves creating a custom dataset derived from Bogen’s documentation manuals to train the model with domain-specific knowledge of the E7000 system. The objective is to assist customer service representatives by developing an LLM capable of processing technical queries, identifying potential issues within the E7000 system, and proposing solutions or troubleshooting tips. By leveraging the RAG framework, the system dynamically retrieves relevant context from an external knowledge base to augment the model’s responses, ensuring scalability and precision. Results demonstrate the feasibility of deploying a fine-tuned LLM to improve query processing efficiency and response accuracy. This work highlights the transformative potential of advanced LLMs in delivering technical customer support in specialized domains. https://journals.flvc.org/FLAIRS/article/view/138954
spellingShingle Jose Della Sala
Technical Customer Service Support with RAG Fine Tuned LLaMA 3
Proceedings of the International Florida Artificial Intelligence Research Society Conference
title Technical Customer Service Support with RAG Fine Tuned LLaMA 3
title_full Technical Customer Service Support with RAG Fine Tuned LLaMA 3
title_fullStr Technical Customer Service Support with RAG Fine Tuned LLaMA 3
title_full_unstemmed Technical Customer Service Support with RAG Fine Tuned LLaMA 3
title_short Technical Customer Service Support with RAG Fine Tuned LLaMA 3
title_sort technical customer service support with rag fine tuned llama 3
url https://journals.flvc.org/FLAIRS/article/view/138954
work_keys_str_mv AT josedellasala technicalcustomerservicesupportwithragfinetunedllama3