Unipa-GPT: Large Language Models for university-oriented QA in Italian

This paper illustrates the architecture and training of Unipa-GPT, a chatbot relying on a Large Language Model, developed for assisting students in choosing a bachelor/master degree course at the University of Palermo. Unipa-GPT relies on gpt-3.5-turbo, it was presented in the context of the Europea...

Full description

Saved in:
Bibliographic Details
Main Authors: Irene Siragusa, Roberto Pirrone
Format: Article
Language:English
Published: Accademia University Press 2024-12-01
Series:IJCoL
Online Access:https://journals.openedition.org/ijcol/1476
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper illustrates the architecture and training of Unipa-GPT, a chatbot relying on a Large Language Model, developed for assisting students in choosing a bachelor/master degree course at the University of Palermo. Unipa-GPT relies on gpt-3.5-turbo, it was presented in the context of the European Researchers’ Night (SHARPER night). In our experiments we adopted both the Retrieval Augmented Generation (RAG) approach and fine-tuning to develop the system. The whole architecture of Unipa-GPT is presented, both the RAG and the fine-tuned systems are compared, and a brief discussion on their performance is reported. Further comparison with other Large Language Models and the experimental results during the SHARPER night are illustrated. Corpora and code are available on GitHub1.
ISSN:2499-4553