Design and Implementation of an Interactive System for Service Robot Control and Monitoring

This project aims to develop an interactive control system for an autonomous service robot using an ROS (robot operating system). The system integrates an intuitive web interface and an interactive chatbot supported by Google Gemini to enhance the control experience and personalization for the user....

Full description

Saved in:
Bibliographic Details
Main Authors: Jonas Machado Santana, Bruno Duarte Silveira, Crescencio Lima, Jose Diaz-Amado, Cléia Santos Libarino, Joao E. Soares Marques, Dennis Barrios-Aranibar, Raquel E. Patiño-Escarcina
Format: Article
Language:English
Published: MDPI AG 2025-02-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/25/4/987
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849722280438923264
author Jonas Machado Santana
Bruno Duarte Silveira
Crescencio Lima
Jose Diaz-Amado
Cléia Santos Libarino
Joao E. Soares Marques
Dennis Barrios-Aranibar
Raquel E. Patiño-Escarcina
author_facet Jonas Machado Santana
Bruno Duarte Silveira
Crescencio Lima
Jose Diaz-Amado
Cléia Santos Libarino
Joao E. Soares Marques
Dennis Barrios-Aranibar
Raquel E. Patiño-Escarcina
author_sort Jonas Machado Santana
collection DOAJ
description This project aims to develop an interactive control system for an autonomous service robot using an ROS (robot operating system). The system integrates an intuitive web interface and an interactive chatbot supported by Google Gemini to enhance the control experience and personalization for the user. The methodology includes the integration of an API (application programming interface) to access a database storing user preferences, such as speed and frequent destinations. Furthermore, the system employs facial recognition, people groups’ recognition, and adaptive responses from the chatbot for autonomous navigation, ensuring a service tailored to the individual needs of each user. To validate the proposal, it was implemented on an autonomous service robot, integrated into a motorized wheelchair. Tests demonstrated that the system effectively adjusts the wheelchair’s behavior to user preferences, resulting in safer and more personalized navigation. The use of facial recognition and chatbot interaction provided more intuitive and efficient control. The developed system significantly improves the autonomy and quality of life for wheelchair users, proving to be a viable and efficient solution for autonomous and personalized control. The results indicate that integrating technologies like ROS, intuitive web interfaces, and interactive chatbots can transform the user experience of autonomous wheelchairs, better meeting the specific needs of users.
format Article
id doaj-art-286a5f49dac34a1385a7cc71c78ebc94
institution DOAJ
issn 1424-8220
language English
publishDate 2025-02-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj-art-286a5f49dac34a1385a7cc71c78ebc942025-08-20T03:11:22ZengMDPI AGSensors1424-82202025-02-0125498710.3390/s25040987Design and Implementation of an Interactive System for Service Robot Control and MonitoringJonas Machado Santana0Bruno Duarte Silveira1Crescencio Lima2Jose Diaz-Amado3Cléia Santos Libarino4Joao E. Soares Marques5Dennis Barrios-Aranibar6Raquel E. Patiño-Escarcina7GIPAR Research Group, Instituto Federal da Bahia, IFBA, Vitória da Conquista, Bahia 45078-900, BrazilGIPAR Research Group, Instituto Federal da Bahia, IFBA, Vitória da Conquista, Bahia 45078-900, BrazilGIPAR Research Group, Instituto Federal da Bahia, IFBA, Vitória da Conquista, Bahia 45078-900, BrazilGIPAR Research Group, Instituto Federal da Bahia, IFBA, Vitória da Conquista, Bahia 45078-900, BrazilGIPAR Research Group, Instituto Federal da Bahia, IFBA, Vitória da Conquista, Bahia 45078-900, BrazilGIPAR Research Group, Instituto Federal da Bahia, IFBA, Vitória da Conquista, Bahia 45078-900, BrazilElectrical and Electronic Engineering Department Universidad Católica San Pablo, UCSP, Arequipa 04001, PeruElectrical and Electronic Engineering Department Universidad Católica San Pablo, UCSP, Arequipa 04001, PeruThis project aims to develop an interactive control system for an autonomous service robot using an ROS (robot operating system). The system integrates an intuitive web interface and an interactive chatbot supported by Google Gemini to enhance the control experience and personalization for the user. The methodology includes the integration of an API (application programming interface) to access a database storing user preferences, such as speed and frequent destinations. Furthermore, the system employs facial recognition, people groups’ recognition, and adaptive responses from the chatbot for autonomous navigation, ensuring a service tailored to the individual needs of each user. To validate the proposal, it was implemented on an autonomous service robot, integrated into a motorized wheelchair. Tests demonstrated that the system effectively adjusts the wheelchair’s behavior to user preferences, resulting in safer and more personalized navigation. The use of facial recognition and chatbot interaction provided more intuitive and efficient control. The developed system significantly improves the autonomy and quality of life for wheelchair users, proving to be a viable and efficient solution for autonomous and personalized control. The results indicate that integrating technologies like ROS, intuitive web interfaces, and interactive chatbots can transform the user experience of autonomous wheelchairs, better meeting the specific needs of users.https://www.mdpi.com/1424-8220/25/4/987interactionservice robotchatbotsystemrecognitionrobotics
spellingShingle Jonas Machado Santana
Bruno Duarte Silveira
Crescencio Lima
Jose Diaz-Amado
Cléia Santos Libarino
Joao E. Soares Marques
Dennis Barrios-Aranibar
Raquel E. Patiño-Escarcina
Design and Implementation of an Interactive System for Service Robot Control and Monitoring
Sensors
interaction
service robot
chatbot
system
recognition
robotics
title Design and Implementation of an Interactive System for Service Robot Control and Monitoring
title_full Design and Implementation of an Interactive System for Service Robot Control and Monitoring
title_fullStr Design and Implementation of an Interactive System for Service Robot Control and Monitoring
title_full_unstemmed Design and Implementation of an Interactive System for Service Robot Control and Monitoring
title_short Design and Implementation of an Interactive System for Service Robot Control and Monitoring
title_sort design and implementation of an interactive system for service robot control and monitoring
topic interaction
service robot
chatbot
system
recognition
robotics
url https://www.mdpi.com/1424-8220/25/4/987
work_keys_str_mv AT jonasmachadosantana designandimplementationofaninteractivesystemforservicerobotcontrolandmonitoring
AT brunoduartesilveira designandimplementationofaninteractivesystemforservicerobotcontrolandmonitoring
AT crescenciolima designandimplementationofaninteractivesystemforservicerobotcontrolandmonitoring
AT josediazamado designandimplementationofaninteractivesystemforservicerobotcontrolandmonitoring
AT cleiasantoslibarino designandimplementationofaninteractivesystemforservicerobotcontrolandmonitoring
AT joaoesoaresmarques designandimplementationofaninteractivesystemforservicerobotcontrolandmonitoring
AT dennisbarriosaranibar designandimplementationofaninteractivesystemforservicerobotcontrolandmonitoring
AT raquelepatinoescarcina designandimplementationofaninteractivesystemforservicerobotcontrolandmonitoring