Development of an Integrated Human-Computer Interactive Model for Improved User Experience in Gesture-Controlled Smart Mirrors

The advancement of smart technologies has led to the development of innovative home automation devices, with smart mirrors emerging as a modern convenience tool. This paper focuses on the design and implementation of a gesture-controlled smart mirror, incorporating a two-way mirror, monitor, raspbe...

Full description

Saved in:
Bibliographic Details
Main Authors: Ayorinde Joseph Olanipekun, Olubusola Olufunke Nuga, Peter Olamide Onabanjo, Emmanuel Uchechukwu Ogbodo, Samuel Blessing Owusu
Format: Article
Language:English
Published: College of Engineering of Afe Babalola University, Ado-Ekiti (ABUAD), Ekiti State, Nigeria 2025-07-01
Series:ABUAD Journal of Engineering Research and Development
Subjects:
Online Access:https://journals.abuad.edu.ng/index.php/ajerd/article/view/1340
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849717449379807232
author Ayorinde Joseph Olanipekun
Olubusola Olufunke Nuga
Peter Olamide Onabanjo
Emmanuel Uchechukwu Ogbodo
Samuel Blessing Owusu
author_facet Ayorinde Joseph Olanipekun
Olubusola Olufunke Nuga
Peter Olamide Onabanjo
Emmanuel Uchechukwu Ogbodo
Samuel Blessing Owusu
author_sort Ayorinde Joseph Olanipekun
collection DOAJ
description The advancement of smart technologies has led to the development of innovative home automation devices, with smart mirrors emerging as a modern convenience tool. This paper focuses on the design and implementation of a gesture-controlled smart mirror, incorporating a two-way mirror, monitor, raspberry pi, gesture-enabled camera, power adaptor and a swipeable interface to enhance user interaction. The objectives of the paper include designing a comprehensive smart mirror using CAD, integrating gesture control technology through Python's OpenCV package, constructing a functional prototype utilizing the Magic Mirror software, and conducting extensive testing. Key tests conducted include usability test to assess user interaction, functionality test to validate gesture control and mirror operations, data analysis for performance metrics, and visibility test for optimal display quality. Functionality test showed an average gesture detection accuracy of 92.5%, with the swipe left and swipe right gestures achieving the highest accuracy. In the usability test, the average response time across all gestures was 0.75 seconds, which is within the acceptable range for real-time interaction. Other performance indicators like error rate, average user satisfaction, device uptime and gesture latency were tested. These results demonstrated the effectiveness of the gesture-controlled interface, with the prototype showing high accuracy in gesture recognition and overall positive user feedback in terms of usability and reliability. The findings of this work suggest that the developed smart mirror could serve as a valuable addition to smart home environments, offering a seamless and interactive experience for users.
format Article
id doaj-art-cf7022d1a5a0429bba21f8a5e6edad0c
institution DOAJ
issn 2756-6811
2645-2685
language English
publishDate 2025-07-01
publisher College of Engineering of Afe Babalola University, Ado-Ekiti (ABUAD), Ekiti State, Nigeria
record_format Article
series ABUAD Journal of Engineering Research and Development
spelling doaj-art-cf7022d1a5a0429bba21f8a5e6edad0c2025-08-20T03:12:39ZengCollege of Engineering of Afe Babalola University, Ado-Ekiti (ABUAD), Ekiti State, NigeriaABUAD Journal of Engineering Research and Development2756-68112645-26852025-07-018210.53982/ajerd.2025.0802.15-jDevelopment of an Integrated Human-Computer Interactive Model for Improved User Experience in Gesture-Controlled Smart MirrorsAyorinde Joseph Olanipekun0Olubusola Olufunke Nuga1Peter Olamide Onabanjo2Emmanuel Uchechukwu Ogbodo3Samuel Blessing Owusu4Electrical and Electronics Engineering Department, Federal University of Agriculture, Abeokuta, NigeriaFederal University of Agriculture, AbeokutaElectrical and Electronics Engineering Department, Federal University of Agriculture, Abeokuta, NigeriaFederal University of Agriculture, AbeokutaElectrical and Electronics Engineering Department, Federal University of Agriculture, Abeokuta, NigeriaFederal University of Agriculture, AbeokutaElectrical and Electronics Engineering Department, Federal University of Agriculture, Abeokuta, NigeriaFederal University of Agriculture, AbeokutaElectrical and Electronics Engineering Department, Federal University of Agriculture, Abeokuta, Nigeria The advancement of smart technologies has led to the development of innovative home automation devices, with smart mirrors emerging as a modern convenience tool. This paper focuses on the design and implementation of a gesture-controlled smart mirror, incorporating a two-way mirror, monitor, raspberry pi, gesture-enabled camera, power adaptor and a swipeable interface to enhance user interaction. The objectives of the paper include designing a comprehensive smart mirror using CAD, integrating gesture control technology through Python's OpenCV package, constructing a functional prototype utilizing the Magic Mirror software, and conducting extensive testing. Key tests conducted include usability test to assess user interaction, functionality test to validate gesture control and mirror operations, data analysis for performance metrics, and visibility test for optimal display quality. Functionality test showed an average gesture detection accuracy of 92.5%, with the swipe left and swipe right gestures achieving the highest accuracy. In the usability test, the average response time across all gestures was 0.75 seconds, which is within the acceptable range for real-time interaction. Other performance indicators like error rate, average user satisfaction, device uptime and gesture latency were tested. These results demonstrated the effectiveness of the gesture-controlled interface, with the prototype showing high accuracy in gesture recognition and overall positive user feedback in terms of usability and reliability. The findings of this work suggest that the developed smart mirror could serve as a valuable addition to smart home environments, offering a seamless and interactive experience for users. https://journals.abuad.edu.ng/index.php/ajerd/article/view/1340Gesture RecognitionHuman-Computer InteractionMagicMirrorRaspberry PiSwipeable Pages
spellingShingle Ayorinde Joseph Olanipekun
Olubusola Olufunke Nuga
Peter Olamide Onabanjo
Emmanuel Uchechukwu Ogbodo
Samuel Blessing Owusu
Development of an Integrated Human-Computer Interactive Model for Improved User Experience in Gesture-Controlled Smart Mirrors
ABUAD Journal of Engineering Research and Development
Gesture Recognition
Human-Computer Interaction
MagicMirror
Raspberry Pi
Swipeable Pages
title Development of an Integrated Human-Computer Interactive Model for Improved User Experience in Gesture-Controlled Smart Mirrors
title_full Development of an Integrated Human-Computer Interactive Model for Improved User Experience in Gesture-Controlled Smart Mirrors
title_fullStr Development of an Integrated Human-Computer Interactive Model for Improved User Experience in Gesture-Controlled Smart Mirrors
title_full_unstemmed Development of an Integrated Human-Computer Interactive Model for Improved User Experience in Gesture-Controlled Smart Mirrors
title_short Development of an Integrated Human-Computer Interactive Model for Improved User Experience in Gesture-Controlled Smart Mirrors
title_sort development of an integrated human computer interactive model for improved user experience in gesture controlled smart mirrors
topic Gesture Recognition
Human-Computer Interaction
MagicMirror
Raspberry Pi
Swipeable Pages
url https://journals.abuad.edu.ng/index.php/ajerd/article/view/1340
work_keys_str_mv AT ayorindejosepholanipekun developmentofanintegratedhumancomputerinteractivemodelforimproveduserexperienceingesturecontrolledsmartmirrors
AT olubusolaolufunkenuga developmentofanintegratedhumancomputerinteractivemodelforimproveduserexperienceingesturecontrolledsmartmirrors
AT peterolamideonabanjo developmentofanintegratedhumancomputerinteractivemodelforimproveduserexperienceingesturecontrolledsmartmirrors
AT emmanueluchechukwuogbodo developmentofanintegratedhumancomputerinteractivemodelforimproveduserexperienceingesturecontrolledsmartmirrors
AT samuelblessingowusu developmentofanintegratedhumancomputerinteractivemodelforimproveduserexperienceingesturecontrolledsmartmirrors