Real-time multiple people gait recognition in the edge

Abstract Deploying deep learning models on edge devices offers advantages in terms of data security and communication latency. However, optimizing these models to achieve fast computing speeds without sacrificing accuracy can be challenging, especially in video surveillance applications where real-t...

Full description

Saved in:
Bibliographic Details
Main Authors: Paula Ruiz-Barroso, José María González-Linares, Francisco M. Castro, Nicolás Guil
Format: Article
Language:English
Published: Nature Portfolio 2025-06-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-025-02351-x
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850223889620140032
author Paula Ruiz-Barroso
José María González-Linares
Francisco M. Castro
Nicolás Guil
author_facet Paula Ruiz-Barroso
José María González-Linares
Francisco M. Castro
Nicolás Guil
author_sort Paula Ruiz-Barroso
collection DOAJ
description Abstract Deploying deep learning models on edge devices offers advantages in terms of data security and communication latency. However, optimizing these models to achieve fast computing speeds without sacrificing accuracy can be challenging, especially in video surveillance applications where real-time processing is crucial. In this study, we investigate the deployment of gait recognition models as a multi-objective selection problem in which we seek to simultaneously minimize several objectives, such as latency and energy consumption, while maintaining accuracy. The decision space of a problem comprises all models that can be built by varying parameters, such as the size of the model, the operating frequency of the device, and the precision of the operations. From this problem definition, a subset of Pareto optimal models can be selected to be deployed on the target device. We conducted experiments with two different gait recognition models on NVIDIA Jetson Orin Nano and Jetson AGX Orin to explore their decision spaces. In addition, we investigated different strategies to increase the throughput of the deployed models by taking advantage of batching and concurrent execution. Together, these techniques allowed us to design real-time solutions for gait recognition in scenarios with multiple subjects. These solutions can process between 42 and 188 simultaneous subjects at 25 inferences per second with an energy consumption ranging from 6.31 to 9.71 mJ per inference, depending on the device and the deployed model.
format Article
id doaj-art-9532b55777cf443cbca8a68fb0d15d88
institution OA Journals
issn 2045-2322
language English
publishDate 2025-06-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj-art-9532b55777cf443cbca8a68fb0d15d882025-08-20T02:05:48ZengNature PortfolioScientific Reports2045-23222025-06-0115111110.1038/s41598-025-02351-xReal-time multiple people gait recognition in the edgePaula Ruiz-Barroso0José María González-Linares1Francisco M. Castro2Nicolás Guil3Department of Computer Architecture, Institute for Mechatronics Engineering & Cyber-Physical Systems (IMECH.UMA), Universidad de MálagaDepartment of Computer Architecture, Institute for Mechatronics Engineering & Cyber-Physical Systems (IMECH.UMA), Universidad de MálagaDepartment of Computer Architecture, Institute for Mechatronics Engineering & Cyber-Physical Systems (IMECH.UMA), Universidad de MálagaDepartment of Computer Architecture, Institute for Mechatronics Engineering & Cyber-Physical Systems (IMECH.UMA), Universidad de MálagaAbstract Deploying deep learning models on edge devices offers advantages in terms of data security and communication latency. However, optimizing these models to achieve fast computing speeds without sacrificing accuracy can be challenging, especially in video surveillance applications where real-time processing is crucial. In this study, we investigate the deployment of gait recognition models as a multi-objective selection problem in which we seek to simultaneously minimize several objectives, such as latency and energy consumption, while maintaining accuracy. The decision space of a problem comprises all models that can be built by varying parameters, such as the size of the model, the operating frequency of the device, and the precision of the operations. From this problem definition, a subset of Pareto optimal models can be selected to be deployed on the target device. We conducted experiments with two different gait recognition models on NVIDIA Jetson Orin Nano and Jetson AGX Orin to explore their decision spaces. In addition, we investigated different strategies to increase the throughput of the deployed models by taking advantage of batching and concurrent execution. Together, these techniques allowed us to design real-time solutions for gait recognition in scenarios with multiple subjects. These solutions can process between 42 and 188 simultaneous subjects at 25 inferences per second with an energy consumption ranging from 6.31 to 9.71 mJ per inference, depending on the device and the deployed model.https://doi.org/10.1038/s41598-025-02351-x
spellingShingle Paula Ruiz-Barroso
José María González-Linares
Francisco M. Castro
Nicolás Guil
Real-time multiple people gait recognition in the edge
Scientific Reports
title Real-time multiple people gait recognition in the edge
title_full Real-time multiple people gait recognition in the edge
title_fullStr Real-time multiple people gait recognition in the edge
title_full_unstemmed Real-time multiple people gait recognition in the edge
title_short Real-time multiple people gait recognition in the edge
title_sort real time multiple people gait recognition in the edge
url https://doi.org/10.1038/s41598-025-02351-x
work_keys_str_mv AT paularuizbarroso realtimemultiplepeoplegaitrecognitionintheedge
AT josemariagonzalezlinares realtimemultiplepeoplegaitrecognitionintheedge
AT franciscomcastro realtimemultiplepeoplegaitrecognitionintheedge
AT nicolasguil realtimemultiplepeoplegaitrecognitionintheedge