Transformer-Based Multi-Player Tracking and Skill Recognition Framework for Volleyball Analytics

Volleyball is a dynamic sport requiring high technical skills and tactical awareness, demanding effective training methods for performance improvement. Traditional training approaches often rely heavily on subjective analysis by coaches, leading to inconsistencies in skill development. The integrati...

Full description

Saved in:
Bibliographic Details
Main Authors: Lei Jiang, Zhihong Yang, Lei Gang
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10830493/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832592936581201920
author Lei Jiang
Zhihong Yang
Lei Gang
author_facet Lei Jiang
Zhihong Yang
Lei Gang
author_sort Lei Jiang
collection DOAJ
description Volleyball is a dynamic sport requiring high technical skills and tactical awareness, demanding effective training methods for performance improvement. Traditional training approaches often rely heavily on subjective analysis by coaches, leading to inconsistencies in skill development. The integration of advanced computing technologies has opened new avenues in sports analytics, enabling data-driven methods for performance monitoring and strategy development. Despite advancements in sports like baseball, soccer, and basketball, volleyball has not yet been thoroughly explored for computer-assisted analysis, particularly in player tracking and skill recognition. This study proposes a novel Volleyball Player Tracking and Skill Analytics (VPTSA) framework designed specifically for comprehensive volleyball match analysis. The framework integrates multi-player tracking and action recognition systems, leveraging YOLOv7 for player detection and a memory transformer to maintain spatiotemporal information for accurate tracking. Additionally, a transformer-based action recognition module identifies volleyball maneuvers, providing detailed analytics on player performance and behavior. The proposed methodology effectively overcomes challenges such as occlusions, similar appearances among players, and complex motion patterns, which are prevalent in high-intensity sports like volleyball. Results demonstrate that our model achieves superior performance, with an IDF1 score of 72.6, MOTA of 94.8, and HOTA of 73.7, outperforming state-of-the-art models such as TransTrack and ByteTrack on the SportsMOT dataset. In terms of action recognition, our Volleyball Skill Analytics Network (VSAN) model outperforms existing methods, achieving an individual action mAP of 85.5% and a group action mAP of 90.7% on the Volleyball dataset, demonstrating its efficacy in accurately identifying and classifying volleyball maneuvers.
format Article
id doaj-art-85a8a50951ce49d4bfe2dded4baf587e
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-85a8a50951ce49d4bfe2dded4baf587e2025-01-21T00:01:56ZengIEEEIEEE Access2169-35362025-01-01138806882410.1109/ACCESS.2025.352677510830493Transformer-Based Multi-Player Tracking and Skill Recognition Framework for Volleyball AnalyticsLei Jiang0https://orcid.org/0009-0009-8459-1058Zhihong Yang1Lei Gang2Sports, Central South University, Changsha, Hunan, ChinaSports, Central South University, Changsha, Hunan, ChinaSports, Central South University, Changsha, Hunan, ChinaVolleyball is a dynamic sport requiring high technical skills and tactical awareness, demanding effective training methods for performance improvement. Traditional training approaches often rely heavily on subjective analysis by coaches, leading to inconsistencies in skill development. The integration of advanced computing technologies has opened new avenues in sports analytics, enabling data-driven methods for performance monitoring and strategy development. Despite advancements in sports like baseball, soccer, and basketball, volleyball has not yet been thoroughly explored for computer-assisted analysis, particularly in player tracking and skill recognition. This study proposes a novel Volleyball Player Tracking and Skill Analytics (VPTSA) framework designed specifically for comprehensive volleyball match analysis. The framework integrates multi-player tracking and action recognition systems, leveraging YOLOv7 for player detection and a memory transformer to maintain spatiotemporal information for accurate tracking. Additionally, a transformer-based action recognition module identifies volleyball maneuvers, providing detailed analytics on player performance and behavior. The proposed methodology effectively overcomes challenges such as occlusions, similar appearances among players, and complex motion patterns, which are prevalent in high-intensity sports like volleyball. Results demonstrate that our model achieves superior performance, with an IDF1 score of 72.6, MOTA of 94.8, and HOTA of 73.7, outperforming state-of-the-art models such as TransTrack and ByteTrack on the SportsMOT dataset. In terms of action recognition, our Volleyball Skill Analytics Network (VSAN) model outperforms existing methods, achieving an individual action mAP of 85.5% and a group action mAP of 90.7% on the Volleyball dataset, demonstrating its efficacy in accurately identifying and classifying volleyball maneuvers.https://ieeexplore.ieee.org/document/10830493/Volleyballplayer trackingdeep learningtransformerrecognitionmulti-model
spellingShingle Lei Jiang
Zhihong Yang
Lei Gang
Transformer-Based Multi-Player Tracking and Skill Recognition Framework for Volleyball Analytics
IEEE Access
Volleyball
player tracking
deep learning
transformer
recognition
multi-model
title Transformer-Based Multi-Player Tracking and Skill Recognition Framework for Volleyball Analytics
title_full Transformer-Based Multi-Player Tracking and Skill Recognition Framework for Volleyball Analytics
title_fullStr Transformer-Based Multi-Player Tracking and Skill Recognition Framework for Volleyball Analytics
title_full_unstemmed Transformer-Based Multi-Player Tracking and Skill Recognition Framework for Volleyball Analytics
title_short Transformer-Based Multi-Player Tracking and Skill Recognition Framework for Volleyball Analytics
title_sort transformer based multi player tracking and skill recognition framework for volleyball analytics
topic Volleyball
player tracking
deep learning
transformer
recognition
multi-model
url https://ieeexplore.ieee.org/document/10830493/
work_keys_str_mv AT leijiang transformerbasedmultiplayertrackingandskillrecognitionframeworkforvolleyballanalytics
AT zhihongyang transformerbasedmultiplayertrackingandskillrecognitionframeworkforvolleyballanalytics
AT leigang transformerbasedmultiplayertrackingandskillrecognitionframeworkforvolleyballanalytics