Integrated AI System for Real-Time Sports Broadcasting: Player Behavior, Game Event Recognition, and Generative AI Commentary in Basketball Games
This study presents an AI-based sports broadcasting system capable of real-time game analysis and automated commentary. The model first acquires essential background knowledge, including the court layout, game rules, team information, and player details. YOLO model-based segmentation is applied for...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-02-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/15/3/1543 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850200204922322944 |
|---|---|
| author | Sunghoon Jung Hanmoe Kim Hyunseo Park Ahyoung Choi |
| author_facet | Sunghoon Jung Hanmoe Kim Hyunseo Park Ahyoung Choi |
| author_sort | Sunghoon Jung |
| collection | DOAJ |
| description | This study presents an AI-based sports broadcasting system capable of real-time game analysis and automated commentary. The model first acquires essential background knowledge, including the court layout, game rules, team information, and player details. YOLO model-based segmentation is applied for a local camera view to enhance court recognition accuracy. Player’s actions and ball tracking is performed through YOLO algorithms. In each frame, the YOLO detection model is used to detect the bounding boxes of the players. Then, we proposed our tracking algorithm, which computed the IoU from previous frames and linked together to track the movement paths of the players. Player behavior is achieved via the R(2+1)D action recognition model including player actions such as running, dribbling, shooting, and blocking. The system demonstrates high performance, achieving an average accuracy of 97% in court calibration, 92.5% in player and object detection, and 85.04% in action recognition. Key game events are identified based on positional and action data, with broadcast lines generated using GPT APIs and converted to natural audio commentary via Text-to-Speech (TTS). This system offers a comprehensive framework for automating sports broadcasting with advanced AI techniques. |
| format | Article |
| id | doaj-art-129b22a9ee314bfc94c97993b047b19c |
| institution | OA Journals |
| issn | 2076-3417 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj-art-129b22a9ee314bfc94c97993b047b19c2025-08-20T02:12:24ZengMDPI AGApplied Sciences2076-34172025-02-01153154310.3390/app15031543Integrated AI System for Real-Time Sports Broadcasting: Player Behavior, Game Event Recognition, and Generative AI Commentary in Basketball GamesSunghoon Jung0Hanmoe Kim1Hyunseo Park2Ahyoung Choi3Department of AI and Software, Gachon University, Seongnam-si 13120, Republic of KoreaDepartment of AI and Software, Gachon University, Seongnam-si 13120, Republic of KoreaDepartment of AI and Software, Gachon University, Seongnam-si 13120, Republic of KoreaDepartment of AI and Software, Gachon University, Seongnam-si 13120, Republic of KoreaThis study presents an AI-based sports broadcasting system capable of real-time game analysis and automated commentary. The model first acquires essential background knowledge, including the court layout, game rules, team information, and player details. YOLO model-based segmentation is applied for a local camera view to enhance court recognition accuracy. Player’s actions and ball tracking is performed through YOLO algorithms. In each frame, the YOLO detection model is used to detect the bounding boxes of the players. Then, we proposed our tracking algorithm, which computed the IoU from previous frames and linked together to track the movement paths of the players. Player behavior is achieved via the R(2+1)D action recognition model including player actions such as running, dribbling, shooting, and blocking. The system demonstrates high performance, achieving an average accuracy of 97% in court calibration, 92.5% in player and object detection, and 85.04% in action recognition. Key game events are identified based on positional and action data, with broadcast lines generated using GPT APIs and converted to natural audio commentary via Text-to-Speech (TTS). This system offers a comprehensive framework for automating sports broadcasting with advanced AI techniques.https://www.mdpi.com/2076-3417/15/3/1543sports activity recognitioncourt segmentationcommentary generation |
| spellingShingle | Sunghoon Jung Hanmoe Kim Hyunseo Park Ahyoung Choi Integrated AI System for Real-Time Sports Broadcasting: Player Behavior, Game Event Recognition, and Generative AI Commentary in Basketball Games Applied Sciences sports activity recognition court segmentation commentary generation |
| title | Integrated AI System for Real-Time Sports Broadcasting: Player Behavior, Game Event Recognition, and Generative AI Commentary in Basketball Games |
| title_full | Integrated AI System for Real-Time Sports Broadcasting: Player Behavior, Game Event Recognition, and Generative AI Commentary in Basketball Games |
| title_fullStr | Integrated AI System for Real-Time Sports Broadcasting: Player Behavior, Game Event Recognition, and Generative AI Commentary in Basketball Games |
| title_full_unstemmed | Integrated AI System for Real-Time Sports Broadcasting: Player Behavior, Game Event Recognition, and Generative AI Commentary in Basketball Games |
| title_short | Integrated AI System for Real-Time Sports Broadcasting: Player Behavior, Game Event Recognition, and Generative AI Commentary in Basketball Games |
| title_sort | integrated ai system for real time sports broadcasting player behavior game event recognition and generative ai commentary in basketball games |
| topic | sports activity recognition court segmentation commentary generation |
| url | https://www.mdpi.com/2076-3417/15/3/1543 |
| work_keys_str_mv | AT sunghoonjung integratedaisystemforrealtimesportsbroadcastingplayerbehaviorgameeventrecognitionandgenerativeaicommentaryinbasketballgames AT hanmoekim integratedaisystemforrealtimesportsbroadcastingplayerbehaviorgameeventrecognitionandgenerativeaicommentaryinbasketballgames AT hyunseopark integratedaisystemforrealtimesportsbroadcastingplayerbehaviorgameeventrecognitionandgenerativeaicommentaryinbasketballgames AT ahyoungchoi integratedaisystemforrealtimesportsbroadcastingplayerbehaviorgameeventrecognitionandgenerativeaicommentaryinbasketballgames |