Temporal Gap-Aware Attention Model for Temporal Action Proposal Generation
Temporal action proposal generation is a method for extracting temporal action instances or proposals from untrimmed videos. Existing methods often struggle to segment contiguous action proposals, which are a group of action boundaries with small temporal gaps. To address this limitation, we propose...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-11-01
|
| Series: | Journal of Imaging |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2313-433X/10/12/307 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846104229961269248 |
|---|---|
| author | Sorn Sooksatra Sitapa Watcharapinchai |
| author_facet | Sorn Sooksatra Sitapa Watcharapinchai |
| author_sort | Sorn Sooksatra |
| collection | DOAJ |
| description | Temporal action proposal generation is a method for extracting temporal action instances or proposals from untrimmed videos. Existing methods often struggle to segment contiguous action proposals, which are a group of action boundaries with small temporal gaps. To address this limitation, we propose incorporating an attention mechanism to weigh the importance of each proposal within a contiguous group. This mechanism leverages the gap displacement between proposals to calculate attention scores, enabling a more accurate localization of action boundaries. We evaluate our method against a state-of-the-art boundary-based baseline on ActivityNet v1.3 and Thumos 2014 datasets. The experimental results demonstrate that our approach significantly improves the performance of short-duration and contiguous action proposals, achieving an average recall of 78.22%. |
| format | Article |
| id | doaj-art-9f0594a2e6d843508dea3dce31c2e6c4 |
| institution | Kabale University |
| issn | 2313-433X |
| language | English |
| publishDate | 2024-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Journal of Imaging |
| spelling | doaj-art-9f0594a2e6d843508dea3dce31c2e6c42024-12-27T14:32:32ZengMDPI AGJournal of Imaging2313-433X2024-11-01101230710.3390/jimaging10120307Temporal Gap-Aware Attention Model for Temporal Action Proposal GenerationSorn Sooksatra0Sitapa Watcharapinchai1National Electronic and Computer Technology Center, National Science and Technology Development Agency, Khlong Nueng, Khlong Luang District, Pathum Thani 12120, ThailandNational Electronic and Computer Technology Center, National Science and Technology Development Agency, Khlong Nueng, Khlong Luang District, Pathum Thani 12120, ThailandTemporal action proposal generation is a method for extracting temporal action instances or proposals from untrimmed videos. Existing methods often struggle to segment contiguous action proposals, which are a group of action boundaries with small temporal gaps. To address this limitation, we propose incorporating an attention mechanism to weigh the importance of each proposal within a contiguous group. This mechanism leverages the gap displacement between proposals to calculate attention scores, enabling a more accurate localization of action boundaries. We evaluate our method against a state-of-the-art boundary-based baseline on ActivityNet v1.3 and Thumos 2014 datasets. The experimental results demonstrate that our approach significantly improves the performance of short-duration and contiguous action proposals, achieving an average recall of 78.22%.https://www.mdpi.com/2313-433X/10/12/307temporal action proposal generationattention mechanismcontiguous action proposal |
| spellingShingle | Sorn Sooksatra Sitapa Watcharapinchai Temporal Gap-Aware Attention Model for Temporal Action Proposal Generation Journal of Imaging temporal action proposal generation attention mechanism contiguous action proposal |
| title | Temporal Gap-Aware Attention Model for Temporal Action Proposal Generation |
| title_full | Temporal Gap-Aware Attention Model for Temporal Action Proposal Generation |
| title_fullStr | Temporal Gap-Aware Attention Model for Temporal Action Proposal Generation |
| title_full_unstemmed | Temporal Gap-Aware Attention Model for Temporal Action Proposal Generation |
| title_short | Temporal Gap-Aware Attention Model for Temporal Action Proposal Generation |
| title_sort | temporal gap aware attention model for temporal action proposal generation |
| topic | temporal action proposal generation attention mechanism contiguous action proposal |
| url | https://www.mdpi.com/2313-433X/10/12/307 |
| work_keys_str_mv | AT sornsooksatra temporalgapawareattentionmodelfortemporalactionproposalgeneration AT sitapawatcharapinchai temporalgapawareattentionmodelfortemporalactionproposalgeneration |