Novel video anomaly detection method based on global-local self-attention network

In order to improve the accuracy of video anomaly detection, a novel video anomaly detection method based on global-local self-attention network was proposed.Firstly, the video sequence and the corresponding RGB sequence were fused to highlight the motion change of the object.Secondly, the temporal...

Full description

Saved in:
Bibliographic Details
Main Authors: Jing YANG, Chengmao WU, Liuping ZHOU
Format: Article
Language:zho
Published: Editorial Department of Journal on Communications 2023-08-01
Series:Tongxin xuebao
Subjects:
Online Access:http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023151/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841540073774907392
author Jing YANG
Chengmao WU
Liuping ZHOU
author_facet Jing YANG
Chengmao WU
Liuping ZHOU
author_sort Jing YANG
collection DOAJ
description In order to improve the accuracy of video anomaly detection, a novel video anomaly detection method based on global-local self-attention network was proposed.Firstly, the video sequence and the corresponding RGB sequence were fused to highlight the motion change of the object.Secondly, the temporal correlation of the video sequence in the local area was captured by the expansion convolution layer, along with the self-attention network was utilized to compute the global temporal dependencies of the video sequence.Meanwhile, by deepening the basic network U-Net and combining the relevant motion and representation constraints, the network model was trained end-to-end to improve the detection accuracy and robustness of the model.Finally, experiments were carried out on the public data sets UCSD Ped2, CUHK Avenue and ShanghaiTech, as well as the test results were visually analyzed.The experimental results show that the detection accuracy AUC of the proposed method reaches 97.4%, 86.8% and 73.2% respectively, which is obviously better than that of the compared methods.
format Article
id doaj-art-ceac619ffa7747baa3eb1b51511e2d8b
institution Kabale University
issn 1000-436X
language zho
publishDate 2023-08-01
publisher Editorial Department of Journal on Communications
record_format Article
series Tongxin xuebao
spelling doaj-art-ceac619ffa7747baa3eb1b51511e2d8b2025-01-14T06:22:53ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2023-08-014424125059386131Novel video anomaly detection method based on global-local self-attention networkJing YANGChengmao WULiuping ZHOUIn order to improve the accuracy of video anomaly detection, a novel video anomaly detection method based on global-local self-attention network was proposed.Firstly, the video sequence and the corresponding RGB sequence were fused to highlight the motion change of the object.Secondly, the temporal correlation of the video sequence in the local area was captured by the expansion convolution layer, along with the self-attention network was utilized to compute the global temporal dependencies of the video sequence.Meanwhile, by deepening the basic network U-Net and combining the relevant motion and representation constraints, the network model was trained end-to-end to improve the detection accuracy and robustness of the model.Finally, experiments were carried out on the public data sets UCSD Ped2, CUHK Avenue and ShanghaiTech, as well as the test results were visually analyzed.The experimental results show that the detection accuracy AUC of the proposed method reaches 97.4%, 86.8% and 73.2% respectively, which is obviously better than that of the compared methods.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023151/video anomaly detectionself-attentionpredictionreconstruction
spellingShingle Jing YANG
Chengmao WU
Liuping ZHOU
Novel video anomaly detection method based on global-local self-attention network
Tongxin xuebao
video anomaly detection
self-attention
prediction
reconstruction
title Novel video anomaly detection method based on global-local self-attention network
title_full Novel video anomaly detection method based on global-local self-attention network
title_fullStr Novel video anomaly detection method based on global-local self-attention network
title_full_unstemmed Novel video anomaly detection method based on global-local self-attention network
title_short Novel video anomaly detection method based on global-local self-attention network
title_sort novel video anomaly detection method based on global local self attention network
topic video anomaly detection
self-attention
prediction
reconstruction
url http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023151/
work_keys_str_mv AT jingyang novelvideoanomalydetectionmethodbasedongloballocalselfattentionnetwork
AT chengmaowu novelvideoanomalydetectionmethodbasedongloballocalselfattentionnetwork
AT liupingzhou novelvideoanomalydetectionmethodbasedongloballocalselfattentionnetwork