Two–Stage Detection and Localization of Inter–Frame Tampering in Surveillance Videos Using Texture and Optical Flow
Surveillance cameras provide security and protection through real-time monitoring or through the investigation of recorded videos. The authenticity of surveillance videos cannot be taken for granted, but tampering detection is challenging. Existing techniques face significant limitations, including...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-11-01
|
| Series: | Mathematics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-7390/12/22/3482 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850068403992133632 |
|---|---|
| author | Naheed Akhtar Muhammad Hussain Zulfiqar Habib |
| author_facet | Naheed Akhtar Muhammad Hussain Zulfiqar Habib |
| author_sort | Naheed Akhtar |
| collection | DOAJ |
| description | Surveillance cameras provide security and protection through real-time monitoring or through the investigation of recorded videos. The authenticity of surveillance videos cannot be taken for granted, but tampering detection is challenging. Existing techniques face significant limitations, including restricted applicability, poor generalizability, and high computational complexity. This paper presents a robust detection system to meet the challenges of frame duplication (FD) and frame insertion (FI) detection in surveillance videos. The system leverages the alterations in texture patterns and optical flow between consecutive frames and works in two stages; first, suspicious tampered videos are detected using motion residual–based local binary patterns (MR–LBPs) and SVM; second, by eliminating false positives, the precise tampering location is determined using the consistency in the aggregation of optical flow and the variance in MR–LBPs. The system is extensively evaluated on a large COMSATS Structured Video Tampering Evaluation Dataset (CSVTED) comprising challenging videos with varying quality of tampering and complexity levels and cross–validated on benchmark public domain datasets. The system exhibits outstanding performance, achieving 99.5% accuracy in detecting and pinpointing tampered regions. It ensures the generalization and wide applicability of the system while maintaining computational efficiency. |
| format | Article |
| id | doaj-art-bb2d0ed8ed7b4d7e927f9c30ab2bf841 |
| institution | DOAJ |
| issn | 2227-7390 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Mathematics |
| spelling | doaj-art-bb2d0ed8ed7b4d7e927f9c30ab2bf8412025-08-20T02:48:05ZengMDPI AGMathematics2227-73902024-11-011222348210.3390/math12223482Two–Stage Detection and Localization of Inter–Frame Tampering in Surveillance Videos Using Texture and Optical FlowNaheed Akhtar0Muhammad Hussain1Zulfiqar Habib2Department of Computer Science, University of Education, Lahore 54510, PakistanDepartment of Computer Science, King Saud University, Riyadh 11543, Saudi ArabiaDepartment of Computer Science, COMSATS University Islamabad, Lahore Campus, Islamabad 45550, PakistanSurveillance cameras provide security and protection through real-time monitoring or through the investigation of recorded videos. The authenticity of surveillance videos cannot be taken for granted, but tampering detection is challenging. Existing techniques face significant limitations, including restricted applicability, poor generalizability, and high computational complexity. This paper presents a robust detection system to meet the challenges of frame duplication (FD) and frame insertion (FI) detection in surveillance videos. The system leverages the alterations in texture patterns and optical flow between consecutive frames and works in two stages; first, suspicious tampered videos are detected using motion residual–based local binary patterns (MR–LBPs) and SVM; second, by eliminating false positives, the precise tampering location is determined using the consistency in the aggregation of optical flow and the variance in MR–LBPs. The system is extensively evaluated on a large COMSATS Structured Video Tampering Evaluation Dataset (CSVTED) comprising challenging videos with varying quality of tampering and complexity levels and cross–validated on benchmark public domain datasets. The system exhibits outstanding performance, achieving 99.5% accuracy in detecting and pinpointing tampered regions. It ensures the generalization and wide applicability of the system while maintaining computational efficiency.https://www.mdpi.com/2227-7390/12/22/3482inter–frame tamperingmotion residuallocal binary patternoptical flowframe duplication detectionframe insertion detection |
| spellingShingle | Naheed Akhtar Muhammad Hussain Zulfiqar Habib Two–Stage Detection and Localization of Inter–Frame Tampering in Surveillance Videos Using Texture and Optical Flow Mathematics inter–frame tampering motion residual local binary pattern optical flow frame duplication detection frame insertion detection |
| title | Two–Stage Detection and Localization of Inter–Frame Tampering in Surveillance Videos Using Texture and Optical Flow |
| title_full | Two–Stage Detection and Localization of Inter–Frame Tampering in Surveillance Videos Using Texture and Optical Flow |
| title_fullStr | Two–Stage Detection and Localization of Inter–Frame Tampering in Surveillance Videos Using Texture and Optical Flow |
| title_full_unstemmed | Two–Stage Detection and Localization of Inter–Frame Tampering in Surveillance Videos Using Texture and Optical Flow |
| title_short | Two–Stage Detection and Localization of Inter–Frame Tampering in Surveillance Videos Using Texture and Optical Flow |
| title_sort | two stage detection and localization of inter frame tampering in surveillance videos using texture and optical flow |
| topic | inter–frame tampering motion residual local binary pattern optical flow frame duplication detection frame insertion detection |
| url | https://www.mdpi.com/2227-7390/12/22/3482 |
| work_keys_str_mv | AT naheedakhtar twostagedetectionandlocalizationofinterframetamperinginsurveillancevideosusingtextureandopticalflow AT muhammadhussain twostagedetectionandlocalizationofinterframetamperinginsurveillancevideosusingtextureandopticalflow AT zulfiqarhabib twostagedetectionandlocalizationofinterframetamperinginsurveillancevideosusingtextureandopticalflow |