Abstract
A tremendous amount of video data is transferred over the Internet from one location to another, and its amount is growing exponentially every day. Significant advances made in multipurpose video editing software technology have considerably increased the chances of digital video tampering/forgeries. Therefore, the authenticity of digital video has become important. In this paper, the passive algorithm based on the correlation consistency between entropy coded (DistrEn2D and MSE2D) frames for video forgery detection is proposed. The entropy-based texture feature, such as two-dimensional distribution entropy (DistrEn2D) and bi-dimensional multiscale entropy (MSE2D), is used in the proposed algorithm. This algorithm works in four stages and can investigate the presence of multiple forgeries in the videos. The first stage is pre-processing. In step second, the texture feature is extracted from the video frames. After that, inter-frame correlation consistency between Entropy coded frames is investigated to detect multiple forgeries. In the final stage, multiple forgeries are localized in the video using an abnormal point detection. An experimental result shows that the proposed algorithm (using DistrEn2D and MSE2D feature) provides better performance in identifying the forgeries present in the video.
Similar content being viewed by others
Notes
ffmpeg software available online at https://www.ffmpeg.org/
References
Aghamaleki, J.A., Behrad, A.: Malicious inter-frame video tampering detection in mpeg videos using time and spatial domain analysis of quantization effects. Multimed. Tools Appl. 76(20), 20691–20717 (2017)
Azami, H., Escudero, J., Humeau-Heurtier, A.: Bidimensional distribution entropy to analyze the irregularity of small-sized textures. IEEE Signal Process. Lett. 24(9), 1338–1342 (2017)
Bakas, J., Naskar, R., Dixit, R.: Detection and localization of inter-frame video forgeries based on inconsistency in correlation distribution between haralick coded frames. Multimed. Tools Appl. 78(4), 4905–4935 (2019)
Chao, J., Jiang, X., Sun, T.: A novel video inter-frame forgery model detection scheme based on optical flow consistency. In: International Workshop on Digital Watermarking, Springer, pp 267–281 (2012)
Costa, M., Goldberger, A.L., Peng, C.K.: Multiscale entropy analysis of complex physiologic time series. Phys. Rev. Lett. 89(6), 068102 (2002)
D’Avino, D., Cozzolino, D., Poggi, G., Verdoliva, L.: Autoencoder with recurrent neural networks for video forgery detection. Electron. Imaging 7, 92–99 (2017)
Dong, Q., Yang, G., Zhu, N.: A MCEA based passive forensics scheme for detecting frame-based video tampering. Digit. Investig. 9(2), 151–159 (2012)
Fadl, S., Han, Q., Qiong, L.: Exposing video inter-frame forgery via histogram of oriented gradients and motion energy image. Multidimens. Syst. Signal Process. 31(4), 1365–1384 (2020)
Fadl, S.M., Han, Q., Li, Q.: Authentication of surveillance videos: detecting frame duplication based on residual frame. J. Forensic Sci. 63(4), 1099–1109 (2018)
Johnston, P., Elyan, E., Jayne, C.: Video tampering localisation using features learned from authentic content. Neural Comput. Appl. 32(16), 12243–12257 (2020)
Kharat, J., Chougule, S.: A passive blind forgery detection technique to identify frame duplication attack. Multimed. Tools Appl. 79, 8107–8123 (2020)
Liu, Y., Huang, T.: Exposing video inter-frame forgery by zernike opponent chromaticity moments and coarseness analysis. Multimed. Syst. 23(2), 223–238 (2017)
Qadir, G., Yahaya, S., Ho, ATS.: surrey university library for forensic analysis (sulfa) of video content. 1–6, http://sulfa.cs.surrey.ac.uk/ (2012)
REWIND: Datset. https://sites.google.com/site/rewindpolimi/downloads/datasets/video-copy-move-forgeries-dataset. Accessed 2 Dec 2020 (2013)
Shelke, N.A., Kasana, S.S.: A comprehensive survey on passive techniques for digital video forgery detection. Multimed. Tools Appl. 80, 6247–6310 (2021)
Silva, L.E., Duque, J.J., Felipe, J.C., Murta, L.O., Jr., Humeau-Heurtier, A.: Two-dimensional multiscale entropy analysis: applications to image texture evaluation. Signal Process. 147, 224–232 (2018)
Singh, R.D., Aggarwal, N.: Optical flow and prediction residual based hybrid forensic system for inter-frame tampering detection. J. Circuits Syst. Comput. 26(07), 1750107 (2017)
VTL Video trace library. http://trace.eas.asu.edu/. Accessed 24 Dec 2020
Wang, Q., Li, Z., Zhang, Z., Ma, Q.: Video inter-frame forgery identification based on consistency of correlation coefficients of gray values. J. Comput. Commun. 2(04), 51 (2014)
Wei, W., Fan, X., Song, H., Wang, H.: Video tamper detection based on multi-scale mutual information. Multimed. Tools Appl. 78(19), 27109–27126 (2019)
Wu, Y., Jiang, X., Sun, T., Wang, W.: Exposing video inter-frame forgery based on velocity field consistency. In: 2014 IEEE international conference on acoustics, speech and signal processing (ICASSP), IEEE, pp 2674–2678 (2014)
Xu, J., Liang, Y., Tian, X., Xie, A.: A novel video inter-frame forgery detection method based on histogram intersection. In: 2016 IEEE/CIC international conference on communications in China (ICCC), IEEE, pp 1–6 (2016)
Yang, J., Huang, T., Su, L.: Using similarity analysis to detect frame duplication forgery in videos. Multimed. Tools Appl. 75(4), 1793–1811 (2016)
Zampoglou, M., Markatopoulou, F., Mercier, G., Touska, D., Apostolidis, E., Papadopoulos, S., Cozien, R., Patras, I., Mezaris, V., Kompatsiaris, I.: Detecting tampered videos with multimedia forensics and deep learning. In: International Conference on Multimedia Modeling, Springer, pp 374–386 (2019)
Zhang, Z., Hou, J., Ma, Q., Li, Z.: Efficient video frame insertion and deletion detection based on inconsistency of correlations between local binary pattern coded frames. Secur. Commun. Netw. 8(2), 311–320 (2015)
Zhao, D.N., Wang, R.K., Lu, Z.M.: Inter-frame passive-blind forgery detection for video shot based on similarity analysis. Multimed. Tools Appl. 77(19), 25389–25408 (2018)
Zheng, L., Sun, T., Shi, YQ.: Inter-frame video forgery detection based on block-wise brightness variance descriptor. In: International Workshop on Digital Watermarking, Springer, pp 18–30 (2014)
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by T. Yao.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Shelke, N.A., Kasana, S.S. Multiple forgeries identification in digital video based on correlation consistency between entropy coded frames. Multimedia Systems 28, 267–280 (2022). https://doi.org/10.1007/s00530-021-00837-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-021-00837-y