Efficient FPGA implementation of corrected reversible contrast mapping algorithm for video watermarking

https://doi.org/10.1016/j.micpro.2020.103092Get rights and content

Abstract

This paper analyses and rectifies the shortcomings of reversible contrast mapping (RCM) algorithm for invisible watermarking. The proposed corrected RCM algorithm is tested by taking a gray scaled video input. The quality of services and structural similarity index matrix (SSIM) of each frame of the input video are tested in software environment. The video is obtained by OV7670 camera through Zed-board in fully field programmable gate array (FPGA) based hardware environment. FPGA devices based corrected high level synthesis of the proposed algorithm is presented. The suggested system engages pipeline structure and practices parallelism to achieve high performance. The quality of services and SSIM are also tested using FPGA devices and the comparative results with software implementations are explained. To process thirty (640 × 480) image blocks with 150 MHz clock we obtain a latency of 876.626 ns with throughput 62.328 Mbps. The critical path for single cycle is 5.992 ns. The number of resources essential is similar for watermark decoding with an improved schedule. The results acquired after implementation on Xilinx Virtex 7-XC7V2000T and programmable system-on-chip (Zynq - XC7Z030) FPGA devices confirm the practicability of real-time use with low cost and great speed.

Introduction

Nowadays to stay away from unproven use of digital multimedia information and to verify the genuineness, digital watermarking is mostly used [1,2]. Digital watermarking can be classified depending on the types of input informations being used like image, text, video watermarking etc. It can further be classified based on the basic characteristics and properties of the applications like robustness, data payload, fidelity and other limitations [3]. The patterns of bits or digital informations like digital signature, finger print that are embedded into the original or input multimedia data are called watermarks. If the watermark is visible after embedding it is called visible watermarking otherwise it is known as invisible watermarking [4,5]. VLSI implementations for both invisible and visible digital watermarking using complementary metal oxide semiconductor (CMOS) technology had been proposed [6], [7], [8]. Later a still digital camera is used to present the VLSI implementation of visible watermarking using 0.35 μm based CMOS technology [9]. To reduce space required for hardware implementation, the discrete cosine transform (DCT) with dual frequencies and voltages had been taken into consideration to present VLSI architecture for both visible and invisible image watermarking [10], [11], [12]. Digital watermarking is not a lossless data embedding method. It is used when extraction of the watermark is not required by third party or the receiver. To recover back the multimedia data without any loss, the third party requires the watermark or some additional information. In some digital watermarking algorithms, without having any additional information the watermark may be extracted back but it causes harm to the cover data. Clearly some information about the cover data is lost during data extraction. Moreover for some applications like medical imaging and military data, small imperceptible distortion due to watermarking process is not acceptable. To overcome the drawbacks of digital watermarking, reversible watermarking (RW) algorithm is used to eliminate the alteration and recover both the data and the watermark [13], [14], [15], [16], [17], [18], [19], [20]. Recently RW has become popular in tele-surgery, remote based patient monitoring and military domain. RW provides high imperceptibility and secured communication in image processing based applications. There are many different types of methods used for RW algorithms [21], [22], [23], [24], [25], [26], [27], [28], [29], [30], [31], [32], [33], [34], [35], [36], [37]. Some popular methods of RW are difference expansion (DE) [15,[17], [18], [19],33,34], histogram bin shifting [35], [36], [37], RCM [13,14,16] and prediction error expansion (PEE) [22,29,30,32]. The histogram bin shifting and its modified version are used to increase the authenticity but they suffer from low embedding capacity. To improve the overall performance of RW, PEE is most acceptable choice but it suffers from large payload size to embed prediction error information which increases distortion. Both DE and RCM are spatial domain type algorithms where a linear transformation is used to realize the reversibility. In DE algorithm, the linear transformation is applied only on the pixel intensity values that cause the need of location map control mechanism. In other hands to reduce the arithmetic complexity, the linear transformation in RCM algorithm is applied on pixel intensity values as well as the pair of pixel locations. In this way under a low mathematical complexity RCM provides higher embedding bit rate than DE in single iteration. That makes the RCM most attractive algorithm for RW particularly for real-time implementation.

RCM method [14] for video watermarking is utilized in this work. Based on the mathematical analysis, it is found that there are shortcomings in the embedding algorithm. The invertible property of the algorithm is not satisfied at all cases followed by different conditions that are explained in section 3. After correcting the shortcomings we have provided the rectified algorithm. Very low mathematical complexity along with high data embedding can make the method most consequent use in research. The basic concept of RCM algorithm is discussed in other studies [13], [14], [15], [16]. In this paper, we have focused to explore and implement high speed VLSI architecture by following the reward of RCM based watermarking technique by taking a video input signal. Foremost attention is given on developing a less hardware resources based architecture. For this purpose, hardware implementations of digital watermarking for different types of multimedia data are considered [38], [39], [40], [41], [42], [43], [44], [45], [46], [47], [48], [49], [50].

Literature witnesses FPGA based hardware implementations for RCM method [41,42,48]. A 6 stage pipeline is required for VLSI architecture of RW [41]. It requires high numbers of resources which reduces the speed. A modified RCM method [42] is proposed by increasing the contrast value to 5 from 3. The embedding capacity will reduce drastically for these modifications due to larger bit stream of location map. Also to embed the larger bit stream, more numbers of pipeline cycles are required. In the proposed work the same steps are followed for corrected RCM method based video RW and in addition to reduce number of pipeline cycles and hardware resources, the high level synthesis approach based controller design [49] is used. In our previous work [49], the high level synthesis (HLS) approach is proposed for DE based RW. This work uses the HLS approach to present the controller followed by suitable pipeline structure and practices parallelism for corrected RCM method.

The corrected architecture has been presented and verified using VIVADO HLS tool. The key objective of the present work is to reduce the complexity without harming the performance. Video processing using FPGA is always challenging and complicated. To overcome the complexity and provide a simple way for VLSI implementation of image processing algorithms on FPGA environment, the VIVADO based HLS tool is most preferred choice to process a continuous signal like video [51,52]. The RCM method is implemented using VHDL and synthesized into FPGA environment. The video is obtained by OV7670 camera through Zed-Board in Zynq system-on-chip (SoC) platform.

Section snippets

Reversible contrast mapping algorithm

The RCM algorithm [14] gives a pair of integer transformation function as,x=2xyandy=2yx

The inverse functions are given as:x=23×x+13×yandy=23×y+13×xwhere ⌈x⌉ represents the ceil function. A boundary condition is applied to prevent underflow and overflow which is given by,02xyL,02yxL

The boundary condition can be represented by a sub-domain DC. Transformation is restricted to the sub-domain Dc⊂[0, L] × [0, L]. Here [0, L]is the image gray-level range. L is 255 for eight-bit

Mathematical analysis of reversible contrast mapping algorithm

If the LSBs of x′and y′are not changed, Eq. (2) exactly inverts Eq. (1). The odd pixel pairs are avoided for data embedding as the recoverability is very less. If LSB of both x′ and y′ is set to ‘0′, x and y can be recovered by Eq. (2) when x′ and y′are odd integers [14]. But this shows discrepancy. It can be verified by taking a simple example. There are four conditions shown in Table 1. Each condition has four cases as shown in Table 2. It is noted that x′ and y′are odd integer numbers when x

Proposed RCM algorithm

The embedding and decoding algorithms of the proposed corrected RCM method are given in algorithm 1 and 2 as represented in Tables 3 and 4 respectively. In this case the step 5b is performed when the pair (x, y) does not belong to odd pixel values. The step 5a is applied when the pair (x, y) belongs to odd pixel values.

VLSI architecture of the proposed RCM algorithm

The implementation of the corrected RCM algorithm is designed using VIVADO design suite Xilinx for Virtex 7 - XC7V2000T and programmable SoC (Zynq - XC7Z030) based FPGA family. The VLSI architecture of the proposed algorithm has two major blocks. They are encoder and decoder blocks. Each block has three sub-blocks. They are Module 1, Module 2 and Module 3. Now the Eqs. (1) and (2) can be written as,Atransform=2×AB,Btransform=2×BAA=13×(2×Atransform+Btransform)B=13×(2×Btransform+Atransform)

Software implementation

The corrected RCM is tested and verified in both software and hardware environments. The algorithm is implemented using MATLAB for 50 numbers of gray scale images, videos as the input test data. The proposed algorithm can be applicable to any size of test images. The algorithm is applied into one component of color video signal at a time with a modification in boundary conditions. A video having thirty frames is taken as the input original video. The first five original video frames (640 × 480)

Conclusion

This paper analyzed a new reversible video watermarking process using corrected RCM algorithm. The algorithm is first verified and shortcomings are mathematically discussed. The shortcomings are solved and the corrected algorithm is briefly explained. The corrected VLSI architecture with efficient pipeline structure using HLS approach of the improved algorithm for a gray-scale video signal is presented. The average PSNR and SSIM of 30 frames based gray-scale video signal are 38.44 dB and 0.9647

Declaration of Competing Interest

None

Subhajit Das received B. Tech. degree in electronics & communication engineering from Mizoram University (A Central University), Aizawl, India and M. Tech. degree in embedded system from Sambalpur University, Sambalpur, India in 2013 and 2015 respectively. Currently he is doing research leading to Ph.D. degree in the department of electronics and instrumentation engineering, National Institute of Technology, Silchar, India. His research interests include VLSI design and SoC implememtation.

References (52)

  • S.P. Mohanty et al.

    VLSI implementation of invisible digital watermarking algorithms towards the development of a secure JPEG encoder

    Proc. IEEE Workshop Signal Process. Syst.

    (2003)
  • S.P. Mohanty et al.

    FPGA based implementation of an invisible-robust image watermarking encoder

    Lect. Notes Comput. Sci.

    (2004)
  • S.P. Mohanty et al.

    VLSI implementation of visible watermarking for a secure digital still camera design

    Proc. 17th Int. Conf. VLSI Des.

    (2004)
  • S.P. Mohanty et al.

    A VLSI architecture for visible watermarking in a secure still digital camera (S2DC) design

    IEEE Trans. VLSI Syst.

    (2005)
  • S.P. Mohanty et al.

    A dual voltage frequency VLSI chip for image watermarking in DCT domain

    IEEE Trans. Circuits Syst. II

    (2006)
  • S.P. Mohanty et al.

    VLSI architecture and chip for combined invisible robust and fragile watermarking

    IET Comput. Digit. Tech.

    (2007)
  • D. Coltuc et al.

    Simple reversible watermarking schemes: further results

    Proc. SPIE Secur. Steganogr. Watermark. Multimed. Contents VIII

    (2006)
  • D. Coltuc et al.

    Very fast watermarking by reversible contrast mapping

    IEEE Signal Process. Lett.

    (2007)
  • D. Coltuc et al.

    Multibit versus multilevel embedding in high capacity difference expansion reversible watermarking

    Proc. 20th European Signal Process. Conf.

    (2012)
  • D. Coltuc

    Low distortion transform for reversible watermarking

    IEEE Trans. Image Process.

    (2012)
  • C. Dragoi et al.

    Improved rhombus interpolation for reversible watermarking by difference expansion

    Proc. 20th European Signal Process. Conf.

    (2012)
  • M. Alattar

    Reversible watermark using difference expansion of triplet

    IEEE Proc. Int. Conf. Image Process.

    (2003)
  • M. Alattar

    Reversible watermark using the difference expansion of a generalized integer transform

    IEEE Trans. Image Process.

    (2004)
  • M. Alattar

    Reversible watermark using difference expansion of quads

    IEEE Proc. Int. Conf. Acoust. Speech Signal Process.

    (2004)
  • M. Celik et al.

    Lossless generalized-lsb data embedding

    IEEE Trans. Image Process.

    (2005)
  • M. Ishtiaq et al.

    Hybrid predictor based four-phase adaptive reversible watermarking

    IEEE Access

    (2018)
  • Cited by (11)

    • FPGA implementation of high-fidelity hybrid reversible watermarking algorithm

      2022, Microprocessors and Microsystems
      Citation Excerpt :

      Besides, it can control distortion adaptively. In our previous work [24, 25], based on well-known parameters for RW like distortion, embedding bit rate, payload size, and data hiding capacity, an efficient embedding bit rate control based contrast mapping algorithm is presented. An adaptive linear contrast mapping on pixel intensity value is asserted with RCM based forward transform that controls the embedding bit rate without changing the embedding capacity to maintain distortion.

    • Efficient FPGA implementation and verification of difference expansion based reversible watermarking with improved time and resource utilization

      2021, Microprocessors and Microsystems
      Citation Excerpt :

      This approach with resource constraint design makes the architecture novel that needs only single adder, subtractor, multiplier, and divider along with some registers and multiplexers for embedding. This approach is also applied for hardware implementation of corrected reversible contrast mapping based RW to reduce the number of resources and possible delays [37-39]. It is found that most of the hardware resources are required for storing and reading the image data.

    • Swimming target detection and tracking technology in video image processing

      2021, Microprocessors and Microsystems
      Citation Excerpt :

      Some of his works deal with the recovery of the scene and get color scenes in bad weather contrast. Deburring applications [22] interpretation estimated prediction image degradation atmospheric weather modulation transfer function and distance. Returning to the development of the field of computer appearance of the platform, researchers should focus more on video-based discovery of moving objects.

    • High-Speed FPGA-Based Video Watermarking Using LSB Technique in the Spatial Domain

      2024, International Journal of Intelligent Systems and Applications in Engineering
    View all citing articles on Scopus

    Subhajit Das received B. Tech. degree in electronics & communication engineering from Mizoram University (A Central University), Aizawl, India and M. Tech. degree in embedded system from Sambalpur University, Sambalpur, India in 2013 and 2015 respectively. Currently he is doing research leading to Ph.D. degree in the department of electronics and instrumentation engineering, National Institute of Technology, Silchar, India. His research interests include VLSI design and SoC implememtation.

    Arun Kumar Sunaniya received M. Tech. in microelectronics and VLSI design from SGSITS, Indore, India and Ph.D. degree in VLSI design from Maulana Azad National Institute of Technology, Bhopal, India. Dr. Sunaniya, from 2012–2014, was an Associate Professor in Corporate Institute of Science & Technology, Bhopal, India. Since 2014, he is an Assistant Professor in National Institute of Technology, Silchar, India. He is the author of more than 30 archival refereed publications. His research interests include low power VLSI, hybrid and CMOS devices.

    Reshmi Maity received the B. Tech. and M. Tech. degree in radio physics and electronics from University of Calcutta, India, in 2004 and 2006 respectively. She has completed her Ph. D. degree in electronics and communication engineering from National Institute of Technology, Silchar, India, in 2016. Dr. Maity, from 2004–2008, was an Assistant Professor in JIS College of Engineering at Kolkata and an Assistant Professor in Mizoram University at Aizawl, India. Since 2018, she is an Associate Professor in the department of electronics and communication engineering, Mizoram University, India. She is the author of more than 100 archival refereed publications. Her research interests include nanoelectronics and MEMS.

    Niladri Pratap Maity received the M. Tech. degree in electronics design and technology from Tezpur University, India, in 2004 and the Ph.D. degree in electronics and communication engineering from National Institute of Technology, Silchar, India, in 2015. Since 2017, he is an Associate Professor in the department of electronics and communication engineering, Mizoram University, India. Currently he is the Head of the department of electronics & communication engineering and Coordinator of the advanced VLSI laboratory (funded by INTEL). He is the author of more than 100 articles. His research interests include MOS device modeling, VLSI Design and MEMS.

    View full text