Existing texture filtering techniques acquiesce in the removal of all undesired background texture patterns simultaneously, and lead to the disappearance of small-scale foreground structures. Differently, this paper considers both multi-scale structures and specified texture patterns within an image as significant image contents, and presents a content-aware texture filtering approach via an easy-to-use

We present a new video compression framework (ViSTRA2) which exploits adaptation of spatial resolution and effective bit depth, down-sampling these parameters at the encoder based on perceptual criteria, and up-sampling at the decoder using a deep convolution neural network. ViSTRA2 has been integrated with the reference software of both the HEVC (HM 16.20) and VVC (VTM 4.0.1), and evaluated under

An array of existing active contour models is prone to suffering from the deficiencies of poor anti-noise ability, initialization sensitivity, and slow convergence. In order to handle these problems, a robust hybrid active contour method based on bias correction is proposed in this research paper The energy functional is formulated through incorporating the adaptive edge indicator function and level

Light Field (LF) image angular super-resolution aims to synthesize a high angular resolution LF image from a low angular resolution one, and is drawing increased attention because of its wide applications. In order to reconstruct a high angular resolution LF image, many learning based LF image angular super-resolution methods have been proposed. However, most existing methods are based on LF Epipolar

Digital imagery and video can have content at higher resolutions than can be projected by most data projectors, which has led to a variety of techniques to improve the high-resolution perception from lower-resolution displays. However, the downsampling procedures frequently used to fit an original image or video of high-resolution into a lower-resolution projector cause a frustrating loss of fine structures

Living in the age of data explosion, the research of solutions for efficient long term storage of the infrequently used ”cold” data is becoming of great interest. However, even if existing storage systems suggest efficiency in capacity, they are lacking in durability. Hard disks, flash, tape or even optical storage have limited lifespan in the range of 5 to 20 years. Interestingly, recent studies have

The development of consumer depth cameras makes it possible to acquire depth information of a scene in real-time. However, low resolution and low quality of a depth map has greatly constrained its applications. In this paper, we propose a novel framework for single depth map super-resolution, which considers local and non-local information jointly in the depth map. For the non-local constraint, group-based

For real-world simulation, terrain models must combine various types of information on material and texture in terrain reconstruction for the three-dimensional numerical simulation of terrain. However, the construction of such models using the conventional method often involves high costs in both manpower and time. Therefore, this study used a convolutional neural network (CNN) architecture to classify

The paper presents a new algorithm for the image inpainting problem. The algorithm uses a recently designed versatile library of quasi-analytic complex-valued wavelet packets (qWPs) which originate from polynomial splines of arbitrary orders. Tensor products of 1D qWPs provide a diversity of 2D qWPs oriented in multiple directions. For example, a set of the fourth-level qWPs comprises 62 different

Learning robust representations is critical for the success of person re-identification and attribute recognition systems. However, to achieve this, we must use a large dataset of diverse person images as well as annotations of identity labels and/or a set of different attributes. Apart from the obvious concerns about privacy issues, the manual annotation process is both time consuming and too costly

In comparison with the generation of monoscopic images, the time cost of rendering stereoscopic images is doubled. When generating stereoscopic images by computer algorithms, it is desirable to save the computational expense by decreasing the image resolution, without degrading the visual perceptual quality of the images. In this work, to evaluate the perceptual visual quality of computer-generated

Sparse models and their variants have been extensively investigated, and have achieved great success in image denoising. Compared with recently proposed deep-learning-based methods, sparse models have several advantages: (1) Sparse models do not require a large number of pairs of noisy images and the corresponding clean images for training. (2) The performance of sparse models is less reliant on the

The goal of Visual Question Answering (VQA) is to answer questions about images. For the same picture, there are often completely different types of questions. Therefore, the main difficulty of VQA task lies in how to properly reason relationships among multiple visual objects according to types of input questions. To solve this difficulty, this paper proposes a deep neural network to perform multi-modal

Lossy compression for Experimental Holograms (EH) and Computer-Generated Holograms (CGH) using standardized coding solutions is a highly efficient process provided that these solutions can be applied to the object plane. This compression efficiency reveals to be more relevant in CGH. Speckle noise mainly affects reconstructed EH, and to less extent reconstructed CGH. In the current work, the reduction

Blind image quality assessment (BIQA) aims to design a model that can accurately evaluate the quality of the distorted image without any information about its reference image. Previous studies have shown that gradients and textures of image is widely used in image quality evaluation tasks. However, few studies used the joint statistics of gradient and texture information to evaluate image quality.

Versatile video coding is a new video coding standard that has more capabilities and higher coding efficiency compared with its predecessor. Practical video storage and transmission applications face constrained buffer size and available bandwidth. It is necessary to design the appropriate rate control algorithm to overcome such challenges. In this paper, the non-linear relationship between consumed

The enhanced local maximum intensity prior is proposed in this paper. We find that the intermediate latent image restoration can be enhanced by joining the local maximum intensity with the local maximum gradient, and the quality of the recovered kernel is hereby improved. Our method is based on the fact that the maximum value of local patch pixels and gradients will decrease with the blurring process

The mathematical characterization of the texture component plays an instrumental role in image decomposition. In this paper, we are concerned with a low-rank texture prior based cartoon–texture image decomposition model, which utilizes a total variation norm and a global nuclear norm to characterize the cartoon and texture components, respectively. It is promising that our decomposition model is not

It is known that optical flow estimation techniques suffer from the issues of ill-defined edges and boundaries of the moving objects. Traditional variational methods for optical flow estimation are not robust to handle these issues since the local filters in these methods do not hold the robustness near the edges. In this paper, we propose a non-local total variation NLTV-L1 optical flow estimation

Highly discriminative feature expression for non-rigid shape recognition is an important and challenging task, which requires both abstract and robust shape descriptors. However, the majority of existing low-level descriptors are designed via hand-crafted, which are sensitive to local changes and larger deformation. To address this issue, this paper proposes a bag of shape descriptor based on unsupervised

To save bandwidth and storage space as well as speed up data transmission, people usually perform lossy compression on images. Although the JPEG standard is a simple and effective compression method, it usually introduces various visually unpleasing artifacts, especially the notorious blocking artifacts. In recent years, deep convolutional neural networks (CNNs) have seen remarkable development in

Underwater image enhancement has attracted much attention due to the rise of marine resource development in recent years. Benefit from the powerful representation capabilities of Convolution Neural Networks(CNNs), multiple underwater image enhancement algorithms based on CNNs have been proposed in the past few years. However, almost all of these algorithms employ RGB color space setting, which is insensitive

Multi-Focus Image Fusion (MFIF) is a promising image enhancement technique to generate all-in-focus images meeting visual needs, and it is a precondition for other computer vision tasks. One emergent research trend in MFIF involves approaches to avoiding a defocus spread effect (DSE) around a focus/defocus boundary (FDB). This study proposes a generative adversarial network for MFIF tasks called MFIF-GAN

A fast and accurate assessment of visual masking effects is desirable while encoding in order to utilize such effects to improve the quality of compressed videos through an adaptive quantization (AQ) scheme. Here, we propose a method of estimating the contrast masking threshold on natural scene patches, using texture cues imparted by steerable filter responses. We then employ the estimated thresholds

Camera-based transmission line detection (TLD) is a fundamental and crucial task for automatically patrolling powerlines by aircraft. Motivated by instance segmentation, a TLD algorithm is proposed in this paper with a novel deep neural network, i.e., CableNet. The network structure is designed based on fully convolutional networks (FCNs) with two major improvements, considering the specific appearance

In spite of the fact that convolutional neural network-based stereo matching models have shown good performance in both accuracy and robustness, the issue of image feature loss in regions of texture-less, complex scenes and occlusions remains. In this paper, we present a dense convolutional neural network-based stereo matching method with multiscale feature connection, named Dense-CNN. First, we construct

With the rapid development of Internet technology, the copyright protection of color images has become more and more important. In order to fulfill this purpose, this paper designs a blind color digital image watermarking method based on image correction and eigenvalue decomposition (EVD). Firstly, all the eigenvalues of the pixel block in the color host image are obtained by EVD. Then, the sum of

This paper proposes an intrinsic decomposition method from a single RGB-D image. To remedy the highly ill-conditioned problem, the reflectance component is regularized by a sparsity term, which is weighted by a bilateral kernel to exploit non-local structural correlation. As shading images are piece-wise smooth and have sparse gradient fields, the sparse-induced ℓ1-norm is used to regularize the finite

Detecting objects and estimating their 6D poses from a single RGB image is quite challenging under severe occlusions. Recently, vector-field based methods have shown certain robustness to occlusion and truncation. Based on the vector-field representation, applying voting strategy to localize 2D keypoints can further reduce the influence of outliers. To improve the effectiveness of vector-field based

To facilitate the diversity of network and end-user devices, bit allocation technology must be combined with scalable high efficiency video coding (SHVC) to achieve continuous bitrate variation. However, to date, the multilayer coding feature in SHVC has not been fully utilized. In this paper, a bit allocation algorithm is proposed for the enhancement layer in SHVC. The algorithm includes two parts:

Recognizing human interactions in still images is quite a challenging task since compared to videos, there is only a glimpse of interaction in a single image. This work investigates the role of human poses in recognizing human–human interactions in still images. To this end, a multi-stream convolutional neural network architecture is proposed, which fuses different levels of human pose information

Many image completion methods are based on a low-rank approximation of the underlying image using matrix or tensor decomposition models. In this study, we assume that the image to be completed is represented by a multi-way array and can be approximated by a conical hull of subtensors in the observation space. If an observed tensor is near-separable along at least one mode, the extreme rays, represented

In this paper, a high-capacity reversible data hiding (RDH) scheme for encrypted images with separability is proposed. The image is first divided into non-overlapping blocks, and each block is encrypted with the same random value. The advantage is that the correlation between adjacent pixels can be preserved. Utilizing the preserved correlation, the prediction difference in encrypted domain is exactly

Guided image filtering (GIF) based cost aggregation or disparity refinement stereo matching algorithms are studied extensively owing to the edge-aware preserved smoothing property. However, GIF suffers from halo artifacts in sharp edges and shows high computational costs on high-resolution images. The performance of GIF in stereo matching would be limited by the above two defects. To solve these problems

Underwater image enhancement algorithms have attracted much attention in underwater vision task. However, these algorithms are mainly evaluated on different datasets and metrics. In this paper, we utilize an effective and public underwater benchmark dataset including diverse underwater degradation scenes to enlarge the test scale and propose a fusion adversarial network for enhancing real underwater

Fully convolutional Siamese network (SiamFC) has demonstrated high performance in the visual tracking field, but the learned CNN features are redundant and not discriminative to separate the object from the background. To address the above problem, this paper proposes a dual attention module that is integrated into the Siamese network to select the features both in the spatial and channel domains.

There has been great interest in image forensics in recent years. However, most of the existing research focuses on detecting a certain tampering operation, which means that the introduced features usually depend on the investigated operation and only binary classification is considered. Given the case where the image tampering process involves diverse processing operations, we propose a decision fusion

Thanks to its flexible coding structure, high-efficiency video coding (HEVC) can save more coding bit rates than the previous standard, H.264. However, it also increases the complexity of integer-pixel motion estimation (IME). To speed up the encoding process, we propose a parallel spiral search (PSS) algorithm, which features the following characteristics and advantages. First, the proposed algorithm

This work proposes an efficient example-based photorealistic style transfer algorithm for video. Given a source unprocessed video and a reference image color graded by an artist, we describe an automatic algorithm to transfer the visual style of the reference onto the source footage. Our approach builds upon the color transfer methods based on the statistical properties of images. These methods are

Blind authentication is one of the challenging techniques which has attracted considerable attention with the increasing security hacks on digital images. This paper evaluates different models based on feature extraction to detect digitally-altered images. Various feature-extraction methods have been investigated and compared including LBP, MSLBP, CSLBP, SLBP, WLD, LPQ, MSLPQ and DCT. Moreover, we

The large size of hyperspectral imaging poses a significant threat to its potential use in real life due to the abundant information stored in it. The use of deep learning for such data processing is visible in recent applications. In this work, we propose a lossy hyperspectral image compression algorithm based on the concept of autoencoders. It uses a combination of the convolution layer and max-pooling

Nonnegative matrix factorization(NMF) is an effective dimension reduction method, which is widely used in image clustering and other fields. Some NMF variants preserve the manifold structure of the original data. However, the construction of the traditional neighbor graph depends on the original data, so it may be affected by noise and outliers. Moreover, these methods are unsupervised and do not use

The key of robots operating autonomously in dynamic environments is understanding the dynamic characteristics of objects. This paper aims to detect dynamic objects and reconstruct 3D static maps from consecutive scans of scenes. Our work starts from an encode–decode network, which receives two range maps provided by a Velodyne HDL-64 laser scanner and outputs dynamic probability of each point. Since

Applying a chaotic system to digital image communication is an effective way to resist the attack of intelligent system with strong computing power. However, the traditional chaotic systems lack more complex dynamic behavior that is very valuable for a series of applications. Based on Lorenz system, this study proposes a hyper-chaotic system with multi-scroll coexistence attractors by using a piecework

An image encryption scheme based on a four-wing hyperchaotic system combined with compressed sensing and DNA coding is proposed. The scheme uses compressed sensing (CS) to reduce the image according to a certain scale in the encryption process. The measurement matrix is constructed by combining the Kronecker product (KP) and chaotic system. KP is used to extend the low-dimensional seed matrix to the

Stereoscopic Image Retargeting (SIR) has made it possible for the popularity of 3D application. Meanwhile, the adjustments brought to images may affect the visual comfort when enjoying 3D service. While for SIR, previous Visual Comfort Assessment (VCA) methods often cannot perform well, because they only analyze the influence of disparity on discomfort and do not take into account the effects from

Lane-detection methods are still facing robustness issues when confronted with challenging road surfaces, road markings and illumination conditions. Such combined challenges occur infrequently but are crucial for driving safety. Although advanced learning-based methods (using deep learning) demonstrate an impressive performance, they rely on plenty of training images for varying scenes and their performance

In a secret image sharing (SIS) scheme, a secret image is divided into n shadow images. Then, any t or more shadow images can recover the secret image. Different from pure SIS, extended SIS (ESIS) further embeds shadow images into a cover image to generate stego images. In this way, ESIS can be more secure because shadow images are always noise-like images which might arouse suspicion of attackers

Due to the absorption and scattering effects of the water, underwater images tend to suffer from many severe problems, such as low contrast, grayed out colors and blurring content. To improve the visual quality of underwater images, we proposed a novel enhancement model, which is a trainable end-to-end neural model. Two parts constitute the overall model. The first one is a non-parameter layer for

High dynamic range (HDR) images have many practical applications because they offer an extended dynamic range and a more realistic visual experience. A HDR image is usually stored in floating-point format, so pre-processing is required to make the HDR image compatible with coding standards. A transfer function is also used to achieve better coding efficiency. Typically, HDR images are generated using

Because salient objects usually have fewer data in a scene, the problem of class imbalance is often encountered in salient object detection (SOD). In order to address this issue and achieve the consistent salient objects, we propose an adversarial focal loss network with improving generative adversarial networks for RGB-D SOD (called AFLNet), in which color and depth branches constitute the generator

In many real-world cases such as printer devices and in-camera interpolation, only the interpolated versions of the low-resolution images are available. In this paper, a new low-complexity high-performance image super resolution network is proposed that starting from the bicubic interpolated version of the low resolution image produces a high quality super resolved image. The main idea in the proposed

Owing to the complexity of the underwater environment and the limitations of imaging devices, the quality of underwater images varies differently, which may affect the practical applications in modern military, scientific research, and other fields. Thus, achieving subjective quality assessment to distinguish different qualities of underwater images has an important guiding role for subsequent tasks

Recent advances in unsupervised domain adaptation mainly focus on learning shared representations by global statistics alignment, such as the Maximum Mean Discrepancy (MMD) which matches the Mean statistics across domains. The lack of class information, however, may lead to partial alignment (or even misalignment) and poor generalization performance. For robust domain alignment, we argue that the similarities