Super-resolution reconstruction technology has important scientific significance and application value in the field of image processing by performing image restoration processing on one or more low-resolution images to improve image spatial resolution. Based on the SCSR algorithm and VDSR network, in order to further improve the image reconstruction quality, an image super-resolution reconstruction

Very recently, with the widespread research of deep learning, its achievements are increasingly evident in image inpainting tasks. However, many existing methods fail to effectively reconstruct vivid contents and refine structures. In order to solve this issue, in this paper, a novel two-stage generative adversarial network based on the fusion of edge structures and color aware maps is proposed. In

Visible-infrared cross-modality person re-identification (VI-ReId) is an essential task for video surveillance in poorly illuminated or dark environments. Despite many recent studies on person re-identification in the visible domain (ReId), there are few studies dealing specifically with VI-ReId. Besides challenges that are common for both ReId and VI-ReId such as pose/illumination variations, background

Saliency detection is still very challenging in computer vision and image processing. In this paper, we propose a novel visual saliency detection framework via bagging-based saliency distribution learning (BSDL). Given an input image, we firstly segment it into superpixels as basic units. Then two prior knowledge containing background prior and center prior are integrated to generate an initial prior

In the literature of secret sharing, the property of essential secret sharing scheme ensures that no set of participants, missing at least one essential participant, should be able to get any information regarding the secret. However, there are essential secret image sharing schemes available in the literature in which we have shown mathematically as well as through experiments that any k or more non-essential

The step of expert taxa recognition currently slows down the response time of many bioassessments. Shifting to quicker and cheaper state-of-the-art machine learning approaches is still met with expert scepticism towards the ability and logic of machines. In our study, we investigate both the differences in accuracy and in the identification logic of taxonomic experts and machines. We propose a systematic

Image retrieval is an important research topic in pattern recognition and computer vision. We propose a novel content-based image retrieval method. At the image description stage, our method first modifies the traditional micro-structure descriptor (MSD) to capture the direct relationship between the shape and texture features and that between the color and texture features. Our method then extracts

Underwater image processing technologies have always been challenging tasks due to the complex underwater environment. Images captured under water are not only affected by the water itself, but also by the diverse suspended particles that increase the effect of absorption and scattering. Moreover, these particles themselves are usually imaged on the picture, causing the spot noise signal to interfere

We develop a novel no-reference image quality assessment model for stereoscopic 3D (S3D) images that is inspired by functional receptive field models of perceptual mechanisms in primary visual cortex (V1). The approach is called the Blind S3D Integrated Quality Evaluator (BSIQE). BSIQE simulates monocular and binocular responses to stereo views using channel separation and weighted multi-channel combination

Inspired by multiple information processing mechanisms of the human nervous system, a fusion simplified pulse coupled neural network (FSPCNN) model for infrared (IR) image segmentation is proposed in this paper. In the method based on FSPCNN, the time decay factor is set adaptively based on Stevens’ power law, and the synaptic weight is generated adaptively based on Lateral Inhibition (LI), without

Generalized zero shot classification aims to recognize both seen and unseen samples in test sets, which has gained great attention. Recently, many works consider using generative adversarial network to generate unseen samples for solving generalized zero shot classification problem. In this paper, we study how to generate discriminative and meaningful samples. We propose a method to learn discriminative

A common processing scheme of Visual Cryptography (VC) consists of generating two ciphered images from a secret image. The sender transmits these key images via two different channels. The receiver collects the key images and recovers the secret image by superimposing them. In this article, Voronoi tessellation is exploited in Visual Cryptography for the first time to the best of our knowledge. The

Hand pose estimation plays an important role in human–computer interaction and augmented reality. Regressing the joints coordinates is a difficult task due to the flexibility of the joint, self-occlusion and so on. In this paper, we propose a novel and simple hierarchical neural network for hand pose estimation. The hand joint coordinates are divided into six parts and each part is regressed in sequence

The level set method is widely used in medical image segmentation, in which the performance is seriously subject to the initialization and parameters configuration. An automatic segmentation method was proposed in this paper, which integrates fuzzy clustering with level set method through a dynamic constrained term in the new energy functional. It is able to use the results of fuzzy clustering directly

Performance of an orthogonal frequency division multiplexing (OFDM) system is greatest when the exact channel state information (CSI) is used for transmitter rate control and power allocation. However, in real systems CSI can only be approximately known. Moreover, in video communication, it can be difficult to use any CSI for rate control of a video codec if the channel changes significantly during

Due to the light absorption and scattering, captured underwater images usually contain severe color distortion and contrast reduction. To address the above problems, we combine the merits of deep learning and conventional image enhancement technology to improve the underwater image quality. We first propose a two-branch network to compensate the global distorted color and local reduced contrast, respectively

The Cover-Source Mismatch (CSM) has been long recognized as a major problem in modern steganography and steganalysis. Indeed, while a vast majority of works in steganography and steganalysis had been tailored to a specific reference database, namely BOSSbase, recent works show that, because of CSM, the results may greatly differ when changing this dataset. Although the CSM has already been the subject

Recently, as the number of cameras built into polydioptric cameras has increased, image rectification of these cameras has become complicated. However, because conventional methods cannot compensate for the calibration errors or are limited by the camera arrangement, they cannot be widely applied to various kinds of polydioptric cameras. In this work, we adopted the idea of disparity-error-minimization

At low bit rates, visually annoying blocking artifacts are usually introduced in JPEG compressed images. In this paper, we proposed an image deblocking method combined with the shape-adaptive low-rank (SALR) prior, the quantization constraint (QC) prior and sparsity-based detail enhancement. We firstly design a deblocking model to obtain initial deblocked images under the maximum a posteriori (MAP)

Person search aims to search for a target person among multiple images recorded by multiple surveillance cameras, which faces various challenges from both pedestrian detection and person re-identification. Besides the large intra-class variations owing to various illumination conditions, occlusions and varying poses, background clutters in the detected pedestrian bounding boxes further deteriorate

In computer vision, the reflections impair the overall perception of images and introduce undesired interference to high-level image understanding. To date, reflection removal approaches have been developed with advantage of visual quality enhancement. However, the reflection removal for single image is still a challenging task with its performance to be further boosted. During this process, additional

In this paper, a novel method to decompose an image into “intrinsic images” is introduced. This decomposition is based on the dichromatic model which separates the influence of specular and diffuse reflections. The separation of these components is very important in several applications of image analysis including segmentation, classification, recoloring, and specularity removal. The proposed method

Image feature extraction technology is one of main topics in the field of computer vision, which has been widely applied in biological recognition, image retrieval, target detection and other fields. To overcome the drawbacks of WLD under complex illumination condition, we propose a novel illumination–insensitive feature descriptor named as anisotropic Weber synergy gradient descriptor (AWSGD). The

Anaglyph reversion aims to recover the best possible approximation of a stereo pair of images from an anaglyph. Possible applications include a range of practical situations like enabling visualization of legacy anaglyphs on the Web, saving storage/transmission bandwidth by encoding stereo pairs as anaglyphs before stereo visualization or enabling users to enjoy stereo visualization using any available

Humans mainly communicate among them and with the world around them using light and vision, thus implying that visual representation technologies play a central role in human societies. While visual representation has been based on the 2D representation paradigm for many decades, multiple developments are nowadays pressing towards the adoption of more realistic and immersive 3D visual representation

In this study, we propose a new deep learning architecture named Multi-Level Dense Network (MLDNet) for multi-focus image fusion (MFIF). We introduce shallow and dense feature extraction in our feature extraction module to extract images features in a more robust way. In particular, we extracted the features from a mixture of many distributions from prior to the complex distribution through densely

In this paper we combine video compression and modern image processing methods. We construct novel iterative filter methods for prediction signals based on Partial Differential Equation (PDE) based methods. The mathematical framework of the employed diffusion filter class is given and some desirable properties are stated. In particular, two types of diffusion filters are constructed: a uniform diffusion

Recent years have witnessed that the multimodal medical image fusion (MMIF) plays critical roles in clinical diagnostics and treatment. Many MMIF algorithms have been proposed to improve the MMIF images quality. The quality of multimodal medical fused images will significantly affect the results of the clinical diagnosis. However, little work has been designed to evaluate the effectiveness of MMIF

This paper presents a two-stage approach, track and then segment, to perform semi-supervised video object segmentation (VOS) with only bounding box annotations. The proposed reverse optimization for VOS (ROVOS) which leverages a fully convolutional Siamese network performs tracking and segmentation in the tracker. The segmentation cues are able to reversely optimize the location of the tracker and

Compressive sensing (CS) allows for the reconstruction of sparse signals based on measurements acquired at sub-Nyquist sampling rates. Amongst the common CS methods, total variation (TV) minimization is a common approach used to reconstruct images that are approximately piece-wise constant. The discrete gradient operation in TV can be described as a filtering operation using the horizontal and vertical

In this paper, we study the tracking of deformable shapes in sequences of images. Our target application is the tracking of clouds in satellite images. We propose to use a recent state-of-the-art method for off-the-grid sparse analysis to describe clouds in image as mixtures of 2D atoms. Then, we introduce a method to handle the tracking with its specificities: apparition or disappearance of objects

Interpreting remote sensing images by combining manual visual interpretation and computer automatic classification and recognition is an important application of human–computer interaction (HCI) in the field of remote sensing. Remote sensing images with high spatial resolution and high spectral resolution is an important basis for automatic classification and recognition. However, such images are often

According to the fast development of Internet technologies, nowadays more and more web applications require accessing and processing massive-scale visual data, such as content image search and automatic navigation. Practically, the computing power of a single personal PC is insufficient for handling such massive-scale visual elements. Owing to the advancement of cloud platforms, this problem can be

Image restoration is the process of restoring latent clear images from degraded images, and it has received substantial attention in various restoration scenarios recently. Contrary to the considerable progress of image restoration algorithms, the quality evaluation for image restoration falls behind, which may hinder the further development of advanced image restoration techniques. So far, only several

With the advance in content-based image retrieval and the popularity of Data-as-a-Service, enterprises can outsource their image retrieval systems on cloud platforms to reduce heavy storage, computation, and communication burdens. However, this brings many privacy problems. Although several privacy-preserving image retrieval schemes have been proposed to protect users’ privacy, they have two major

Image compression systems that exploit the properties of the human visual system have been studied extensively over the past few decades. For the JPEG2000 image compression standard, all previous methods that aim to optimize perceptual quality have considered the irreversible pipeline of the standard. In this work, we propose an approach for the reversible pipeline of the JPEG2000 standard. We introduce

Lane detection is a useful technique in modern autonomous vehicles systems, which assists vehicle to accurately localize itself according to detected road lines. Traditional methods leveraged edge detection and Hough transform based algorithms to plot lines along the detected lane. Noticeably, they did not take the informative feature road gradient into account. In addition, most previous deep learning-based

Human action recognition plays an important role in modern intelligent systems, such as human–computer interaction (HCI), sport analysis, and somatosensory game. Compared with conventional 2-D based human action analysis, using Kinect sensor can obtain depth information of human action, which is significant for human action recognition. In this paper, we propose a joint angle sequence model for recognizing

The task of object tracking is very important since its various applications. However, most object tracking methods are based on visible images, which may fail when visible images are unreliable, for example when the illumination conditions are poor. To address this issue, in this paper a fusion tracking method which combines information from RGB and thermal infrared images (RGB-T) is presented based

In sport sceneries, automatically recognizing human actions is a useful technique that can be popularly applied in may domains, such as human body tracking and athlete behavior analysis Most state-of-the-art deep architectures have achieved competitive performance in recognizing human action. However, it is still a challenging task due to the unavoidable occlusion, camera angle changes, and varied

Target recognition is a key module in modern human–computer interaction (HCI) and computer vision systems It is pervasively used in many domains like autonomous vehicles and robot, remote operation, and video surveillance. However, due to the complicated environment and object occlusion, target recognition is still a challenging task. In this paper, we propose a novel target recognition algorithm toward

Detecting and understanding human action under sophisticated lighting condition and backgrounds, also known as human action recognition in real-world context, is an indispensable component in modern intelligent systems and has becoming a hot research topic currently. Nowadays, human action recognition is still a tough challenge due to intra-class and inter-class, environment and temporal-level differences

Intelligently tracking objects with varied shapes, color, lighting conditions, and backgrounds is an extremely useful application in many HCI applications, such as human body motion capture, hand gesture recognition, and virtual reality (VR) games. However, accurately tracking different objects under uncontrolled environments is a tough challenge due to the possibly dynamic object parts, varied lighting

Image shadow detection and removal can effectively recover image information lost in the image due to the existence of shadows, which helps improve the accuracy of object detection, segmentation and tracking. Thus, aiming at the problem of the scale of the shadow in the image, and the inconsistency of the shadowed area with the original non-shadowed area after the shadow is removed, the multi-scale

In this paper, a novel method for lossless image encryption based on set partitioning in hierarchical trees and cellular automata. The proposed encryption method embeds the encryption into the compression process, in which a small part of the data is encrypted quickly, while maintaining the good coding characteristics of set partitioning in hierarchical trees (SPIHT). The proposed encryption system

Rate Distortion Optimization (RDO) is employed in High-Efficiency Video Coding (HEVC) to enhance its coding efficiency. Owing to its coding complexity, RDO is traditionally performed within each frame with fixed quantization parameters (QPs), without fully considering the coding dependencies between the current frame and future frames within a temporal propagation chain. To improve the coding efficiency

Emotion recognition is a hot research in modern intelligent systems. The technique is pervasively used in autonomous vehicles, remote medical service, and human–computer interaction (HCI). Traditional speech emotion recognition algorithms cannot be effectively generalized since both training and testing data are from the same domain, which have the same data distribution. In practice, however, speech

Fitting a model to data contaminated by noise and outliers is a common task in computer vision, and it is often solved by maximizing inlier set. Most existing methods cannot guarantee global optimality, due to the two techniques widely utilized in inlier maximization: randomized sampling to generate candidate models and a hard threshold on residuals to classify inliers and outliers. In this paper,

In recent years, hyperspectral image super-resolution has attracted the attention of many researchers and has become a hot topic in the field of computer vision. However, it is difficult to obtain high-resolution images due to imaging hardware devices. At present, many existing hyperspectral image super-resolution methods have not achieved good results. In this paper, we propose a hyperspectral image

Video-based person re-identification (Re-ID) is of important capability for artificial intelligence and human–computer interaction. The spatial and temporal features play indispensable roles to comprehensively represent the person sequences. In this paper, we propose a comprehensive feature fusion mechanism (CFFM) for video-based Re-ID. We use multiple significance-aware attention to learn attention-based

This paper presents an effective hand-crafted texture operator for texture recognition, referred to as oriented star sampling structure based multi-scale ternary pattern (O3S-MTP) which is expected to better represent salient local texture structure. Instead of heuristic code constructions, the proposed O3S-MTP descriptor is defined as a gray-scale invariant texture measure, derived from a general

In this work, we explore the feasibility and rationality of the glove-type massage information acquisition system combined with the pneumatic human organ simulator in the traditional massage context. We proposed the glove-type massage information acquisition system and the pneumatic human organ simulator to compare and analyze the effectiveness of the compression displacement, stiffness, and pressure

With the rapid development of computer vision and multimedia technology, especially the visual tracking technology and network transmission, teacher-centered education is popular nowadays. The shortcomings of the conventional classroom teaching mode by manually student behavior analysis are gradually becoming less effective. Aiming at the main problems existing in the application of classroom teaching

Considering the image captioning problem, it is difficult to correctly extract the global features of the images. At the same time, most attention methods force each word to correspond to the image region, ignoring the phenomenon that words such as “the” in the description text cannot correspond to the image region. To address these problems, an adaptive attention model with a visual sentinel is proposed

Human action recognition is the key technique in many modern intelligent systems, such as video surveillance, sport motion analysis, virtual reality, and shopping behavior analysis. Human action recognition is a challenging task due to the sophisticated backgrounds and possible occlusions In this paper, we aim to recognize human actions from the video stream of sport scenes by intelligently fusing

Universal Multimedia Access (UMA) calls for solutions where content is created once and subsequently adapted to given requirements. With regard to UMA and scalability, which is required often due to a wide variety of end clients, the best suited codecs are wavelet based (like the MC-EZBC) due to their inherent high number of scaling options. However, most transport technologies for delivering videos