Understanding the complex semantic structure of scene images requires mapping the image from pixel space to high-level semantic space. In semantic space, a scene image is represented by the posterior probabilities of concepts (e.g., ‘car,’ ‘chair,’ ‘window,’ etc.) present in it and such representation is known as semantic multinomial (SMN) representation. SMN generation requires a concept annotated

Powder metallurgy gears are often accompanied by broken teeth, abrasion, scratches and crack defects. In order to eliminate the defective gears in gear production and improve the yield of gears, this paper presents an improved GA–PSO algorithm, called the SHGA–PSO algorithm. Firstly, the gear images were preprocessed by bilateral filtering, and the images were segmented by the Sobel operator. Then

In this paper, we present a novel machine learning-based image ranking approach using Convolutional Neural Networks (CNN). Our proposed method relies on a similarity metric learning algorithm operating on lists of image examples and a loss function taking into account the ranking in these lists with respect to different query images. This comprises two major contributions: (1) Rank lists instead of

Multi-exposure fusion is a technique used to generate a high-dynamic-range image without calculating the camera response function and without compressing its ranges with the tone mapping process. There are many schemes for fusing multi-exposure images. One of the famous schemes is the pyramid-based blending, which fuses multi-exposure images together based on the concept of multi-resolution blending

Small inter-class and large intra-class variations are the key challenges in fine-grained visual classification. Objects from different classes share visually similar structures, and objects in the same class can have different poses and viewpoints. Therefore, the proper extraction of discriminative local features (e.g., bird’s beak or car’s headlight) is crucial. Most of the recent successes on this

This paper introduces a novel method to super-resolve multi-spectral images captured by modern real-time single-shot mosaic image sensors, also known as multi-spectral cameras. Our contribution is twofold. Firstly, we super-resolve multi-spectral images from mosaic images rather than image cubes, which helps to take into account the spatial offset of each wavelength. Secondly, we introduce an external

Pedestrian detection and re-identification technology is a research hotspot in the field of computer vision. This technology currently has issues such as insufficient pedestrian expression ability, occlusion, diverse pedestrian attitude, and difficulty of small-scale pedestrian detection. In this paper, we proposed an end-to-end pedestrian detection and re-identification model in real scenes, which

Salient object detection is a hot spot of current computer vision. The emergence of the convolutional neural network (CNN) greatly improves the existing detection methods. In this paper, we present 3MNet, which is based on the CNN, to make the utmost of various features of the image and utilize the contour detection task of the salient object to explicitly model the features of multi-level structures

This study aims to utilize a modified you only look once (YOLO) network to address the detection and classification of spilled loads on freeways. YOLO architecture was augmented in two ways. Firstly, a kernel size of 1 × 1 for the conv layers was used. Secondly, the use of connections between the convolution layers was proposed. For training the network, a synthetic dataset was constructed where ImageNet

Crowd density classification has been a challenging task in the field of computer vision, which has various applications in public and commercial domains. Many researches on the classification and recognition method of the crowd density have been introduced in the past, while there still exists the problems of inaccuracy, poor robustness and inefficiency. An adaptive crowd density classification method

Automated three-dimensional (3D) object reconstruction is the task of building a geometric representation of a physical object by means of sensing its surface. Even though new single-view reconstruction techniques can predict the surface, they lead to incomplete models, specially, for non-commons objects such as antique objects or art sculptures. Therefore, to achieve the task’s goals, it is essential

Most domain adaptation methods consider the problem of transferring knowledge to the target domain from a single-source dataset. However, in practical applications, we typically have access to multiple sources. In this paper we propose the first approach for multi-source domain adaptation (MSDA) based on generative adversarial networks. Our method is inspired by the observation that the appearance

The Gaussian kernel function is widely used to encode the nonlinear correlations of the face images. However, some issues greatly limit its superiority, for example, it is sensitive to the parameter setting because of its definition based on the exponential operation, on the other hand, the Gaussian kernel needs costly computational time. Besides, the hidden information such as the distance information

Coded targets are used as reference targets with a known location during camera calibration, for robust searching of corresponding features between images during various applications of machine vision like object tracking, robot navigation or 3D measurement. In this paper, a target system for industrial photogrammetric applications is outlined. The methods which have been chosen emphasize maximum robustness

Recently, deep convolutional neural networks (CNNs) have been used for ear recognition with the increasing and available ear image databases. However, most known ear recognition methods may be affected by selecting and weighting features; this is always a challenging issue in ear recognition and other pattern recognition applications. Metric learning can address this issue by using an accurate and

Automatic airplane detection in aerial imagery has a variety of applications. Two of the significant challenges in this task are variations in the scale and direction of the airplanes. To solve these challenges, we present a rotation-and-scale-invariant airplane proposal generator. We call this generator symmetric line segments (SLS) that is developed based on the symmetric and regular boundaries of

Image inpainting technology can patch images with missing pixels. Existing methods propose convolutional neural networks to repair corrupted images. The network extracts effective pixels around the missing pixels and uses the encoding–decoding structure to extract valuable information to repair the vacancy. However, if the missing part is too large to provide useful information, the result will be

In this paper, we tackle depth estimation and blur removal from a single out-of-focus image. Previously, depth is estimated, and blurred is removed using multiple images; for example, from multiview or stereo scenes, but doing so with a single image is challenging. Earlier works of monocular images for depth estimated and deblurring either exploited geometric characteristics or priors using hand-crafted

The level set method is one of the most widely used and powerful techniques in image science such as image/motion segmentation, object tracking, etc. This paper brings up an unstudied issue with discretized level set algorithms about ‘the non-uniqueness’ of segmentation results which is different from the problem of ‘the existence’ of a result. Our solution is to numerically approximate the level set

Recognizing the face with partial occlusion is an important problem for many face recognition applications. Since the occluded parts have no contribution to recognize the face, these parts should be excluded when performing the classification. In this paper, we propose a new method to detect and to use the non-occluded parts of face image for modular face recognition approaches. The occlusion of a

In this paper, we present a localization system for the use of drone in a remote laboratory. The objective is to allow a drone to inspect remote electronic instruments autonomously, as well as to return to its base and land on a platform for the recharge of its batteries. In addition, the drone should be able to detect the presence of a teacher in the laboratory and to center the human face in the

In narrow overlap welding, serious defects in the weld will lead to band breakage accident, and the whole hot dip galvanizing unit will be shut down. Laser vision inspection hardware is used to collect real-time image of weld surface, and image defect recognition and evaluation system is developed to real-time detect quality. Firstly, region division is implemented. In view of the characteristics of

This study proposed an assistive system to recognize the special character CAPTCHAs for the visually impaired community in the Chinese region. To improve the recognition precision, a convolutional neural network (CNN), which is named Captchanet for recognition, was proposed. Firstly, a ten-layer network architecture was designed and three improved training strategies were proposed for the deep learning

We propose an innovative method of material classification based on the imaging model of pulsed time-of-flight (ToF) camera integrated with the unique signature that describes physical properties of each material named reflection point spread function (RPSF). First, the optimization method reduces the effect of material surface interreflection, which would affect RPSF and lead to decreased accuracy

Deep convolutional neural network (DCNN) is an influential tool for solving various problems in machine learning and computer vision. Recurrent connectivity is a very important component of visual information processing within the human brain. The idea of recurrent connectivity is rarely applied within convolutional layers, the exceptions being a couple of DCNN architectures including recurrent convolutional

Food security, which has currently attracted much attention, requires minimizing crop damage by timely detection of plant diseases. Therefore, the automatic identification and diagnosis of plant diseases are highly desired in agricultural information. In this paper, we propose a novel approach to identify plant diseases. The method is divided into two parts: starting with the enhancement of the artificial

We present a method to recover the 3D flying shape of a sail using passive markers. In the navigation and naval architecture domain, retrieving the sail shape may be of immense value to confirm or contest simulation results, and to aid the design of new optimal sails. Our acquisition setup is very simple and low-cost, as it is only necessary to fix a series of printable markers on the sail and register

This paper presents a new effective descriptor for microfilaria. Since microfilaria is a thin elastic object, the proposed descriptor handles it locally. At each medial point of the microfilaria, the local structure of the microfilaria votes for a given shape. Accumulating these votes in the polar domain yields a rich descriptor. Experimental results show the effectiveness of the proposed approach

The rising demand for high security and reliable authentication schemes, led to the development of the unimodal biometric system so that the multimodal biometric system has emerged. The multimodal biometric system will use more than one biometric trait of an individual for identification and security purpose. Fusion plays a major role in the multimodal biometric system. Several fusion techniques are

Recent days have stamped enormous upsurge about health awareness in society. Self tutoring systems for supervising the performed exercises offer numerous advantages and are therefore emerging as an entity of dire necessity in health-sector. Considering the significantly increasing global acceptance of ‘\({{Yog\bar{a}sana}}\)’ as one of the most preferred exercise, this paper proposes a novel and an

We propose an industrial measurement and inspection system for steel workpieces eroded by electrical discharge machining, which uses deep neural networks for surface roughness estimation and defect detection. Specifically, a convolutional neural network (CNN) is used as a regressor in order to obtain steel surface roughness and a CNN based on spatial pooling pyramid is applied for defect classification

Recent studies have shown that CycleGAN is a highly influential medical image synthesis model. However, the lack of sufficient constraints and the bottleneck layer in auto-encoder network usually lead to blurry image and meaningless features, which may affect medical judgment. In order to synthesize accurate and meaningful medical images, weighted feature transfer GAN (WFT-GAN) is proposed to improve

As the network structure of convolutional neural network (CNN) becomes deeper and wider, network optimization, such as pruning, has received ever-increasing research focus. This paper propose a new pruning strategy based on Feature Extraction Ability Measurement (FEAM), which is a novel index of the feature extraction ability from both theoretical analysis and practical operation. Firstly, FEAM is

Neutral buoyancy systems simulate the microgravity environment by taking advantage of buoyancy forces of water to offset the gravity of test bodies. Functional verification of space robots in neutral buoyancy system is of great importance for ground tests. The relative pose determination of a spacecraft plays an essential role in the on-orbit operation of space robots. In order to meet the requirement

The success of deep learning-based techniques in solving various computer vision problems motivated the researchers to apply deep learning to predict the optical flow of a video in the next frame. However, the problem of predicting the motion of an object in the next few frames remains an unsolved and less explored problem. Given a sequence of frames, predicting the motion in the next few frames of

Modern, high-speed, railway transportation requires rails to conform strictly to requirements specified in various standards. One key requirement is the conformance of the dimensions of the rail cross section to those of the corresponding rail model, within tight tolerances. This paper deals with a system for dimensional quality inspection during the manufacture of railway rails. Optical triangulation

This paper proposed an adaptive multi-object pedestrian recognition algorithm based on SLIC. First, we used SLIC to superpixel the pre-segmentation processing on the image. Then, the hash distance is added as the superpixel point aggregation parameter based on the traditional superpixel measurement unit of LAB color space distance and position distance. Finally, we identified the clustering subject

The eye region is one of the most attractive sources for identification and verification due to the representative availability of such biometric modalities as periocular and iris. Many score-level fusion approaches have been proposed to combine these two modalities targeting to improve the robustness. The score-level approaches can be grouped into three categories: transformation-based, classification-based

Till August 17, 2020, COVID-19 has caused 21.59 million confirmed cases in more than 227 countries and territories, and 26 naval ships. Chest CT is an effective way to detect COVID-19. This study proposed a novel deep learning model that can diagnose COVID-19 on chest CT more accurately and swiftly. Based on traditional deep convolutional neural network (DCNN) model, we proposed three improvements:

Scene reconstruction and visual localization in dynamic environments such as street scenes are a challenge due to the lack of distinctive, stable keypoints. While learned convolutional features have proven to be robust to changes in viewing conditions, handcrafted features still have advantages in distinctiveness and accuracy when applied to structure from motion. For collaborative reconstruction of

In unmanned aerial vehicle (UAV) flights, power lines are considered as one of the most threatening hazards and one of the most difficult obstacles to avoid. In recent years, many vision-based techniques have been proposed to detect power lines to facilitate self-driving UAVs and automatic obstacle avoidance. However, most of the proposed methods are typically based on a common three-step approach:

To accurately and efficiently distinguish the stem end and the blossom end of a navel orange from its black spots, we propose a feature skyscraper detector (FSD) with low computational cost, compact architecture and high detection accuracy. The main part of the detector is inspired from small object that the stem (blossom) end is complex and the black spot is densely distributed, so we design the feature

Novel object grasping is an important technology for robot manipulation in unstructured environments. For most of current works, a grasp sampling process is required to obtain grasp candidates, combined with a local feature extractor using deep learning. However, this pipeline is time–cost, especially when grasp points are sparse such as at the edge of a bowl. To tackle this problem, our algorithm

Hyperspectral (HS) cameras record the spectrum at multiple wavelengths for each pixel in an image, and are used, e.g., for quality control and agricultural remote sensing. We introduce a fast, cost-efficient and mobile method of taking HS images using a regular digital camera equipped with a passive diffraction grating filter, using machine learning for constructing the HS image. The grating distorts

Many crowd analysis methods rely on optical flow techniques to estimate the main moving directions. In this work, we propose a crowd flow filtering approach for calibrated cameras that can be coupled to any generic optical flow method. It projects the input optical flow to the world coordinate system, performs a local motion analysis exploring a Social Forces Model and then projects the filtered flow

The goal of visual surface inspection is to analyze an object’s surface and detect defects by looking at it from different angles. Developments over the past years have made it possible to partially automate this process. Inspection systems use robots to move cameras and obtain pictures that are evaluated by image processing algorithms. Setting up these systems or adapting them to new models is primarily

Despite the significant improvement in the performance of monocular pose estimation approaches and their ability to generalize to unseen environments, multi-view approaches are often lagging behind in terms of accuracy and are specific to certain datasets. This is mainly due to the fact that (1) contrary to real-world single-view datasets, multi-view datasets are often captured in controlled environments

Plant leaf segmentation has a very important role in most plant identification methods. Tree leaves segmentation in images with complex background is very difficult when there is no prior information about the leaves and backgrounds. In practice, the parameters of unsupervised image segmentation algorithms must be set for each image to get the best results. In this paper, to overcome this problem,

Recently, convolutional neural network has been employed to obtain better performance in single image super-resolution task. Most of these models are trained and evaluated on synthetic datasets in which low-resolution images are synthesized with known bicubic degradation and hence they perform poorly on real-world images. However, by stacking more convolution layers, the super-resolution (SR) performance

With the advent of autonomous vehicles, detection of the occupants’ posture is crucial to tackle the needs of infotainment interaction or passive safety systems. Generative approaches have been recently proposed for human body pose in-car detection, but this type of approaches requires a large training dataset for a feasible accuracy. This requirement poses a difficulty, given the substantial time

This article presents a new method for automatic calibration of surveillance cameras. We are dealing with traffic surveillance, and therefore, the camera is calibrated by observing vehicles; however, other rigid objects can be used instead. The proposed method is using keypoints or landmarks automatically detected on the observed objects by a convolutional neural network. By using fine-grained recognition

Microaneurysm (MA) is the earliest lesion of diabetic retinopathy (DR). Accurate detection of MA is helpful for the early diagnosis of DR. In this paper, an efficient approach is proposed to detect MA, based on feature-transfer network and local background suppression. In order to reduce noise, a feature-distance-based algorithm is proposed to suppress local background. The similarity matrix of feature

In this paper, we propose a self-localization method for a soccer robot using an omnidirectional camera. Based on the projective geometry of the omnidirectional visual system, the image distortion from the original omnidirectional image can be completely corrected, so the robot can quickly localize itself on the playing field. First, we transform the distorted omnidirectional image to a distortion-free

One of the most relevant tasks in an intelligent vehicle navigation system is the detection of obstacles. It is important that a visual perception system for navigation purposes identifies obstacles, and it is also important that this system can extract essential information that may influence the vehicle’s behavior, whether it will be generating an alert for a human driver or guide an autonomous vehicle

Current human pose estimation methods mainly rely on designing efficient Convolutional Neural Networks (CNN) frameworks. These CNN architectures typically consist of high-to-low resolution sub-networks to learn semantic information, and then followed by low-to-high sub-networks to raise the resolution to locate the keypoints. Because low-level features have high resolution but less semantic information

Abnormal crowd behavior detection is a hot research topic in the field of computer vision. In order to solve the problems of high computational cost and the imbalance between positive and negative samples, we propose an efficient algorithm that can detect and locate anomalies in videos. In order to solve the problem of less negative samples, the algorithm uses the spatiotemporal autoencoder to identify

We propose a combination of image processing methods to detect ceramic tiles defects automatically. The primary goal is to identify faults in ceramic tiles, with or without texture. The process consists of four steps: preprocessing, feature extraction, optimization, and classification. In the second step, gray-level co-occurrence matrix, segmentation-based fractal texture analysis, discrete wavelet

This paper deals with the task of autocalibration of scanning electron microscope (SEM), which is a technique allowing to compute camera motion and intrinsic parameters. In contrast to classical calibration, which implies the use of a calibration object and is known to be a tedious and rigid operation, auto- or selfcalibration is performed directly on the images acquired for the visual task. As autocalibration

The cleanliness of edible bird’s nest (EBN) is among the determinative factors for market acceptance. As it is meant for human consumption, EBN should be free of any impurities or matter which are foreign to it, such as bird feathers, egg fragments and droppings. However, natural variations in composition, density and thickness impose inconsistency to the level of translucency and colour of EBN, resulting

Although in recent years we have witnessed an explosion of the scientific research in the recognition of facial soft biometrics such as gender, age and expression with deep neural networks, the recognition of ethnicity has not received the same attention from the scientific community. The growth of this field is hindered by two related factors: on the one hand, the absence of a dataset sufficiently