Abstract. Most existing multispectral fusion algorithms often suffer from spectral or spatial information distortion. Driven by this motivation, we propose an edge-guided multispectral (MS) image fusion algorithm. In particular, it combines the advantages of generative adversarial networks and improved fusion frameworks, so the merged image can better preserve the spectral information of the original

Realtime stereo processing, particularly in computationally constrained environments such as the Mars 2020 Perseverance rover, requires image rectification to enable efficient one-dimensional correlation. A camera model has been designed to perform better image rectification for fish-eye lenses with a particular emphasis on the engineering cameras on Perseverance. The primary innovation is the use

In hyperspectral remote sensing imagery, the sensor, atmosphere, topography, and other factors often bring about some degradations, such as noise, haze, clouding, and shadowing. Due to inevitable tradeoff between spatial resolution and spectral resolution, low spatial details of hyperspectral images (HSIs) also limit the range of potential applications. Compensating for these degradations through quality

Remote sensing image processing has been widely used in environmental monitoring, terrain survey, military investigation, disaster early warning, and other fields. The remote sensing images matching is a key step, and the accuracy and real-time of the alignment have a great impact on these applications. Due to the high resolution and complexity of remote sensing images, scale-invariant feature transformation

Guest Editors Shen-En Qian, Robert O. Green, and Antonio J. Plaza introduce the Special Section on Hyperspectral Remote Sensing and Imaging Spectrometer Design.

Hyperspectral images contain rich spectral–spatial information. Therefore exploring spectral–spatial classifiers has become a mainstream trend in the field of hyperspectral image classification. However, current studies seldom delve into the contribution of the extracted spectral and spatial features to the subsequent classification task. To further explore the contribution of spectral and spatial

Anomaly detection (AD) is a crucial task for detecting salient objects in cluttered backgrounds. Classical AD algorithms based on statistical models or geometric models have achieved acceptable detection results. However, most of them do not hierarchically extract deep features or consider the spatial structure of the images. We propose a method that combines the reconstruction error of autoencoder

Convolutional neural networks (CNNs) have achieved remarkable results in multispectral (MS) and panchromatic (PAN) image fusion (pansharpening) because of their strong image feature extraction ability. However, previous CNN-based pansharpening methods mostly use an ordinary convolution, which has a small receptive field in the convolution layer, has insufficient contextual information, and can only

Spectral and spatial details abound in hyperspectral data. However, there are few labeled samples available, and obtaining them is expensive and time-consuming. As a result, improving the classification accuracy of HSI with limited training samples is a critical challenge. We propose a double-branch network with attention feature fusion (DBN-AFF) for HSI classification. One branch extracts spectral

In inverse synthetic aperture radar (ISAR) imaging, micro-Doppler (m-D) has always been a hot research topic. m-D will interfere with the imaging of the main body of the target, which will affect the image quality. However, m-D also contains micromotion information. In order to obtain a clearer image of the main body of the target and more micromotion information, some methods can be considered to

Waveform design is a key component of cognitive radar. However, waveforms designed using a single criterion have difficulty meeting the multi-working mode of radar. We present a joint waveform design method in the presence of signal-dependent interference based on a long short term memory network. The proposed method combines characteristics of mutual information (MI) and signal to interference-plus-noise-ratio

The detection of urban land use is of great significance to urban planning. With the development of deep learning technology, convolutional neural networks (CNN) are widely used in remote sensing image processing. However, existing CNN models lack the ability to fuse high-dimensional semantic information and low-dimensional position information of images and thus perform poorly in feature restoration

Given the unprecedented size of ultraspectral sounder data, there is a special process of radiance thinning in assimilating this data to reduce the data volume with minimal loss of atmospheric information. Considering the potential correlation between the selected data by radiance thinning and the unselected data, a lossless compression method for ultraspectral sounder data is proposed based on key

Soil moisture is an important parameter that directly impacts crop productivity. Microwave signals are highly sensitive to soil dielectric constant and so they are used to derive soil moisture. The potential of entropy and alpha (H / α) decomposition for moisture estimations at 0- to 5-cm soil depth was assessed. The H / α parameters were extracted from the dual-polarimetric Sentinel-1 dataset. Also

Remote sensing images have the characteristics of a multi-scale, high resolution, and complex background, making the accuracy of small target detection too low. We propose an improved method based on the “you-only-look-once” v5 network model to make it more suitable for small target detection. First, we design a four-scale detection layer that improves the depth of the network and the accuracy of small

Hyperspectral remote sensing data have been widely used in lithological identification and mapping. In existing studies, sufficient training samples are required. However, collecting sufficient labeled training samples for lithological classification in remote and inaccessible areas is generally time consuming, expensive, and even hard to implement, which causes the insufficient training sample problems

Remote sensing (RS) oblique imagery provides valuable information of buildings’ facades. Facade detection using spectral-, spatial-, and texture-only features does not accurately separate facade and nonfacade regions in a single-view oblique image. Therefore, a facade index and a unimodal thresholding method were proposed to characterize and detect facade regions. This new index, named the probability-spatial

We propose a panchromatic (Pan) and multispectral (MS) image fusion method in order to synthesize an MS image with enhanced spatial resolution and preserved spectral information of the original MS image. The proposed method is based on the spatial frequency and the à trous wavelet transform (SFATWT). The à trous wavelet transform (ATWT) is used to decompose Pan and MS images into low and high frequencies

The Conne River watershed is dominated by wetlands that provide valuable ecosystem services, including contributing to the survivability and propagation of Atlantic salmon, an important subsistence species that has shown a dramatic decline over the past 30 years. To better understand and improve the management of the watershed, and in turn, the Atlantic salmon, a wetland inventory of the area is developed

Recent technological advancements in satellite imagery have increased the production of remotely sensed images. Therefore, developing efficient methods for annotating these images has gained popularity. Most of the current state-of-the-art methods are based on supervised machine learning techniques. We propose a method called semisupervised multi-label annotizer (SS-MLA) that adapts vector-quantized

For the estimation of a dense disparity map from a rectified space-borne stereo image pair and generation of the most qualified digital surface model (DSM), new image matching algorithms are being developed. Our study has two main goals of the DSM quality validation of Worldview-4 (WV-4), which offers the highest ground sampling distance (GSD) (30 cm) of civilian optical space-borne missions together

Discrimination of crop varieties spanned over heterogeneous agriculture land is a vital application of polarimetric SAR images for agriculture monitoring and assessment. The covariance matrix of polarimetric SAR images is observed to follow a complex Wishart distribution for major classification tasks. It is true for homogeneous regions, but for heterogeneous regions, the covariance matrix follows

Advanced differential SAR interferometry (A-DInSAR) has been used as an effective monitoring tool in mining environments. This work presents an investigation of surface displacement in the Germano iron mining complex (Mariana, Minas Gerais, Brazil), where on November 5, 2015, the Fundão tailings dam collapsed. Initially, the analysis was performed with 14 Sentinel-1 images, acquired from May 8, 2015

The guest editors introduce the Special Section on Satellite Remote Sensing for Disaster Monitoring and Risk Assessment, Management, and Mitigation.

Classifying land cover using high-resolution remote-sensing images is challenging. The emergence of deep learning provides improved possibilities, but owing to the limitations of network structures, traditional convolutional neural network methods lose essential information about boundaries and small ground objects. We propose a superpixel-optimized convolutional neural network (SOCNN) framework to

The unmanned aerial vehicle (UAV) plays an increasingly important role in monitoring and managing islands recently for their high feasibility and the miniaturization of sensors, which provide new possibilities for accurate island green cover mapping. We developed a framework that integrates UAV-acquired high-spatial resolution multispectral image and LiDAR data for effective object-based green cover

In our study, a real-world application using the latest unmanned aerial vehicle (UAV) functionality is presented. Sugar beet is an important industrial crop in many countries. According to estimates, weeds in sugar beet fields dramatically reduce both the quantity and quality of sugar beet crops. Due to the spectral similarities between weeds and sugar beet seedlings, visual identification of weeds

Deep convolutional neural network semantic segmentation has played a significant role in remote sensing applications due to its capability of end-to-end training and automatic high-level features extraction. Highly accurate predictions have been recorded from different network architectures that are designed using the convolutional layers. However, the accuracy is mainly achieved at a very high cost

Semisupervised learning (SSL) techniques explore the progressive discovery of the hidden latent data structure by propagating supervised information on unlabeled data, which are thereafter used to reinforce learning. These schemes are beneficial in remote sensing, where thousands of new images are added every day, and manual labeling results are prohibitive. Our work introduces an ensemble-based semisupervised

Hyperspectral imagery denoising is a classical problem in hyperspectral remote sensing applications. In our previous work, we combined principal component analysis with wavelet shrinkage, and good denoising results were obtained. We combine minimum noise fraction (MNF) with video block matching and 3D filtering (VBM3D), which is a powerful video denoising method. After MNF transform, we automatically

Determining the amount of grain stored in silos is very important for accurate commercial inventory planning. A convolutional neural network (CNN) is developed for the first time to determine the amount of the grain using step-frequency continuous wave radar (SFCWR) signals. The radar reflection signal of different grain quantity for different grain surface patterns is gathered by means of a constructed

In recent years, Gabor filtering has been successfully applied in spectral–spatial hyperspectral image (HSI) classification tasks due to its strong power to characterize surface materials. Generally, the standard Gabor filter involves the real and imaginary parts. However, the traditional usage to integrate both the two parts, i.e., the Gabor magnitude feature, might weaken some unique characteristics

In remote sensing images, pixel-based classifiers use means or variance-covariance statistical parameters generated from training sample data sets. These parameters do not represent in totality about variations within the class. This research work enlightens each training sample’s role in handling heterogeneity within the class instead of using statistical parameters (mean). Modified possibilistic

The unsupervised classification of hyperspectral images (HSIs) draws attention in the remote sensing community due to its inherent complexity and the lack of labeled data. Among unsupervised methods, sparse subspace clustering (SSC) achieves high clustering accuracy by constructing a sparse affinity matrix. However, SSC has limitations when clustering HSI images due to the number of spectral pixels

Bayesian methods are widely used to recover sparse signals from their incomplete measurements with Gaussian white noise. However, while recovering multidimensional signals, these methods are limited by their considerable computational complexities. To address this problem, we develop the truncated Bayesian recovery algorithm for compressive sensing (CS) of multidimensional signals, such as hyperspectral

Accurate extraction of ground objects in mining areas using high spatial resolution imagery can effectively assist in the arrangement and deployment of the production work in mining areas. Therefore, it is essential to extract ground objects of mining areas quickly and accurately. However, the task is very difficult due to the variety of complex scenes, the high intra-class variation, low inter-class

Pan-sharpening is an effective method to obtain high-resolution multispectral (MS) images by fusing panchromatic (PAN) images with fine spatial structure and low-resolution MS images with rich spectral information. Many methods have been recently developed based on convolutional neural networks (CNNs) for pan-sharpening, which try to achieve better fusion performance using a large amount of training

Drought is one of the most serious natural disasters affecting global food security and human life. Traditional drought monitoring is based on the impact of water deficit on crop morphology. Due to the time lag of traditional drought monitoring based on vegetation index and land surface temperature, crop yield has been adversely affected when drought detection is delayed. Early drought warning is an

Airborne lidar data for fishery surveys often do not contain physics-based features that can be used to identify fish; consequently, the fish must be manually identified, which is a time-consuming process. To reduce the time required to identify fish, supervised machine learning was successfully applied to lidar data from fishery surveys to automate the process of identifying regions with a high probability

Domain adaptation is a technology enabling aided target recognition and other algorithms for environments and targets with data or labeled data that is scarce. Recent advances in unsupervised domain adaptation have demonstrated excellent performance but only when the domain shift is relatively small. We proposed targeted adversarial discriminative domain adaptation (T-ADDA), a semi-supervised domain

Crop height is useful to monitor the effects of cropland reclamation. Unmanned aircraft system (UAS)-based observation through digital cameras has exhibited significant potential as a cost-effective way to predict crop height. However, the performance of UAS-based multispectral images has not been adequately analyzed in the context of estimating crop height. Therefore, our study investigates the performance

Aboveground carbon (AGC) maps will assist with the monitoring and verification of carbon stored through restoration of subtropical thicket. Field methods are required to capture AGC ground truth data at the plot scale, but they are highly impractical for large area mapping of carbon stocks. Against this background, a remote sensing method to estimate AGC from very high spatial resolution multi-spectral

The hyperspectral image (HSI) has the characteristics of high resolution, a large amount of data, and a high correlation of bands. In the many HSI processing technologies, image classification is the most basic one. Supervised classification is the most effective and common classification method. However, to achieve the ideal classification effect, supervised classification needs a large number of

A method of monitoring produce freshness with hyperspectral imaging and machine learning is described as a way to reduce food waste in grocery stores. The method relies on hyperspectral reflectance images in the visible–near-infrared spectral range from 387.12 to 1023.5 nm with a 2.12-nm spectral resolution. The images were recorded in a laboratory with the imager viewing produce samples illuminated

Hyperspectral imaging has been used in a variety of geological applications since its advent in the 1970s. In the last few decades, different techniques have been developed by geologists to analyze hyperspectral data in order to quantitatively extract geological information from the high-spectral-resolution remote sensing images. We attempt to review and update various steps of the techniques used

The erratum corrects an error in the originally published version of the article.

Laser scanning technology has enabled to study three-dimensional (3D) structures in forests. For example, airborne laser scanning (ALS) point cloud has been applied to detect individual trees and segment tree crowns. However, the accuracy of such approach remains a challenge because of the intersected crowns and complicated understories. We developed a metabolic theory-based algorithm for individual

Spectroscopy plays a vital role in the identification and characterization of minerals on terrestrial and planetary surfaces. We review the three different spectroscopic techniques for characterizing minerals on the Earth and lunar surfaces separately. Seven sedimentary and metamorphic terrestrial rock samples were analyzed with three field-based spectrometers, i.e., Raman, Fourier transform infrared

Building damage assessment plays an essential role during post-disaster rescue operations. Given that labeled samples are difficult to timely obtain after a disaster, transfer learning attracts increasing attention. However, different sensors employed cause considerable discrepancies not only between historical and current scenes but also among historical scenes, which could exert an effect on transfer

Image stitching is an active research area in many photogrammetric and remote sensing applications. The main contribution of our work is to regard stitching as a multi-image matching problem that exploits advantages of invariant local features and homographic transformation to overcome photometric, geometric, and perspective distortions. Our proposed approach, referred to as Haar Invariant Feature

With the rapid development of optical remote sensing, it is urgent to find a reliable target detection method. Compared with traditional detection algorithms, a convolutional neural network has attracted considerable attention owing to its efficiency and high transitivity. However, different from general images, remote sensing images contain complex background information and dense small targets with

The lack of shortwave (SW, visible, and near-infrared) geostationary satellite data at night results in degradation of many weather forecasts and real-time diagnostic products. We present a method to extrapolate SW GOES-16 advanced baseline imager data through night using nighttime longwave (LW, infrared) observations and the relationships between LW and SW data observed during the previous day. The

The fusion of a hyperspectral image (HSI) and a panchromatic image (PI) creates data that is beneficial to subsequent processing. Based on the traditional nonnegative matrix factorization (NMF)-based fusion method, the logarithmic hyperbolic cosine function is introduced as a spectral constraint. Under the constraint, the original HSI is decomposed into endmember and abundance matrices. The abundance

Vicarious calibration approaches using in-situ measurements are key techniques applied to on-orbit remote sensors. The in-situ measurements have advantages in terms of traceability and quantifiable accuracy that make them ideal for inter-consistency studies of on-orbit sensors. The Committee on Earth Observation Satellites Working Group on Calibration and Validation Infrared Visible Optical Sensors

Remote sensing technology is an important means of ocean exploration. Unmanned aerial vehicle (UAV) remote sensing is widely used in small observation areas because of its flexible operation, timely data transmission, and high spatial resolution. According to these characteristics, we propose a ship attribute inversion algorithm based on the wake characteristics. First, a band selection method is used

Preprocessing is a major area of interest in the field of hyperspectral endmember extraction, for it can provide a few high-quality candidates for fast endmember extraction without sacrificing endmember accuracy. We propose a superpixel-guided preprocessing (SGPP) algorithm to accelerate endmember extraction based on spatial compactness and spectral purity analysis. The proposed SGPP first transforms

Mobile laser scanning (MLS), which can quickly collect a high-resolution and high-precision point cloud of the surroundings of a vehicle, is an appealing technology for three-dimensional (3D) urban scene analysis. In this regard, the classification of MLS point clouds is a common and core task. We focus on pointwise classification, in which each individual point is categorized into a specific class

Cloud detection in satellite images is a vital step for cloud/land recognition, cloud/snow discrimination, and cloud shadow removal. Accurate cloud detection plays an important role in land resource management, environmental pollution monitoring, and land target recognition. Deep learning (DL) algorithms have shown great progress in cloud detection. However, as the complexity of the DL-based model

The variability of the remote sensing reflectance, Rrs, now routinely retrieved from ocean color (OC) and high spatial resolution sensors, is often used to characterize water variability due to changes in inherent optical properties of the water body. At the same time, Rrs is partially variable because of uncertainties in its retrieval in the process of atmospheric correction. Using data from SNPP-VIIRS

Accurate information on the spatial distribution of crops is of great significance for scientific research and production practices. Such accurate information can be extracted from high-spatial-resolution optical remote sensing images. However, acquiring these images with a wide coverage is difficult. We established a model named multispectral super-resolution generative adversarial network (MS_SRGAN)