当前位置: X-MOL 学术IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Hyperspectral Image Classification Method based on 2D-3D CNN and Multi-branch Feature Fusion
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing ( IF 5.5 ) Pub Date : 2020-01-01 , DOI: 10.1109/jstars.2020.3024841
Zixian Ge , Guo Cao , Xuesong Li , Peng Fu

The emergence of a convolutional neural network (CNN) has greatly promoted the development of hyperspectral image (HSI) classification technology. However, the acquisition of HSI is difficult. The lack of training samples is the primary cause of low classification performance. The traditional CNN-based methods mainly use the 2-D CNN for feature extraction, which makes the interband correlations of HSIs underutilized. The 3-D CNN extracts the joint spectral–spatial information representation, but it depends on a more complex model. Also, too deep or too shallow network cannot extract the image features well. To tackle these issues, we propose an HSI classification method based on the 2D–3D CNN and multibranch feature fusion. We first combine 2-D CNN and 3-D CNN to extract image features. Then, by means of the multibranch neural network, three kinds of features from shallow to deep are extracted and fused in the spectral dimension. Finally, the fused features are passed into several fully connected layers and a softmax layer to obtain the classification results. In addition, our network model utilizes the state-of-the-art activation function Mish to further improve the classification performance. Our experimental results, conducted on four widely used HSI datasets, indicate that the proposed method achieves better performance than the existing alternatives.

中文翻译:

基于2D-3D CNN和多分支特征融合的高光谱图像分类方法

卷积神经网络(CNN)的出现极大地推动了高光谱图像(HSI)分类技术的发展。然而,收购恒生指数是困难的。缺乏训练样本是分类性能低的主要原因。传统的基于 CNN 的方法主要使用 2-D CNN 进行特征提取,这使得 HSI 的带间相关性没有得到充分利用。3-D CNN 提取联合光谱-空间信息表示,但它依赖于更复杂的模型。此外,太深或太浅的网络都不能很好地提取图像特征。为了解决这些问题,我们提出了一种基于 2D-3D CNN 和多分支特征融合的 HSI 分类方法。我们首先结合 2-D CNN 和 3-D CNN 来提取图像特征。然后,通过多分支神经网络,在光谱维度上提取并融合了由浅到深的三种特征。最后,融合的特征被传递到几个全连接层和一个 softmax 层,以获得分类结果。此外,我们的网络模型利用最先进的激活函数 Mish 来进一步提高分类性能。我们在四个广泛使用的 HSI 数据集上进行的实验结果表明,所提出的方法比现有替代方法具有更好的性能。我们的网络模型利用最先进的激活函数 Mish 来进一步提高分类性能。我们在四个广泛使用的 HSI 数据集上进行的实验结果表明,所提出的方法比现有替代方法具有更好的性能。我们的网络模型利用最先进的激活函数 Mish 来进一步提高分类性能。我们在四个广泛使用的 HSI 数据集上进行的实验结果表明,所提出的方法比现有替代方法具有更好的性能。
更新日期:2020-01-01
down
wechat
bug