当前位置: X-MOL 学术IEEE Trans. Comput. Imaging › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Reconstruction of Hyperspectral Data from RGB Images with Prior Category Information
IEEE Transactions on Computational Imaging ( IF 5.4 ) Pub Date : 2020-01-01 , DOI: 10.1109/tci.2020.3000320
Longbin Yan , Xiuheng Wang , Min Zhao , Maboud Kaloorazi , Jie Chen , Susanto Rahardja

Hyperspectral recovery using RGB images has recently attracted considerable attention in many imaging and computer vision applications because of its ability to equip a low cost tool in acquiring spectral signatures of natural scenes. Current methods of recovering hyperspectral information via RGB measurements may fail for objects sharing similar RGB features. In this paper, we introduce a novel framework with the U-net-based architecture, namely C2H-Net, which is used to reconstruct high quality hyperspectral images from their RGB measurements. C2H-Net also exploits prior information comprising of category and coordinate information of specific objects of interest to address the restriction of the existing methods. C2H-Net is highly accurate and outputs “true” spectral information of objects/scenes. In addition, a new hyperspectral dataset namely C2H-Data (available at Github) is developed in this work and used for additional extensive evaluation on the proposed framework. The C2H-Data contains a variety of objects with large number of images and category information which would be useful for the research community. We conduct experiments using three different datasets to show the effectiveness of C2H-Net. The experimental results show that our proposed method outperforms several existing methods.

中文翻译:

从具有先验类别信息的 RGB 图像重建高光谱数据

使用 RGB 图像的高光谱恢复最近在许多成像和计算机视觉应用中引起了相当大的关注,因为它能够配备低成本工具来获取自然场景的光谱特征。对于共享相似 RGB 特征的对象,当前通过 RGB 测量恢复高光谱信息的方法可能会失败。在本文中,我们介绍了一种基于 U-net 架构的新框架,即 C2H-Net,用于从 RGB 测量中重建高质量的高光谱图像。C2H-Net 还利用包括特定感兴趣对象的类别和坐标信息的先验信息来解决现有方法的限制。C2H-Net 高度准确,输出对象/场景的“真实”光谱信息。此外,在这项工作中开发了一个新的高光谱数据集,即 C2H-Data(可在 Github 上获得),并用于对提议的框架进行额外的广泛评估。C2H-Data 包含各种具有大量图像和类别信息的对象,这对研究界很有用。我们使用三个不同的数据集进行实验来展示 C2H-Net 的有效性。实验结果表明,我们提出的方法优于现有的几种方法。我们使用三个不同的数据集进行实验来展示 C2H-Net 的有效性。实验结果表明,我们提出的方法优于现有的几种方法。我们使用三个不同的数据集进行实验来展示 C2H-Net 的有效性。实验结果表明,我们提出的方法优于现有的几种方法。
更新日期:2020-01-01
down
wechat
bug