当前位置: X-MOL 学术ACM Trans. Multimed. Comput. Commun. Appl. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Hyperspectral Reconstruction with Redundant Camera Spectral Sensitivity Functions
ACM Transactions on Multimedia Computing, Communications, and Applications ( IF 5.1 ) Pub Date : 2020-05-25 , DOI: 10.1145/3386313
Xian-Hua Han 1 , Yinqiang Zheng 2 , Jiande Sun 3 , Yen-Wei Chen 4
Affiliation  

High-resolution hyperspectral (HS) reconstruction has recently achieved significantly progress, among which the method based on the fusion of the RGB and HS images of the same scene can greatly improve the reconstruction performance compared with those based on the individually spectral or spatial enhancement. It is well known that the HS image is obtained only via the costly hypersoectral sensor, whereas the RGB images can be provided by low-price RGB cameras and the spectral sensitivity (SS) functions of RGB cameras are usually different. Thus, this study proposes a HS reconstruction, which fuses merely two RGB images with redundant spectral responses. In this work, we design a new RGB camera via shifting the SS of an existed RGB camera, which can provide similar strength of spectral response with different spectral centers of SS, and fuse the new achieved color image with an existed RGB image by a deep ResNet. Experiments validate that fusion of two existed RGB images can provide impressive HS reconstruction performance and further improvement can be achieved by integrating the color image of the simulated SS with the RGB image.

中文翻译:

具有冗余相机光谱灵敏度函数的高光谱重建

高分辨率高光谱(HS)重建最近取得了显着进展,其中基于同一场景的RGB和HS图像融合的方法与基于单独光谱或空间增强的方法相比,可以大大提高重建性能。众所周知,HS 图像只能通过昂贵的超中心传感器获得,而 RGB 图像可以由低价 RGB 相机提供,并且 RGB 相机的光谱灵敏度(SS)功能通常不同。因此,本研究提出了一种 HS 重建,它仅融合了两个具有冗余光谱响应的 RGB 图像。在这项工作中,我们通过移动现有 RGB 相机的 SS 设计了一种新的 RGB 相机,它可以在 SS 的不同光谱中心提供相似强度的光谱响应,并通过深度 ResNet 将新获得的彩色图像与现有的 RGB 图像融合。实验证明,融合两个现有的 RGB 图像可以提供令人印象深刻的 HS 重建性能,并且可以通过将模拟 SS 的彩色图像与 RGB 图像相结合来实现进一步的改进。
更新日期:2020-05-25
down
wechat
bug