Abstract

The registration of a 3D model over an image can be seen as the alignment of visual correspondences extracted from these two data. This is a challenging task and it is even more complex when the two images have a different modality. This paper introduces an approach that allows matching features detected in two different modalities: photographs and 3D models, by using a common 2D representation. Our approach is based on a modification of the Marching Cubes algorithm aiming to remove ambiguous cases without adding further calculations in each cube. We share the idea about the crucial importance of splitting the equivalence cases into two classes. Considering all the possible states inside/outside in the four corners of a cube side, indeed, there are only four non-trivial cases after eliminating those equivalences through the rotation. The obtained results allow us to validate the feasibility of the proposed methodology.

中文翻译：

---

修改行进立方体算法以获得平面图像的 3D 表示

摘要

3D 模型在图像上的配准可以看作是从这两个数据中提取的视觉对应关系的对齐。这是一项具有挑战性的任务，当两个图像具有不同的模态时，它会更加复杂。本文介绍了一种方法，通过使用常见的 2D 表示，允许在两种不同的模式中检测到匹配的特征：照片和 3D 模型。我们的方法基于对 Marching Cubes 算法的修改，旨在消除不明确的情况，而无需在每个立方体中添加进一步的计算。我们同意将等价案例分成两类至关重要的想法。考虑立方体边的四个角的内部/外部所有可能的状态，实际上，通过旋转消除这些等价后，只有四种非平凡的情况。