Risley-prism-based multi-beam scanning LiDAR for high-resolution three-dimensional imaging

https://doi.org/10.1016/j.optlaseng.2021.106836Get rights and content

Highlights

  • Coherent light detection and ranging architecture for three-dimensional imaging.

  • Risley-prism-based multi-beam scanning enables high-resolution spatial sampling.

  • Multi-mode integrated point cloud filtering method for efficient outlier removal.

  • Coarse-fine coupled alignment strategy for multi-channel point cloud registration.

Abstract

Light detection and ranging (LiDAR) as a significant approach to three-dimensional perception has increasingly suffered from challenges for compact structure, high resolution and strong adaptability. This paper presents a versatile LiDAR system that incorporates multi-beam scanning using Risley prisms and coherent detection based on triangular frequency modulation. By combining Risley-prism-based multi-beam steering model with simultaneous distance and velocity measurements, the LiDAR architecture for three-dimensional imaging is theoretically demonstrated. A unified LiDAR point cloud processing framework is developed, where the multi-mode integrated filtering method is proposed for outlier removal using point cloud characteristics. The coarse-fine coupled strategy is also formulated to combine statistical modeling with iterative optimization for multi-channel point cloud registration. It is experimentally validated that our LiDAR can achieve high-resolution three-dimensional information acquisition against long range, and the proposed point cloud processing technique can fully reconstruct the spatial form of object while preserving sufficient details.

Introduction

Three-dimensional (3D) imaging has garnered emerging interest as a technology to recover the surrounding environment from the signals acquired with various sensors or instruments, which can significantly contribute to object identification and situational perception. In contrast with passive methods represented by stereo vision, light detection and ranging (LiDAR) offers an essential approach to active 3D imaging. Due to its potential to achieve wide coverage, high resolution and ambient immunity [1], LiDAR has found extensive applications in many fields, such as remote sensing, topographic mapping and autonomous driving [2], [3], [4].

The existing LiDAR systems normally fall under two categories, in which one relies on flash illumination and the other requires beam scanning. Based on time of flight (TOF) ranging with large-area light pulses [5], the flash LiDAR usually necessitates a high peak laser power and high-performance detectors such as avalanche photodiodes and charge-coupled devices [6], [7], [8]. Comparatively, the scanning LiDAR working in a serial information acquisition mode allows performance enhancement at relatively low cost [9] Most beam scanning methods for 3D imaging LiDAR are based on mature technologies such as opto-mechanical devices or micro-electro-mechanical systems (MEMS). The conventional opto-mechanical LiDARs may incorporate different types of scanning systems to generate specific beam scan patterns, such as rotors, polygonal mirrors, galvanometric scanners or oscillatory scanners [10]. However, such mechanisms have some shortcomings in complex internal structure, high power consumption and limited scan rate [11,12]. The MEMS scanning LiDARs employs deformable mirrors driven by micro actuators for high dynamic response, which are still limited due to the inherent sensitivity to vibration and the angular resolution restricted by aperture size [13,14]. In recent years, solid-state LiDARs with inertia-free designs have attracted increasing attention in industries where reliability and stability are highly desired. One potential solid-state beam steering approach is to use optical phased arrays (OPA), for which the optical phase control and the complicated fabrication process remain challenging [15], [16], [17]. Alternatively, nonmechanical beam steering is made possible through lens-assisted integrated optical switch array [18], time-stretch spectrally scanning with tunable lasers [19], or wideband frequency swept source [20]. But those methods can only achieve beam scanning with a limited range or in one dimension. Differing from the above solutions, Risley-prism beam scanner offers significant advantages in compact structure, conformal aperture, low moment of inertia and great flexibility [21]. There have already been some basic studies about Risley prisms, mostly related to system setup and performance evaluation [22,23], analytical solutions to inverse problem [24,25], and graphical analysis for scan patterns [26]. By producing a wide variety of scan patterns through the coaxial rotation of two wedge prisms, this scanner can provide a multi-mode beam scanning mechanism for 3D imaging LiDAR [21,27].

As for light detection methods used in 3D LiDAR systems, TOF ranging based on direct pulsed laser detection has been dominant in many applications due to matured hardware setting and signal processing methods [[5], [6], [7], [8],11,14,[16], [17], [18], [19],27]. However, the TOF ranging performance is constrained by the limited laser pulse power for safety requirements and the returned signals that may be affected by strong sunlight or laser beams from other systems. There is a growing interest to develop frequency modulated continuous wave (FMCW) ranging based on coherent detection [15,20]. By reducing system complexity and resisting ambient influence in principle, the FMCW ranging is advantageous in high sensitivity, superior resolution and large dynamic range while performing simultaneous distance and velocity measurements.

In our previous work [28], we have proposed a 3D coherent imaging LiDAR that combines Risley prisms for wide-FOR beam scanning with FMCW for high-accuracy ranging, which has been validated in an airborne flight experiment. However, the LiDAR adopted a single-beam scanning scheme which leads to inherent limitations on spatial sampling and 3D sensing. Here we present, to the best of our knowledge, the first demonstration of Risley-prism-based multi-beam scanning (RMS) LiDAR using FMCW coherent detection. By steering multiple beams simultaneously through Risley prisms, the RMS LiDAR can significantly enhance the spatial sampling agility and information acquisition efficiency, thus enabling multi-channel point cloud generation with variable density and flexible resolution. The LiDAR data processing framework is developed to handle these large-scale point clouds, which incorporates a multi-mode integrated filtering method and a coarse-fine coupled registration method. It is intended that the proposed technique can achieve high-quality 3D imaging and reconstruction while balancing between computational efficiency and processing performance.

The remainder of this paper is outlined as follows. In Section 2, the 3D imaging architecture using RMS LiDAR is presented through theoretical demonstration and performance evaluation. In Section 3, the multi-channel data processing framework is developed with an emphasis on multi-mode integrated filtering and coarse-fine coupled registration. In Section 4, the proposed technique is validated by a 3D imaging experiment. The conclusions are drawn in Section 5.

Section snippets

Risley-prism-based 3D imaging LiDAR

As illustrated in Fig. 1, the proposed RMS LiDAR is mainly composed of a FMCW ranging module, a multi-channel optical fiber array, and a Risley-prism beam scanner. The FMCW ranging module incorporates an arbitrary waveform generator, an electro-optical modulator and an optical filter to achieve broadband frequency modulation. The frequency-modulated laser signal is divided into two parts for transceiver and local oscillator, respectively. The laser signal entering the transceiver chain is first

Framework for multi-channel point cloud processing

The basic framework for RMS LiDAR data processing incorporates the acquisition, filtering and registration of multi-channel point clouds, as depicted in Fig. 5. It has been clarified in Section 2 that the original point cloud in each channel can be acquired by combining FMCW ranging information with prism motion law, leading to 3D coordinates, velocity and echo intensity. By removing the background or noisy points in terms of geometrical and physical properties, the filtering process is

Experimental setup

The proposed 3D imaging architecture using RMS LiDAR has been further validated in a long-range experiment under outdoor conditions. For high-resolution FMCW ranging, the central wavelength for transmitted signals is λ = 1550 nm, the frequency modulation bandwidth is B = 800 MHz, and the half modulation period is τ = 50µs. The Risley-prism beam scanner comprises two identical elements with the wedge angle α = 6.5° and refractive index n = 3.4795. The spacing angle between neighboring channels

Conclusion

In this paper, we present both theoretical and experimental demonstration of a RMS LiDAR which combines Risley-prism multi-beam steering with FMCW coherent detection. By investigating the multi-beam scanning mechanism through a ray tracing method, the mathematical model for multi-channel point cloud acquisition is derived from prism motion and simultaneous distance and velocity measurements. The parametric analysis is performed to investigate the contribution of Risley-prism-based multi-beam

CRediT authorship contribution statement

Anhu Li: Conceptualization, Supervision, Writing – review & editing. Xingsheng Liu: Methodology, Investigation, Writing – original draft, Writing – review & editing. Jianfeng Sun: Conceptualization, Supervision. Zhiyong Lu: Resources, Methodology, Validation.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgement

This work was supported by National Natural Science Foundation of China (61975152). The authors acknowledge Xindong Li, Hao Chen and Haisheng Cong for their assistance in experiment.

References (34)

  • B.F. Aull et al.

    A study of crosstalk in a 256×256 photon counting imager based on silicon Geiger-mode avalanche photodiodes

    IEEE Sens J

    (2015)
  • T. Raj et al.

    A survey on LiDAR scanning mechanisms

    Electronics (Basel)

    (2020)
  • G.F. Marshall et al.

    Handbook of optical and laser scanning

    (2011)
  • R. Halterman et al.

    Velodyne HDL-64E lidar for unmanned surface vehicle obstacle detection

  • T. Bifano

    MEMS deformable mirrors

    Nat Photonics

    (2011)
  • B. Hellman et al.

    Wide-angle MEMS-based imaging lidar by decoupled scan axes

    Appl Opt

    (2020)
  • C.V. Poulton et al.

    Coherent solid-state LIDAR with silicon photonic optical phased arrays

    Opt Lett

    (2017)
  • Cited by (28)

    • Analytical inverse solution of a rotational achromatic Risley prism based on Fourier series fitting

      2023, Precision Engineering
      Citation Excerpt :

      Risley prism systems (RPSs) having compact structures and low costs are gradually being applied in various areas that involve scanning [1–5], optical communications [6,7], and optoelectronic tracking [8–13] and pointing [14–16].

    • LiDAR intensity correction for road marking detection

      2023, Optics and Lasers in Engineering
      Citation Excerpt :

      Autonomous vehicle (AV) technology is one of the focus areas of current research on intelligent transportation systems (ITS), providing a proven set of strategies for advancing transportation safety, comfort, and environmental sustainability [1,2]. Mobile laser scanning (MLS) systems are a type of survey-grade, light detection and ranging (LiDAR) that can quickly and efficiently perceive the surrounding environment by actively emitting laser beams to generate point cloud data [3]. LiDAR is less sensitive to environmental illumination than camera sensors; it performs well in shadows, in an excess–or lack of light–and it provides more comprehensive and accurate information about the environment [4].

    View all citing articles on Scopus
    1

    These authors contributed equally to this work.

    View full text