Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Highly-time-resolved FMCW LiDAR with synchronously-nonlinearity-corrected acquisition for dynamic locomotion

Open Access Open Access

Abstract

Highly-time-resolved and precise tracking of position, velocity, and acceleration is urgently required when highly dynamic legged robots are walking, trotting, and jumping. Frequency-modulated continuous-wave (FMCW) laser ranging is able to provide precise measurement in short distance. However, FMCW light detection and ranging (LiDAR) suffers from a low acquisition rate and poor linearity of laser frequency modulation in wide bandwidth. A sub-millisecond-scale acquisition rate and nonlinearity correction in the wide frequency modulation bandwidth have not been reported in previous studies. This study presents the synchronous nonlinearity correction for a highly-time-resolved FMCW LiDAR. The acquisition rate of 20 kHz is obtained by synchronizing the measurement signal and the modulation signal of laser injection current with a symmetrical triangular waveform. The linearization of laser frequency modulation is conducted by resampling of 1000 intervals interpolated in every up-sweep and down-sweep of 25 µs, while measurement signal is stretched or compressed in every period of 50 µs. The acquisition rate is demonstrated to be equal to the repetition frequency of laser injection current for the first time to the best of authors’ knowledge. This LiDAR is successfully used to track the foot trajectory of a jumping single-leg robot. The high velocity up to 7.15 m/s and high acceleration of 365 m/s2 are measured during the up-jumping phase, while heavy shock takes place with high acceleration of 302 m/s2 as the foot end strikes the ground. The measured foot acceleration of over 300 m/s2, which is more than 30 times gravity acceleration, is reported on a jumping single-leg robot for the first time.

© 2023 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

1. Introduction

In recent years, plenty of attention for light detection and ranging (LiDAR) has been paid to the development of autonomous vehicles [1], drones [2] and robots [3,4], which requires the ability to quickly recognize and classify objects under fast-changing and highly dynamic conditions. Robotic intelligence in challenging natural environments relies on its own blind kinematic estimation, reinforcement learning, and adaptive actuation [5]. For example, quadrupedal robots can run at high speed and jump in a dynamic pose with millisecond-scale actuation [6], and they require precise perception to operate in sub-millisecond scale, just as instinct perception of their bionic counterparts, like dogs, cats, etc [79]. However, to the best of authors’ knowledge, it is nearly impossible for state-of-the-art perceptive sensors, such as LiDAR [4,10], camera [11], fiducial marker [12], etc., to operate with sub-millisecond response for highly dynamic targets.

Coherent ranging, also known as frequency-modulated continuous-wave (FMCW) laser-based LiDAR [13] is extensively used for precise perception on autonomous systems. Compared with the conventional time-of-flight (ToF) LiDAR, FMCW LiDAR will not require high-speed electronics to measure ultra-short flight time, which is quite suitable for precise measurement of the distance of <1 m for robots’ perception. However, FMCW LiDAR requires highly coherent [14] and precisely chirped [15] laser sources with a wide modulation bandwidth, and usually has a low acquisition rate. The coherence length of laser sources is correlated with the maximum detectable range, which is determined by the linewidth of the laser. The maximum measurement resolution is inversely proportional to the frequency chirp bandwidth. This coherent LiDAR requires ideally linear chirp modulation, but in practice it is difficult for lasers, especially for compact and low-cost semiconductor laser diodes (LD), to deliver linear modulation in sub-THz wide chirp bandwidth. Nonlinearities in frequency modulation widen the target spectrum, thereby decreasing the measurement accuracy and sometimes providing detection errors. Distributed feedback (DFB) lasers can provide a large chirp bandwidth, but the laser linewidth is usually limited by the short cavity length [16]. With self-injection locking, the linewidth can be effectively narrowed, and yet the chirp bandwidth is also decreased [17,18]. Recently, several integrated external cavity lasers have been demonstrated, which possess a wide chirp bandwidth and a narrow linewidth, quite suitable for the FMCW LiDAR applications [1921]. With synchronous tuning by pre-distortion algorithms, the chirp nonlinearity is reduced to 1.02 × 10−7 in a 7.68-GHz chirp bandwidth at the 1 kHz repetition rate [22]. In order to get further wider chirp bandwidth, multiple distributed feedback lasers (DFBs) were combined to realize a 300 GHz swept frequency bandwidth [23]. An all-digital phase locked loop was proposed to achieved a sweep bandwidth of more than 200 GHz with mode-hop-free [24]. Moreover, the auxiliary interference beat signal was proposed to correct the nonlinearity in the beat frequency of each laser source by resampling the measurement signal [25,26]. Afterwards, signal stitching and resampling for multiple laser sources are conducted, where synchronous phase matching between measurement signals is critical [27]. Therefore, we can find that it is quite complicated and time-consuming for the effective nonlinearity correction in wide chirp bandwidth of sub-THz. Moreover, in order to get a large beam steering angle for optical phased array (OPA) based LiDAR, the wavelength range for laser sources are required to go beyond 200 nm, but it will be very difficult to simultaneously obtain linearly-chirped frequency signals for all these wavelengths [2832]. Nonlinearity correction for FMCW ranging has been mostly demonstrated with pre-distorted laser chirps or phase locked loop [2227]. So far, there has been no enough attention paid to post-processing algorithms for nonlinearity correction during data acquisition. FMCW laser ranging has been used to measure the distance of a dynamic vibration, but the measured speed and acceleration for vibrations are very low with low time resolution of 25 ms [33,34]. Low-noise integrated laser has been used to demonstrate a FMCW LiDAR at high acquisition rate of 800 kHz, but the distance resolution is limited to 12.5 cm at 10-m ranging because the frequency chirp bandwidth is only 1 GHz [35]. Up to now, wide frequency chirp bandwidth and acceptable linearity for FMCW LiDAR at a high data acquisition rate of sub-millisecond scale have not been achieved.

In this paper, a simplified scheme of synchronous nonlinearity correction for FMCW measurement signals is demonstrated. A triangular waveform of injection current is used to drive a DFB laser source, involving nonlinearity in the frequency chirp bandwidth of 160 GHz. Meanwhile, this triangular waveform of laser injection current is feedforwarded to a high-speed data acquisition module (DAQ). We use this high-speed DAQ to accommodate measurement signals, extract low-frequency signals by low-pass filter (LPF), and then synchronize this low-frequency signals and the signals of laser injection current. Afterwards, nonlinearities of frequency chirp are effectively corrected by resampling of 1000 intervals interpolated in each up-sweep/down-sweep frequency modulation. Therefore, the highly-time-resolved beat signals are achieved with the high acquisition rate of 20 kHz, which is equal to repetition rate of frequency-modulated signals. Lastly, this FMCW LiDAR is mounted on a single-leg robot to measure the locomotion during the highly dynamic jumping. The highly-time-resolved ranging results clearly show the sub-millisecond-scale time evolution of the height, velocity and acceleration of foot, for the first time.

2. Principle

The frequency of the FMCW laser ranging system is generally modulated in the form of symmetrical triangular waves or saw-tooth waves and the basic interferometric optical path is the Mach-Zender interferometer (MZI). If the laser frequency is not ideally linear modulated, the laser modulation form can be expressed as Fig. 1(a).

 figure: Fig. 1.

Fig. 1. (a) Principle of beat frequency formation, (b) schematic scheme of synchronous nonlinearity correction for FMCW LiDAR.

Download Full Size | PDF

The principle of nonlinearity correction for laser frequency sweeping interference to measure the distance is presented below.

The linear frequency modulation function of the tunable laser can be expressed as follows:

$$f(t )= {f_0} + kt \qquad \quad- T/2 < t < T/2,$$
where f0 is the initial laser frequency, k is the laser frequency modulation slope, and T is the laser frequency modulation period. The difference between the measurement optical path and the reference optical path causes the two signals to arrive at the photodetector at different times. The delay between the two optical paths is the time the laser light propagates in air, and R is the distance along the laser path in air. The air refractive index is n, and the speed of light is c, where
$$\tau = 2Rn/c.$$

Consider a nonlinear term in the frequency modulation laser output G(t): the instantaneous frequency f(t) of the laser at time t is then

$$f(t )= {f_0} + kt + G(t )\quad- T/2 < t < T/2.$$

The frequency functions of the reference and measurement circuits are shown in Fig. 1(a).

The two signals mix during every sweep cycle and interfere at the detector to produce an electrical signal with a beat frequency fb.

The phase of mixed signal can be written as

$$\varphi (t )= 2\pi \tau [{{f_0} + kt + G(t )} ]\quad- T/2 < t < T/2.$$

The pre-corrected signal involving nonlinear frequency chirp is presented in Eq. (5) [3638]:

$$\tilde{{\boldsymbol E}}({\boldsymbol t} )= {E_0}{e^{i2\pi \tau [{{f_0} + kt + G(t )} ]}} \qquad \quad- T/2 < t < T/2.$$

Then, we have

$$E(t )= {E_0}cos2\pi \tau [{{f_0} + kt + G(t )} ]\quad- T/2 < t < T/2.$$

The beat frequency extracted from Eq. (6):

$${f_b} = [{k + \partial G(t )/\partial t} ]\tau \qquad- T/2 < t < T/2,$$
where fb will be a time-dependent variable that involves nonlinear errors, as shown in Fig. 1(a). Because of the nonlinear fb as function of time, the waveform of pre-corrected signals in Eq. (6) is deformed and becomes non-uniform in time domain as indicated by “Pre-corrected signals” in Fig. 1(b).

If the injection current for laser source is strictly set as a form of symmetrical triangular waves, I(t), the nonlinearity of laser frequency modulation can be formulated as:

$$G(t )\sim G(I )I(t ) \qquad- T/2 < t < T/2,$$
where I(t) has the same modulation period T as f(t), and G(I) is presented as the nonlinear correlation of laser frequency with injection current. The pre-corrected signal in Eq. (6) has low-frequency component, whose repetition frequency is equal to the frequency of I(t). Then, the signal in Eq. (6) can be synchronized with synchronous signal I(t) as shown in Fig. 1(b), and the up-sweep period and down-sweep period can be identified in every period T of pre-corrected signal E(t).

Within every up-sweep and down-sweep of laser modulation, the nonlinearities can be corrected by linearizing G(t)=kl × t with over 1000 intervals interpolated, where kl is a time-independent constant. In this work, the correlation of laser frequency versus different injection currents, G(I), is measured by an offline method. The laser frequency has nonlinear relationship with injection current and the injection current strictly follows linear relationship with time. Then, the nonlinear relationship of laser frequency with time, G(t), is obtained by numerically fitting the laser frequency versus injection current G(I). Lastly, the linearization of G(t) will be conducted by numerical resampling of laser frequency versus time with G(t)=kl × t. Afterwards, the frequency modulation waveform is achieved as a triangular waveform, as indicated by a dashed red curve in Fig. 1(b). Meanwhile, E(t) in Eq. (6) is resampled according to the linearizing relationship of G(t), and some signals are stretched in time domain while other signals are compressed with linearized G(t). Then the measurement signals are recovered to be uniform in time domain, as indicated by “Corrected signals” in Fig. 1(b). Accordingly, the corrected signals El(t) are presented as below:

$${E_l}(t )= {E_0}cos2\pi \tau [{{f_0} + ({k + {k_l}} )t} ] \quad- T/2 < t < T/2,$$
where, fbl = (k + kl)τ=Bτ/T becomes a time-independent constant, and B is the laser frequency modulation bandwidth with synchronously nonlinearities corrected in every period T. It can be further expressed as:
$${f_{bl}} = ({B/T} )\; \tau = ({2nB/cT} )\; R.$$

In principle, the corrected signals El(t) should be uniform in time domain, except for the transition time from up-sweep to down-sweep, as schematically presented in Fig. 1(b). However, in the real implementation of a FMCW LiDAR system, the corrected signals El(t) include the beat frequency, frequency components of internal reflections, and phase noises, which leads to a non-uniform waveform of El(t) in time domain.

3. Experimental setup and results

3.1 Experimental setup

The optical path of the highly time-resolved FMCW LiDAR is shown in Fig. 2. This setup is based on a frequency-modulated continuous-wave laser ranging system with synchronously nonlinearity corrected on data acquisition module. Optical frequency modulation is achieved by modulating the injection current of a compact DFB laser diode (Sacher Lasertechnik DFB-1556-100-FC/APC). Current modulation is performed by a function generator with a form of symmetrical triangular waves of laser injection current and a repetition frequency of 20 kHz. The function generator also provides a synchronous voltage signal with the same waveform of current modulation toward DAQ in Fig. 2, in order to trigger the synchronization between the measurement signal and injection current signal. The measurement signal is emitted to the target through a collimating lens (CL, Thorlabs PAF2-A7C) and is reflected back along the original path. The reflected signal is collected by CL, and coupled with the reference signal in a 2 × 2 coupler (50:50). Then, the optical mixing signal is directed to a balanced photodetector (BPD, Thorlabs PDB450C-AC). A data acquisition card (DAQ, ART Technology PCIe8914) with two channels is used to simultaneously record the measurement signal and synchronous signal at a rate of 100 MS/s with an accuracy of 14 bits. Finally, the synchronous nonlinearity correction is conducted on DAQ programmed by a computer.

 figure: Fig. 2.

Fig. 2. Schematic diagram of the experimental setup. CIR: circulator; CL: collimating lens; BPD: balanced photodetector; TIA: trans-impedance amplifier; DAQ: data acquisition card.

Download Full Size | PDF

The real-time program by LabVIEW software is run by a parallel computing platform (CUDA) on graphics processing units (GPU, RTX3060). It includes five steps of real-time signal processing: low-frequency components extraction from measurement signals by low-pass filtering, synchronization of low-pass filtered signals and the modulation signals of laser injection current, linearization and resampling of laser frequency modulation according to the relationship of laser frequency with injection current, real-time Discrete Fourier transform (DFT) of resampled signals by FIFO method within every up-sweep and down-sweep of 25 µs, and smoothing/filtering of all obtained DFT spectra. The details for real-time program can be found in Supplement 1.

3.2 Results and discussion

The nonlinear properties of DBF laser source are characterized in Fig. 3. The superimposed lasing spectra are measured by an optical spectrum analyzer (OSA, AQ6370D, YOKOGAWA). The wavelength resolution is 0.02 nm and the dynamic range is 90 dB, which ensures the measurement accuracy of the side mode suppression ratio (SMSR). When the injection currents change from 20 mA to 500 mA and the TEC temperature was fixed at 25°C in Fig. 3(a), the laser wavelength is tuned from 1548.12 nm to 1549.76 nm, covering a 205 GHz frequency continuous sweep range. The nonlinearity of laser frequency versus injection current of laser diode is obtained by numerical fitting of the experimental data, as shown in Fig. 3(b). The nonlinear modulation of laser frequency is accordingly shown in Fig. 3(c), and a down-sweep laser frequency modulation bandwidth of 160 GHz is obtained by modulating injection current from 160 mA to 480 mA. A symmetrical triangular waveform of injection current modulation is schematically shown in the inset of Fig. 3(c), with the range of modulating injection current of 160-480 mA and a repetition frequency of 20 kHz. With a high sampling rate of 100 MS/s at DAQ, the low-frequency component is simultaneously extracted when recording the pre-corrected measurement signal (red line) in Fig. 3(d). And the low-pass filtered signal (green line) is synchronized with the synchronous voltage signal (black line) fed by the injection current modulation of laser source.

 figure: Fig. 3.

Fig. 3. Nonlinearity characteristic for the DFB laser source. (a) Measured wavelength tuning when changing the injection currents from 20 mA to 500 mA. (b) The nonlinearity of laser frequency versus injection current. (c) The nonlinear laser frequency modulation with down-sweep 160 GHz. (d) Synchronous FMCW measurement signal with injection current signal. Black line represents the synchronous voltage signal from laser source, red line represents the pre-corrected measurement signal and green line is low-pass filtered measurement signal.

Download Full Size | PDF

The DAQ has a high sampling rate of 100 MS/s with a high accuracy of 14 bits, and it can realize the real-time resampling of measurement signals in every period. Figure 4(a) shows the measurement signal in up-sweep frequency chirp before synchronous correction. Here, the laser frequency nonlinearly changes as time goes in an up-sweep, as presented in the right axis of Fig. 4(a). The DAQ simultaneously records the measurement signal and synchronous signal, and accurately synchronizes the low-frequency measurement signal and synchronous signal as shown in Fig. 3(d). With identifying up-sweep and down-sweep in each period in time, the measurement signal can be resampled to correct the nonlinearity of frequency modulation in every up-sweep and down-sweep. Figure 4(b) demonstrates a typical resampling process of the measured FMCW signal on DAQ, according to the nonlinearity correction of an up-sweep frequency modulation. The linearization of frequency modulation versus time is conducted with 1000 highly time-resolved intervals in the up-sweep of 25 µs. The measurement signal is also interpolated with 1000 intervals in time domain and resampled according to linearization of laser frequency. Compared with signal stitching and resampling for multiple laser sources in [23,27], this LiDAR system is simplified with similar frequency modulation bandwidth of sub THz and phase mismatching for signal stitching is eliminated. Therefore, this synchronous acquisition with nonlinear chirps corrected in every 25 µs can deliver the precise measurement results at a high data rate of 20 kHz, which is equal to the repetition frequency of laser frequency chirps. The amplitude waveform in Fig. 4(b) at 0-15 µs is relatively uniform compared to that at 15-25 µs, close to the adjacent down-sweep, because the waveform is dominated by low-frequency amplitude modulation at the transition time from up-sweep to down-sweep. Also, the corrected signal should be non-uniform in time domain in the real implementation of a LiDAR, since it consists of many frequency components in frequency domain including the beat frequency, the signal internally reflected by CL, and phase noise.

 figure: Fig. 4.

Fig. 4. (a) The Pre-corrected measurement signal (blue curve on the left axis) with a nonlinear frequency modulation in up-sweep period (black curve on the right axis). (b) The corrected signal is resampled (red curve on the left axis), according to a linear up-sweep frequency modulation (black curve on the right axis).

Download Full Size | PDF

Figure 5(a) shows the synchronous correction for measured signals of 1-m distance in time domain. As previously discussed, the measurement signal is corrected based on the synchronous linearization of laser frequency, with signal stretched or compressed in time domain (blue curve). Discrete Fourier transform (DFT) of time-domain signal is used to extract the beat frequency signal. The pre-corrected waveform in time domain is deformed and non-uniform at 0-15 µs in Fig. 5(a), because nonlinear laser frequency chirps are involved. The beat signal cannot be exacted on the pre-corrected frequency spectrum in Fig. 5(b). With nonlinearity corrected, the waveform is stretched and becomes uniform at 0-15 µs. Clear and robust beat frequency is obtained on the corrected spectrum in Fig. 5(b).

 figure: Fig. 5.

Fig. 5. Measured signals for 1-m distance in time domain (a) and frequency domain (b). (b) is obtained by DFT of (a).

Download Full Size | PDF

This highly-time-resolved FMCW LiDAR is validated by a series of measurement experiments. The moving target is mounted on a guide rail with accurate pre-defined position. Typical frequency spectra after DFT of nonlinearity-corrected signals are superimposed in Fig. 6(a), corresponding to the distance measurement for 0.05-1 m. The distance versus beat frequency is shown in Fig. 6(b). Each measurement point involves 40,000 pieces of beat signal curve in two seconds. And a visualized probability density function of 1-m distance measurement is shown in the inset of Fig. 6(b). The beat signal is clearly presented even though the background noise involving thermal noise and phase noise is much brighter. The statistical distribution of 1-m distance measurement presents a Gaussian function (dashed line) as in Fig. 6(c), with an average distance of 0.997 m and a standard deviation of 2.5 cm. Error bars are marked for each point of Fig. 6(b) to provide the deviations for all measurements. The theoretical resolution for FMCW LiDAR ranging is related to the laser frequency modulation bandwidth [16,27], which is about millimeter scale for 160 GHz modulation bandwidth. Here, the ranging accuracy is deteriorated by phase noises and thermal noise during this fast measurement as show in the inset of Fig. 6(b). The accuracy of this fast FMCW laser ranging is good enough for the measurement of highly dynamic locomotion of robots.

 figure: Fig. 6.

Fig. 6. (a) Measured frequency spectra of 0.05-1 m distance with nonlinearity corrected. (b) Highly-time-resolved distance measurement by FMCW LiDAR. (c) Statistical distribution of 1-m distance measurement with total 40,000 counts.

Download Full Size | PDF

With pre-defined movement of target on a guide rail, this LiDAR is used to track the dynamic locomotion of a moving target. In Fig. 7, the target moves at high speed and low speed respectively. The velocity is derived by the derivative of distance as function of time, and the acceleration is the derivative of velocity. Figure 7(a) and Fig. 7(d) show the distance tracking of a fast locomotion and a slow locomotion, respectively. The fast locomotion speeds up to the velocity of about 2.7 m/s in 0.1 s and then slows down in Fig. 7(b). The slow locomotion speeds up to 1.6 m/s, keeps the fixed velocity for 0.2 s, and then slows down in Fig. 7(e). The acceleration of fast locomotion is approaching 20 m/s2 in Fig. 7(c), which is almost two times gravity acceleration. In contrast, in Fig. 7(f), the measured acceleration for slow locomotion is below the gravity acceleration. We can see that this highly-time-resolved FMCW LiDAR is able to accurately track the distance, velocity and acceleration together for dynamic locomotion.

 figure: Fig. 7.

Fig. 7. Measured data for a moving target using highly-time-resolved FMCW LiDAR. Distance (a), velocity (b), and acceleration (c) of fast locomotion; and distance (d), velocity (e), and acceleration (f) of slow locomotion, respectively.

Download Full Size | PDF

4. Demonstration of highly-time-resolved ranging

4.1 Dynamic jumping of single-leg robot

Legged robots have powerful motion ability and are able to overcome challenging terrains. When the legged robot is walking, trotting or jumping, its feet would strike the ground and swing periodically [39]. The high velocity of the foot end in the direction perpendicular to the ground when striking the ground will cause collision and shock on the leg [40]. The internal sensors equipped on legged robots, such as encoders, accelerometers, cannot provide direct data for foot end tracking. The robot cannot respond fast enough to avoid collision and shock without the environmental perception. So, highly-time-resolved and precise tracking for the high velocity and high acceleration of the foot end is quite critical to characterize dynamic locomotion of legged robots.

As shown in Fig. 8(a), the single-legged robot platform has two joints, each joint consisting of a high-speed electric motor (Maxon EC45) equipped with a harmonic gear driven with reduction ratio of 100 and a 14-bit absolute encoder. In order to minimize the inertia of the robot’s leg, both the motors are mounted on the hip joint. Different from the hip joint in dynamic structure, the knee joint is driven by a motor mounted on the hip through a belt from which the torque is transmitted to the harmonic gear. The robot platform has a thigh length of 0.38 m and a shank length of 0.361 m, which is equipped with horizontal and vertical guides, so that the robot can move forth or back, up or down. The high reduction ratio of harmonic gear and belt make the structure absorb the torque fluctuation of the motor input more efficiently. The locomotion control system uses a computer as EtherCAT’s host with TwinCAT running at 4 kHz. The CL of FMCW LiDAR is mounted on the shank of this leg robot, with laser beam perpendicular to the ground. The repetition frequency for laser chirp is 20 kHz and the LiDAR can track the position of foot end in the direction perpendicular to the ground by every 50 µs. Figure 8(b) shows the foot trajectory in one cycle of jumping, as planned actions including leg protraction, leg retraction and foot landing.

 figure: Fig. 8.

Fig. 8. (a) The CL is mounted on shank of a single-leg robot to track the dynamic locomotion of foot end. (b) The planned foot trajectory in one cycle of jumping, including leg protraction, leg retraction and foot landing.

Download Full Size | PDF

As shown in Fig. 9, the maximum distance measured by LiDAR is 0.42 m at around 150 ms in one cycle of jumping actions.

 figure: Fig. 9.

Fig. 9. The screenshot of the jumping experiment on the single leg at every 50 ms (see Visualization 1).

Download Full Size | PDF

4.2 Dynamic tracking of jumping single-leg robot with high time resolution

The distance, velocity and acceleration are acquired in Fig. 10 by every 50 µs during one cycle of jumping. In the up-jumping phase, the distance increases quickly to 0.4 m at about 100 ms as marked in Fig. 9 and Fig. 10(a). In order to jump to a much higher position, the robot make a second protraction within 50 ms in the leg swing phase and reach the maximum height of 0.42 m at about 150 ms (dashed purple lines in Fig. 10). This behavior is clearly characterized by highly-time-resolved LiDAR for the first time. In the leg protraction progress in Fig. 8(b), there will be some unexpected disturbances deviated from the planned trajectory. This high-time-resolution measurement can help identify the sources of disturbances during the leg protraction. There are two peaks of velocity, 7.15 m/s at 78 ms and 2.84 m/s at 128 ms in Fig. 10(b), corresponding to the first and second leg protractions, respectively. Meanwhile, there are two valleys of acceleration, -365 m/s2 and -312 m/s2 in Fig. 10(c), corresponding to the distance peaks of 0.4 m and 0.42 m in Fig. 10(a), respectively. During the foot end landing on the ground, there is an acceleration peak of 302 m/s2 at about 200 ms. After the foot strikes the ground for the first time, it is bounced upwards, and strikes the ground again with acceleration of 78 m/s2 at about 250 ms, as shown by dashed blue lines in Fig. 10(c). This highly-time-resolved characterization of one cycle of leg jumping can also be found in details in video of Visualization 1.

 figure: Fig. 10.

Fig. 10. Measured data for one cycle of jumping experiment on the single leg using highly-time-resolved FMCW LiDAR. Distance (a), velocity (b), and acceleration (c) in one cycle are acquired, respectively.

Download Full Size | PDF

With the high acquisition rate of 20 kHz, tracking of highly dynamic legged robot is presented with measured acceleration of over 300 m/s2, as summarized in Table 1. The high velocity of over 7 m/s during the leg protraction is recorded also. The tracking of acceleration peaks corresponds to the accurate time when the foot end strikes the ground (200 ms and 250 ms), which leads to collision and shock on the leg. The accurate measurement can provide the timely precautions for locomotion control to reduce striking collisions. This high acceleration over 30 times gravity has not been successfully characterized for legged robot so far. This highly-time-resolved FMCW LiDAR presents the clear and precise tracking of leg protraction and landing for the first time, to the best of authors’ knowledge.

Tables Icon

Table 1. Summary of measurement in one cycle of jumping

5. Conclusion

A highly-time-resolved FMCW LiDAR is proposed to track the position, velocity and acceleration of foot for a jumping single-leg robot. A synchronously-nonlinearity-corrected acquisition is principally and experimentally validated with a high acquisition rate of 20 kHz. The linearization of laser frequency modulation is conducted in every up-sweep and down-sweep by synchronizing the measurement signal and the modulation signal of laser injection current. The laser frequency modulation bandwidth of 160 GHz is obtained by modulating injection current from 160 mA to 480 mA, with a symmetrical triangular waveform of injection current and a repetition frequency of 20 kHz. With signal stretched or compressed in every period T, the measurement signal is corrected based on the synchronous linearization of laser frequency. Then, the clear and robust beat frequency is obtained on the corrected frequency spectrum. With the LiDAR mounted on a single-leg robot, the leg swinging and landing in one cycle of jumping is recorded. The high velocity up to 7.15 m/s and high acceleration of 365 m/s2 are measured during the up-jumping phase, while heavy shock takes place with high acceleration of 302 m/s2 as the foot strikes the ground.

To the best of our knowledge, the acquisition rate is demonstrated to be equal to the repetition frequency of laser injection current for the first time. If the laser is modulated up to higher frequency, the data acquisition can be increased accordingly. The measured acceleration of over 300 m/s2, which is more than 30 times gravity acceleration, is reported on a jumping single-leg robot for the first time. This method relaxes the tight requirements for coherence and linearity of laser source and reduces the time consumed in nonlinearity correction for FMCW measurement. It paves a new way of realizing real-time tracking for autonomous systems operating in highly dynamic conditions.

Funding

National Natural Science Foundation of China (U1613223, U1813207); Shenzhen Fundamental Research and Discipline Layout project (JCYJ20180508163015880); Basic and Applied Basic Research Foundation of Guangdong Province (2021B1515120084); Tip-top Scientific and Technical Innovative Youth Talents of Guangdong Special Support Program (2019TQ05X062).

Acknowledgments

Caiming Sun thanks Peng Cheng Laboratory for providing facilities of equipment and software for this work.

Disclosures

The authors declare that there are no conflicts of interest related to this article.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Supplemental document

See Supplement 1 for supporting content.

References

1. J. Shi, J. Guo, M. Kagami, P. Suni, and O. Ziemann, “Photonic technologies for autonomous cars: feature introduction,” Opt. Express 27(5), 7627–7628 (2019). [CrossRef]  

2. L. Chen, Z. Zhu, C. Sun, and A. Zhang, “An Efficient Lightweight 2D Driven 3D Detector for Underwater Robots Tracking,” IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 1103–1110, 27-31 Dec. 2021.

3. P. Fankhauser, M. Bloesch, P. Krüsi, R. Diethelm, M. Wermelinger, T. Schneider, M. Dymczyk, M. Hutter, and R. Siegwart, “Collaborative navigation for flying and walking robots,” IEEE/RSJ International Conference on Intelligent Robots and Systems(IROS) 2016, pp. 2859–2866, 09-14 October 2016.

4. L. Chen, S. Ye, C. Sun, A. Zhang, G. Deng, and T. Liao, “Optimized Foothold Planning and Posture Searching for Energy-Efficient Quadruped Locomotion Over Challenging Terrains,” IEEE International Conference on Robotics and Automation (ICRA) 2020, pp.399–405, Paris, France, May 31-June 04, 2020.

5. J. Lee, J. Hwangbo, L. Wellhausen, V. Koltun, and M. Hutter, “Learning quadrupedal locomotion over challenging terrain,” Sci. Robot. 5(47), eabc5986 (2020). [CrossRef]  

6. Q. Nguyen, M. J. Powell, B. Katz, J. D. Carlo, and S. Kim, “Optimized Jumping on the MIT Cheetah 3 Robot,” IEEE International Conference on Robotics and Automation (ICRA) 2019, pp.7448–7454, Montreal, QC, Canada, 20-24 May 2019.

7. S. Ye, J. Luo, C. Sun, B. Jin, J. Su, and A. Zhang, “Design of a Large-Scale Electrically-Actuated Quadruped Robot and Locomotion Control for the Narrow Passage,” IEEE/RSJ International Conference on Intelligent Robots and Systems(IROS) 2021, pp. 7424–7431, 27 Sept.-1 Oct. 2021.

8. B. Jin, C. Sun, A. Zhang, N. Ding, J. Lin, G. Deng, Z. Zhu, and Z. Sun, “Joint Torque Estimation toward Dynamic and Compliant Control for Gear-Driven Torque Sensorless Quadruped Robot,” IEEE/RSJ International Conference on Intelligent Robots and Systems(IROS) 2019, pp. 4630–4637, Nov 2019.

9. B. Jin, C. Sun, D. Cheng, S. Ye, J. Su, and A. Zhang, “Fast and Compliant Whole Body Control for Gear-Driven Torque Sensorless Quadruped Robot Trotting,” IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 919–926, 27-31 Dec. 2021.

10. L. Chen, S. Ye, C. Sun, A. Zhang, G. Deng, T. Liao, and J. Sun, “CNNs based Foothold Selection for Energy-Efficient Quadruped Locomotion over Rough Terrains,” IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 1115–1120, Dec 2019.

11. G. Deng, J. Luo, C. Sun, D. Pan, L. Peng, N. Ding, and A. Zhang, “Vision-based Navigation for a Small-scale Quadruped Robot Pegasus-Mini,” IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 893–900, 27-31 Dec. 2021.

12. J. Chen, C. Sun, and A. Zhang, “Autonomous Navigation for Adaptive Unmanned Underwater Vehicles Using Fiducial Markers,” IEEE International Conference on Robotics and Automation (ICRA) 2021, pp.9298–9304, Xi’an, China, 31 May-4 Jun, 2021.

13. H. Bostick, “A carbon dioxide laser radar system,” IEEE J. Quantum Electron. 3(6), 232 (1967). [CrossRef]  

14. D. Uttam and B. Culshaw, “Precision time domain reflectometry in optical fiber systems using a frequency modulated continuous wave ranging technique,” J. Lightwave Technol. 3(5), 971–977 (1985). [CrossRef]  

15. P. A. Roos, R. R. Reibel, T. Berg, B. Kaylor, Z. W. Barber, and W. R. Babbitt, “Ultrabroadband optical chirp linearization for precision metrology applications,” Opt. Lett. 34(23), 3692–3694 (2009). [CrossRef]  

16. X. Zhang, J. Pouls, and M. C. Wu, “Laser frequency sweep linearization by iterative learning pre-distortion for FMCW LiDAR,” Opt. Express 27(7), 9965–9974 (2019). [CrossRef]  

17. L. Tang, H. Jia, S. Shao, S. Yang, H. Chen, and M. Chen, “Hybrid integrated low-noise linear chirp frequency-modulated continuous-wave laser source based on self-injection to an external cavity,” Photonics Res. 9(10), 1948–1957 (2021). [CrossRef]  

18. J. Qin, Q. Zhou, W. Xie, Y. Xu, S. Yu, Z. Liu, Y. Tong, Y. Dong, and W. Hu, “Coherence enhancement of a chirped DFB laser for frequency-modulated continuous-wave reflectometry using a composite feedback loop,” Opt. Lett. 40(19), 4500–4503 (2015). [CrossRef]  

19. Y. Guo, R. Zhao, G. Zhou, L. Lu, A. Stroganov, M. Nisar, J. Chen, and L. Zhou, “Thermally tuned high-performance III-V/Si3N4 external cavity laser,” IEEE Photonics J. 13(2), 1–13 (2021). [CrossRef]  

20. A. van Rees, Y. Fan, D. Geskus, E. J. Klein, R. M. Oldenbeuving, P. J. M. van der Slot, and K. J. Boller, “Ring resonator enhanced mode-hop-free wavelength tuning of an integrated extended-cavity laser,” Opt. Express 28(4), 5669–5683 (2020). [CrossRef]  

21. K.-J. Boller, A. van Rees, Y. Fan, et al., “Hybrid integrated semiconductor lasers with silicon nitride feedback circuits,” Photonics 7(1), 4 (2019). [CrossRef]  

22. C. Liu, L. Lu, Y. Guo, X. Li, J. Chen, and L. Zhou, “Hybrid Integrated Frequency-Modulated Continuous-Wave Laser with Synchronous Tuning,” J. Lightwave Technol. 40(16), 5636–5645 (2022). [CrossRef]  

23. A. Vasilyev, N. Satyan, S. Xu, G. Rakuljic, and A. Yariv, “Multiple source frequency-modulated continuous-wave optical reflectometry: theory and experiment,” Appl. Opt. 49(10), 1932–1937 (2010). [CrossRef]  

24. Z. Chen, G. Hefferman, and T. Wei, “A Sweep Velocity-Controlled VCSEL Pulse Laser to Interrogate Sub-THz-Range Fiber Sensors,” IEEE Photon. Technol. Lett. 29(17), 1471–1474 (2017). [CrossRef]  

25. S. Jiang, B. Liu, and H. C. Wang, “FMCW laser ranging method based on a frequency multiplier,” Appl. Opt. 60(4), 918–922 (2021). [CrossRef]  

26. X. Zhang, M. Kong, T. Guo, J. Zhao, D. Wang, L. Liu, W. Liu, and X. Xu, “Frequency modulation nonlinear correction and range-extension method based on laser frequency scanning interference,” Appl. Opt. 60(12), 3446–3451 (2021). [CrossRef]  

27. C. Li, F. Zhang, and X. Qu, “High-Resolution Frequency-Modulated Continuous-Wave LiDAR Using Multiple Laser Sources Simultaneously Scanning,” J. Lightwave Technol. 41(1), 367–373 (2023). [CrossRef]  

28. C. V. Poulton, M. J. Byrd, P. Russo, B. Moss, O. Shatrovoy, M. Khandaker, and M. R. Watts, “Coherent LiDAR with an 8,192-Element Optical Phased Array and Driving Laser,” IEEE J. Select. Topics Quantum Electron. 28(5: Lidars and Photonic Radars), 1–8 (2022). [CrossRef]  

29. C. Sun, B. Li, W. Shi, J. Lin, N. Ding, H. K. Tsang, and A. Zhang, “Large-Scale and Broadband Silicon Nitride Optical Phased Arrays,” IEEE J. Select. Topics Quantum Electron. 28(6), 1–10 (2022). [CrossRef]  

30. C. Sun, L. Yang, B. Li, W. Shi, H. Wang, Z. Chen, X. Nie, S. Deng, N. Ding, and A. Zhang, “Parallel emitted silicon nitride nanophotonic phased arrays for two-dimensional beam steering,” Opt. Lett. 46(22), 5699–5702 (2021). [CrossRef]  

31. H. Wang, Z. Chen, C. Sun, S. Deng, X. Tang, L. Zhang, R. Jiang, W. Shi, Z. Chen, Z. Li, and A. Zhang, “Broadband silicon nitride nanophotonic phased arrays for wide-angle beam steering,” Opt. Lett. 46(2), 286–289 (2021). [CrossRef]  

32. B. Li, C. Sun, H. Wang, Z. Chen, X. Nie, S. Deng, L. Yang, and A. Zhang, “Liquid-cladded optical phased array for a single-wavelength beam steering,” Opt. Lett. 46(19), 4948–4951 (2021). [CrossRef]  

33. X. Jia, Z. Liu, L. Tao, and Z. Deng, “Frequency-scanning interferometry using a time-varying Kalman filter for dynamic tracking measurements,” Opt. Express 25(21), 25782–25796 (2017). [CrossRef]  

34. L. Tao, Z. Liu, W. Zhang, and Y. Zhou, “Frequency-scanning interferometry for dynamic absolute distance measurement using Kalman filter,” Opt. Lett. 39(24), 6997–7000 (2014). [CrossRef]  

35. G. Lihachev, J. Riemensberger, W. Weng, J. Liu, H. Tian, A. Siddharth, V. Snigirev, V. Shadymov, A. Voloshin, R. N. Wang, J. He, S. A. Bhave, and T. J. Kippenberg, “Low-noise frequency-agile photonic integrated lasers for coherent ranging,” Nat. Commun. 13(1), 3522 (2022). [CrossRef]  

36. J. L. Brooks, R. H. Wentworth, R. C. Youngquist, M. Tur, B. Kim, and H. Shaw, “Coherence multiplexing of fiber-optic interferometric sensors,” J. Lightwave Technol. 3(5), 1062–1072 (1985). [CrossRef]  

37. J. Zheng, “Analysis of optical frequency-modulated continuouswave interference,” Appl. Opt. 43(21), 4189–4198 (2004). [CrossRef]  

38. J. Zheng, “Optical frequency-modulated continuous-wave interferometers,” Appl. Opt. 45(12), 2723–2730 (2006). [CrossRef]  

39. G. Zeng and A. Hemami, “An overview of robot force control,” Robotica 15(5), 473–482 (1997). [CrossRef]  

40. D. Cheng, B. Jin, C. Sun, and A. Zhang, “Joint Torque Estimation for Dynamic Jumping Control of Compliant Gear-Driven Legged Robot,” International Conference on Robotics and Biomimetics, pp. 95–101 (IEEE, 2019).

Supplementary Material (2)

NameDescription
Supplement 1       Supplement 1
Visualization 1       This supplementary video presents the data acquisition of FMCW LiDAR on a jumping single-leg robot. A sub-millisecond-scale acquisition for beat frequency is visualized and validated. The dynamic tracking for one cycle of jumping is demonstrated.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (10)

Fig. 1.
Fig. 1. (a) Principle of beat frequency formation, (b) schematic scheme of synchronous nonlinearity correction for FMCW LiDAR.
Fig. 2.
Fig. 2. Schematic diagram of the experimental setup. CIR: circulator; CL: collimating lens; BPD: balanced photodetector; TIA: trans-impedance amplifier; DAQ: data acquisition card.
Fig. 3.
Fig. 3. Nonlinearity characteristic for the DFB laser source. (a) Measured wavelength tuning when changing the injection currents from 20 mA to 500 mA. (b) The nonlinearity of laser frequency versus injection current. (c) The nonlinear laser frequency modulation with down-sweep 160 GHz. (d) Synchronous FMCW measurement signal with injection current signal. Black line represents the synchronous voltage signal from laser source, red line represents the pre-corrected measurement signal and green line is low-pass filtered measurement signal.
Fig. 4.
Fig. 4. (a) The Pre-corrected measurement signal (blue curve on the left axis) with a nonlinear frequency modulation in up-sweep period (black curve on the right axis). (b) The corrected signal is resampled (red curve on the left axis), according to a linear up-sweep frequency modulation (black curve on the right axis).
Fig. 5.
Fig. 5. Measured signals for 1-m distance in time domain (a) and frequency domain (b). (b) is obtained by DFT of (a).
Fig. 6.
Fig. 6. (a) Measured frequency spectra of 0.05-1 m distance with nonlinearity corrected. (b) Highly-time-resolved distance measurement by FMCW LiDAR. (c) Statistical distribution of 1-m distance measurement with total 40,000 counts.
Fig. 7.
Fig. 7. Measured data for a moving target using highly-time-resolved FMCW LiDAR. Distance (a), velocity (b), and acceleration (c) of fast locomotion; and distance (d), velocity (e), and acceleration (f) of slow locomotion, respectively.
Fig. 8.
Fig. 8. (a) The CL is mounted on shank of a single-leg robot to track the dynamic locomotion of foot end. (b) The planned foot trajectory in one cycle of jumping, including leg protraction, leg retraction and foot landing.
Fig. 9.
Fig. 9. The screenshot of the jumping experiment on the single leg at every 50 ms (see Visualization 1).
Fig. 10.
Fig. 10. Measured data for one cycle of jumping experiment on the single leg using highly-time-resolved FMCW LiDAR. Distance (a), velocity (b), and acceleration (c) in one cycle are acquired, respectively.

Tables (1)

Tables Icon

Table 1. Summary of measurement in one cycle of jumping

Equations (10)

Equations on this page are rendered with MathJax. Learn more.

f ( t ) = f 0 + k t T / 2 < t < T / 2 ,
τ = 2 R n / c .
f ( t ) = f 0 + k t + G ( t ) T / 2 < t < T / 2.
φ ( t ) = 2 π τ [ f 0 + k t + G ( t ) ] T / 2 < t < T / 2.
E ~ ( t ) = E 0 e i 2 π τ [ f 0 + k t + G ( t ) ] T / 2 < t < T / 2.
E ( t ) = E 0 c o s 2 π τ [ f 0 + k t + G ( t ) ] T / 2 < t < T / 2.
f b = [ k + G ( t ) / t ] τ T / 2 < t < T / 2 ,
G ( t ) G ( I ) I ( t ) T / 2 < t < T / 2 ,
E l ( t ) = E 0 c o s 2 π τ [ f 0 + ( k + k l ) t ] T / 2 < t < T / 2 ,
f b l = ( B / T ) τ = ( 2 n B / c T ) R .
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.