1 Introduction

Direction-of-arrival (DOA) estimation is widely applied in array signal processing field, such as radar, wireless communications, sonar, and seismic sensing [1,2,3,4]. For the single-frequency signal, traditional subspace-based algorithms and their improved methods have been verified as efficient estimation techniques [5, 6]. With the rapid development of signal processing technologies, the linear frequency modulation (LFM) signal has many good characteristics, such as carrying a large amount of information and possessing better detection performance, which makes it being widely used in electronic countermeasures. Nevertheless, subspace-based algorithms have limitations to deal with LFM signals which are wideband and nonstationary; thus it is very important to study the DOA estimation of LFM signals. The time-frequency (TF) analysis tools can deal with LFM signals, because they can make full use of the TF energy aggregation property of LFM signals. Belouchrani and Amin proposed the concept of STFD [7], and then a series of DOA estimation algorithms based on the STFD matrix have been proposed [8,9,10,11,12,13,14]. These algorithms mainly use the STFD matrix to replace the covariance matrix in the multiple signal classification (MUSIC) algorithm, which forms the TF-MUSIC algorithm. Compared with subspace-based algorithms, the TF-MUSIC algorithm can provide better DOA estimation performance because the noise power is spread while localizing the source energy in TF domain. In order to construct the STFD matrix, it is necessary to select the single-source TF points belonging to each signal in TF domain.

When LFM signals are TF-disjoint in TF domain, there exists efficient single-source TF points selection algorithms [15, 16]. The reference [15] obtained the single-source TF points based on the improved clustering algorithm. In [16], Heidenreich firstly applied the morphological image processing method to detect instantaneous frequency (IF) segments. Then, multiple detected IF segments of each signal are combined together for DOA estimation based on a bootstrap resampling technique. Unfortunately, these two methods only can be used in the situation that the signals are TF-disjoint. When the signals are non-disjoint (i.e., spectrally overlapped) in TF domain, the studies of single-source TF points selection algorithms are not very full. In [17,18,19], the single-source TF points selection algorithms are proposed based on the Wigner-Ville distribution (WVD). However, considering that the WVD has higher computational complexity and generates cross-term TF points in TF domain, it is very difficult to apply the WVD in practice. The reference [20] proposes the short-time Fourier transform (STFT) distribution model for DOA estimation of LFM signals, which greatly reduces implementation cost. Based on the STFT distribution, many DOA estimation algorithms have also been proposed [21,22,23,24,25] when LFM signals are non-disjoint in TF domain. However, all of them have some limitations. The single-source TF points selection algorithms in [21] are only suitable for real-valued array manifold matrix, but the array manifold vector in the DOA estimation is complex-valued. In [22, 23], the signals are required to satisfy the W-disjoint distribution in TF domain. Zhang proposes single-source TF points selection algorithm based on the TF points intensity information [24]. Although it can successfully realize the DOA estimation when two LFM signals are non-disjoint, the algorithm will fail when multiple LFM signals intersect at one point. In [25], the author uses the forward-backward spatial smoothing (FBSS) algorithm to eliminate the effect of multiple-source TF points and then perform DOA estimation. Although this method can achieve DOA estimation, the DOA estimation accuracy is poor.

In order to ease the limitations of existing algorithms for spectrally overlapped LFM signals, this paper propose the single-source TF points selection algorithm based on Hough transform and STFT when multiple LFM signals are non-disjoint in TF domain. Theoretically, the TF distribution of LFM signal is the straight line in TF domain. However, since the sampling data is discrete and finite, the TF distribution of each LFM signal under STFT has somewhat wide, which is called the TF ridgeline. Therefore, based on the Hough transform in TF domain, two line segments can be detected for every LFM signal. By traversing the TF domain, all line segments of LFM signals can be detected, and the line segments intersections can be calculated according to the endpoint coordinates. The area which is surrounded by these intersections is the multiple-source TF points set. Therefore, by removing multiple-source TF points around the intersections, the single-source TF points set is reserved. Then, based on the Euclidean distance operator, single-source TF points set belonging to each signal can be obtained according to the property that TF points of the same signal have same eigenvector. Finally, the averaged STFD matrix for every signal is computed, and DOA estimation can be achieved based on the MUSIC algorithm. In this way, the proposed algorithm has lower computational complexity and can achieve DOA estimation in the underdetermined cases. In addition, when there exists multiple signals at the intersections (i.e., greater than two), the accurate DOA estimation can still be achieved. Due to automatically select single-source TF points set of each signal, the proposed algorithm exhibits remarkable superiority in estimation accuracy and angular resolution over the state-of-the-art schemes.

The remainder of this paper is organized as follows. Section 2 formulates the STFT model of LFM signal based on the ULA and illustrates how to select single-source TF points in detail. Section 3 carries the numerical simulations, and the proposed algorithm is discussed referring to the simulation results. Section 4 concludes the paper.

2 Methods

2.1 STFT model of LFM signal

In this paper, a uniform linear array (ULA) with M sensors is considered, and the inter-element spacing is d. Furthermore, N LFM signals are assumed to impinge on the ULA from θ1, θ2, ⋯, θN. The array output at time t can be modeled as

$$ \mathbf{X}(t)=\mathbf{A}(t)\mathbf{S}(t)+\mathbf{N}(t), $$
(1)

where X(t) = [x1(t), x2(t), ⋯, xM(t)]T is the array observation vector, S(t) = [s1(t), s2(t), ⋯, sN(t)]T is the LFM signal vector, and N(t) = [n1(t), n2(t), ⋯, nM(t)]T is the additive white Gaussian noise vector. A(t) = [a1(t), a2(t), ⋯, aN(t)] is the M × N array manifold matrix, and an(t) = [exp(−jfn(t)τn1), ⋯, exp(−jfn(t)τnM)]T is the steering vector of the nth signal at time t, where j is the imaginary unit. τnm =  − 2π(m − 1)d cos(θn)/c represents the time delay of the nth signal on the mth element respecting to the reference element, where c is the speed of light. The instantaneous frequency fn(t) is denoted as

$$ {f}_n(t)={f}_{n0}+{\gamma}_nt, $$
(2)

where fn0 and γn are initial frequency and modulated frequency of the nth signal, respectively. When γn = 0, the LFM signal becomes narrowband single-frequency signal.

In 1946, Gabor proposed the concept of the STFT, which is an effective TF analysis tool for dealing with the LFM signal. The STFT distribution of X(t) in the free of noise can be expressed as

$$ {\mathbf{S}}_X\left(t,f\right)=\mathbf{A}(t){\mathbf{S}}_S\left(t,f\right)=\mathbf{A}(t)\left[\begin{array}{c}{S}_{S_1}\left(t,f\right)\\ {}\vdots \\ {}{S}_{S_N}\left(t,f\right)\end{array}\right], $$
(3)

where \( {S}_{S_n}\left(t,f\right) \) is the STFT value of the nth LFM signal.

Then, the STFD matrix can be calculated through the correlation operation of SX, namely,

$$ {\mathbf{D}}_{XX}\left(t,f\right)={\mathbf{S}}_X{\mathbf{S}}_X^H=\mathbf{A}(t){\mathbf{D}}_{SS}\left(t,f\right){\mathbf{A}}^H(t), $$
(4)

where DXX and DSS are array output STFD matrix and signal STFD matrix, respectively.

The STFT distribution of LFM signals in TF domain can be described as Fig. 1. Figure 1a denotes that the LFM signals are TF-disjoint in TF domain, which means that signals are independent of each other, and the reference [15] has proposed efficient single-source TF points selection method.

Fig. 1
figure 1

TF distribution condition of LFM signals, (a) TF-disjoint LFM signals, (b) TF non-disjoint LFM signals

This paper mainly studies that LFM signals are tiny spectrally overlapped in TF domain. That is to say, multiple signals only have a small number of same TF points in TF domain, as is shown in Fig. 1b. In the TF domain, there exist noise-term TF points and auto-term TF points, and auto-term contains single-source TF points and multiple-source TF points. Based on the proposed algorithm, we can remove noise-term TF points and multiple-source TF points in turn and obtain the single-source TF points set of each signal. Finally, the STFD matrix can be constructed, and subsequent DOA estimation can also be achieved.

In TF domain, the LFM signals have obvious energy aggregation effect. According to [15], DXX is very large at the TF ridgeline, and DXX is close to zero at other TF points. Let ΩX be the TF support domain, we can obtain

$$ {\displaystyle \begin{array}{l}{\mathbf{D}}_{XX}\left(t,f\right)\gg 0\kern1.2em \left(t,f\right)\in {\varOmega}_X\\ {}{\mathbf{D}}_{XX}\left(t,f\right)\approx 0\kern1.2em \left(t,f\right)\notin {\varOmega}_X.\end{array}} $$
(5)

In order to filter out the noise and obtain the TF points which have enough energy in TF domain, we can set an empirical threshold value and perform following criterion at each sampling time instant (t, f) of DXX

$$ \frac{{\left\Vert {\mathbf{D}}_{XX}\left(t,f\right)\right\Vert}_F}{\underset{f}{\mathit{\max}}{\left\Vert {\mathbf{D}}_{XX}\left(t,f\right)\right\Vert}_F}>{\varepsilon}_1\kern0.8000001em \left(t,f\right)\in {\varOmega}_X, $$
(6)

where ‖·‖F is the Frobenius norm and ε1 is a small empirical threshold value and is related to noise. Typically, ε1 = 0.05 when SNR = 10 dB [18].

Then, the new TF points set ΩA which includes single-source TF points ΩS and multiple-source TF points ΩM can be obtained.

2.2 Extracting single-source TF points

At the signal intersections, LFM signals are coherent owing to same frequency, which brings the rank deficiency of the signal subspace matrix. If these intersected TF points are selected to construct the STFD matrix, then subsequent DOA estimation will fail. Therefore, our goal is to remove multiple-source TF points and obtain single-source TF points set belonging to each signal.

In theory, two LFM signals only have an intersection in TF domain. However, since the sampling data is discrete and finite, the TF ridgeline of LFM signals under STFT has somewhat wide. Therefore, there exist multiple TF points around the intersections when LFM signals are non-disjoint in TF domain. By converting the TF distribution of LFM signals into ordinary grayscale image, we can use the Hough transform method to detect straight lines in the grayscale image [26]. Hough transform is a parameter estimation technique using the voting principle in TF domain. The basic principle is to map the straight line detecting problem in the plane coordinate domain into the parameter coordinate domain by using the point-line duality property, so that the mapped result is easier to be detected. It is assumed that the curve satisfies the following equation

$$ F\left(\left(t,f\right),\left({a}_1,{a}_2,\cdots, {a}_m\right)\right)=0. $$
(7)

In the plane Cartesian coordinates, the curve satisfies specific parameters (a1, a2, ⋯, am), and (t, f) is located at the curve. ρ denotes the distance between the curve and the coordinate origin, and θ is the angle between ρ and the sampling time axis. After mapping into the parameter domain, we use the polar coordinates to describe the parameters, and there exists following relationship

$$ \rho =t\ast \cos \left(\theta \right)+f\ast \sin \left(\theta \right). $$
(8)

Equation (8) shows that a point in the plane coordinates corresponds to a curve in the parameter coordinates. The different points of the same curve in the plane coordinates intersect at a point in the parameter coordinates, as is shown in Fig. 2.

Fig. 2
figure 2

The Hough transform schematic

Figure 2 shows that the three points A, B, C of the same line in the plane coordinate domain can be mapped into three curves and curves intersect at the point D. By integrating along with different θ, we can obtain the Hough transform. As a consequence, the Hough transform is a kind of projection integral essentially.

Firstly, we convert the TF distribution into the grayscale image. Then, by performing Hough transform on the grayscale image, we can obtain the corresponding curves of each TF points in the parameter domain. These curves exist multiple intersections, and each intersection corresponds to a detected line segment in the plane coordinate domain. For N LFM signals in TF domain, 2N peak points (θ1, ρ1), (θ2, ρ2), ⋯, (θ2N, ρ2N) can be searched by setting appropriate threshold value and carrying accumulation statistics; this is because the TF distribution of LFM signal under STFT has somewhat wide. The 2N peak points correspond to 2N line segments of the plane coordinate domain, and the mathematical equation of these lines can be calculated based on the endpoint coordinates, namely,

$$ \Big\{{\displaystyle \begin{array}{l}{f}_1={k}_1t+{b}_1\\ {}{f}_2={k}_2t+{b}_2\\ {}\vdots \\ {}{f}_{2N}={k}_{2N}t+{b}_{2N}\end{array}}, $$
(9)

where k1, k2, ⋯, k2N and b1, b2, ⋯, b2N are slopes and intercepts of lines, respectively.

Since the noise in TF domain has been removed, the energy value in the TF ridgeline is much stronger than other TF points. Therefore, based on the Hough transform, we can precisely extract the line segments where TF distribution boundary of LFM signals is located in TF domain. Assuming that there exist Q  (Q ≤ N(N − 1)/2) intersections between N signals, then the detected 2N line segments which corresponds to N signals will have P  (P ≥ 4Q) intersections. If N LFM signals only pairwise intersect, the detected line segments have 4Q intersections. However, when there exists the situation that multiple signals intersect at one point, the number of intersections among 2N line segments will be more than 4Q. For any intersection in TF domain, we can calculate all intersections (t1, f1), (t2, f2), ⋯, (tP, fP) according to the line equation in the grayscale image. Then the minimum min(t1, t2, ⋯tP) and maximum max(t1, t2, ⋯tP) of the sampling time axis can be obtained in all intersections. In addition, the corresponding min(f1, f2, ⋯fU) and max(f1, f2, ⋯fU) can also be solved based on the (9), where f1, f2, ⋯fU are all frequency values that min(t1, t2, ⋯tP) and max(t1, t2, ⋯tP) correspond to detected line segments. If multiple-source TF points cannot be completely removed, these TF points are selected to estimate DOAs, which will result in the failure of DOA estimation. So we remove multiple-source TF points corresponding to the region of (min(t1tP), max(t1tP)) and (min(f1fU), max(f1fU)) and then obtain single-source TF points set ΩS =  ∪  Ωn for n = 1, 2, ⋯, N, where Ωn denotes single-source TF points set of the nth signal.

2.3 Constructing STFD matrix

In this subsection, we firstly calculate the single-source TF points set belonging to each signal and then construct the STFD matrix for subsequent DOA estimation. According to reference [15], for the signal STFD matrix DSS(t, f), the diagonal elements have a larger value, and the remaining elements are close to zero at the single-source TF points. As a result, based on the (4), the single-source TF points of the nth signal in Ωn satisfies

$$ {\mathbf{D}}_{XX}\left(t,f\right)={\mathbf{D}}_{SS}\left(t,f\right){\mathbf{a}}_n(t){\mathbf{a}}_n^H(t)\kern1.1em \forall \left(t,f\right)\in {\varOmega}_n. $$
(10)

For any two single-source TF points (ti, fi) and (tj, fj) in Ωn, (10) can be rewritten as

$$ {\mathbf{D}}_{XX}\left({t}_i,{f}_i\right)={\mathbf{D}}_{SS}\left({t}_i,{f}_i\right){\mathbf{a}}_n(t){\mathbf{a}}_n^H(t). $$
(11)
$$ {\mathbf{D}}_{XX}\left({t}_j,{f}_j\right)={\mathbf{D}}_{SS}\left({t}_j,{f}_j\right){\mathbf{a}}_n(t){\mathbf{a}}_n^H(t). $$
(12)

It can be seen from (10–12) that the STFD matrix DXX of different TF points in Ωn has same eigenvector an(t).

For any TF point (tp, fp) in ΩS, we can compute the main eigenvalue λ(tp, fp) and the corresponding principal eigenvector e(tp, fp) from the STFD matrix. Without loss of generality, we can make the first element of e(tp, fp) real and positive, namely,

$$ \tilde{\mathbf{e}}\left({t}_p,{f}_p\right)=\left[\begin{array}{c}\frac{{\mathbf{e}}_1\left({t}_p,{f}_p\right)}{\left\Vert \mathbf{e}\left({t}_p,{f}_p\right)\right\Vert}\\ {}\vdots \\ {}\frac{{\mathbf{e}}_M\left({t}_p,{f}_p\right)}{\left\Vert \mathbf{e}\left({t}_p,{f}_p\right)\right\Vert}\end{array}\right].\frac{\left\Vert {\mathbf{e}}_1\left({t}_p,{f}_p\right)\right\Vert }{{\mathbf{e}}_1\left({t}_p,{f}_p\right)}, $$
(13)

where em(tp, fp) denotes the mth element of eigenvector e(tp, fp).

For single-source TF points set ΩS, mathematically, (ti, fi) and (tj, fj) belong to the same signal if they have following relationship

$$ d\left(\tilde{\mathbf{e}}\left({t}_i,{f}_i\right),\tilde{\mathbf{e}}\left({t}_j,{f}_j\right)\right)<{\varepsilon}_2, $$
(14)

where d(·) is the Euclidean distance operator between \( \tilde{\mathbf{e}}\left({t}_i,{f}_i\right) \) and \( \tilde{\mathbf{e}}\left({t}_j,{f}_j\right) \). ε2 is an empirical threshold value, which is greater than 0. Typically, ε2 = 0.05 when SNR = 10 dB [15]. By traversing entire set ΩS, we can obtain single-source TF points set Ωn of the nth signal.

In order to reduce the calculation error and make full use of single-source TF points, we can compute the averaged STFD matrix of all TF points. For the nth signal, the averaged STFD matrix is expressed as

$$ {\overline{\mathbf{D}}}_n\left(t,f\right)=\frac{1}{\varSigma {\varOmega}_n}\sum \limits_{\left(t,f\right)\in {\varOmega}_n}{\mathbf{D}}_{XX}\left(t,f\right), $$
(15)

where \( {\overline{\mathbf{D}}}_n\left(t,f\right) \) is similar to the covariance matrix in the subspace-based algorithm and ΣΩn denotes the number of single-source TF points.

Therefore, based on the MUSIC algorithm, we can carry eigendecomposition on the matrix \( {\overline{\mathbf{D}}}_n\left(t,f\right) \) and obtain the signal subspace and noise subspace. Finally, we can construct the spectrum peak searching function and perform DOA estimation

$$ \mathbf{P}\left(\theta \right)=\frac{1}{{\mathbf{b}}^H\left(\theta \right){\mathbf{U}}_n{{\mathbf{U}}_n}^H\mathbf{b}\left(\theta \right)}, $$
(16)

where b(θ) is the steering vector and Un is the noise subspace.

For the readers’ convenience, the procedure of single-source TF points selection algorithm based on Hough transform and STFT is summarized as follows:

  1. (1)

    Filter out noise according to empirical threshold value ε1 in TF domain.

  2. (2)

    Based on Hough transform, remove multiple-source TF points, and obtain all single-source TF points set ΩS.

  3. (3)

    Classify signals according to the Euclidean distance operator, and get single-source TF points set Ωn of each signal.

  4. (4)

    For every signal, calculate the averaged STFD matrix \( {\overline{\mathbf{D}}}_n\left(t,f\right) \) in the set Ωn, and then construct the spectrum peak search function P(θ) = 1/bH(θ)UnUnHb(θ) based on the MUSIC algorithm.

3 Results and discussion

In order to verify the performance of the proposed algorithm, the following simulations are carried. Here, we set some general simulation parameters. The ULA has M = 8 sensors, and the array element spacing is the half of the wavelength which corresponds to the lowest frequency of LFM signals. The sampling rate is 360 MHz and snapshots are 1024. Since the STFT distribution can obviously gather the signal energy in TF domain and the SNR of signals is improved in TF domain by filtering the noise, we select SNR = 10 dB in the following analyses. Meanwhile, this paper involves the selection of two empirical threshold values. The threshold value ε1 eliminates the effect of noise in TF domain, which is related to the SNR. We take ε1 = 0.05 when SNR = 10 dB, and ε1 has been verified by [18]. Similarly, ε2 = 0.05 when SNR = 10 dB, which is also verified by [15]. In addition, we proceed with the comparison simulations among STFT-MUSIC algorithm [20], STFT-FBSS-MUSIC algorithm [25], the reference [24], and the proposed algorithm. Firstly, the general performance of the proposed algorithm is verified, which includes the DOA estimation precision, the spatial resolution, and underdetermined DOA estimation, as is shown in Sections 3.1 and 3.2. Then, we verify the new property of the proposed algorithm, i.e., the DOA estimation performance when multiple LFM signals intersect at one point, as is shown in Section 3.3. In Section 3.4, the computational complexity of different algorithms is analyzed.

3.1 DOA estimation accuracy analysis

We consider that three spectrally overlapped LFM signals in TF domain come from− 30 °, 0, ° and 30 °. The frequency distribution of three signals are [10, 80] MHz, [170, 10] MHz, and [60, 170] MHz, respectively, and all signals have same power. Figure 3 illustrates the calculation process of the single-source TF points selection method. Figure 3a displays the TF distribution of three LFM signals after filtering noise, whose grayscale image is showed in Fig. 3b. Based on Hough transform, we can search six peak points which is indicated by white in Fig. 3c, and Fig. 3d shows the detected six line segments. After removing multiple-source TF points, the single-source TF points set is shown in Fig. 3e. According to the Euclidean distance operator, we can classify signals and get single-source TF points set of each signal, as is shown in Fig. 3f.

Fig. 3
figure 3

The single-source TF points selection method, (a) the TF distribution, (b) the grayscale image, (c) peak points in the parameter domain, (d) the detected line segments, (e) single-source TF points, (f) single-source TF points of each signal

Based on the abovementioned analysis, Fig. 4a plots ten typical independent estimated spatial spectra of the proposed algorithm, where the dashed lines represent the true DOAs. It can be seen that the proposed algorithm can accurately achieve DOA estimation. In order to quantitatively analyze the DOA estimation accuracy of different algorithms, the root-mean-square error (RMSE) is introduced, which is denoted as

$$ {\mathrm{RMSE}}_{\theta }=\sqrt{\sum \limits_{p=1}^P\sum \limits_{n=1}^N{\left({\hat{\theta}}_{mn}-{\theta}_n\right)}^2/ MN}, $$
(17)
Fig. 4
figure 4

The DOA estimation performance of three LFM signals, (a) the spatial spectrum distribution, (b) the RMSE of DOA estimation versus SNR

where M is the number of Monte Carlo trials, N is the number of signals, and \( {\hat{\theta}}_{mn} \) is the estimated value of θn in the mth simulation.

By carrying 1000 times independent Monte Carlo trials, Fig. 4b shows that the DOA estimation RMSE of 4 algorithms vary with the SNR. From Fig. 4b, we can see that DOA estimation RMSE of four algorithms decreases rapidly with the increase of SNR. In general, the STFT-FBSS-MUSIC algorithm has the worst DOA estimation accuracy, and the estimation precision is 0.7594 ° when SNR is 10 dB. Because of performing the spatial smoothing operation, the array aperture of the STFT-FBSS-MUSIC algorithm is reduced. As a result, the estimation precision is reduced. Then, it is followed by the STFT-MUSIC algorithm, and the estimation precision is 0.3970 ° when SNR is 10 dB. The STFT-MUSIC algorithm performs DOA estimation by using the TF points at the TF ridgeline, and only few TF points are used to estimate DOAs, which results in low estimation precision. In addition, it is not realistic to assume that the TF points are available at the TF ridgeline. By removing multiple-source TF points, the reference [24] and the proposed algorithm can obtain single-source TF points set belonging to each signal. Then, by computing the averaged STFD matrix of all TF points for every signal, the DOA estimation precision of these two methods is improved. Compared with the [24], the proposed algorithm removes multiple-source TF points based on Hough transform and reserves as many single-source TF points as possible. Therefore, the proposed algorithm possesses the best estimation precision, which can achieve 0.1474 ° when SNR is 10 dB.

3.2 The angular resolution analysis and underdetermined DOA estimation

In order to verify the angular resolution of the proposed algorithm, we consider two spectrally overlapped LFM signals coming from−0.5 ° and 0.5 °. The frequency distribution of two signals are [170, 10] MHz and [10, 170] MHz, respectively. Figure 5a plots ten typical independent estimated spatial spectra of the proposed algorithm, which shows that the proposed algorithm can achieve DOA estimation when the spatial spacing of signals is 1 °. By performing 1000 times Monte Carlo trials, Fig. 5b displays that the DOA estimation RMSE of LFM signals at different SNR, which can be seen that the proposed algorithm has better DOA estimation accuracy when the DOA spacing is 1 °. Although the spatial spacing is very close, they are still distinctly distributed in TF domain. Therefore, the proposed algorithm has better angular resolution.

Fig. 5
figure 5

The angular resolution of the proposed algorithm (DOA spacing: 1 °), (a) the spatial spectrum distribution, (b) the RMSE of DOA estimation versus SNR

It is known that conventional subspace-based algorithms will fail in the underdetermined cases. However, the TF analysis can solve this problem. Based on the abovementioned simulation condition, we assume that four spectrally overlapped LFM signals come from− 15 °,− 5 °, 5 °, and 15 °. Figure 6a plots ten typical independent estimated spatial spectra of this case. Then, we reduce the number of sensors to M = 3, and the incident signals remain unchanged; ten independent estimated spatial spectra is plotted in Fig. 6b. It is seen that the proposed algorithm can correctly estimate DOAs in the underdetermined cases. The reason is that the proposed algorithm separately handles each signal in TF domain. Although the number of signals is more than that of sensors, the proposed algorithm can still achieve DOA estimation.

Fig. 6
figure 6

The DOA estimation in the underdetermined cases, (a) M = 8, N = 4, (b) M = 3, and N = 4

According to Sections 3.1 and 3.2, we know that the STFT-MUSIC algorithm is not practical in the engineering applications and the DOA estimation precision of the STFT-FBSS-MUSIC algorithm is poor. Although the reference [24] has good DOA estimation accuracy, it is only applicable to the case that two LFM signals intersect at one point. When multiple signals intersect at one point, the algorithm will fail. However, the proposed algorithm is not restricted by this case. Based on the Hough transform, the proposed algorithm can achieve DOA estimation when multiple signals intersect at one point. The following experiment will illustrate this property.

3.3 The DOA estimation analysis when multiple LFM signals intersect at one point

We consider that three spectrally overlapped LFM signals come from− 30 °, 0 °, and 30 °, and these signals intersect at one point in TF domain. The frequency distribution of three signals are [170,10] MHz, [90,90] MHz , and [10,170] MHz, respectively. Other settings remain unchanged; the TF distribution of three signals is shown in Fig. 7a when SNR = 10 dB, and Fig. 7b shows the detected results by using the Hough transform. Based on the proposed algorithm, the DOA estimation results are shown in Fig. 7c and d. It can be seen that the proposed algorithm has higher DOA estimation precision and the estimation precision can reach 0.1153 ° when SNR = 10 dB. Therefore, the proposed algorithm can achieve DOA estimation when multiple LFM signals intersect at one point.

Fig. 7
figure 7

The DOA estimation results analysis, (a) the TF distribution of three signals, (b) the detected result based on Hough transform, (c) the spatial spectra distribution, (d) the RMSE of DOA estimation versus SNR

3.4 The computational complexity analysis

The computational complexity comparison among the proposed algorithm and three existing methods are presented in Table. 1. We consider a ULA with M sensors and N far-field LFM signals imping on the ULA. Ls snapshots are used. In the STFT-FBSS-MUSIC algorithm, assuming that sub-array elements are K(K < M). Considering that the TF-MUSIC algorithm is based on the quadratic TF operation, it has the highest computational complexity O(NM2Ls2log2Ls). Due to performing the FBSS algorithm, the STFT-FBSS-MUSIC algorithm possesses the lowest computational complexity O(NKLs2log2Ls). However, its estimation precision is poor. The reference [24] and the proposed algorithm have similar computational complexities, where Δ1 and Δ2 denote the increased calculation burden due to extract single-source TF points, respectively. Δ1 and Δ2 are similar and are much smaller than O(NMLs2log2Ls). Therefore, the proposed algorithm has better estimation performance and acceptable computational complexity, which will have broad application prospects in the engineering.

Table 1 Comparison of computation complexity

4 Conclusion

Conventional DOA estimation algorithms will fail when LFM signals are spectrally overlapped in TF domain. In order to solve this problem, this paper proposes single-source TF points selection algorithm based on Hough transform. For the purpose of reducing computational complexity, we select the STFT to analyze LFM signals. The proposed algorithm not only has higher DOA estimation precision and angular resolution but also can achieve DOA estimation in the underdetermined cases. In addition, the proposed algorithm can achieve DOA estimation when multiple signals intersect at one point compared with existing algorithms. Although the current algorithm is only applicable to LFM signals which satisfy the straight line distribution in TF domain, generalized Hough transform can detect other forms of signals with different shapes in TF domain, such as sinusoidal FM signal and frequency-shift-keying signal. Therefore, the proposed algorithm has a broad application prospect in the electronic countermeasures.