1. A laser radar three-dimensional range image high-resolution reconstruction method based on multi-echo extraction is characterized by comprising the following steps:

the method comprises the following steps: extracting four echo positions through Gm-APD laser radar echo data and single pixel point echoes, calculating the positions and the intensities of multiple echoes corresponding to high-resolution 2 multiplied by 2 pixel results, and removing partial noise points to obtain a multiple echo signal array;

step two: arranging the extracted multi-echo signals to obtain a high-resolution range profile containing null pixels;

step three: and reconstructing the image through a neighborhood interpolation algorithm to obtain a high-resolution range profile.

2. The lidar three-dimensional range image high-resolution reconstruction method based on multi-echo extraction as claimed in claim 1, wherein the method for calculating the multi-echo position in the first step comprises: step 1.1 and step 1.2;

the step 1.1 is as follows: performing preprocessing by using convolution of a Gaussian function and the Gaussian function so as to remove abnormal peaks and obtain a smooth distribution histogram;

the step 1.2 is as follows: extracting the characteristics of the target on the smooth distribution histogram, determining the distribution of maximum value points under the current variance, and extracting multiple echoes;

in step 1.1, the formula of the preprocessing mode is as follows:

v is a kernel density function, namely a Gaussian smoothing function, h is a variance value, u is a trigger histogram, w is a smoothed histogram, i is the ith position of the Gaussian kernel function, j is the value of the jth position of the trigger histogram, k is the value of the kth position of the smoothed histogram, and x is a central symmetry point of the Gaussian function, specifically, half of the length of a v-function window;

the derivative expression is:

wherein, V₂Is that the variance is h ═ h₂Kernel density function of (1), w₂The second derivative of the preprocessed data is the position of the second derivative: w is a₂The position corresponding to the minimum value;

in step 1.2, the flow of the algorithm for extracting the multiple echoes is as follows:

scheme 1.2.1: extracting the number n of the echoes to be 4 and the second derivative w2 of the preprocessed data;

scheme 1.2.2: when the precondition retrieval wave number is 1, calculating a minimum value indmin and a maximum value indmax of the second-order derivative, wherein the position of the first echo is the minimum value of the second-order derivative w 2;

scheme 1.2.3: setting the numerical values from the left maximum value to the right minimum value of the second derivative extraction position as 0, and starting to calculate the second echo position;

scheme 1.2.4: calculating a minimum value indmin and a maximum value indmax of the second-order derivative, wherein the position of the first echo is the minimum value of the second-order derivative w 2;

scheme 1.2.5: sequentially completing to a fourth echo;

scheme 1.2.6: multiple echo results are obtained.

The method for calculating the multi-echo intensity in the first step comprises the following steps:

and reversely deducing by using a triggering probability model to obtain the distribution of the photon number in each echo signal gating gate, wherein the triggering probability model is as follows:

λ＝μαS+B

wherein, λ is total photon number distribution of echo, μ is quantum efficiency, α is reflectivity, S is signal photon number distribution, B is background noise photon number, P is probability of triggering k times at ith interval, i is ith interval, k is triggering times, and e is natural constant;

the photon number distribution can be obtained by the trigger model as follows:

wherein u is an echo data histogram, N is the total pulse number, r is the deduced total echo photon number distribution, and i is the ith interval.

3. The method for high-resolution reconstruction of the three-dimensional range image of the lidar based on multi-echo extraction as claimed in claim 1, wherein the step one of the methods for removing the partial noise points is:

part of the noise is removed by using a spatial filter, and the spatial filter is set to be 4 neighborhoods by 20 steps.

4. The lidar three-dimensional range image high-resolution reconstruction method based on multi-echo extraction according to claim 1, wherein the method for arranging the extracted multi-echo signals in the second step is: arranging by using space correlation of distance and space correlation constraint of strength according to a Markov random field;

wherein, the expression of the high-resolution range profile is as follows:

wherein rng is the resulting high resolution range profile, γ₁For distance-constrained term coefficients, gamma₂The reasonable echo ordering can be realized by adjusting the coefficient for the intensity constraint term coefficient; c represents the intensity value of the pixel, D represents the distance value of the pixel, p represents the pixel in any 2 x 2 block of pixels in the high resolution range image, and q represents the pixel in the 2 x 2 block of pixels nearest to p pixels.

5. The lidar three-dimensional range image high-resolution reconstruction method based on multi-echo extraction according to claim 1, wherein the calculation formula for reconstructing the image by the neighborhood interpolation algorithm in step three is as follows:

wherein m represents a null pixel in the high-resolution range profile, n represents a neighborhood pixel of the m pixel, N (m) represents a neighborhood pixel set of the m pixel, L represents a pixel distance value, b represents the number of neighborhood pixels of the m pixel, L (m) is obtained from the neighborhood pixel value of the m pixel, and L (n) is a domain pixel distance value of m.

6. A laser radar three-dimensional range image high-resolution reconstruction device based on multi-echo extraction is characterized by comprising: obtaining an array module, a signal arrangement module and a reconstructed image module;

the array obtaining module is used for extracting four echo positions from echoes of a single pixel point through Gm-APD laser radar echo data, calculating the positions and the intensities of multiple echoes corresponding to high-resolution 2 multiplied by 2 pixel results, and removing part of noise points to obtain a multiple echo signal array;

the signal arrangement module is used for arranging the extracted multi-echo signals to obtain a high-resolution range profile containing null pixels;

the reconstructed image module is used for reconstructing an image through a neighborhood interpolation algorithm to obtain a high-resolution range profile.

7. The apparatus according to claim 6, wherein the array obtaining module further comprises: submodule 1, submodule 2 and submodule 3;

the submodule 1 and the submodule 2 are combined for calculating the position of the multiple echoes;

the submodule 1 is used for performing preprocessing by using convolution of a Gaussian function and the Gaussian function so as to remove abnormal peaks and obtain a smooth distribution histogram;

the submodule 2 is used for extracting the characteristics of the target on the smooth distribution histogram, determining the maximum value point distribution under the current variance and extracting multiple echoes;

the submodule 3 is used for calculating the multi-echo intensity;

the function of the submodule 1 and the formula of the preprocessing mode are as follows:

v is a kernel density function, namely a Gaussian smoothing function, h is a variance value, u is a trigger histogram, w is a smoothed histogram, i is the ith position of the Gaussian kernel function, j is the value of the jth position of the trigger histogram, k is the value of the kth position of the smoothed histogram, and x is a central symmetry point of the Gaussian function, specifically, half of the length of a v-function window;

the derivative expression is:

wherein, V₂Is that the variance is h ═ h₂Kernel density function of (1), w₂The second derivative of the preprocessed data is the position of the second derivative: w is a₂The position corresponding to the minimum value;

the flow of the algorithm for extracting the multiple echoes, which is described by the function of the sub-module 2, is as follows:

scheme 1: extracting the number n of the echoes to be 4 and the second derivative w2 of the preprocessed data;

and (2) a flow scheme: when the precondition retrieval wave number is 1, calculating a minimum value ind min and a maximum value ind max of the second derivative, wherein the position of the first echo is the minimum value of the second derivative w 2;

and (3) a flow path: setting the numerical values from the left maximum value to the right minimum value of the second derivative extraction position as 0, and starting to calculate the second echo position;

and (4) a flow chart: calculating the minimum value ind min and the maximum value ind max of the second-order derivative again, wherein the position of the first echo is the minimum value of the second-order derivative w 2;

and (5) a flow chart: sequentially completing to a fourth echo;

and (6) a flow path: and obtaining a multi-echo result.

The function of the sub-module 3 and the method for calculating the multi-echo intensity are as follows:

and reversely deducing by using a triggering probability model to obtain the distribution of the photon number in each echo signal gating gate, wherein the triggering probability model is as follows:

λ＝μαS+B

wherein, λ is total photon number distribution of echo, μ is quantum efficiency, α is reflectivity, S is signal photon number distribution, B is background noise photon number, P is probability of triggering k times at ith interval, i is ith interval, k is triggering times, and e is natural constant.

The photon number distribution can be obtained by the trigger model as follows:

wherein u is an echo data histogram, N is the total pulse number, r is the deduced total echo photon number distribution, and i is the ith interval.

8. The apparatus according to claim 6, wherein the array obtaining module further comprises: submodule 4; the sub-module 4 is configured to remove the partial noise points, and the method for removing the partial noise points includes:

part of the noise is removed by using a spatial filter, and the spatial filter is set to be 4 neighborhoods by 20 steps.

9. The apparatus according to claim 6, wherein the signal arrangement module is configured to arrange the extracted multiple echo signals by: arranging by using space correlation of distance and space correlation constraint of strength according to a Markov random field;

wherein, the expression of the high-resolution range profile is as follows:

wherein rng is the resulting high resolution range profile, γ₁For distance-constrained term coefficients, gamma₂The reasonable echo ordering can be realized by adjusting the coefficient for the intensity constraint term coefficient; c represents the intensity value of the pixel, D represents the distance value of the pixel, p represents the pixel in any 2 x 2 block of pixels in the high resolution range image, and q represents the pixel in the 2 x 2 block of pixels nearest to p pixels.

10. The lidar three-dimensional range image high-resolution reconstruction device based on multi-echo extraction as claimed in claim 6, wherein the calculation formula of the reconstructed image module for reconstructing the image is as follows:

wherein m represents a null pixel in the high-resolution range profile, n represents a neighborhood pixel of the m pixel, N (m) represents a neighborhood pixel set of the m pixel, L represents a pixel distance value, b represents the number of neighborhood pixels of the m pixel, L (m) is obtained from the neighborhood pixel value of the m pixel, and L (n) is a domain pixel distance value of m.

Background

The imaging resolution of the Gm-APD laser imaging radar is low, and a great deal of difficulty exists in developing a large-array device, so that the spatial resolution is improved in consideration of low cost from the perspective of an algorithm. The existing method for improving the spatial resolution is based on three types of interpolation, reconstruction model and learning. Interpolation-based high-resolution reconstruction algorithms, the nearest neighbor interpolation, the bilinear interpolation and the bicubic interpolation are widely used. The method based on the reconstruction model adds the priori knowledge of the image as a constraint condition into the high-resolution reconstruction process of the image. The distance image high-resolution reconstruction method combining the same-scene high-resolution intensity image is a research hotspot, Diebel et al utilize a Markov random field model to establish a connection between the same-scene high-resolution intensity image and the distance image, prior knowledge of the intensity image is added into a regularization term, and a distance fidelity term and regularization term L2 norm model are constructed. Ferstll et al uses a second-order TGV model to blend the same scene intensity image information into regularization terms by calculating the anisotropic diffusion tensor. Due to the influence of the texture region of the intensity image, the texture mapping phenomenon often occurs in the method, and the reconstruction effect is easily influenced by the registration precision. Based on a learning high-resolution reconstruction algorithm, Dong et al applied a neural network to the image high-resolution reconstruction direction at the earliest, and performed calculation processing on a low-resolution image by using an end-to-end three-layer convolutional layer. Dong et al add a number of convolutional layers to expand the field of view and add a deconvolution layer at the end of the network to increase reconstruction speed. The method needs to spend a large amount of time to construct a sample set for learning training, but the learning-based high-resolution reconstruction method is not suitable for processing the laser radar range profile because of the lack of abundant high-resolution Gm-APD laser radar three-dimensional range profile sample library.

Disclosure of Invention

The method for improving the spatial resolution in the prior art has the problem that the reconstruction effect is easily influenced by the registration precision due to the texture mapping phenomenon. The laser radar three-dimensional range image high-resolution reconstruction method and device based on multi-echo extraction only depend on Gm-APD laser imaging radar echo data processing, and the range image resolution is improved through multi-peak extraction; the multi-peak extraction is the multi-echo signal extraction mentioned in the present invention.

The method comprises the following steps:

the method for reconstructing the three-dimensional range image of the laser radar based on multi-echo extraction comprises the following steps:

the method comprises the following steps: acquiring echo data through a Gm-APD laser radar, extracting four echo positions from echoes of a single pixel point, calculating the positions and the intensities of multiple echoes corresponding to high-resolution 2 x 2 pixel results, and removing part of noise points to obtain a multiple echo signal array;

step two: arranging the extracted multi-echo signals to obtain a high-resolution range profile containing null pixels;

step three: reconstructing an image through a neighborhood interpolation algorithm to obtain a high-resolution range profile;

the method for calculating the position of the multiple echoes in the first step comprises the following steps: step 1.1 and step 1.2;

the step 1.1 is as follows: performing preprocessing by using convolution of a Gaussian function and the Gaussian function so as to remove abnormal peaks and obtain a smooth distribution histogram;

the step 1.2 is as follows: extracting the characteristics of the target on the smooth distribution histogram, determining the distribution of maximum value points under the current variance, and extracting multiple echoes;

further, in step 1.1, the formula of the preprocessing mode is as follows:

v is a kernel density function, namely a Gaussian smoothing function, h is a variance value, u is a trigger histogram, w is a smoothed histogram, i is the ith position of the Gaussian kernel function, j is the value of the jth position of the trigger histogram, k is the value of the kth position of the smoothed histogram, and x is a central symmetry point of the Gaussian function, specifically, half of the length of a v-function window;

the derivative expression is:

wherein, V₂Is that the variance is h ═ h₂Kernel density function of (1), w₂The second derivative of the preprocessed data is the position of the second derivative: w is a₂The position corresponding to the minimum value;

in step 1.2, the flow of the algorithm for extracting the multiple echoes is as follows:

scheme 1.2.1: extracting the number n of the echoes to be 4 and the second derivative w2 of the preprocessed data;

scheme 1.2.2: when the precondition retrieval wave number is 1, calculating a minimum value ind min and a maximum value indmax of the second derivative, wherein the position of the first echo is the minimum value of the second derivative w 2;

scheme 1.2.3: setting the numerical values from the left maximum value to the right minimum value of the second derivative extraction position as 0, and starting to calculate the second echo position;

scheme 1.2.4: calculating the minimum value ind min and the maximum value ind max of the second-order derivative again, wherein the position of the first echo is the minimum value of the second-order derivative w 2;

scheme 1.2.5: sequentially completing to a fourth echo;

scheme 1.2.6: multiple echo results are obtained.

The specific program code is as follows:

the method for calculating the multi-echo intensity in the first step comprises the following steps:

and reversely deducing by using a triggering probability model to obtain the distribution of the photon number in each echo signal gating gate, wherein the triggering probability model is as follows:

λ＝μαS+Bλ＝μαS+B

wherein, λ is total photon number distribution of echo, μ is quantum efficiency, α is reflectivity, S is signal photon number distribution, B is background noise photon number, P is probability of triggering k times at ith interval, i is ith interval, k is triggering times, and e is natural constant;

the photon number distribution can be obtained by the trigger model as follows:

wherein u is an echo data histogram, N is the total pulse number, r is the deduced total echo photon number distribution, and i is the ith interval.

Further, the method for removing partial noise points in step one includes:

removing part of noise by using a spatial filter, and setting the spatial filter to be 4 neighborhoods by 20 step lengths;

further, the method for arranging the extracted multiple echo signals in the second step comprises: arranging by using space correlation of distance and space correlation constraint of strength according to a Markov random field;

wherein, the expression of the high-resolution range profile is as follows:

wherein rng is the resulting high resolution range profile, γ₁For distance-constrained term coefficients, gamma₂The reasonable echo ordering can be realized by adjusting the coefficient for the intensity constraint term coefficient; c represents the intensity value of the pixel, D represents the distance value of the pixel, p represents the pixel in any 2 x 2 block of pixels in the high resolution range image, and q represents the pixel in the 2 x 2 block of pixels nearest to p pixels.

Further, the calculation formula for reconstructing the image by the neighborhood interpolation algorithm described in the third step is as follows:

wherein m represents a null pixel in the high-resolution range profile, n represents a neighborhood pixel of the m pixel, N (m) represents a neighborhood pixel set of the m pixel, L represents a pixel distance value, b represents the number of neighborhood pixels of the m pixel, L (m) is obtained from the neighborhood pixel value of the m pixel, and L (n) is a domain pixel distance value of m.

The flow chart of the laser radar three-dimensional range image high-resolution reconstruction method based on multi-echo extraction is shown in fig. 6.

A lidar three-dimensional range image high-resolution reconstruction device based on multi-echo extraction, the device comprises: obtaining an array module, a signal arrangement module and a reconstructed image module;

the array obtaining module is used for collecting echo data through a Gm-APD laser radar, extracting four echo positions from echoes of a single pixel point, calculating the positions and the intensities of multiple echoes corresponding to high-resolution 2 x 2 pixel results, and removing part of noise points to obtain a multiple echo signal array;

the signal arrangement module is used for arranging the extracted multi-echo signals to obtain a high-resolution range profile containing null pixels;

the reconstructed image module is used for reconstructing an image through a neighborhood interpolation algorithm to obtain a high-resolution range profile.

Further, the obtaining the array module further includes: submodule 1, submodule 2 and submodule 3;

the submodule 1 and the submodule 2 are combined for calculating the position of the multiple echoes;

the submodule 1 is used for performing preprocessing by using convolution of a Gaussian function and the Gaussian function so as to remove abnormal peaks and obtain a smooth distribution histogram;

the submodule 2 is used for extracting the characteristics of the target on the smooth distribution histogram, determining the maximum value point distribution under the current variance and extracting multiple echoes;

the submodule 3 is used for calculating the multi-echo intensity;

the function of the submodule 1 and the formula of the preprocessing mode are as follows:

wherein v is a kernel density function, i.e. a gaussian smoothing function, h is a variance value, u is a trigger histogram, w is a smoothed histogram, i is the ith position of the gaussian kernel function, j is the value of the jth position of the trigger histogram, k is the value of the kth position of the smoothed histogram, and x is a central symmetry point of the gaussian function, specifically, half of the length of a v-function window.

The derivative expression is:

wherein, V₂Is the varianceIs h ═ h₂Kernel density function of (1), w₂The second derivative of the preprocessed data is the position of the second derivative: w is a₂The position corresponding to the minimum value;

the flow of the algorithm for extracting the multiple echoes, which is described by the function of the sub-module 2, is as follows:

scheme 1: extracting the number n of the echoes to be 4 and the second derivative w2 of the preprocessed data;

and (2) a flow scheme: when the precondition retrieval wave number is 1, calculating a minimum value ind min and a maximum value ind max of the second derivative, wherein the position of the first echo is the minimum value of the second derivative w 2;

and (3) a flow path: setting the numerical values from the left maximum value to the right minimum value of the second derivative extraction position as 0, and starting to calculate the second echo position;

and (4) a flow chart: calculating the minimum value ind min and the maximum value ind max of the second-order derivative again, wherein the position of the first echo is the minimum value of the second-order derivative w 2;

and (5) a flow chart: sequentially completing to a fourth echo;

and (6) a flow path: multiple echo results are obtained.

The specific program code is as follows:

the function of the sub-module 3 and the method for calculating the multi-echo intensity are as follows:

and reversely deducing by using a triggering probability model to obtain the distribution of the photon number in each echo signal gating gate, wherein the triggering probability model is as follows:

λ＝μαS+B

wherein, λ is total photon number distribution of echo, μ is quantum efficiency, α is reflectivity, S is signal photon number distribution, B is background noise photon number, P is probability of triggering k times at ith interval, i is ith interval, k is triggering times, and e is natural constant.

The photon number distribution can be obtained by the trigger model as follows:

wherein u is an echo data histogram, N is the total pulse number, r is the deduced total echo photon number distribution, and i is the ith interval.

Further, the obtaining the array module further includes: submodule 4; the sub-module 4 is configured to remove the partial noise points, and the method for removing the partial noise points includes:

removing part of noise by using a spatial filter, and setting the spatial filter to be 4 neighborhoods by 20 step lengths;

further, the method for arranging the extracted multiple echo signals by the signal arrangement module comprises the following steps: arranging by using space correlation of distance and space correlation constraint of strength according to a Markov random field;

wherein, the expression of the high-resolution range profile is as follows:

wherein rng is the resulting high resolution range profile, γ₁For distance-constrained term coefficients, gamma₂The reasonable echo ordering can be realized by adjusting the coefficient for the intensity constraint term coefficient; c represents the intensity value of the pixel, D represents the distance value of the pixel, p represents the pixel in any 2 x 2 block of pixels in the high resolution range image, and q represents the pixel in the 2 x 2 block of pixels nearest to p pixels.

Further, the calculation formula of the reconstructed image module is as follows:

wherein m represents a null pixel in the high-resolution range profile, n represents a neighborhood pixel of the m pixel, N (m) represents a neighborhood pixel set of the m pixel, L represents a pixel distance value, b represents the number of neighborhood pixels of the m pixel, L (m) is obtained from the neighborhood pixel value of the m pixel, and L (n) is a domain pixel distance value of m.

The invention has the advantages that:

the method provided by the invention solves the problem of low imaging resolution of the Gm-APD laser imaging radar by adopting a method based on difference or based on a reconstruction model or based on learning or improvement thereof in the prior art, but solves the problem of low imaging resolution of the Gm-APD laser imaging radar by adopting a mode of analyzing and reconstructing echo signals, is completely different from the conventional common idea for solving the problem, adopts a brand new design idea, namely overcomes the bias of the prior art, the pixel of the range profile obtained by the prior art is 64 x 64, the pixel of the range profile obtained by the method provided by the invention is 128 x 128, the high-resolution range profile is obtained by adopting a mode of low cost, and the unexpected technical effect is obtained.

Drawings

FIG. 1 is a photograph of a live action taken in accordance with an eleventh embodiment of the present invention;

FIG. 2 is a range image of FIG. 1 obtained by the prior art;

FIG. 3 is a range image of FIG. 1 obtained by a method provided by the present invention;

FIG. 4 is a distance image obtained by the prior art for the eleventh embodiment of the present invention;

FIG. 5 is a range profile obtained by the method provided by the present invention;

fig. 6 is a flow chart of a method provided by the present invention.

Detailed Description

The first embodiment is described with reference to fig. 6, and the first embodiment provides a method for reconstructing a three-dimensional range image of a laser radar based on multi-echo extraction, the method comprising the following steps:

the method comprises the following steps: extracting four echo positions through Gm-APD laser radar echo data and single pixel point echoes, calculating the positions and the intensities of multiple echoes corresponding to high-resolution 2 multiplied by 2 pixel results, and removing partial noise points to obtain a multiple echo signal array;

step two: arranging the extracted multi-echo signals to obtain a high-resolution range profile containing null pixels;

step three: and reconstructing the image through a neighborhood interpolation algorithm to obtain a high-resolution range profile.

In a second embodiment, the present embodiment is further directed to the method for reconstructing a three-dimensional range image of a laser radar based on multi-echo extraction according to the first embodiment, where the method for calculating a multi-echo position in the first step includes: step 1.1 and step 1.2;

the step 1.1 is as follows: performing preprocessing by using convolution of a Gaussian function and the Gaussian function so as to remove abnormal peaks and obtain a smooth distribution histogram;

the step 1.2 is as follows: extracting the characteristics of the target on the smooth distribution histogram, determining the distribution of maximum value points under the current variance, and extracting multiple echoes;

in step 1.1, the formula of the preprocessing mode is as follows:

v is a kernel density function, namely a Gaussian smoothing function, h is a variance value, u is a trigger histogram, w is a smoothed histogram, i is the ith position of the Gaussian kernel function, j is the value of the jth position of the trigger histogram, k is the value of the kth position of the smoothed histogram, and x is a central symmetry point of the Gaussian function, specifically, half of the length of a v-function window;

the derivative expression is:

wherein, V₂Is that the variance is h ═ h₂Kernel density function of (1), w₂The second derivative of the preprocessed data is the position of the second derivative: w is a₂The position corresponding to the minimum value;

in step 1.2, the flow of the algorithm for extracting the multiple echoes is as follows:

step 1.2.1: extracting the number n of the echoes to be 4 and the second derivative w2 of the preprocessed data;

step 1.2.2: when the precondition retrieval wave number is 1, calculating a minimum value ind min and a maximum value indmax of the second derivative, wherein the position of the first echo is the minimum value of the second derivative w 2;

step 1.2.3: setting the numerical values from the left maximum value to the right minimum value of the second derivative extraction position as 0, and starting to calculate the second echo position;

step 1.2.4: calculating a minimum value ind min and a maximum value ind max of the second-order derivative, wherein the position of the first echo is the minimum value of the second-order derivative w 2;

step 1.2.5: sequentially completing to a fourth echo;

step 1.2.6: multiple echo results are obtained.

The specific program code is as follows:

in a third embodiment, the present embodiment is further described with respect to the method for reconstructing a three-dimensional range image of a laser radar based on multi-echo extraction according to the first embodiment, where the method for calculating the multi-echo intensity in the first step includes:

and reversely deducing by using a triggering probability model to obtain the distribution of the photon number in each echo signal gating gate, wherein the triggering probability model is as follows:

λ＝μαS+B

wherein, λ is total photon number distribution of echo, μ is quantum efficiency, α is reflectivity, S is signal photon number distribution, B is background noise photon number, P is probability of triggering k times at ith interval, i is ith interval, k is triggering times, and e is natural constant;

the photon number distribution can be obtained by the trigger model as follows:

wherein u is an echo data histogram, N is the total pulse number, r is the deduced total echo photon number distribution, and i is the ith interval.

In a fourth embodiment, the present embodiment is further described with respect to the method for reconstructing a three-dimensional range image of a laser radar based on multi-echo extraction according to the first embodiment, where the method for removing a part of noise points in the first step includes:

part of the noise is removed by using a spatial filter, and the spatial filter is set to be 4 neighborhoods by 20 steps.

The lidar three-dimensional range image high-resolution reconstruction method based on multi-echo extraction according to claim 1, wherein the method for arranging the extracted multi-echo signals in the second step is: arranging by using space correlation of distance and space correlation constraint of strength according to a Markov random field;

wherein, the expression of the high-resolution range profile is as follows:

wherein rng is the resulting high resolution range profile, γ₁For distance-constrained term coefficients, gamma₂The reasonable echo ordering can be realized by adjusting the coefficient for the intensity constraint term coefficient; c represents the intensity value of the pixel, D represents the distance value of the pixel, p represents the pixel in any 2 x 2 pixel block in the high resolution range image, and q representsThe picture elements within the 2 x 2 block of picture elements that are the closest to the p picture elements.

Fifth, in this embodiment, a further description is given of the method for reconstructing a three-dimensional range image of a laser radar based on multi-echo extraction according to the first embodiment, where a calculation formula for reconstructing an image through a neighborhood interpolation algorithm in step three is as follows:

wherein m represents a null pixel in the high-resolution range profile, n represents a neighborhood pixel of the m pixel, N (m) represents a neighborhood pixel set of the m pixel, L represents a pixel distance value, b represents the number of neighborhood pixels of the m pixel, L (m) is obtained from the neighborhood pixel value of the m pixel, and L (n) is a domain pixel distance value of m.

Sixth embodiment and the present embodiment will be described with reference to fig. 6, and the present embodiment provides a lidar three-dimensional range image high-resolution reconstruction device based on multi-echo extraction, the device including: obtaining an array module, a signal arrangement module and a reconstructed image module;

the array obtaining module is used for extracting four echo positions from echoes of a single pixel point through Gm-APD laser radar echo data, calculating the positions and the intensities of multiple echoes corresponding to high-resolution 2 multiplied by 2 pixel results, and removing part of noise points to obtain a multiple echo signal array;

the signal arrangement module is used for arranging the extracted multi-echo signals to obtain a high-resolution range profile containing null pixels;

the reconstructed image module is used for reconstructing an image through a neighborhood interpolation algorithm to obtain a high-resolution range profile.

Seventh, in this embodiment, a laser radar three-dimensional range image high resolution reconstruction apparatus based on multi-echo extraction according to the first embodiment is further described, where the array obtaining module further includes: submodule 1, submodule 2 and submodule 3;

the submodule 1 and the submodule 2 are combined for calculating the position of the multiple echoes;

the submodule 1 is used for performing preprocessing by using convolution of a Gaussian function and the Gaussian function so as to remove abnormal peaks and obtain a smooth distribution histogram;

the submodule 2 is used for extracting the characteristics of the target on the smooth distribution histogram, determining the maximum value point distribution under the current variance and extracting multiple echoes;

the submodule 3 is used for calculating the multi-echo intensity;

the function of the submodule 1 and the formula of the preprocessing mode are as follows:

v is a kernel density function, namely a Gaussian smoothing function, h is a variance value, u is a trigger histogram, w is a smoothed histogram, i is the ith position of the Gaussian kernel function, j is the value of the jth position of the trigger histogram, k is the value of the kth position of the smoothed histogram, and x is a central symmetry point of the Gaussian function, specifically, half of the length of a v-function window;

the derivative expression is:

wherein, V₂Is that the variance is h ═ h₂Kernel density function of (1), w₂The second derivative of the preprocessed data is the position of the second derivative: w is a₂The position corresponding to the minimum value;

the flow of the algorithm for extracting the multiple echoes, which is described by the function of the sub-module 2, is as follows:

scheme 1: extracting the number n of the echoes to be 4 and the second derivative w2 of the preprocessed data;

and (2) a flow scheme: when the precondition retrieval wave number is 1, calculating a minimum value ind min and a maximum value ind max of the second derivative, wherein the position of the first echo is the minimum value of the second derivative w 2;

and (3) a flow path: setting the numerical values from the left maximum value to the right minimum value of the second derivative extraction position as 0, and starting to calculate the second echo position;

and (4) a flow chart: calculating the minimum value ind min and the maximum value ind max of the second-order derivative again, wherein the position of the first echo is the minimum value of the second-order derivative w 2;

and (5) a flow chart: sequentially completing to a fourth echo;

and (6) a flow path: and (5) performing multi-echo results.

The specific program code is as follows:

the function of the sub-module 3 and the method for calculating the multi-echo intensity are as follows:

and reversely deducing by using a triggering probability model to obtain the distribution of the photon number in each echo signal gating gate, wherein the triggering probability model is as follows:

λ＝μαS+B

wherein, λ is total photon number distribution of echo, μ is quantum efficiency, α is reflectivity, S is signal photon number distribution, B is background noise photon number, P is probability of triggering k times at ith interval, i is ith interval, k is triggering times, and e is natural constant.

The photon number distribution can be obtained by the trigger model as follows:

wherein u is an echo data histogram, N is the total pulse number, r is the deduced total echo photon number distribution, and i is the ith interval.

In an eighth embodiment, the present invention is further directed to the apparatus for reconstructing a three-dimensional range image of a laser radar based on multi-echo extraction according to the first embodiment, wherein the array obtaining module further includes: submodule 4; the sub-module 4 is configured to remove the partial noise points, and the method for removing the partial noise points includes:

part of the noise is removed by using a spatial filter, and the spatial filter is set to be 4 neighborhoods by 20 steps.

In a ninth embodiment, the present invention is further directed to the apparatus for reconstructing a three-dimensional range image of a laser radar based on multi-echo extraction according to the first embodiment, wherein the signal arranging module is configured to arrange the extracted multi-echo signals by: arranging by using space correlation of distance and space correlation constraint of strength according to a Markov random field;

wherein, the expression of the high-resolution range profile is as follows:

wherein rng is the resulting high resolution range profile, γ₁For distance-constrained term coefficients, gamma₂The reasonable echo ordering can be realized by adjusting the coefficient for the intensity constraint term coefficient; c represents the intensity value of the pixel, D represents the distance value of the pixel, p represents the pixel in any 2 x 2 block of pixels in the high resolution range image, and q represents the pixel in the 2 x 2 block of pixels nearest to p pixels.

Tenth embodiment and the present embodiment are further directed to the laser radar three-dimensional range image high resolution reconstruction apparatus based on multi-echo extraction according to the first embodiment, wherein the calculation formula of the reconstructed image module to reconstruct the image is as follows:

wherein m represents a null pixel in the high-resolution range profile, n represents a neighborhood pixel of the m pixel, N (m) represents a neighborhood pixel set of the m pixel, L represents a pixel distance value, b represents the number of neighborhood pixels of the m pixel, L (m) is obtained from the neighborhood pixel value of the m pixel, and L (n) is a domain pixel distance value of m.

Description is given to the eleventh embodiment with reference to fig. 1 to 5, which is a description of an effect of a method for reconstructing a three-dimensional range image of a laser radar based on multi-echo extraction according to the first embodiment, where fig. 1 is a live view photograph taken in the present embodiment, fig. 2 is a range image obtained by extracting echo data of a Gm-APD laser imaging radar according to the prior art, and a pixel of the range image is 64 × 64, and fig. 3 is a range image obtained by the method according to the first embodiment and a pixel of the range image is 128 × 128; fig. 4 is a range image obtained by extracting a signal of return data of a Gm-APD laser imaging radar in the prior art, where the pixel is 64 × 64, and fig. 5 is a range image obtained by the method according to the first embodiment, where the pixel is 128 × 128;

comparing fig. 3 and fig. 2, it can be seen that the range profile obtained by the method according to the first embodiment is four times as many as the pixels of the range profile obtained by the method according to the prior art; as can be seen from fig. and a comparison between fig. 5 and 4, the distance image obtained by the method provided in the first embodiment is four times as large as the pixels of the distance image obtained by the method in the prior art.

In conclusion, the method and the device provided by the invention can be distinguished from the prior art, only depend on Gm-APD laser imaging radar echo data processing, and improve the range image resolution through multi-peak extraction; analyzing by using the echo of a single pixel point to obtain a plurality of target distance values; the spatial resolution of the range profile is improved through the arrangement of multiple echoes; by analyzing and reconstructing the echo signals, the prejudice of the prior art is overcome, the high-resolution range profile is obtained, only the echo data processing of the Gm-APD laser imaging radar is relied on, and the cost for obtaining the high-resolution range profile is reduced.