1. The utility model provides a global perception early warning system of intelligent perception sensor which characterized in that includes:

the mobile terminal perception early warning system comprises a first information acquisition module, an information processing module, a feature extraction module and a tracking identification module, and can initiate a calling instruction to a cloud perception information linkage system according to the position of the mobile terminal perception early warning system to obtain a nearest perception information picture of the fixed terminal multi-modal perception system so as to project the nearest perception information picture to a driver interaction interface of the mobile terminal;

the fixed end multi-mode perception system comprises a second information acquisition module, an all-weather perception module, a remote monitoring module and a prediction identification module;

and the cloud perception information linkage system is in wireless connection with the mobile end perception early warning system and the fixed end multi-mode perception system through a wireless communication module.

2. The global perception early warning system of the intelligent perception sensor according to claim 1, wherein the first information collection module includes a visual camera, an ultrasonic unit and an inertial measurement unit, and the mobile terminal perception early warning system can reduce communication errors by replacing human observers with information fusion perception of the visual camera, the ultrasonic unit and the inertial measurement unit.

3. The global sensing and early warning system of the intelligent sensing sensor as claimed in claim 1, wherein the second information collection module comprises a laser sensor, an infrared camera and a doppler radar, and the fixed-end multi-modal sensing system can complete the wide-area accurate sensing of information to perform real-time analysis on the surrounding environment in the operation process by the laser sensor, the infrared camera and the doppler radar.

4. The global perception early warning system of an intelligent perception sensor according to claim 1, wherein an online self-learning module is arranged in the cloud perception information linkage system.

5. The global sensing and early warning system of the intelligent sensing sensor as claimed in claim 1, wherein the cloud sensing information linkage system is provided with a comprehensive data analysis module.

6. The system of claim 1, wherein the wireless communication module comprises a 5G communication unit.

7. The global sensing prewarning system of the intelligent sensing sensor, as claimed in claim 1, wherein the wireless communication module includes a ZigBee wireless communication unit.

8. The global sensing early warning system of intelligent sensing sensors according to claim 7, wherein the chip type of the ZigBee wireless communication module is JN 5148.

9. The global perception early warning system of an intelligent perception sensor according to claim 1, wherein the cloud perception information linkage system is a cloud server formed by computer processing clusters.

10. The global sensing and early warning system of the intelligent sensing sensor as claimed in claim 1, wherein the second information collecting module comprises an ultrasonic range finder, a millimeter wave radar, a laser radar and a solid state radar.

Background

Intelligent perception is the most effective channel to assist humans in obtaining and processing environmental information. The single sensing device is difficult to realize accurate and stable environmental sensing under the conditions of illumination change, dynamic objects and the like. However, the complementary advantages of heterogeneous sensors are not fully exploited in the prior art, and therefore, how to recognize, identify and understand the environment of the heterogeneous sensors through multi-modal information fusion in an environment with uncertain information and high dynamism is a key challenge facing intelligent perception at present. According to the invention, an island operation mode of the mobile terminal intelligent sensing system is broken, the intelligent terminal sensing system and the cloud platform form closed-loop information linkage, the sharing and calling of sensing data and sensing information can be completed in real time, and support is provided for a large data center. The method realizes the global perception of the intelligent terminal-cloud control brain, and has important theoretical significance and application value in the fields of military and civil use.

Disclosure of Invention

The invention aims to overcome the problems in the prior art and provides a global sensing early warning system of an intelligent sensing sensor.

In order to achieve the purpose, the invention adopts the following scheme:

a global perception early warning system of an intelligent perception sensor comprises:

the mobile terminal perception early warning system comprises a first information acquisition module, an information processing module, a feature extraction module and a tracking identification module, and can initiate a calling instruction to a cloud perception information linkage system according to the position of the mobile terminal perception early warning system to obtain a nearest perception information picture of the fixed terminal multi-modal perception system so as to project the perception information picture to a driver interaction interface of the mobile terminal;

the fixed end multi-mode sensing system comprises a second information acquisition module, an all-weather sensing module, a remote monitoring module and a prediction identification module;

and the cloud perception information linkage system is in wireless connection with the mobile end perception early warning system and the fixed end multi-mode perception system through the wireless communication module.

Furthermore, the first information acquisition module comprises a visual camera, an ultrasonic unit and an inertia measurement unit, and the mobile terminal perception early warning system can reduce communication errors by replacing a human observer through information fusion perception of the visual camera, the ultrasonic unit and the inertia measurement unit.

Furthermore, the second information acquisition module comprises a laser sensor, an infrared camera and a Doppler radar, and the fixed-end multi-mode sensing system can complete information complementation through the laser sensor, the infrared camera and the Doppler radar to realize wide-area accurate sensing in the operation process to analyze the surrounding environment in real time.

Furthermore, an online self-learning module is arranged in the cloud perception information linkage system.

Furthermore, a comprehensive data analysis module is arranged in the cloud perception information linkage system.

Further, the wireless communication module includes a 5G communication unit.

Further, the wireless communication module comprises a ZigBee wireless communication unit.

Further, the chip model of the ZigBee wireless communication module is JN 5148.

Furthermore, the cloud sensing information linkage system is a cloud server formed by computer processing clusters.

Furthermore, the second information acquisition module comprises an ultrasonic range finder, a millimeter wave radar, a laser radar and a solid-state radar.

Compared with the prior art, the invention has the following advantages: the mobile terminal perception early warning system improves the perception view range through multi-source sensor information fusion perception, enriches perception information of the environment, and improves all-weather and all-working-condition working capacity of the intelligent perception system. The fixed end multi-mode sensing system completes information complementation by means of sensors such as a laser radar, an infrared camera and a high-definition camera, and positioning and tracking of a target object in a scene are achieved. The mobile end perception early warning system, the fixed end multi-mode perception system and the cloud perception information linkage system are linked to form a set of cloud-to-end intelligent perception system, the digitization and the intellectualization of the intelligent perception system are enhanced, the sharing and the calling of perception data and perception information can be completed in real time, support is provided for a large data center, and an island operation mode is broken.

Drawings

The present application will be described in further detail with reference to the following drawings and detailed description.

Fig. 1 is a schematic diagram of an overall structure of a global sensing and early warning system of an intelligent sensing sensor according to the present invention.

Fig. 2 is a schematic structural diagram of a first information collection module of the global sensing and early warning system of the smart sensor of the present invention.

Fig. 3 is a schematic structural diagram of a second information acquisition module of the global sensing and early warning system of the smart sensor of the present invention.

Fig. 4 is a schematic structural diagram of a second information collection module of another embodiment of the global sensing and early warning system of the smart sensor of the present invention.

Detailed Description

The following detailed description of embodiments of the present invention is provided in connection with the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.

Example one

As shown in fig. 1, a global sensing early warning system of an intelligent sensing sensor includes:

the mobile terminal perception early warning system comprises a first information acquisition module, an information processing module, a feature extraction module and a tracking identification module, and can initiate a calling instruction to a cloud perception information linkage system according to the position of the mobile terminal perception early warning system to obtain a nearest perception information picture of the fixed terminal multi-modal perception system so as to project the perception information picture to a driver interaction interface of the mobile terminal;

the fixed end multi-mode sensing system comprises a second information acquisition module, an all-weather sensing module, a remote monitoring module and a prediction identification module;

and the cloud perception information linkage system is in wireless connection with the mobile end perception early warning system and the fixed end multi-mode perception system through the wireless communication module.

As shown in fig. 2, preferably, the first information acquisition module includes a visual camera, an ultrasonic unit, and an inertia measurement unit, and the mobile terminal perception early warning system can reduce communication errors by replacing human observers with information fusion perception of the visual camera, the ultrasonic unit, and the inertia measurement unit.

As shown in fig. 3, preferably, the second information acquisition module includes a laser sensor, an infrared camera, and a doppler radar, and the fixed-end multimodal sensing system can complete information complementation through the laser sensor, the infrared camera, and the doppler radar to accurately sense a wide area in an operation process and analyze the surrounding environment in real time.

Preferably, an online self-learning module is arranged in the cloud perception information linkage system.

Preferably, a comprehensive data analysis module is arranged in the cloud perception information linkage system.

The mobile terminal perception early warning system improves the perception view range through multi-source sensor information fusion perception, enriches perception information of the environment, and improves all-weather and all-working-condition working capacity of the intelligent perception system. The fixed end multi-mode sensing system completes information complementation by means of sensors such as a laser radar, an infrared camera and a high-definition camera, and positioning and tracking of a target object in a scene are achieved. The mobile end perception early warning system, the fixed end multi-mode perception system and the cloud perception information linkage system are linked to form a set of cloud-to-end intelligent perception system, the digitization and the intellectualization of the intelligent perception system are enhanced, the sharing and the calling of perception data and perception information can be completed in real time, support is provided for a large data center, and an island operation mode is broken.

Preferably, the wireless communication module includes a 5G communication unit.

Preferably, the wireless communication module includes a ZigBee wireless communication unit. The ZigBee wireless communication technology can achieve coordinated communication among thousands of tiny sensors by means of special radio standards, and thus the technology is often called Home RF Lite wireless technology and FireFly wireless technology. In this embodiment, the ZigBee chip used is a JN5148 chip of Jennic corporation. The chip has the working frequency of 2.4-2.485G, 16 available frequency segments, the wireless rate of 250Kbit/s, the transmitting power of +2.5dBm, the receiving sensitivity of-97 dBm, the maximum transmitting current of 15mA, the maximum receiving current of 18mA, the sleeping current of 0.2uA, the working voltage range of 2.0-3.6V, the hardware automatic CSMA-CA function, the hardware automatic frame retransmission function, the hardware automatic address transition function, the hardware FCS calculation function, the hardware clear wireless channel confirmation function, the hardware RSSI calculation function and the hardware AES/DES function. The mobile terminal perception early warning system and the fixed terminal multimodal perception system transmit data through the ZigBee wireless communication unit.

Preferably, the cloud perception information linkage system is a cloud server formed by computer processing clusters.

Example two

As shown in fig. 1, a global sensing early warning system of an intelligent sensing sensor includes:

the mobile terminal perception early warning system comprises a first information acquisition module, an information processing module, a feature extraction module and a tracking identification module, and can initiate a calling instruction to a cloud perception information linkage system according to the position of the mobile terminal perception early warning system to obtain a nearest perception information picture of the fixed terminal multi-modal perception system so as to project the perception information picture to a driver interaction interface of the mobile terminal;

the fixed end multi-mode sensing system comprises a second information acquisition module, an all-weather sensing module, a remote monitoring module and a prediction identification module;

and the cloud perception information linkage system is in wireless connection with the mobile end perception early warning system and the fixed end multi-mode perception system through the wireless communication module.

As shown in fig. 2, preferably, the first information acquisition module includes a visual camera, an ultrasonic unit, and an inertia measurement unit, and the mobile terminal perception early warning system can reduce communication errors by replacing human observers with information fusion perception of the visual camera, the ultrasonic unit, and the inertia measurement unit.

As shown in fig. 4, it is preferable that the second information collecting module includes an ultrasonic range finder, a millimeter wave radar, a laser radar, and a solid state radar. The ultrasonic distance measuring instrument measures distance through sound velocity, and an ultrasonic unit is strong in directivity, slow in energy consumption and long in propagation distance in a medium. The ultrasonic distance measuring instrument is provided with a point aiming device, and as long as the instrument is aimed at a target to be measured, a point appears on a display screen of the distance measuring instrument, and the measurement is mainly carried out through the sound velocity. The ultrasonic transmitter transmits an ultrasonic unit to a certain direction, timing is started at the same time of transmitting time, ultrasonic waves propagate in the air and return immediately when encountering an obstacle in the process, and the ultrasonic receiver stops timing immediately when receiving reflected waves. The propagation speed of the ultrasonic wave in the air is 340m/s, and the distance s between the transmitting point and the obstacle can be calculated according to the time t recorded by the timer. Millimeter-wave radars are radars that operate to detect in the millimeter-wave band. Usually, the millimeter wave is in the frequency domain of 30 to 300GHz (with a wavelength of 1 to 10 mm). Millimeter-wave radar has some of the advantages of both microwave and photoelectric radar because the wavelength of millimeter-wave waves is intermediate between microwave and centimeter waves. Laser radar, which is a short for laser detection and ranging system, uses a laser as a radiation source. Lidar is a product of a combination of laser technology and radar technology. The device consists of a transmitter, an antenna, a receiver, a tracking frame, information processing and the like. Compared with the centimeter wave seeker, the millimeter wave seeker has the characteristics of small volume, light weight and high spatial resolution. The solid-state radar adopts a high-power solid-state microwave source to replace a radar of a high-power microwave tube oscillation source. The solid microwave source comprises a transistor, a microwave source formed by combining the transistor and a frequency multiplier and a microwave source utilizing the effect of a semiconductor material. To achieve high power, a plurality of individual microwave sources are typically arrayed on the array of a phased array antenna, one antenna element is excited by each source, the sources are added spatially, and solid state power amplifiers, integrated microwave receivers, and integrated phase shifting networks, among others, are employed. The fixed end multi-mode sensing system can complete information complementation through an ultrasonic range finder, a millimeter wave radar, a laser radar and a solid-state radar, and can accurately sense a wide area in the operation process to analyze the surrounding environment in real time.

Preferably, an online self-learning module is arranged in the cloud perception information linkage system.

Preferably, a comprehensive data analysis module is arranged in the cloud perception information linkage system. By the fixed-end multi-mode sensing system and the mobile-end sensing early warning system, behavior data are uploaded to the cloud sensing information linkage system data cloud platform synchronously, an island mode of the mobile-end sensing system is broken, a plurality of operation tasks are supported to be carried out synchronously, data support can be provided for operation safety and efficiency, and operation digitization and intelligent management are accelerated.

Preferably, the wireless communication module includes a 5G communication unit.

Preferably, the cloud perception information linkage system is a cloud server formed by computer processing clusters.

Compared with the prior art, the invention has the following advantages: the mobile terminal perception early warning system improves the perception view range through multi-source sensor information fusion perception, enriches perception information of the environment, and improves all-weather and all-working-condition working capacity of the intelligent perception system. The fixed end multi-mode sensing system completes information complementation by means of sensors such as a laser radar, an infrared camera and a high-definition camera, and positioning and tracking of a target object in a scene are achieved. The mobile end perception early warning system, the fixed end multi-mode perception system and the cloud perception information linkage system are linked to form a set of cloud-to-end intelligent perception system, the digitization and the intellectualization of the intelligent perception system are enhanced, the sharing and the calling of perception data and perception information can be completed in real time, support is provided for a large data center, and an island operation mode is broken.

The foregoing is only a preferred embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and substitutions can be made without departing from the technical principle of the present application, and these modifications and substitutions should also be regarded as the protection scope of the present application.