1. A road condition information push system is characterized by comprising: a V2X roadside unit, a core server connected to the V2X roadside unit, an edge communication MEC server connected to the core server, and a user terminal communicatively connected to the edge communication MEC server; the core server is connected with the user terminal through a wireless communication public network link; the user terminal is a mobile terminal or a vehicle-mounted terminal which selects a target route, and the target route is a route provided with the V2X road side unit; wherein the content of the first and second substances,

the V2X road side unit is used for collecting road condition materials and sending the road condition materials to the core server;

the core server is used for processing the road condition materials to obtain road condition event information and transmitting the road condition event information to the edge communication MEC server; the road condition event information comprises an event type, an event occupied lane and an event occurrence place;

and the edge communication MEC server is used for pushing the road condition event information to a user terminal through the wireless communication public network link.

2. The system of claim 1, wherein the V2X roadside unit is connected to the core server by fiber optics; the core server and the edge communication MEC server are connected through an optical fiber.

3. A traffic information push method applied to the core server in the traffic information push system according to claim 1 or 2, the method comprising:

acquiring road condition materials, wherein the road condition materials are acquired by the V2X road side unit;

processing the road condition material to obtain road condition event information; the road condition event information comprises an event type, an event occupied lane and an event occurrence place;

and transmitting the traffic event information to an edge communication MEC server in the traffic information pushing system, so that the edge communication MEC server pushes the traffic event information to a user terminal in the traffic information pushing system.

4. The method according to claim 3, wherein the road condition material comprises road condition video collected by the camera sensing unit and echo lattice data collected by the radar sensing unit; processing the road condition material to obtain road condition event information, including:

performing neural network calculation on the road condition material by adopting a preset visual model, and identifying abnormal events in the road condition material; labeling the abnormal event in the road condition material; the label comprises an event type corresponding to the abnormal event and an area occupied by the abnormal event;

and generating the traffic event information according to the traffic material carrying the label.

5. The method of claim 4, further comprising:

receiving a video request forwarded by the edge communication MEC server, wherein the video request is generated by the user terminal according to response operation aiming at the road condition event information; wherein the video request includes a target location;

extracting a video stream corresponding to the target location from the road condition material carrying the tag;

and sending the video stream to the edge communication MEC server so that the edge communication MEC server forwards the video stream to the user terminal generating the video request.

6. The method of claim 3, further comprising:

acquiring the real-time position of the user terminal according to the road condition material;

sending the traffic event information to an edge communication MEC server in the traffic information push system, comprising:

and when the distance difference between the real-time position and the event occurrence place is smaller than a preset threshold value, sending the road condition event information to the edge communication MEC server.

7. A traffic information push device applied to the core server in the traffic information push system according to claim 1 or 2, the device comprising:

the first acquisition module is used for acquiring road condition materials, and the road condition materials are acquired by the V2X road side unit;

the processing module is used for processing the road condition materials to obtain road condition event information; the road condition event information comprises an event type, an event occupied lane and an event occurrence place;

a first sending module, configured to transmit the traffic event information to an edge communication MEC server in the traffic information push system, so that the edge communication MEC server pushes the traffic event information to a user terminal in the traffic information push system.

8. The device according to claim 7, wherein the road condition material comprises road condition video collected by the camera sensing unit and echo lattice data collected by the radar sensing unit; the processing module comprises:

the calculation submodule is used for carrying out neural network calculation on the road condition material by adopting a preset visual model and identifying abnormal events in the road condition material;

the marking sub-module is used for marking the abnormal event in the road condition material; the label comprises an event type corresponding to the abnormal event and an area occupied by the abnormal event;

and the generation submodule is used for generating the road condition event information according to the road condition material carrying the label.

9. A readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 3 to 6.

10. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executed implements the steps of the method according to any of claims 3-6.

Background

At the moment of rapid development of information technology, smart phones are almost owned devices, and devices such as a Head Unit (HUT Head Unit) and a vehicle-mounted T-BOX (telecommunications BOX) are also conventional configurations of outgoing vehicles. Therefore, the method for assisting the driving of the vehicle is a simple and quick driving assistance method in the process of driving the vehicle by selecting a driving path, avoiding violation of regulations, acquiring road conditions and the like through mobile phone navigation or vehicle-mounted navigation.

However, in the prior art, the road condition information received by the mobile phone navigation or the vehicle navigation has a long delay, which is as long as several minutes, and the judgment of the driver is seriously affected, so that the vehicle cannot select the optimal path during the driving, and the time waste is caused. In addition, the path information received by the mobile phone navigation or the vehicle navigation only has general descriptions such as whether the front is congested or not, and the front is under construction, and the driver cannot know detailed information of the road conditions, for example, cannot know the reason of congestion, the length of a road construction section, and the like, so that the driver has a misjudgment due to lack of detailed road conditions, and a driving accident is caused.

Disclosure of Invention

The embodiment of the application provides a road condition information pushing system, a road condition information pushing method, a road condition information pushing device, road condition information pushing equipment and a road condition information pushing storage medium, and aims to obtain an answer which is accurately matched with at least one question.

A first aspect of the embodiments of the present application provides a traffic information pushing system,

the method comprises the following steps: a V2X road side unit, a core server connected with the V2X road side unit, an edge communication MEC server connected with the core server, and a user terminal connected with the edge communication MEC server in communication; the core server is connected with the user terminal through a wireless communication public network link; the user terminal is a mobile terminal or a vehicle-mounted terminal which selects a target route, and the target route is a route provided with the V2X road side unit; wherein the content of the first and second substances,

the V2X road side unit is used for collecting road condition materials and sending the road condition materials to the core server;

the core server is used for processing the road condition materials to obtain road condition event information and transmitting the road condition event information to the edge communication MEC server; the road condition event information comprises an event type, an event occupied lane and an event occurrence place;

and the edge communication MEC server is used for pushing the road condition event information to a user terminal through the wireless communication public network link.

Optionally, the V2X rsu is connected to the core server via an optical fiber; the core server and the edge communication MEC server are connected through an optical fiber.

A second aspect of the present embodiment provides a method for pushing road condition information, where the method includes:

acquiring road condition materials, wherein the road condition materials are acquired by the V2X road side unit;

processing the road condition material to obtain road condition event information; the road condition event information comprises an event type, an event occupied lane and an event occurrence place;

and transmitting the traffic event information to an edge communication MEC server in the traffic information pushing system, so that the edge communication MEC server pushes the traffic event information to a user terminal in the traffic information pushing system.

Optionally, the road condition material includes a road condition video acquired by the camera sensing unit and echo dot matrix data acquired by the radar sensing unit; processing the road condition material to obtain road condition event information, including:

performing neural network calculation on the road condition material by adopting a preset visual model, and identifying abnormal events in the road condition material; labeling the abnormal event in the road condition material; the label comprises an event type corresponding to the abnormal event and an area occupied by the abnormal event;

and generating the traffic event information according to the traffic material carrying the label.

Optionally, the method further comprises:

receiving a video request forwarded by the edge communication MEC server, wherein the video request is generated by the user terminal according to response operation aiming at the road condition event information; wherein the video request includes a target location;

extracting a video stream corresponding to the target location from the road condition material carrying the tag;

and sending the video stream to the edge communication MEC server so that the edge communication MEC server forwards the video stream to the user terminal generating the video request.

Optionally, the method further comprises:

acquiring the real-time position of the user terminal according to the road condition material;

sending the traffic event information to an edge communication MEC server in the traffic information push system, comprising:

and when the distance difference between the real-time position and the event occurrence place is smaller than a preset threshold value, sending the road condition event information to the edge communication MEC server.

A third aspect of the embodiments of the present application provides a traffic information pushing device, where the device includes:

the first acquisition module is used for acquiring road condition materials, and the road condition materials are acquired by the V2X road side unit;

the processing module is used for processing the road condition materials to obtain road condition event information; the road condition event information comprises an event type, an event occupied lane and an event occurrence place;

a first sending module, configured to transmit the traffic event information to an edge communication MEC server in the traffic information push system, so that the edge communication MEC server pushes the traffic event information to a user terminal in the traffic information push system.

Optionally, the road condition material includes a road condition video acquired by the camera sensing unit and echo dot matrix data acquired by the radar sensing unit; the processing module comprises:

the calculation submodule is used for carrying out neural network calculation on the road condition material by adopting a preset visual model and identifying abnormal events in the road condition material;

the marking sub-module is used for marking the abnormal event in the road condition material; the label comprises an event type corresponding to the abnormal event and an area occupied by the abnormal event;

the generating submodule is configured to generate the traffic event information optionally according to the traffic material carrying the tag, and the apparatus further includes:

a receiving module, configured to receive a video request forwarded by the edge communication MEC server, where the video request is generated by the user terminal according to a response operation for the traffic event information; wherein the video request includes a target location;

the extracting module is used for extracting the video stream corresponding to the target location from the road condition material carrying the tag;

and a second sending module, configured to send the video stream to the edge communication MEC server, so that the edge communication MEC server forwards the video stream to the user terminal that generates the video request.

Optionally, the apparatus further comprises:

the second acquisition module is used for acquiring the real-time position of the user terminal according to the road condition material;

the first transmitting module includes:

and the sending submodule is used for sending the road condition event information to the edge communication MEC server when the distance difference between the real-time position and the event occurrence place is smaller than a preset threshold value.

A third aspect of embodiments of the present application provides a readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps in the method according to the second aspect of the present application.

A fourth aspect of the embodiments of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the steps of the method according to the second aspect of the present application.

This application embodiment is through increasing the outer passageway at the roadside unit, set up the core server, and establish the core server and be connected with V2X roadside unit based on outer passageway, establish the core server again and be connected with marginal communication MEC server, make the perception information that V2X roadside unit gathered can send mobile terminal or vehicle mounted terminal through the public net of wireless communication, will be based on the car networking technology, and the road conditions that car networking communication protocol could reach report the effect, use ordinary mobile terminal and vehicle mounted terminal, the problem that prior art can only realize carrying out general description to real-time road conditions information has been solved.

In another embodiment of the application, the V2X road side unit is connected with the core server through an optical fiber; the core server and the edge communication MEC server are connected through optical fibers. Based on the near real-time high definition video transmission of optic fibre to the road conditions material that gathers with V2X roadside unit high-speed transmission to the core server, realize high-efficient video transmission, and high-efficient echo dot matrix data transmission, reduce communication delay. Meanwhile, the edge communication MEC server is arranged and the connection between the edge communication MEC server and the wireless communication public network is established, so that the edge communication MEC server can directly interact with terminal information through the wireless communication public network without forwarding through multiple base stations, the communication delay is further reduced, and the purpose of real-time broadcasting of road condition information is realized.

Compared with a V2X (vehicle to electric) vehicle networking technology, the road condition information pushing system provided by the embodiment of the application can only send the fusion information to a vehicle provided with the vehicle-mounted unit OBU, and the current-stage V2X technology has the defects that the vehicle is not landed on a large scale and the like, the road condition information pushing system can send real-time detailed road condition information to a mobile phone or a traveling computer, the vehicle does not need to be returned to a factory again to install the vehicle-mounted unit OBU, the cost is saved, only the mobile phone owned by people or the traveling computer almost installed in the existing vehicle is used, and the effect of pushing road events in detail is achieved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments of the present application will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.

Fig. 1 is a schematic structural diagram of a road condition information pushing system according to an embodiment of the present application

FIG. 2 is a schematic diagram of the communication lines between the roadside unit and the on-board unit of V2X;

fig. 3 is a flowchart illustrating steps of a traffic information push method according to an embodiment of the present application;

fig. 4 is a functional block diagram of a traffic information pushing device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The technical method for providing real-time road conditions for vehicles on urban roads, highways and expressways in the prior art comprises the following modes:

firstly, a vehicle-mounted T-BOX (remote BOX) map provider and a mobile phone map provider provide real-time road conditions, vehicle position information and vehicle moving speed information are collected through a running computer (HUT Head Unit) with a GPS function, a mobile phone with a GPS function or other mobile devices, the positions of a plurality of vehicles are analyzed and synthesized through a large amount of data, and then the traffic condition of a certain road section is obtained through statistics. When enough vehicles are in a certain block, the block is considered to be congested, and prompt information is sent to a Head Unit (HUT) or a mobile phone. The communication path of the method is longer, at least through the communication path of the terminal-2-level base station-1-level base station-core network-1-level base station-2-level base station-terminal, the prompt message can be received by a driving computer or a mobile phone, the delay is 3-5 minutes, the timeliness is poor, but the road condition changes at any time, so that a user cannot receive real-time road condition information, and the experience is poor.

Secondly, a coil is laid on the road, when the vehicle rolls and passes through the coil, the coil generates induction current, the current vehicle speed is measured according to the difference of the induction current generation time of the front coil and the induction current generation time of the rear coil, the data is uploaded to a server of government traffic information, and the road electronic indicator board displays the traffic condition in real time by reading the data of the server. The method can obtain accurate data only under the condition that the traffic road conditions are normal, and if the conditions of heavy rainstorm or traffic accidents occur, the method cannot capture correct data, so that wrong navigation judgment can be made.

In view of the above problems, an embodiment of the present application provides a road condition information pushing system, road side equipment of the V2X technology is improved, data collected by the road side equipment is adjusted through innovation of a link and a communication mechanism, so that the road side equipment is more compatible, data collected by a V2X road side unit in an internet of vehicles is sent to a mobile terminal or a vehicle-mounted terminal by using a wireless communication public network, so that an existing vehicle can obtain convenience brought by the V2X technology, audience service groups of the existing V2X road side equipment are greatly increased, and safety and reliability of an auxiliary driving vehicle are guaranteed.

Fig. 1 is a schematic structural diagram of a traffic information push system according to an embodiment of the present application, and referring to fig. 1, the traffic information push system includes: the system comprises a V2X road side unit 10 in the internet of vehicles, a core server 20 connected with the V2X road side unit 10, and an edge communication MEC server 30 connected with the core server 20.

V2X (vehicle to evolution) car networking, i.e. the exchange of information from car to outside. The internet of vehicles defines a new vehicle technology development direction by integrating a Global Positioning System (GPS) navigation technology, a vehicle-to-vehicle communication technology, a wireless communication technology and a remote sensing technology, and realizes the compatibility of manual driving and automatic driving. V2X refers to information interaction between vehicles and everything, and V2X in a broad sense includes vehicle to vehicle (V2V), vehicle to infrastructure (V2I), vehicle to pedestrian (V2P), vehicle to network (V2N), and so on. The information interaction between the vehicle and the outside can be carried out only based on the communication protocol of the vehicle networking proprietary V2X.

The V2X Road Side unit 10 (RSU) refers to a device installed at a lane Side, intersection, or the like, and having information sensing, data calculation, and information transmission capabilities. The road side unit comprises a sensing unit, a calculating unit and a transmitting unit. Sensing units include, but are not limited to: laser radar, monocular camera, depth camera, millimeter wave radar, and the like.

Specifically, a section of interval can be in a uniformly spaced mode, and a plurality of sets of V2X road side units are arranged. For example, a set of V2X road-side units may be arranged every 500 meters at the high speed of S8, and the set of V2X road-side units is used to collect video of the road section and sense the environmental state of the road section, such as whether the road surface has rain, whether the road surface is frozen, air humidity, and the like.

The core server 20 refers to a server with large computing power, such as a computer integrated system installed on the road side, and the core server 20 may include a communication processor, a memory, a database, a V2X network interface, and a wireless communication public network link network interface. The core server 20 may receive and process data transmitted by multiple V2X roadside units 10.

The edge communication MEC server refers to an MEC server installed near a road, and the MEC server is in communication connection with a mobile communication public network. In general, an edge communication MEC server is correspondingly arranged in a section.

The wireless communication public network described in the embodiments of the present application refers to 4G, 5G, WIFI and the like provided by a base station installed by a carrier. For example, an edge communication MEC server may be provided at any position of the named full highway segment at S8, and the edge communication MEC server receives and processes sensing information, such as video, air humidity and the like, sent by all V2X roadside devices of the named full highway segment at S8.

The MEC server (MEC) is a telecommunication level service environment with high performance, low delay and high bandwidth, which is created by using a wireless access network to provide services and cloud Computing functions required by IT of telecommunication users nearby, and accelerates the rapid downloading of various contents, services and applications in the network, so that consumers can enjoy uninterrupted high-quality network experience.

The road condition information pushing system further comprises: a user terminal 40 communicatively connected to the edge communication MEC server; the user terminal 40 is a mobile terminal or a vehicle-mounted terminal that selects a target route, which is a route provided with the roadside unit.

The mobile terminal may be a mobile phone, tablet, etc. The vehicle-mounted terminal can be a vehicle-mounted T-BOX, a traveling computer and the like. The user terminal 40 runs a navigation application program, starts GPS positioning, displays a plurality of driving routes on a navigation application program interface, judges whether a V2X road side unit is arranged on a route selected by the user when the user terminal 40 receives the selection operation of the plurality of driving routes by the user, determines the route selected by the user as a target route when the route selected by the user is provided with the V2X road side unit, and establishes communication connection with the edge communication MEC server so that the user terminal 40 and the edge communication MEC server perform real-time information interaction.

The V2X road side unit 10 is used for collecting road condition materials, specifically collecting road condition video, weather information, echo dot matrix data, traffic signal data, and the offset of the digitized parameters of the road infrastructure compared with historical data, and sending the collected road condition materials to the core server 20, and simultaneously sending other road condition data: weather information, traffic signal data, road infrastructure digitized parameters, historical data offsets, etc. are sent to the core server 20.

The core server 20 is configured to process the road condition material to obtain road condition event information, and send the road condition event information to the edge communication MEC server; the road condition event information comprises an event type, an event occupied lane and an event occurrence place.

Specifically, the core server 20 receives the road condition video, the echo dot matrix data, the weather information, the traffic signal data, the road infrastructure digital parameter, the historical data offset and the like sent by the V2X road side unit through the V2X network interface based on the V2X communication protocol, performs protocol conversion on the received road condition video, the echo dot matrix data, the weather information, the traffic signal data, the road infrastructure digital parameter, the historical data offset and the like, and performs structural processing on all the received information to obtain the road condition event information. And sending the road condition event information to an edge communication MEC server based on an internet communication protocol (Tcp/Ip) through a wireless communication public network link interface.

In an example of the present application, the road condition event information may be that three rear-end collisions occur in the first lane on the left side 200 meters ahead. The road condition event information is accurate to specific lanes and specific accident description, and compared with the prior navigation technology, the road condition event information can only remind a driver of 'accidents occurring in the front', and more excellent driving experience can be brought.

The edge communication MEC server 30 is configured to push the traffic condition event information to the user terminal.

And the edge communication MEC server pushes the road condition event information to the user terminal through a wireless communication public network.

The embodiment of the application is characterized in that an external channel is added to a V2X road side unit, a core server is arranged, the connection between the core server and a V2X road side unit in the Internet of vehicles is established based on the external channel, the connection between the core server and an edge communication MEC server is established again, and meanwhile, a wireless communication public network link is established between the edge communication MEC server and a user terminal, so that sensing information acquired by the V2X road side unit can be sent to a mobile terminal or a vehicle-mounted terminal through a wireless communication public network, the application is based on the Internet of vehicles technology, and a vehicle networking communication protocol can reach a road condition broadcasting effect, the application is applied to a common mobile terminal and a vehicle-mounted terminal, and the problem that the road condition information in the prior art is only summarized is solved.

In another embodiment of the present application, the V2X rsu 10 is connected to the core server 20 via optical fiber; the core server 20 and the edge communication MEC server 30 are connected by optical fiber. Based on the optical fiber near-real-time high-definition video transmission, the road condition materials collected by the V2X road side unit are transmitted to the core server 20 at the regional transmission rate of Gbps, so that high-efficiency video transmission is realized, and the communication delay is reduced. Meanwhile, the edge communication MEC server is arranged and the connection between the edge communication MEC server and the wireless communication public network is established, so that the edge communication MEC server can directly interact with the terminal information through the wireless communication public network without passing through a communication path of the terminal-2-level base station-1-level base station-core network-1-level base station-2-level base station-terminal, the communication delay is further reduced, and the purpose of real-time broadcast of the road condition information is achieved.

Based on the road condition information pushing system provided by the embodiment of the application, the V2X road side unit 10 can also send the sensing information collected by the sensing unit to the vehicle loaded with the receiving module through the internet of vehicles communication protocol, the link is not affected by the link of the road side unit, the core server, the edge communication MEC server and the user terminal, and a method for obtaining real-time road condition detailed information is provided for stock vehicles without the receiving module while internet of vehicles communication is realized.

In addition, referring to fig. 2, fig. 2 is a schematic diagram of a communication line between a roadside unit and an on-board unit in an internet of vehicles, and compared with the V2X (vehicle to electric) internet of vehicles technology, which can only send fusion information to a vehicle equipped with an on-board unit OBU, and the V2X technology does not have the disadvantages of large-scale implementation of landing and the like, the embodiment of the present application can send real-time detailed road condition information to a mobile phone or a driving computer, and does not need to return the vehicle to the factory again to install the on-board unit OBU, so that the cost is saved, and only the mobile phone owned by people or the driving computer almost installed in the existing vehicle is used to achieve the effect of pushing road accidents in detail.

The V2X standard communication mode mainly involves two types of devices: the Road Side Unit RSU (Road-Side Units) and the On-Board Unit OBU (On-Board Unit), the Road Side Unit collects data in real time, sends the data to the V2X server for fusion processing, the V2X server returns a plurality of fused information, the Road Side Unit broadcasts the Road conditions near the installation point in a unified mode, and the real-time Road conditions are broadcasted to the vehicles.

Based on the same inventive concept, an embodiment of the present application provides a traffic information pushing method, which is applied to a core server in a traffic information pushing system provided in any of the embodiments of the present application, and fig. 3 is a flowchart illustrating steps of the traffic information pushing method provided in the embodiment of the present application, where as shown in fig. 3, the steps include:

step S11: and acquiring road condition materials, wherein the road condition materials are acquired by the V2X road side unit.

The sensing unit of the road side unit of V2X is generally responsible for collecting road condition materials. Based on the information which can be sensed by the sensing unit, the obtained road condition materials comprise the following road conditions: pedestrian or animal intrusion, emergency lane parking, vehicle retrograde motion, vehicle breakdown, traffic accidents, or fog, falling rocks, icing, and the like.

Step S12: processing the road condition material to obtain road condition event information; the road condition event information comprises an event type, an event occupied lane and an event occurrence place.

The steps of processing the road condition material include, but are not limited to: image data preprocessing, artificial intelligence algorithm processing analysis, computer vision algorithm analysis and the like. The road condition types can be preset, and the road condition type marks unique identification.

In an example of the present application, a plurality of event types and a unique identifier corresponding to each event type are preset: the method comprises the following steps of icing on a road-A1, occupying a road by a sprinkled object-A2, constructing on the road-A3, caving in a rock-A3, rear-end collision accidents-A4, occupation of emergency lanes in violation-A5, hanging accidents-A6 and driving on the vehicle-A7 with the speed lower than the lowest speed limit of 40%.

Step S13: and transmitting the traffic event information to an edge communication MEC server in the traffic information pushing system, so that the edge communication MEC server pushes the traffic event information to a user terminal in the traffic information pushing system.

After receiving the traffic event information, the user terminal can use a voice system to play the traffic event information.

The embodiment of the application utilizes the core server to receive road condition materials collected by the V2X road side units in the internet of vehicles, the road condition materials comprise road condition video and echo dot matrix data, high-definition real-time road conditions are obtained based on the road condition materials, a series of structural processing is carried out on the high-definition real-time road conditions, road condition event information capable of describing the road conditions in detail is obtained, the core server sends the road condition event information to the edge communication MEC server set by the embodiment of the application aiming at road condition information push, the edge communication MEC server is utilized to pass through a wireless communication public network, the road condition event information is directly sent to a user terminal in communication connection with the edge communication MEC server, and the user terminal can know the detailed road conditions of the non-driving road sections in real time.

Another embodiment of the present application provides a method for obtaining traffic event information, where the traffic material includes traffic video collected by a camera sensing unit and echo lattice data collected by a radar sensing unit; the method comprises the following steps:

the echo dot matrix data is a dot matrix image generated by adopting a radar imaging technology according to a radar signal reflected by a target object.

Step S21: and carrying out neural network calculation on the road condition material by adopting a preset visual model, and identifying abnormal events in the road condition video. The preset visual model may be a model for performing visual target tracking on a target by performing data association between the detected obstacle and the previous frame of detection result by using computer vision algorithm analysis and using the motion mode of the object.

The neural network calculation of the road condition material means that the neural network calculation is respectively carried out on the road condition video and the echo dot matrix data.

In one example of the present application, a target tracking algorithm is used to frame out anomalous events in the road condition material.

An example preset exception event of the present application includes: the method comprises the steps of icing roads, occupying spilled objects, constructing roads, falling rocks and collapsing, rear-end accidents, illegal occupation of emergency lanes, scratching accidents and running of vehicles with the speed lower than the lowest speed limit by 40%, and then collecting training samples according to the abnormal events to obtain a visual model capable of identifying the abnormal events in any road condition material, wherein the visual model is used as a preset visual model of the embodiment of the application.

Step S22: labeling the abnormal event in the road condition material; the label comprises an event type corresponding to the abnormal event and an area occupied by the abnormal event.

The area occupied by the abnormal event refers to the road surface area covered by the abnormal event.

Step S23: and generating the traffic event information according to the traffic material carrying the label.

The road condition material carries the label, and the label records the information such as the area occupied by the abnormal event, the road condition type and the like, so that the corresponding road condition event information can be generated. According to the embodiment of the application, the core server adopts a visual algorithm and the like, road condition materials of the V2X road side units are fused, information fusion of the whole road is achieved, and detailed description of accidents can be generated based on the real-time road condition of the whole road.

Another embodiment of the present application provides specific steps for a core server to send traffic event information.

Step S31: and acquiring the real-time position of the user terminal according to the road condition materials.

The real-time position refers to the position of the vehicle on the current road, and in one example of the application, the S8 is named at a high speed (A land to B land) with the full length of 293.2 kilometers, and the real-time position is 100 kilometers away from the A land.

Because the core server can receive road condition materials collected by a plurality of sets of road side units arranged on a road, the core server can detect running vehicles in the road condition materials sent by at least one set of V2X road side units, and then the positions of the running vehicles are obtained.

The core server can also determine running vehicles in each frame of the road condition material through an artificial intelligence algorithm or the visual model provided by the embodiment, distinguish different vehicles according to the user terminal identification or the license plate, and acquire the real-time position of each running vehicle.

Artificial intelligence algorithms include, but are not limited to: and (3) performing machine learning and deep learning neural network algorithm data processing such as image matching, image segmentation, example segmentation, obstacle detection and the like, such as vehicle and pedestrian detection, lane line detection, traffic sign identification and the like.

Step S32: and when the distance difference between the real-time position and the event occurrence place is smaller than a preset threshold value, sending the road condition event information to the edge communication MEC server.

And the core server extracts the event occurrence place in the road condition event information and calculates the distance difference between the real-time position and the road condition occurrence place according to the position of the event occurrence place. The preset threshold may be set according to a safe vehicle distance, for example, 200 meters.

In an example of the present application, the core server may further dynamically adjust the vehicle safety distance according to the weather information, and in a rainy or snowy weather, the vehicle safety distance of 200 m is increased to 300 m to ensure the safe driving of the vehicle.

In an example of the present application, it is assumed that 30 sets of road side units are arranged in a certain segment of the designated high-speed interval of S8, and after processing road condition materials sent by the 30 sets of road side units, the core server obtains 2 pieces of road condition event information, namely that a first left lane is under construction at a distance of 100 km from a first left lane and a second left lane is in rear-end collision at a distance of 200 km from the first left lane. And meanwhile, the core server detects that the vehicle C travels 1000200 m away from the A, determines the vehicle C as a target vehicle at the moment, and sends the target vehicle identification and road condition event information to the edge communication MEC server. And the edge communication MEC server determines a target terminal according to the target vehicle identification and pushes the road condition event information to the target terminal. The target terminal is a user terminal which is connected with the edge communication MEC server in a communication mode, and the real-time position displayed by the GPS positioning is consistent with the real-time position of the target vehicle.

The core server of the embodiment of the application can fuse information in road condition materials sent by each road side unit, so that the real-time position of a running vehicle is determined, and when the running vehicle is about to run to an accident place, the information is sent to a corresponding target vehicle through the edge communication MEC server, namely the vehicle about to run to the accident place, so as to warn and assist a driver to realize safe driving by combining the actual occurrence position of road condition event information.

Yet another embodiment of the present application provides a method for acquiring a video stream. The video stream is a video capable of showing the surrounding environment of the place where the road condition accident occurs to the user. The method comprises the following steps:

step S41: receiving a video request forwarded by the edge communication MEC server, wherein the video request is generated by the user terminal according to response operation aiming at the road condition event information; wherein the video request includes a target location.

And after receiving the click operation of the displayed road condition event information by the user, generating a video request.

In an example of the application, at high speed, congestion occurs at S8, a large number of vehicles stop running, a user starts to be anxious, after voice broadcast of road condition event information is received, an information confirmation mark occurs on a mobile phone navigation interface or a vehicle central control interface, the user clicks the confirmation mark, a mobile phone or a vehicle-mounted terminal generates a video request, the video request is forwarded to a core server through an edge communication MEC server, the core server obtains video streams of accident occurrence places, the video streams are fed back to the mobile phone or the vehicle-mounted terminal through the edge communication MEC server, after the user views the video streams, the specific events causing the congestion are known, the emotion is pacified, and no longer guess without any purpose.

The target location is a location of the traffic accident included in the traffic event information.

Step S42: and extracting the video stream corresponding to the target location from the road condition material carrying the tag. And the core server obtains a corresponding video stream according to the video request.

Because the core server carries out structuralization processing on the road condition materials sent by the road side unit in advance, namely, the accident reaction position and the accident related vehicle are marked in the road condition materials, the video stream can intelligently assist driving to see six roads and hear eight directions, such as real-time application of medium and long distance map planning, vehicle gathering early warning, high-precision map updating and the like, and the cooperative safety of the vehicle and the road is realized.

Step S43: and sending the video stream to the edge communication MEC server so that the edge communication MEC server forwards the video stream to the user terminal generating the video request.

According to the embodiment of the application, the video request generated by the user terminal is forwarded through the edge communication MEC server, the core server is ensured to be capable of acquiring the user requirement in time, and the corresponding video stream is provided according to the user requirement.

Based on the same inventive concept, the embodiment of the application provides a road condition information pushing device. Referring to fig. 4, fig. 4 is a functional block diagram of a traffic information pushing device according to an embodiment of the present application. The device includes:

a first obtaining module 41, configured to obtain road condition materials, where the road condition materials are collected by a road side unit of V2X;

the processing module 42 is configured to process the road condition material to obtain road condition event information; the road condition event information comprises an event type, an event occupied lane and an event occurrence place;

a first sending module 43, configured to transmit the traffic event information to an edge communication MEC server in the traffic information pushing system, so that the edge communication MEC server pushes the traffic event information to a user terminal in the traffic information pushing system

Optionally, the road condition material includes a road condition video acquired by the camera sensing unit and echo dot matrix data acquired by the radar sensing unit; the processing module comprises:

the calculation submodule is used for carrying out neural network calculation on the road condition material by adopting a preset visual model and identifying abnormal events in the road condition material;

the marking sub-module is used for marking the abnormal event in the road condition material; the label comprises an event type corresponding to the abnormal event and an area occupied by the abnormal event;

and the generation submodule is used for generating the road condition event information according to the road condition material carrying the label.

Optionally, the apparatus further comprises:

a receiving module, configured to receive a video request forwarded by the edge communication MEC server, where the video request is generated by the user terminal according to a response operation for the traffic event information; wherein the video request includes a target location;

the extracting module is used for extracting the video stream corresponding to the target location from the road condition material carrying the tag;

and a second sending module, configured to send the video stream to the edge communication MEC server, so that the edge communication MEC server forwards the video stream to the user terminal that generates the video request.

Optionally, the apparatus further comprises:

the second acquisition module is used for acquiring the real-time position of the user terminal according to the road condition material;

the first transmitting module includes:

and the sending submodule is used for sending the road condition event information to the edge communication MEC server when the distance difference between the real-time position and the event occurrence place is smaller than a preset threshold value.

Based on the same inventive concept, another embodiment of the present application provides a readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in the traffic information pushing method according to any of the embodiments of the present application.

Based on the same inventive concept, another embodiment of the present application provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and running on the processor, where the processor implements the steps of the traffic information pushing method according to any of the above embodiments of the present application when executing the computer program.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are described in a progressive or descriptive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one of skill in the art, embodiments of the present application may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus, and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the true scope of the embodiments of the application.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The above detailed description is given to a road condition information pushing system, a road condition information pushing method, a road condition information pushing device, road condition information pushing equipment and a storage medium, and the description of the above embodiments is only used for helping to understand the method and the core idea of the method; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.