1. A control system for an unmanned vehicle, comprising: the system comprises a central security gateway, an automatic driving system and a human-computer interaction system;

the automatic driving system and the human-computer interaction system are located in two different domains, and the automatic driving system and the human-computer interaction system are communicated through the central safety gateway.

2. The system of claim 1, wherein the autopilot system comprises:

the main computing unit and the redundant computing unit are in network communication connection with the central security gateway, and are in network communication with the human-computer interaction system through the central security gateway;

the main computing unit is used for controlling the unmanned automobile to run;

the redundancy calculation unit is used for detecting whether the main calculation unit is abnormal or not and controlling the unmanned automobile to run when the main calculation unit is determined to be abnormal.

3. The system of claim 2, wherein the redundant computing unit is further to:

and when the main computing unit is determined to be abnormal, controlling the unmanned automobile to stop at the side or brake emergently according to the running state of the unmanned automobile.

4. The system of claim 2 or 3, wherein the autopilot system further comprises: a plurality of types of sensors;

wherein at least one type of sensor comprises a primary sensor and a redundant sensor, each of the sensors being connected to the primary and redundant computing units.

5. The system of claim 4, wherein the plurality of types of sensors comprises:

the sensor comprises a sensing sensor, a redundant sensing sensor, a positioning sensor and a redundant positioning sensor;

the perception sensor and the redundant perception sensor, and the positioning sensor and the redundant positioning sensor are connected with the main computing unit and the redundant computing unit through Ethernet.

6. The system of claim 5, wherein the autopilot system further comprises a first switch;

the multiple types of sensors are connected with the main computing unit and the redundant computing unit through the first switch in an Ethernet communication mode.

7. The system of claim 5, wherein the perception sensor further comprises:

a perception camera and a millimeter wave radar;

the sensing camera is connected with the main computing unit and the redundancy computing unit through a radio frequency connector, and the millimeter wave radar is connected with the main computing unit and the redundancy computing unit through an Ethernet or a CAN bus.

8. The system of claim 4, wherein the autopilot system further comprises:

the vehicle-mounted unit is connected with the main computing unit and the redundancy computing unit through an Ethernet;

the vehicle-mounted unit is used for acquiring road side traffic information.

9. The system of any one of claims 1-8, wherein the human-machine interaction system comprises: a central control unit, at least one controller, and an interactive device;

the automatic driving system is in network communication with the central control unit through the central safety gateway;

the at least one controller is connected with the central control unit in a network communication mode;

the central control unit is a transfer station for communication among different controllers, and the different controllers are communicated through the central control unit.

10. The system of claim 9, wherein the at least one controller comprises: a display controller, the interaction device comprising a first display device mounted within the unmanned vehicle;

the display controller is electrically connected with the first display device and used for controlling the first display device to display information.

11. The system of claim 9, wherein the interaction device comprises: at least one second display device mounted on an exterior of the unmanned vehicle;

the central control unit is connected with the second display device in a network communication mode, and the central control unit is further used for controlling the second display device to display information.

12. The system of claim 9, wherein the at least one controller comprises: a voice controller, the interactive device comprising: an audio input device and an audio output device;

the audio input device and the audio output device are electrically connected with the voice controller;

the audio output device comprises a power amplifier unit, a first loudspeaker installed in the unmanned automobile and a second loudspeaker installed outside the unmanned automobile;

the power amplifier unit is electrically connected with the voice controller, and the first loudspeaker and the second loudspeaker are respectively electrically connected with the power amplifier unit.

13. The system of claim 9, wherein the at least one controller comprises: a light controller, the interaction device comprising: a lighting device;

the lighting equipment is connected with the lighting controller through a CAN bus;

the lighting equipment comprises at least one of the following:

an interior lighting lamp, a breathing lamp, a disinfection lamp and an interior lamp belt.

14. The system of claim 9, wherein the interaction device further comprises: the first temperature measuring device is in network communication connection with the central control unit, and the second temperature measuring device is in network communication connection with the central control unit;

the first temperature measuring device is used for detecting the body temperature of a human body in the vehicle;

the second temperature measuring device is used for detecting the temperature inside the vehicle and/or the temperature outside the vehicle.

15. The system of claim 9, wherein the interaction device further comprises: the card-punching charging device is in network communication connection with the central control unit;

the card-punching toll collection device is used for realizing the automatic toll collection function of the passing fee of the unmanned automobile.

16. The system of any one of claims 9-15, wherein the human-computer interaction system further comprises: the second switch is connected to the first switch,

the at least one controller and the interaction device are in network communication connection with the central control unit through the second switch.

17. The system of any of claims 1-16, further comprising: a system of the Internet of vehicles,

the Internet of vehicles system is connected with the central security gateway in a network communication way;

the automatic driving system and the human-computer interaction system are in network communication connection with the Internet of vehicles system through the central security gateway;

the car networking system is used for realizing network communication between the automatic driving system and the man-machine interaction system and equipment outside the control system.

18. The system of claim 17, wherein the autopilot system further comprises:

the system comprises a cloud designated driving camera, a redundant computing unit and a main computing unit, wherein the cloud designated driving camera is electrically connected with the main computing unit and the redundant computing unit of the automatic driving system and is used for collecting image data inside and/or around the unmanned automobile and sending the image data to the main computing unit or the redundant computing unit;

and the main computing unit or the redundant computing unit of the automatic driving system carries out network communication with the cloud server through the central security gateway and the Internet of vehicles system, sends the image data to the cloud server, and controls the unmanned automobile according to the driving operation information sent by the cloud server.

19. The system of any of claims 1-18, wherein the autopilot system is in a domain with a higher safety rating than a domain in which the human-machine interaction system is.

20. An unmanned vehicle comprising: a vehicle body and a control system for an unmanned automotive vehicle according to any one of claims 1 to 19.

Background

When the unmanned automobile is put into operation, an automatic driving system is required to replace a human driver to drive the automobile, the unmanned automobile can interact with external people and objects, and the communication and interaction with external other equipment are also required to be realized, and the real operation of the unmanned automobile can be realized only by integrating the functions.

At present, the technical scheme related to the unmanned automobile basically focuses on realizing automatic driving control of the automobile, and a system architecture capable of realizing operation of the unmanned automobile is lacked.

Disclosure of Invention

The disclosure provides a control system of an unmanned automobile and the unmanned automobile.

According to a first aspect of the present disclosure, there is provided a control system of an unmanned automobile, comprising: the system comprises a central security gateway, an automatic driving system and a human-computer interaction system;

the automatic driving system and the human-computer interaction system are located in two different domains, and the automatic driving system and the human-computer interaction system are communicated through the central safety gateway.

According to a second aspect of the present disclosure, there is provided an unmanned vehicle comprising: a vehicle body and the control system for an unmanned automobile according to the first aspect.

The technology according to the present disclosure provides an overall architecture of a control system for an unmanned vehicle that can be brought into operation.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

fig. 1 is a block diagram of a control system of an unmanned vehicle provided in a first embodiment of the present disclosure;

FIG. 2 is a schematic diagram of an autopilot system provided by a second embodiment of the present disclosure;

FIG. 3 is a schematic structural diagram of a human-computer interaction system provided by a second embodiment of the disclosure;

FIG. 4 is a schematic structural diagram of a control system of an unmanned vehicle according to a second embodiment of the present disclosure;

fig. 5 is an exemplary diagram of the overall structure of a control system of an unmanned automobile according to a second embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

When the unmanned automobile is put into operation, an automatic driving system is required to replace a human driver to drive the automobile, the unmanned automobile can interact with external people and objects, and the communication and interaction with external other equipment are also required to be realized, and the real operation of the unmanned automobile can be realized only by integrating the functions.

At present, the technical scheme related to the unmanned automobile basically emphasizes the realization of an automatic driving system of the automobile, only realizes the most basic simple automatic driving functions such as debugging, automatic driving route navigation and the like, and lacks a system architecture capable of realizing the operation of the unmanned automobile.

The system architecture integrates an automatic driving system, a communication system and a human-computer interaction system, can realize automatic driving of the L4 level, can realize data sharing between the automatic driving system and the human-computer interaction system, and can also realize safety isolation between the automatic driving system and the human-computer interaction system.

Fig. 1 is a block diagram of a control system of an unmanned vehicle according to a first embodiment of the present disclosure. As shown in fig. 1, the present embodiment provides a control system 10 for an unmanned vehicle, including: a central security gateway 11, an autopilot system 21 and a human-machine interaction system 31.

In practical applications, the functions of the systems are different, the safety requirements are different, the overall control system is divided into two domains (simply referred to as "domains"), and the automatic driving system 21 and the human-computer interaction system 31 are located in the two different domains. The safety requirement level of the automatic driving system 21 is generally higher than that of the human-computer interaction system 31.

In this embodiment, the domain in which the automatic driving system 21 is located is an automatic driving domain (or referred to as an AD domain), and the domain in which the human-computer interaction system 31 is located is an intelligent cockpit domain or a human-computer interaction domain (abbreviated as an HMI domain). Two different domains can not influence each other and can share data. Therefore, if the man-machine interaction system 31 with lower safety requirement level is abnormal, the normal work of the automatic driving system 21 with higher safety requirement level is not influenced, the stability and the reliability of the control system are improved, and the safety and the reliability of the unmanned automobile are improved. The safety level of the AD domain where the automatic driving system is located is higher than that of the HMI domain where the human-computer interaction system is located.

In addition, according to the functions of electronic components of the automobile, the whole automobile can be divided into several domains such as a power assembly, an intelligent cabin, an automatic driving and the like, and each domain is relatively and intensively controlled by utilizing a multi-core CPU/GPU chip with stronger processing capacity so as to replace the conventional distributed electronic and electrical architecture.

In the control system of the unmanned vehicle, the automatic driving system 21 and the human-computer interaction system 31 communicate with each other through the central security gateway 11.

The central security gateway 11 is used for realizing the secure communication between the autopilot system 21 and the human-computer interaction system 31, and can isolate data between the autopilot system 21 and the human-computer interaction system 31 which are located in different domains in the control system 10, thereby improving data security.

The central security gateway 11 is also used to cryptographically protect data transmitted outside the control system 10.

The central security gateway 31 provides standard functions of an ethernet public gateway, supports information security, manages and protects communication links between an internal network and an external network, and safely isolates communication between different system devices in different domains.

Alternatively, the autopilot system 21 and the human-computer interaction system 31 may communicate with each other via a high-speed ethernet or wireless network.

In addition, the autopilot system 21 and the human-computer interaction system 31 can also communicate securely with devices of the extranet via the central security gateway 11.

In the embodiment, aiming at the problem of information security, the central security gateway 11 is used to arrange the automatic driving system 21 and the human-computer interaction system 31 in different domains, and the central security gateway 11 is used to realize secure network communication and data isolation between the automatic driving system 21 and the human-computer interaction system 31 in the control system 10; and the central security gateway 11 can realize the secure data transmission between the control system 10 and the external equipment, realize the information encryption protection and the data isolation for the communication between the internal and external network communication and the systems with different security levels, and improve the safety and the reliability of the unmanned automobile.

FIG. 2 is a schematic diagram of an autopilot system provided by a second embodiment of the present disclosure; fig. 3 is a schematic structural diagram of a human-computer interaction system according to a second embodiment of the present disclosure. On the basis of the first embodiment described above, the present embodiment describes in detail the architecture of the control system.

In general, an autonomous driving system includes a calculation unit for performing relevant calculations in the autonomous driving system. In this embodiment, the reliability of the automatic driving system is improved by providing a redundant computing unit.

As shown in fig. 2, the automatic driving system 21 includes: a main calculation unit 211 and a redundant calculation unit 212. The main computing unit 211 and the redundant computing unit 212 are connected with the central security gateway 11 through network communication, and the main computing unit 211 and the redundant computing unit 212 are in network communication with the human-computer interaction system 31 through the central security gateway 11.

The main computing unit 211 is configured to receive sensor data and control the driving of an unmanned vehicle (hereinafter referred to as a "vehicle") according to the sensor data, so as to realize automatic driving of the vehicle. Illustratively, the master computing unit 211 may implement at least an L4 level of autopilot capability.

The redundancy calculation unit 212 is used to detect whether the main calculation unit 211 is abnormal, and control the driving of the unmanned automobile when it is determined that the main calculation unit 211 is abnormal.

Optionally, the main computing unit 211 and the redundant computing unit 212 and the central security gateway 11 may perform network communication through a high-speed ethernet network, so as to improve the efficiency of data transmission between the computing units and the central security gateway, and improve the timeliness, safety and reliability of the automatic driving system of the unmanned vehicle.

By arranging the main calculating unit 212 of the main calculating unit 211, when the main calculating unit 211 is abnormal, the main calculating unit 212 can take over the vehicle, control the running of the unmanned automobile, ensure that the unmanned automobile is not out of control, and ensure the safety and reliability of the unmanned automobile.

Alternatively, the function of the main computing unit 212 may be consistent with that of the main computing unit 211, and when it is determined that the main computing unit 211 is abnormal, the main computing unit 212 may still maintain normal driving of the vehicle after taking over the vehicle, thereby improving safety and reliability of the unmanned vehicle.

Alternatively, the function of the main computing unit 212 may not be consistent with that of the main computing unit 211, and the main computing unit 212 is only used for ensuring that the vehicle can be safely parked when the main computing unit 211 is abnormal, so as to avoid dangerous situations such as traffic accidents.

Illustratively, the host computing unit 212 is configured to: when the main computing unit 211 is determined to have abnormality, the vehicle is controlled to stop at the side or brake emergently according to the running state of the unmanned automobile, so that the vehicle can be ensured to be safely stopped when the main computing unit 211 has abnormality, dangerous situations such as traffic accidents are avoided, and meanwhile, the main computing unit 212 is arranged to take over the vehicle and then control the vehicle to be safely stopped after the main computing unit 211 normally runs most of the time, so that the function of emergency response to the abnormality such as the vehicle safety stop is controlled, and the vehicle safety and reliability can be ensured, and meanwhile, the cost can be saved.

Alternatively, the main calculation unit 212 controls the vehicle to stop at the side according to the driving state of the unmanned vehicle, may control the vehicle to stop at the side immediately, or may control the vehicle to stop at the side after driving for a certain distance. The control logic for parking in the side may be different for different driving states of the vehicle.

Wherein, the driving state of the unmanned automobile comprises: the driving state of the unmanned vehicle can be set and adjusted according to the requirements of actual application scenarios, and the present embodiment is not limited specifically here.

Alternatively, the main computing unit 211 and the main computing unit 212 may be implemented in a split type, that is, the main computing unit 211 and the main computing unit 212 are implemented by using different hardware respectively.

Alternatively, the main computing unit 211 and the main computing unit 212 may be implemented by a highly integrated dual computing unit, for example, a dual CPU processor may be used, one CPU as the main computing unit 211 and the other CPU as the main computing unit 212, which can meet the requirements of cost, performance and integration of operating the vehicle.

Alternatively, in order to save cost, the performance of the main computing unit 212 may be set to be slightly inferior to that of the main computing unit 211, and the need for a function to deal with an abnormality in an emergency may be satisfied.

Illustratively, the host computing unit 211 and the host computing unit 212 may be various general and/or special purpose processing components having processing and computing capabilities. Some examples of the main computing units 211 and 212 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The computing unit executes various methods and processes related to automatic driving.

Further, as shown in fig. 2, the automatic driving system 21 further includes: and a plurality of types of sensors 213 for collecting various types of data for implementing an automatic driving function and a man-machine interaction function. The multi-sensor fusion sensing is realized through various types of sensors, and the reliability of data is improved, so that the reliability of the automatic driving system 21 is improved.

Wherein at least one type of sensor includes a primary sensor and a redundant sensor, each sensor being connected to a primary computing unit 211 and a primary computing unit 212.

Compared with the existing automatic driving system 21, in order to reduce the cost, each sensor type uses a single sensor, once the sensor fails, the automatic driving system 21 cannot be used or enters an unexpected state, in the embodiment, by setting the redundant sensors of each type of sensor, when the main sensor fails, the redundant sensors can collect relevant data, so that the normal use of the automatic driving system 21 can be maintained, and the safety and reliability of the automatic driving system 21 are improved.

Illustratively, as shown in fig. 2, the various types of sensors 213 in the autopilot system 21 include at least: a sensing module 2131 and a positioning module 2132. The sensing module 2131 comprises a sensing sensor and a redundant sensing sensor, and the positioning module 2132 comprises a positioning sensor and a redundant positioning sensor.

Through the redundant perception sensor that sets up the perception sensor, can acquire perception data through redundant perception sensor when main perception sensor is invalid, provide essential perception data for autopilot system 21 to keep autopilot system 21's normal use, improve autopilot system 21's security and reliability.

Through setting up positioning sensor's redundant positioning sensor, can obtain the locating data through redundant positioning sensor when main positioning sensor is invalid, provide essential locating data for autopilot system 21 to keep autopilot system 21's normal use, improve autopilot system 21's security and reliability.

At least one sensing sensor and redundant sensing sensors are connected with the main computing unit 211 and the main computing unit 212 through the high-speed Ethernet, so that the efficiency of data transmission between the sensing sensors and the computing unit can be improved, and the timeliness, effectiveness and safety of the automatic driving system 21 are improved.

The positioning sensor and the redundant positioning sensor are connected with the main computing unit 211 and the main computing unit 212 through the high-speed Ethernet, so that the efficiency of data transmission between the positioning sensor and the computing unit can be improved, and the timeliness, effectiveness and safety of the automatic driving system 21 are improved.

Illustratively, the perception sensors in the autopilot system 21 may include lidar (lidar) and the redundant perception sensors include redundant lidar.

Further, the automatic driving system 21 further includes a first switch. The various types of sensors (including the sensing sensor and the redundant sensing sensor, and the positioning sensor and the redundant positioning sensor) in the autopilot system 21 are in ethernet communication connection with the main computing unit 211 and the main computing unit 212 through the first switch, so that the efficiency of data transmission between the sensors and the computing units can be improved, and the timeliness, the effectiveness and the safety of the autopilot system 21 are improved.

Optionally, the perception sensor in the automatic driving system 21 may further include: a perception camera (camera), which typically includes a plurality of perception cameras disposed around the vehicle, and a millimeter wave radar (radar), which may include a plurality of millimeter wave radars disposed around the vehicle, capable of collecting environmental data around the vehicle and providing the environmental data around the vehicle to the autopilot system 21, providing a data basis for the autopilot system 21.

Wherein the perception camera is connected with the main computing unit 211 and the main computing unit 212 through a radio frequency connector (FAKRA). The millimeter wave radar is connected to the main calculation unit 211 and the main calculation unit 212 through an ethernet or CAN bus.

In this embodiment, multi-sensor fusion sensing is realized by multiple types of sensing sensors such as lidar, radar, camera, and the like, so that the reliability of data is improved, and thus the reliability of the autopilot system 21 is improved.

Optionally, as shown in fig. 2, the automatic driving system 21 may further include: an On Board Unit (OBU) 214. The on-board unit 214 is used to acquire roadside traffic information. The on-board unit 214 realizes an ethernet communication connection with the main calculation unit 211 and the main calculation unit 212 through the first switch.

By introducing the vehicle-mounted Unit 214, the vehicle-mounted Unit 214 can communicate with a Road Side Unit (RSU for short) erected on the roadside, obtain and provide Road Side traffic information for the computing Unit, provide a foundation for realizing vehicle-Road cloud-coordinated intelligent traffic, and improve the automatic driving capability.

The automatic driving system 21 provided by the embodiment comprises a computing unit, a sensor and an on-board unit 214, the system structure is flexible, the addition or reduction of the sensor is supported, the maintainability is good, and the reliability of the automatic driving system 21 can be greatly improved by arranging a main computing unit 212 and a redundant sensor.

In an alternative embodiment, as shown in fig. 3, the human-computer interaction system 31 includes: a central control unit 311, at least one controller 312, and an interaction device 313.

The central control unit 311 is in network communication with the central security gateway 11, and the automatic driving system 21 is in network communication with the central control unit 311 through the central security gateway 11. At least one controller 312 has a network communication connection with the central control unit 311. The high-speed network communication between the automatic driving system 21 and the human-computer interaction system 31 is realized through the central security gateway 11, and the requirements of high-speed interconnection and information security can be met.

The central control unit 311 is a transfer station for communication between different controllers, and the different controllers communicate with each other via the central control unit 311. Each controller is responsible for each other, and information sharing between the controllers can be realized through the central control unit 311, which supports addition or reduction of the controllers and the interactive devices 313, and improves maintainability of the human-computer interactive system 31 in the control system 10.

Alternatively, as shown in fig. 3, the controller 312 in the human machine interaction system 31 may include a display controller 3121, and the interaction apparatus 313 in the human machine interaction system 31 includes a first display device 3131 installed in the vehicle.

The display controller 3121 is electrically connected to the first display device 3131, and the display controller 3121 is used to control the first display device 3131 to display information.

Optionally, the first display device 3131 is connected to the display controller 3121 through a High Definition Multimedia Interface (HDMI).

The first display device 3131 may be a display screen for displaying navigation information or other information in the vehicle, the first display device 3131 may be provided in plurality, different first display devices 3131 are used for displaying the same or different display information, and the number, type and size of the first display devices 3131 may be set and adjusted according to the information content required to be displayed in the actual application scenario, which is not limited in this embodiment.

Alternatively, different first display devices 3131 may be used to display the same information, so that the occupant may select an appropriately angled one of the first display devices 3131 for viewing.

Alternatively, different first display devices 3131 may be used to display different information to simultaneously display a variety of different information to the vehicle occupant through the plurality of first display devices 3131, increasing the dimensionality of the displayed information.

The display controller 3121 is configured to display information that the automatic driving system 21 requires to display, under the control of the central control unit 311. The display controller 3121 is used to display information transmitted by the autopilot system 21 that is forwarded via the central control unit 311.

By integrating the human-computer interaction system 31 including the display controller 3121 and the first display device provided inside the vehicle into the control system 10 of the unmanned vehicle, it is possible to display information such as navigation information, warning/prompt information, and the like of the unmanned vehicle to passengers, realize a human-computer interaction function between the unmanned vehicle and the passengers inside the vehicle based on the display device, and improve the integration level and maintainability of the control system 10 of the unmanned vehicle.

Optionally, as shown in fig. 3, the interaction device 313 in the human-computer interaction system 31 may further include: at least one second display device 3132 mounted on the outside of the vehicle. The central control unit 311 has a network communication connection with the second display device 3132, and the central control unit 311 is further configured to control the second display device 3132 to display information.

The second display device 3132 is used to display information to a person outside the vehicle, where the displayed information may be information related to the vehicle, or may also be advertisement information, and the present embodiment is not limited in this respect.

Alternatively, the second display device 3132 outside the vehicle may perform network communication with the central control unit 311 through a high-speed ethernet to improve the timeliness and efficiency of information presentation.

A plurality of second display devices 3132 may be provided, different second display devices 3132 are used for displaying the same or different information, the number, type and size of the second display devices 3132 may be set and adjusted according to the information content required to be displayed outside the vehicle in the actual application scenario, and the embodiment is not limited in this embodiment.

Alternatively, different second display devices 3132 may be used to display the same information, so that an outside person may view the content presented by one of the second display devices 3132 from a point of view of when. For example, two second display devices 3132 for simultaneously displaying the same information may be provided on both sides of the vehicle, allowing the displayed information to be viewed by people on both sides.

Alternatively, different second display devices 3132 may be used to display different information to simultaneously display a variety of different information to the person outside the vehicle through a plurality of second display devices 3132, increasing the dimensionality of the displayed information.

By integrating the human-machine interaction system 31 including the second display device 3132 provided outside the vehicle into the control system 10 of the unmanned vehicle, it is possible to realize that the vehicle displays information related to the unmanned vehicle, advertisement information, and the like to the person outside the vehicle, realize a human-machine interaction function between the unmanned vehicle and the person outside the vehicle by the display device, and improve the integration degree and maintainability of the control system 10 of the unmanned vehicle.

Alternatively, as shown in fig. 3, the at least one controller 312 of the human-computer interaction system 31 includes a voice controller 3122, and the interaction device 313 includes: an audio input device 3133 and an audio output device 3134. The audio input device 3133 and the audio output device 3134 are electrically connected to the voice controller 3122.

The voice controller 3122 is configured to control the audio input device 3133 to collect audio data that the autopilot system 21 requires to be acquired, and control the audio output device 3134 to output the audio data that the autopilot system 21 requires to be output, under the control of the central control unit 311. The voice controller 3122 controls the audio input device 3133 to collect audio data and/or controls the audio output device 3134 to output audio data according to control information transmitted by the autopilot system 21 and processed or forwarded via the central control unit 311. The voice controller 3122 can control the speaker and microphone inside and outside the vehicle to achieve independent voice control inside and outside the vehicle.

Specifically, the audio output device 3134 may include a power amplification unit, a first speaker installed inside the vehicle, and a second speaker installed outside the vehicle. The power amplifier unit is electrically connected with the voice controller 3122, and the first loudspeaker and the second loudspeaker are electrically connected with the power amplifier unit respectively.

Optionally, the power amplifier unit may be electrically connected to the voice controller 3122 through an audio line, the first speaker in the vehicle may be electrically connected to the power amplifier unit through a twisted pair, and the second speaker outside the vehicle may be electrically connected to the power amplifier unit through a twisted pair.

Alternatively, the audio input device 3133 may be a microphone (e.g., a microphone), and the audio input device 3133 may be electrically connected to the voice controller 3122 via a twisted pair wire.

In addition, the audio input device 3133 may be provided in plurality, with different audio input devices 3133 being provided at different locations on the vehicle for picking up audio data in different orientations. The number and the set position of the audio input devices 3133 may be set and adjusted according to the requirements of the actual application scenario, and the embodiment is not limited in detail here.

The first loudspeakers in the vehicle can be arranged in a plurality of ways, and different first loudspeakers are arranged at different positions in the vehicle, so that passengers in the vehicle can better receive the played audio data. The number and the set position of the first speakers in the vehicle may be set and adjusted according to the requirements of the actual application scenario, and this embodiment is not specifically limited herein.

The second speaker outside the vehicle can also be arranged in a plurality of different positions outside the vehicle, so that even in an open or noisy environment, people outside the vehicle can also well receive the played audio data. The number and the set position of the second speakers outside the vehicle may be set and adjusted according to the requirements of the actual application scenario, and this embodiment is not specifically limited herein.

By integrating the human-machine interaction system 31 including the audio input device 3133 and the audio input device 3133 into the control system 10 of the unmanned vehicle, it is possible to collect audio data such as a voice command of a passenger in the vehicle and to play the audio data to a passenger in the vehicle or outside the vehicle, thereby implementing a human-machine interaction function based on voice between the unmanned vehicle and the passenger in the vehicle or outside the vehicle, and improving the integration and maintainability of the control system 10 of the unmanned vehicle.

Alternatively, as shown in fig. 3, the at least one controller 312 of the human-computer interaction system 31 includes a light controller 3123, and the interaction device 313 includes: the light device 3135. The light device 3135 is connected to the light controller 3123 through a CAN bus.

Wherein the light device 3135 comprises at least one of:

an interior lighting lamp, a breathing lamp, a disinfection lamp and an interior lamp belt.

In addition, the light device 3135 may further include other light devices 3135 on the vehicle body, and the type and number of the light devices 3135 specifically included may be set and adjusted according to the needs of the actual application scenario, which is not specifically limited herein.

Optionally, the light controller 3123 may be connected to the central control unit 311 through an Asynchronous Receiver/Transmitter (UART).

In this embodiment, the light controller 3123 is connected to all the light devices 3135 on the vehicle through the CAN bus, and controls all the light devices 3135 on the vehicle body through the CAN bus in a unified manner, so as to ensure that the frequency and the timing sequence of all the light devices 3135 on the vehicle body are synchronous, and solve the problem that the frequency and the timing sequence of the light devices 3135 on the vehicle body are not synchronous.

Optionally, as shown in fig. 3, the interaction device 313 of the human-computer interaction system 31 may further include: a first temperature measuring device 3136 and/or a second temperature measuring device 3137, the first temperature measuring device 3136 being in network communication connection with the central control unit 311, the second temperature measuring device 3137 being in network communication connection with the central control unit 311.

The first temperature measuring device 3136 is used to detect the body temperature of the human body in the vehicle. The first temperature measuring device 3136 may be a temperature measuring device fixedly installed on the vehicle, or may be an independent temperature measuring device separated from the vehicle body, and the first temperature measuring device 3136 may perform network communication with the central control unit 311 through a high speed ethernet, so as to report the body temperature of the passenger inside the vehicle in real time through the central control unit 311, thereby implementing body temperature monitoring of the passenger inside the vehicle.

The second temperature measuring device 3137 is used to detect the temperature inside the vehicle and/or outside the vehicle. The second temperature measuring device 3137 may be provided in plurality, some of which are provided inside the vehicle to detect the temperature inside the vehicle, and some of which are provided outside the vehicle to detect the temperature outside the vehicle. By integrating the second temperature measuring device 3137 in the human-computer interaction system 31, the temperature inside the vehicle and/or the temperature outside the vehicle can be detected in real time.

Optionally, as shown in fig. 3, the interaction device 313 of the human-computer interaction system 31 may further include: the card-punching charging device 3138, the card-punching charging device 3138 and the central control unit 311 have a network communication connection therebetween. The card-punch fee charging device 3138 is used to implement an automatic fee charging function for a vehicle passing fee.

Among them, the card-punch fee charging device 3138 may perform network communication with the central control unit 311 through a high-speed ethernet, may implement an automatic fee charging function for a vehicle passing fee, and may report information related to card-punch fee charging in real time through the central control unit 311.

For example, after the card-punch charging device 3138 performs automatic card-punch charging, the charging information and the card-punch position information are reported to the autopilot system 21 through the central control unit 311 and the central security gateway 11. The automatic driving system 21 may record the charging information or perform automatic driving control using the card punching position information, and may display the card punching charging information through the central security gateway 11, the central control unit 311, the display controller control display device. The automatic driving system 21 can also voice-report card-punch charging information through the central security gateway 11, the central control unit 311, and the voice controller controlling the voice output device.

In addition, after the card-punching charging device 3138 realizes automatic card-punching charging and reports the charging information and the card-punching position information to the automatic driving system 21 through the central control unit 311 and the central security gateway 11, the central control unit 311 may directly control the display device to display the card-punching charging information through the display controller, or the voice controller controls the voice output device to voice-report the card-punching charging information.

By integrating the card-punching toll collection device 3138 in the man-machine interaction system 31, not only can automatic card-punching toll collection of the unmanned vehicle be realized, but also the card-punching toll collection information can be displayed through other interaction equipment 313, so that the man-machine interaction function of the unmanned vehicle is enriched, and the operability of the unmanned system is improved.

Optionally, the human-computer interaction system 31 may further include: the second switch (also referred to as HMI switch), through which the at least one controller and the interaction device 313 are connected in network communication with the central control unit 311, can improve the efficiency of data transmission between the controller and the central control unit 311, thereby improving the timeliness, effectiveness, and safety of the autopilot system 21.

Further, as shown in fig. 4, the control system 10 of the unmanned vehicle may further include: a vehicle networking system (Telematics Box, TBox for short) 41. The internet of vehicles system 41 and the central security gateway 11 are connected in network communication; the automatic driving system 21 and the human-computer interaction system 31 are connected with the internet of vehicles 41 through the central security gateway 11 in a network communication mode.

The internet of vehicles system 41 is used to enable network communication between the autopilot system 21 and the human machine interaction system 31 and devices external to the control system 10.

Optionally, the internet of vehicles system 41 is networked with central security gateway 11 via high speed ethernet. Illustratively, the internet of vehicles system 41 and the central security gateway 11 communicate over a high bandwidth, low latency 5G network.

The vehicle networking system 41 can be a 5G TBox, the central security gateway 11 is connected with the 5G TBox, 5G network communication between the automatic driving system 21 and the man-machine interaction system 31 and equipment of an external network is achieved, the capacity of communication with the external network is provided for the automatic driving system 21 and the man-machine interaction system 31, the functions of the control system 10 of the unmanned vehicle can be further expanded on the basis, and the unmanned capacity and operability of the unmanned vehicle are improved. Further, the central security gateway 11 can encrypt data communicated with the external network, protect the data of the unmanned vehicle from being leaked, and improve the safety and reliability of the unmanned vehicle.

Further, the automatic driving system 21 may include: cloud drives the camera. The cloud-designated driving camera is used for acquiring image data of the inside and/or the periphery of the vehicle and transmitting the image data to the main computing unit 211 or 212.

The cloud-designated driving camera is electrically connected to the main calculation unit 211 and the main calculation unit 212 of the automatic driving system 21. The main computing unit 211 or 212 of the automatic driving system 21 performs network communication with the cloud server through the central security gateway 11 and the car networking system, transmits image data to the cloud server, and controls the vehicle according to driving operation information transmitted by the cloud server.

The image data collected by the cloud designated driving camera comprises monitoring data of the driving state of the unmanned automobile, and the unmanned automobile can be remotely controlled according to the driving state of the unmanned automobile.

The image data collected by the cloud designated driving camera can be transmitted to a computing unit (a main computing unit 211 or a main computing unit 212) of the automatic driving system 21, the computing unit can perform data compression on the image data collected by the cloud designated driving camera, and the compressed data is sent to the cloud server. The cloud driver can carry out remote driving operation through the cloud server and send driving operation information to the computing unit, so that the computing unit controls the vehicle according to the driving operation information, the remote cloud designated driving function of the unmanned vehicle is realized, and the real unmanned vehicle can be realized.

In addition, a remote driver can take over the vehicle in time when the unmanned vehicle meets an extreme condition that the unmanned vehicle cannot be applied, so that the vehicle is remotely controlled, a remote cloud designated driving function is realized, and the safety of the unmanned vehicle is improved.

It should be noted that the network communication implemented in the present disclosure may be a high-speed network communication implemented by 5G, 4G or other transmission protocols, and the embodiment is not limited in detail here.

Fig. 5 is an exemplary diagram of the overall structure of a control system of an unmanned automobile according to a second embodiment of the present disclosure. As shown in fig. 5, the control system of the unmanned vehicle includes a central security gateway, an automatic driving system, and the human-computer interaction system and the control system of the unmanned vehicle may further include: a vehicle networking system (TBox).

Wherein, autopilot system includes: the system comprises a main computing unit, a redundant computing unit, a sensor, an on-board unit and a first switch.

Further, the sensor specifically includes: the device comprises a sensing module and a positioning module. The perception module 2131 includes: and the sensing sensors comprise sensing sensors such as laser radars, sensing cameras and millimeter wave radars, and redundant sensing sensors such as redundant laser radars.

The positioning module includes a positioning sensor and a redundant positioning sensor.

The main computing unit and the redundant computing unit are connected through the Ethernet.

And the laser radar, the redundant laser radar, the positioning sensor and the redundant positioning sensor are connected with the main computing unit and the redundant computing unit through the first switch.

The perceptual camera is connected to the primary and redundant computing units via a radio frequency connector (FAKRA).

The millimeter wave radar is connected with the main computing unit and the redundancy computing unit through an Ethernet or a CAN bus.

The vehicle-mounted unit realizes Ethernet connection with the main computing unit and the redundant computing unit through the first switch.

As shown in fig. 5, the human-computer interaction system includes: a central control unit, at least one controller, an interaction device, and a second switch. The central control unit is connected with the central security gateway through the Ethernet, and the controller is connected with the central control unit through the Ethernet of the second switch.

Wherein the controller in the human-computer interaction system may include a display controller, and the interaction apparatus includes a first display device installed in the vehicle, and at least one second display device installed outside the vehicle. The first display device is connected with the display controller in a high-definition multimedia interface (HDMI) mode, and the second display device is connected with the central control unit through the second switch in an Ethernet mode.

The controller of the human-computer interaction system further comprises: speech controller, the mutual equipment includes: an audio input device and an audio output device. The audio input device is connected with the voice controller through a twisted pair.

The audio output device may include a power amplification unit, a first speaker installed inside the vehicle, and a second speaker installed outside the vehicle. The power amplifier unit can be electrically connected with the voice controller through an audio line, a first loudspeaker in the vehicle can be electrically connected with the power amplifier unit through a twisted pair, and a second loudspeaker outside the vehicle can be electrically connected with the power amplifier unit through a twisted pair.

The controller of the human-computer interaction system further comprises: light controller, interactive equipment still includes: light equipment. The light controller CAN be connected with the central control unit through an asynchronous receiver transmitter (UART), and the light equipment is connected with the light controller through a CAN bus. Wherein, light equipment can include: the interior lighting lamp, the breathing lamp, the disinfection lamp, the interior lamp area of car etc..

The human-computer interaction system may further include: the interaction device of the human-computer interaction system may further include: the first temperature measuring device is in network communication connection with the central control unit, and the second temperature measuring device is in network communication connection with the central control unit. Wherein, the first temperature measuring device is used for detecting the body temperature of the human body in the vehicle. The second temperature measuring device is used for detecting the temperature inside the vehicle and/or the temperature outside the vehicle.

The interaction device of the human-computer interaction system may further include: the card-punching charging device is connected with the central control unit through network communication. The card-punching charging device is used for realizing the automatic charging function of the vehicle passing fee.

As shown in fig. 5, the car networking system is connected with the central security gateway through a high-speed ethernet. And the automatic driving system and the human-computer interaction system realize network communication with the Internet of vehicles system through the central security gateway.

The perception sensor of the automatic driving system may further include: cloud drives the camera. The cloud designated driving camera is connected with the main computing unit and the redundant computing unit through a radio frequency connector (FAKRA). The cloud designated driving camera is used for acquiring image data inside and/or around the vehicle and sending the image data to the main computing unit or the redundant computing unit.

The main computing unit or the redundant computing unit of the automatic driving system is in network communication with the cloud server through the central security gateway and the internet of vehicles, sends image data to the cloud server, and controls the vehicle according to driving operation information sent by the cloud server.

According to the scheme disclosed by the invention, the high-speed Ethernet is used for connecting different domains (different domains realize different system functions), and compared with the traditional on-vehicle communication link (such as a CAN bus, a lin and a flexray) and the like, a large amount of data CAN be rapidly transmitted, and the communication requirement of a higher level is supported. Different systems (or modules) in the unmanned automobile control system and direct data transmission between the control system and an external network are realized by using the central security gateway, so that data can be encrypted and protected, data isolation among irrelevant modules is realized, and the information security requirement of the unmanned automobile is met. By using redundant computing units and redundant sensors, the reliability and safety of the autopilot system of the unmanned vehicle is improved. Roadside intelligent traffic data are acquired by using OBU equipment, more detailed road information is acquired, and the perception capability of an automatic driving system is improved. Through using TBox to realize the network communication with outside high in the clouds server, realize that the cloud drives the function for the day, remote control unmanned vehicle replaces the security officer on the car, guarantees passenger and the outer pedestrian's of car absolute safety in the car when unmanned vehicle is in non-automatic driving state to high in the clouds driver can be alone for a lot of car service, has also reduced security officer's cost.

The present disclosure also provides an unmanned vehicle, comprising: the vehicle main body and any one of the above embodiments provide a control system for an unmanned automobile.

In the technical scheme of the disclosure, the acquisition, storage, application and the like of the personal information of the related user all accord with the regulations of related laws and regulations, and do not violate the good customs of the public order.

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The Server can be a cloud Server, also called a cloud computing Server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service ("Virtual Private Server", or simply "VPS"). The server may also be a server of a distributed system, or a server incorporating a blockchain.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and the present disclosure is not limited herein.

The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.