1. A method of alerting a traffic signal light, comprising:

responding to the color vision disorder mode in a working state, and acquiring a traffic signal lamp image;

identifying the traffic signal lamp image to obtain the current color information of the traffic signal lamp;

and generating prompt information based on the current color information, wherein the prompt information at least indicates the text information corresponding to the current color information.

2. The method of claim 1, wherein the generating hint information based on the current color information comprises:

determining character information corresponding to the current color information; and

and associating the current color information with the character information to serve as the prompt information.

3. The method of claim 1 or 2, wherein the hint information comprises a display style adjustment instruction; the generating of the prompt information based on the current color information includes:

determining target content from a plurality of candidate content based on the current color information, wherein each candidate content is displayed in a first display style, each candidate content comprises candidate color information and text information corresponding to the candidate color information, and the candidate color information in the target content is the same as the current color information; and

generating a display style adjustment instruction for adjusting the target content, wherein the display style adjustment instruction is used for indicating that the target content is displayed in a second display style.

4. The method of any of claims 1-3, further comprising:

generating inquiry information for inquiring whether to start the dyschromatosis mode in response to detection of vehicle start;

receiving reply information aiming at the inquiry information, wherein the reply information comprises an starting instruction for starting a dyschromatopsia mode or a refusing instruction for refusing to start the dyschromatopsia mode; and

and starting the color vision disorder mode in response to the inquiry information including a starting instruction for starting the color vision disorder mode.

5. The method of any of claims 1-4, wherein the acquiring a traffic signal image comprises:

sending an image acquisition instruction to an image acquisition device; and

and receiving the traffic signal lamp image collected by the image collecting device.

6. A notification device for a traffic signal, comprising:

the acquisition module is used for responding to the working state of the color vision disorder mode and acquiring the traffic signal lamp image;

the identification module is used for identifying the traffic signal lamp image to obtain the current color information of the traffic signal lamp; and

and the first generation module is used for generating prompt information based on the current color information, wherein the prompt information at least indicates character information corresponding to the current color information.

7. The apparatus of claim 6, wherein the first generating module comprises:

the first determining submodule is used for determining the character information corresponding to the current color information; and

and the second determining submodule is used for associating the current color information with the character information to serve as the prompt information.

8. The apparatus according to claim 6 or 7, wherein the prompt message includes a display style adjustment instruction; the first generation module comprises:

a third determining sub-module, configured to determine target content from multiple candidate contents based on the current color information, where each candidate content is displayed in a first display style, each candidate content includes candidate color information and text information corresponding to the candidate color information, and the candidate color information in the target content is the same as the current color information; and

and the generation submodule is used for generating a display style adjustment instruction for adjusting the target content, wherein the display style adjustment instruction is used for indicating the target content to be displayed in a second display style.

9. The apparatus of any of claims 6-8, further comprising:

a second generation module configured to generate inquiry information for inquiring whether to start the color vision disorder mode in response to detection of vehicle start;

a receiving module, configured to receive reply information for the inquiry information, where the reply information includes a start instruction for starting a color vision disorder mode or a rejection instruction for rejecting starting the color vision disorder mode; and

and the starting module is used for responding to a starting instruction for starting the dyschromatopsia mode in the inquiry information and starting the dyschromatopsia mode.

10. The apparatus of any of claims 6-9, wherein the means for obtaining comprises:

the sending submodule is used for sending an image acquisition instruction to the image acquisition device; and

and the receiving submodule is used for receiving the traffic signal lamp images acquired by the image acquisition device.

11. A vehicle, comprising:

a vehicle machine system for performing the method of any one of claims 1-5;

the image acquisition device is used for receiving an image acquisition instruction from the vehicle-mounted machine system and acquiring a traffic signal lamp image based on the image acquisition instruction;

and the display unit is used for receiving the prompt information from the vehicle-mounted machine system and displaying based on the prompt information.

12. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.

13. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-5.

14. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-5.

Background

In driving a vehicle, it is generally necessary to recognize the color of a traffic light in order to perform a driving operation according to the color of the traffic light. However, in the related art, the driver is usually required to identify the color of the traffic signal lamp, and it is difficult to ensure the accuracy of identification when the driver identifies the color, so that potential safety hazards exist in the driving process.

Disclosure of Invention

The present disclosure provides a prompting method, apparatus, vehicle, electronic device, storage medium, and program product for a traffic signal lamp.

According to an aspect of the present disclosure, there is provided a prompting method for a traffic signal lamp, including: responding to the color vision disorder mode in a working state, and acquiring a traffic signal lamp image; identifying the traffic signal lamp image to obtain the current color information of the traffic signal lamp; and generating prompt information based on the current color information, wherein the prompt information at least indicates the text information corresponding to the current color information.

According to another aspect of the present disclosure, there is provided a notification device for a traffic signal lamp, including: the device comprises an acquisition module, an identification module and a first generation module. The acquisition module is used for responding to the working state of the color vision disorder mode and acquiring the traffic signal lamp image; the identification module is used for identifying the traffic signal lamp image to obtain the current color information of the traffic signal lamp; and the first generation module is used for generating prompt information based on the current color information, wherein the prompt information at least indicates character information corresponding to the current color information.

According to another aspect of the present disclosure, a vehicle is provided, including a vehicle-mounted machine system, an image capture device, and a display unit. The vehicle-mounted machine system is used for executing the prompting method aiming at the traffic signal lamp. And the image acquisition device is used for receiving the image acquisition instruction from the vehicle-mounted machine system and acquiring the traffic signal lamp image based on the image acquisition instruction. And the display unit is used for receiving the prompt information from the vehicle-mounted machine system and displaying based on the prompt information.

According to another aspect of the present disclosure, there is provided an electronic device including: at least one processor and a memory communicatively coupled to the at least one processor. Wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the above-described method for alerting a traffic light.

According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the above-described alerting method for a traffic signal.

According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the above-described alerting method for a traffic signal.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

fig. 1 schematically illustrates an application scenario of a prompting method and apparatus for a traffic signal lamp according to an embodiment of the present disclosure;

FIG. 2 schematically illustrates a flow chart of a method of alerting a traffic signal light according to an embodiment of the present disclosure;

FIG. 3 schematically illustrates a schematic diagram of a hint information according to an embodiment of the present disclosure;

FIG. 4 schematically illustrates a schematic diagram of a hint information according to another embodiment of the present disclosure;

FIG. 5 schematically illustrates a flow chart of a method of alerting a traffic signal light according to another embodiment of the present disclosure;

FIG. 6 schematically illustrates a block diagram of a notification device for a traffic signal according to an embodiment of the present disclosure; and

FIG. 7 is a block diagram of an electronic device for performing alerts for traffic lights used to implement an embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.

All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.

Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).

The embodiment of the disclosure provides a prompting method for a traffic signal lamp. The prompting method for the traffic signal lamp comprises the following steps: and responding to the working state of the color vision disorder mode, and acquiring the traffic signal lamp image. Then, the traffic signal lamp image is identified to obtain the current color information of the traffic signal lamp. Next, a prompt message is generated based on the current color information, wherein the prompt message indicates at least text information corresponding to the current color information.

Fig. 1 schematically illustrates an application scenario of a prompting method and apparatus for a traffic signal lamp according to an embodiment of the present disclosure. It should be noted that fig. 1 is only an example of an application scenario in which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.

As shown in fig. 1, an application scenario 100 according to this embodiment may include a vehicle 110 and a traffic light 120.

The vehicle 110 includes, for example, a vehicle-mounted machine system, an image pickup device 111, and a display unit. The car-in-vehicle system may control the image capture device 111 to capture a traffic signal image for the traffic signal 120. The image capturing device 111 may be a camera.

After the image acquisition device 111 acquires the traffic signal lamp image, the traffic signal lamp image can be sent to the vehicle-mounted device system, the vehicle-mounted device system performs image recognition on the traffic signal lamp image to obtain current color information of the traffic signal lamp, and the current color information includes, but is not limited to, red, green and yellow. Or, when the image capturing device 111 has an image recognition function, the image capturing device 111 may perform image recognition on the traffic signal image to obtain current color information of the traffic signal, and send the current color information obtained by the image recognition to the vehicle-mounted device system.

After obtaining the current color information, prompt information may be generated for the current color information, the prompt information indicating, for example, text information corresponding to the current color information. For example, the current color information is "green", and the prompt information indicates, for example, the word "green". The characters 'green' can be displayed through the display unit, so that a driver can know the current color information of the traffic signal lamp conveniently through the characters.

It should be noted that the traffic signal light prompting method provided by the embodiment of the present disclosure may be executed by a vehicle-mounted device system. Correspondingly, the prompt device for the traffic signal lamp provided by the embodiment of the disclosure can be arranged in a vehicle-mounted machine system.

The embodiment of the present disclosure provides a prompting method for a traffic signal lamp, and the following describes the prompting method for a traffic signal lamp according to an exemplary embodiment of the present disclosure with reference to fig. 2 to 5 in combination with the application scenario of fig. 1.

Fig. 2 schematically illustrates a flow chart of a method of alerting a traffic signal light according to an embodiment of the present disclosure.

As shown in fig. 2, the prompting method 200 for a traffic signal lamp according to the embodiment of the present disclosure may include, for example, operations S210 to S230.

In operation S210, a traffic signal lamp image is acquired in response to the color vision disorder mode being in an operating state.

In operation S220, the traffic signal image is recognized to obtain current color information of the traffic signal.

In operation S230, a prompt message indicating at least text information corresponding to the current color information is generated based on the current color information.

For example, when a driver with color vision disorder needs to drive a vehicle, it is difficult for the driver to accurately recognize the color of a traffic signal during driving, resulting in a safety hazard during driving. Examples of color vision disorders include color blindness, color weakness, and the like. Therefore, the vehicle configures the color vision disorder mode for the driver having the color vision disorder. The vehicle may start the color vision disorder mode after the vehicle receives a start instruction for starting the color vision disorder mode from the driver.

After the color vision disorder mode is started, the color vision disorder mode is in a working state, and at the moment, the vehicle can acquire the traffic light image in real time, for example, the vehicle acquires the traffic light image through the image acquisition device. And after the traffic signal lamp image is acquired, carrying out image recognition on the traffic signal lamp image to obtain the current color information of the traffic signal lamp. The current color information includes, but is not limited to, red, green, and yellow.

After obtaining the current color information of the traffic signal lamp, prompt information is generated based on the current color information, and the prompt information comprises text information corresponding to the current color information or indicates the text information corresponding to the current color information. For example, the current color information is "green", the text information corresponding to the current color information is, for example, the text "green", and the prompt information includes, for example, the text "green", or may further include an instruction for highlighting the text "green" displayed in advance.

According to the embodiment of the disclosure, the vehicle sets the color vision disorder mode for the driver with color vision disorder, identifies the color of the traffic signal lamp based on the color vision disorder mode, and generates the prompt information aiming at the text information, so that the driver can know the current color of the traffic signal lamp through the text. It can be understood that through the technical scheme of the embodiment of the disclosure, when the driver is difficult to accurately identify the color of the traffic signal lamp, the color identification is carried out by assisting the driver through the color vision disorder mode, so that the driving safety is improved, and the use experience of the driver is improved.

FIG. 3 schematically shows a schematic diagram of a hint information according to an embodiment of the present disclosure.

As shown in fig. 3, generating the cue information based on the current color information includes: and determining character information corresponding to the current color information, associating the current color information with the character information to serve as prompt information, and then displaying the prompt information.

For example, the current color information of the traffic signal lamp is obtained as green through image recognition, and the character information corresponding to the current color information is determined as the character "green". The current color information and the text information are displayed in association on the display unit 300 of the vehicle.

For example, the current color information 310 is the color "green", the text information 320 is the text "green", and the color "green" and the text "green" are displayed in association with each other.

According to the embodiment of the disclosure, the color and the characters are displayed in an associated manner, so that a driver can know the current color of the traffic signal lamp by combining the color with the characters, the accuracy of color prompt is improved, and the driving safety is ensured.

FIG. 4 schematically shows a schematic diagram of a hint information according to another embodiment of the present disclosure.

As shown in fig. 4, the hint information includes a display style adjustment instruction. Generating the cue information based on the current color information includes: and determining target content from the candidate contents based on the current color information, and generating a display style adjusting instruction for adjusting the target content.

For example, each of the plurality of candidate contents 400A, 400B, 400C includes candidate color information and text information corresponding to the candidate color information. Each candidate content is displayed in a first display style prior to identifying a current color of a traffic light. Taking the current color information of the traffic light as "green" as an example, the candidate content 400B is determined as the target content from the plurality of candidate contents 400A, 400B, 400C based on the current color information, and the candidate color information in the target content is the same as the current color information of the traffic light, for example, both are "green".

After the target content is determined, the vehicle generates a display style adjustment instruction for adjusting the target content, wherein the display style adjustment instruction is used for indicating that the target content is displayed in a second display style, namely, the target content is switched from a first display style to a second display style. The second display style is different from the first display style, for example. For example, the second display style includes highlighting the target content, or bolding and enlarging the text "green" in the target content, and so on. In other words, the plurality of candidate contents 400A, 400B, 400C are displayed on the display unit 400 in a first display pattern in advance, and after the current color information of the traffic light is determined, the corresponding target contents are displayed in a prominent second display pattern so that the driver can know the current color information of the traffic light from the target contents.

According to the embodiment of the disclosure, the color and the characters are associated and displayed in the obvious second display style, so that the driver can conveniently know the current color of the traffic signal lamp in time, and the driving safety is ensured.

Fig. 5 schematically illustrates a flow chart of a method of alerting a traffic signal light according to another embodiment of the present disclosure.

As shown in fig. 5, the prompting method 500 for a traffic signal lamp according to the embodiment of the present disclosure may include, for example, operations S501 to S508.

In operation S501, it is determined whether the vehicle is started. If so, operation S502 is performed. If not, return to perform operation S501.

In operation S502, in response to detection of vehicle start, inquiry information for inquiring whether to start the dyschromatopsia mode is generated.

For example, the inquiry information may be displayed on a display unit of the vehicle, or the inquiry information may be an inquiry voice.

In operation S503, a reply message to the inquiry message is received, the reply message including an activation instruction for activating the color vision disorder mode or a rejection instruction for rejecting activation of the color vision disorder mode.

Illustratively, the reply information may include, for example, a click operation or a touch operation performed by the driver on the display unit for selecting the start of the color vision disorder mode or for denying the start of the color vision disorder mode.

For example, the reply message may further include a voice message issued by the driver, the voice message including an activation instruction for activating the color vision disorder mode or a rejection instruction for rejecting activation of the color vision disorder mode.

In operation S504, the dyschromatopsia mode is started in response to the query information including a start instruction for starting the dyschromatopsia mode.

Illustratively, after receiving the reply message, if a start instruction for starting the color vision disorder mode is included in the reply message, the color vision disorder mode is started.

In operation S505, in response to the dyschromatopsia mode being in the operating state, an image acquisition instruction is sent to the image acquisition apparatus.

In operation S506, a traffic signal image collected from an image collecting device is received.

In operation S507, the traffic signal image is recognized to obtain current color information of the traffic signal.

In operation S508, a prompt message indicating at least text information corresponding to the current color information is generated based on the current color information.

According to the embodiment of the disclosure, the vehicle can automatically inquire whether the driver needs to start the color vision disorder mode, so that the operation complexity of the driver is reduced, and the use experience of the driver is improved. The vehicle sets up the dyschromatopsia mode to the driver that has the dyschromatopsia, discerns the colour of traffic signal lamp based on the dyschromatopsia mode, and the suggestion information to text message is generated, and the driver of being convenient for in time learns the current colour of traffic signal lamp through the characters to the security of driving has been improved.

Fig. 6 schematically illustrates a block diagram of a notification device for a traffic signal lamp according to an embodiment of the present disclosure.

As shown in fig. 6, the prompting device 600 for a traffic signal lamp according to the embodiment of the disclosure includes, for example, an obtaining module 610, an identifying module 620, and a first generating module 630.

The acquiring module 610 may be configured to acquire a traffic light image in response to the color vision disorder mode being in an operating state. According to the embodiment of the present disclosure, the obtaining module 610 may perform, for example, the operation S210 described above with reference to fig. 2, which is not described herein again.

The identification module 620 may be configured to identify the traffic signal lamp image to obtain current color information of the traffic signal lamp. According to the embodiment of the present disclosure, the identifying module 620 may perform, for example, the operation S220 described above with reference to fig. 2, which is not described herein again.

The first generating module 630 may be configured to generate a prompt message based on the current color information, where the prompt message indicates at least text information corresponding to the current color information. According to the embodiment of the present disclosure, the first generating module 630 may, for example, perform operation S230 described above with reference to fig. 2, which is not described herein again.

According to an embodiment of the present disclosure, the first generating module 630 includes: a first determination submodule and a second determination submodule. The first determining submodule is used for determining character information corresponding to the current color information; and the second determining submodule is used for associating the current color information with the text information to serve as prompt information.

According to an embodiment of the present disclosure, the prompt message includes a display style adjustment instruction; the first generation module 630 includes: a third determining submodule and a generating submodule. The third determining submodule is used for determining target content from a plurality of candidate contents based on the current color information, wherein each candidate content is displayed in a first display mode and comprises candidate color information and character information corresponding to the candidate color information, and the candidate color information in the target content is the same as the current color information; and the generation submodule is used for generating a display style adjustment instruction for adjusting the target content, wherein the display style adjustment instruction is used for indicating the target content to be displayed in a second display style.

According to an embodiment of the present disclosure, the apparatus 600 may further include: the device comprises a second generating module, a receiving module and a starting module. A second generation module configured to generate inquiry information for inquiring whether to start the color vision disorder mode in response to detection of start of the vehicle; the receiving module is used for receiving reply information aiming at the inquiry information, wherein the reply information comprises a starting instruction for starting the dyschromatopsia mode or a refusing instruction for refusing to start the dyschromatopsia mode; and the starting module is used for responding to a starting instruction for starting the dyschromatopsia mode in the inquiry information and starting the dyschromatopsia mode.

According to an embodiment of the present disclosure, the obtaining module 610 includes: a sending submodule and a receiving submodule. The sending submodule is used for sending an image acquisition instruction to the image acquisition device; and the receiving submodule is used for receiving the traffic signal lamp images acquired by the image acquisition device.

In the technical scheme of the disclosure, the acquisition, storage, application and the like of the personal information of the related user all accord with the regulations of related laws and regulations, and do not violate the good customs of the public order.

The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.

FIG. 7 is a block diagram of an electronic device for performing alerts for traffic lights used to implement an embodiment of the present disclosure.

FIG. 7 illustrates a schematic block diagram of an example electronic device 700 that can be used to implement embodiments of the present disclosure. The electronic device 700 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 7, the device 700 comprises a computing unit 701, which may perform various suitable actions and processes according to a computer program stored in a Read Only Memory (ROM)702 or a computer program loaded from a storage unit 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 can also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other by a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.

Various components in the device 700 are connected to the I/O interface 705, including: an input unit 706 such as a keyboard, a mouse, or the like; an output unit 707 such as various types of displays, speakers, and the like; a storage unit 708 such as a magnetic disk, optical disk, or the like; and a communication unit 709 such as a network card, modem, wireless communication transceiver, etc. The communication unit 709 allows the device 700 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.

Computing unit 701 may be a variety of general purpose and/or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 701 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The calculation unit 701 performs the respective methods and processes described above, such as the alert method for a traffic signal lamp. For example, in some embodiments, the prompting method for traffic lights may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 708. In some embodiments, part or all of a computer program may be loaded onto and/or installed onto device 700 via ROM 702 and/or communications unit 709. When the computer program is loaded into the RAM 703 and executed by the computing unit 701, one or more steps of the above-described alerting method for traffic lights may be performed. Alternatively, in other embodiments, the computing unit 701 may be configured by any other suitable means (e.g., by means of firmware) to perform the alerting method for traffic lights.

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server with a combined blockchain.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel or sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.

The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.