1. A method for improving HDR image quality, the method comprising:

receiving a high bit width HDR image;

splitting one frame of the HDR image with the high bit width into a plurality of frames of images with low bit widths, and reducing the bit width by using different splitting gains for different frames of images with low bit widths in the splitting process;

performing image processing on the multi-frame low-bit-width image to obtain a plurality of frames of low-bit-width images with different brightness;

and fusing the multiple frames of low bit width images with different brightness into a frame of low bit width HDR image.

2. The method according to claim 1, wherein said image processing said plurality of frames of low bit-wide images comprises:

and sequentially carrying out image processing on each frame of image in the plurality of frames of low-bit-width images.

3. The method according to claim 2, wherein the image processing on the plurality of frames of low bit-wide images comprises any one or more of:

black level correction, automatic white balance, lens shading correction, denoising processing, demosaicing processing and image format conversion processing.

4. The method according to claim 3, wherein said denoising said plurality of frames of low bit-width images comprises:

and distinguishing denoising strength by using different gains for different low-bit-width images.

5. The method of claim 3, wherein the distinguishing denoising strengths using different gains for different low bit-width images comprises:

and denoising the low-bit-width image of each frame by using the gain of the image sensor and the gain multiple of the low-bit-width image of the frame during splitting.

6. An apparatus for improving HDR image quality, the apparatus comprising:

the receiving module is used for receiving the HDR image with high bit width;

the splitting module is used for splitting one frame of the HDR image with the high bit width into a plurality of frames of images with the low bit width, and reducing the bit width by using different gains for different frames of images with the low bit width in the splitting process;

the image processing module is used for carrying out image processing on the multi-frame low-bit-width image to obtain a plurality of frames of low-bit-width images with different brightness;

and the fusion module is used for fusing the multiple frames of low bit width images with different brightness into one frame of low bit width HDR image.

7. The apparatus of claim 6,

the image processing module is specifically configured to perform image processing on each frame of image in the multiple frames of low-bit-width images in sequence.

8. The apparatus of claim 7, wherein the image processing module comprises any one or more of the following processing units: the device comprises a black level correction unit, an automatic white balance unit, a lens shading correction unit, a denoising processing unit, a demosaicing processing unit and an image format conversion unit.

9. The apparatus of claim 8,

the denoising processing unit is specifically used for distinguishing denoising strengths of different low-bit-width images by using different gains.

10. The apparatus of claim 8,

and the denoising processing unit is used for denoising each frame of low bit width image by adding the gain of the image sensor to the gain multiple of the low bit width image in the splitting process.

11. The apparatus of any one of claims 8 to 10, further comprising: the automatic exposure control module is respectively connected with the image sensor and the image processing module;

the image sensor is used for acquiring a high bit width HDR image and transmitting the high bit width HDR image to the splitting module;

the automatic exposure control module is used for controlling the brightness of the HDR image with the high bit width acquired by the image sensor through set gain and transmitting the set gain to the image processing module;

the image processing module is also used for enabling the set gain transmitted by the automatic exposure control module to be invalid.

12. A computer-readable storage medium, being a non-volatile storage medium or a non-transitory storage medium, having a computer program stored thereon, the computer program, when being executed by a processor, performing the steps of the method according to any of the claims 1 to 6.

13. An electronic device comprising a memory and a processor, the memory having stored thereon a computer program being executable on the processor, wherein the processor, when executing the computer program, performs the steps of the method of any of claims 1 to 6.

Background

HDR (High Dynamic Range) images generally have a higher bit width, contain a higher luminance Range and more detailed information. With the development of HDR technology, high dynamic range image processing is applied more and more, and in order to ensure that image accuracy is not lost, an image processing system supporting high bit width input is generally required, but the requirement of high bit width on chip area is very high, which may cause a significant increase in chip cost.

The maximum bit width of some existing image processors is usually fixed to 10-bit data or 8-bit data, in order to control cost and not lose image precision, a high-bit-width image is usually split into N frames (N ≧ 2) of low-bit-width images for processing, and the processing process is roughly as follows:

the method comprises the steps of splitting a frame of HDR image with a high bit width into N frames of low bit width images, multiplying an original image by corresponding gains in the splitting process, performing low bit truncation operation to obtain a low bit width image, enabling each frame of image with the reduced bit width to keep information of different bits of the original image, inputting the images into an image processor with a low bit width, processing the images, outputting the images to obtain N frames of low bit width images, and fusing the N frames of low bit width images into a frame of HDR image with low bit width.

Digital gain in the image processor typically uses the gain values introduced by the automatic exposure control system to supplement the brightness values that cannot be achieved by controlling the image sensor only, which results in loss of highlight information and loss of dynamic range of the image. Moreover, when the image processors are respectively used for processing the N frames of images, the same group of denoising parameters are called according to the gain value of an undisassembled single high-bit high-dynamic range, so that the noise of some images in the N frames of images is amplified.

Disclosure of Invention

The embodiment of the application provides a method and a device for improving HDR image quality, so as to solve one or more problems in HDR image processing in the prior art.

Therefore, the embodiment of the invention provides the following technical scheme:

a method of improving HDR image quality, the method comprising:

receiving a high bit width HDR image;

splitting one frame of the HDR image with the high bit width into a plurality of frames of images with low bit widths, and reducing the bit width by using different splitting gains for different frames of images with low bit widths in the splitting process;

performing image processing on the multi-frame low-bit-width image to obtain a plurality of frames of low-bit-width images with different brightness;

and fusing the multiple frames of low bit width images with different brightness into a frame of low bit width HDR image.

Optionally, the image processing on the plurality of frames of low-bit-width images includes: and sequentially carrying out image processing on each frame of image in the plurality of frames of low-bit-width images.

Optionally, the image processing on the multiple frames of low-bit-width images includes any one or more of the following processes: black level correction, automatic white balance, lens shading correction, denoising processing, demosaicing processing and image format conversion processing.

Optionally, the denoising processing on the multi-frame low-bit-width image includes: and distinguishing denoising strength by using different gains for different low-bit-width images.

Optionally, the distinguishing the denoising strengths using different gains for different low bit-width images comprises: and denoising the low-bit-width image of each frame by using the gain of the image sensor and the gain multiple of the low-bit-width image of the frame during splitting.

An apparatus to improve HDR image quality, the apparatus comprising:

the receiving module is used for receiving the HDR image with high bit width;

the splitting module is used for splitting one frame of the HDR image with the high bit width into a plurality of frames of images with the low bit width, and reducing the bit width by using different gains for different frames of images with the low bit width in the splitting process;

the image processing module is used for carrying out image processing on the multi-frame low-bit-width image to obtain a plurality of frames of low-bit-width images with different brightness;

and the fusion module is used for fusing the multiple frames of low bit width images with different brightness into one frame of low bit width HDR image.

Optionally, the image processing module is specifically configured to sequentially perform image processing on each frame of image in the plurality of frames of low-bit-width images.

Optionally, the image processing module comprises any one or more of the following processing units: the device comprises a black level correction unit, an automatic white balance unit, a lens shading correction unit, a denoising processing unit, a demosaicing processing unit and an image format conversion unit.

Optionally, the denoising processing unit is specifically configured to distinguish denoising strengths for different low-bit-width images by using different gains.

Optionally, the denoising processing unit denoises each frame of low bit width image by using the gain of the image sensor plus the gain multiple of the frame of low bit width image during splitting.

Optionally, the apparatus further comprises: the automatic exposure control module is respectively connected with the image sensor and the image processing module;

the image sensor is used for acquiring a high bit width HDR image and transmitting the high bit width HDR image to the splitting module;

the automatic exposure control module is used for controlling the brightness of the HDR image with the high bit width acquired by the image sensor through set gain and transmitting the set gain to the image processing module;

the image processing module is also used for enabling the set gain transmitted by the automatic exposure control module to be invalid.

An embodiment of the present invention further provides a computer-readable storage medium, which is a non-volatile storage medium or a non-transitory storage medium, and on which a computer program is stored, where the computer program is executed by a processor to perform the steps of the above method.

The embodiment of the present invention further provides an electronic device, which includes a memory and a processor, where the memory stores a computer program that can be executed on the processor, and the processor executes the steps of the method when executing the computer program.

According to the method and the device for improving the HDR image quality, provided by the embodiment of the invention, when one frame of HDR image with the high bit width is split into multiple frames of low bit width images, different splitting gains are used for reducing the bit width of the low bit width images of different frames, namely N images in the splitting process have different splitting gains, so that high brightness details and low brightness details in an original image are well reserved in the split images. Compared with the splitting mode using the same gain for the low-bit-width image in the prior art, the method can effectively avoid the situation that the dynamic range of the HDR image is damaged in the splitting process, and increase the dynamic range of the image.

Furthermore, when the split multi-frame low bit-width image is denoised, the gain of the image sensor is not directly used, but the denoising strength of each frame of low bit-width image is controlled based on the split gain of each frame of low bit-width image, so that the denoising effect of each frame of low bit-width image is optimal, the noise cannot be amplified because each frame of low bit-width image is processed, and the noise of the fused high bit-width HDR image is reduced.

Drawings

FIG. 1 is a flow chart of a method for improving HDR image quality according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of splitting an HDR image with a high bit width in an embodiment of the present invention;

FIG. 3 is another flow chart of a method for improving HDR image quality according to an embodiment of the present invention;

FIG. 4 is a schematic diagram illustrating the need of using different gains to distinguish the denoising strengths for different low-bit-width images according to an embodiment of the present invention;

FIG. 5 is a block diagram of an apparatus for improving HDR image quality according to an embodiment of the present invention;

fig. 6 is a block diagram of another structure of an apparatus for improving HDR image quality according to an embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.

In order to solve the problem in the prior art that the HDR image is subjected to framing processing, embodiments of the present invention provide a method and an apparatus for improving the quality of the HDR image, where when a frame of the HDR image with a high bit width is split into multiple frames of low bit width images, different splitting gains are used for different frames of low bit width images to reduce the bit width, that is, N images in the splitting process have different splitting gains, so that high brightness details and low brightness details in an original image are better retained in the split images.

As shown in fig. 1, it is a flowchart of a method for improving HDR image quality according to an embodiment of the present invention, including the following steps:

step 101, receiving a high bit width HDR image.

The HDR image with a high bit width is a RAW image from an image sensor, and the RAW image is RAW data obtained by converting a captured light source signal into a digital signal by an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) or a CCD (Charge-coupled Device).

The high bit width HDR image is generally higher than the processing data bit width of the existing image processor, and may be 12, 14, 16, 20, 24 bits, etc.

Step 102, splitting a frame of the HDR image with the high bit width into multiple frames of low bit width images, and reducing the bit width by using different splitting gains for different frames of the low bit width images in the splitting process.

The low bit width image is an image which has a reduced bit width compared with the high bit width HDR input image and meets the bit width requirement of the existing image processor.

In the embodiment of the invention, different from the prior art that the same splitting gain is used for reducing the bit width in the process of splitting the HDR image with the high bit width, different splitting gains are used for each frame of low bit width image.

For example, splitting a frame of a high bit-wide HDR image into N frames of low bit-wide images that can be used in existing image processors. The splitting gain of the 1 st frame image is pic1, the splitting gain of the 2 nd frame image is a × pic1, the splitting gain of the 3 rd frame image is b × pic 1.., and the splitting gain of the nth frame image is (n-1) × pic1, for example, a < b < > n can be set, which is not limited to this setting, and the splitting process is as shown in fig. 2.

In this way, both the high brightness details and the low brightness details in the original image (i.e. the high bit width HDR image) can be better preserved in the split low bit width image.

And 103, performing image processing on the multiple frames of low-bit-width images to obtain multiple frames of low-bit-width images with different brightness.

It should be noted that, for each split low-bit-width image, it is necessary to input the split low-bit-width image into an image processor in sequence for processing, and the multi-frame low-bit-width images with different brightness obtained after processing may be images in YUV or RGB formats.

The image processor generally has functions of BLC (black level Correction), AWB (Automatic white balance), LSC (lens Shading Correction), denoising, demosaicing, image format conversion, and the like.

It should be noted that the embodiment of the present invention does not limit the specific functions of the image processor, that is, there may be other processing functions besides the above processing functions, and the implementation of each function is not limited.

And 104, fusing the multiple frames of low bit width images with different brightness into one frame of low bit width HDR image.

The specific fusion mode may adopt the prior art, and the embodiment of the present invention is not limited.

According to the method for improving the HDR image quality provided by the embodiment of the invention, when a frame of HDR image with a high bit width is split into multiple frames of low bit width images, different splitting gains are used for different frames of low bit width images to reduce the bit width, namely N images in the splitting process have different splitting gains, so that high brightness details and low brightness details in an original image are better reserved in the split images. Compared with the splitting mode using the same gain for the low-bit-width image in the prior art, the method can effectively avoid the situation that the dynamic range of the HDR image is damaged in the splitting process, and increase the dynamic range of the image.

Further, in another embodiment of the method of the present invention, the one frame of low bit-width HDR image obtained by fusing in step 104 may be sent back to the image processor again to complete post-processing, and RAW image data is converted into a YUV image, and finally converted into a format image such as Jpg.

Fig. 3 is another flowchart of a method for improving HDR image quality according to an embodiment of the present invention, including the following steps:

step 301, receiving a high bit width HDR image.

Step 302, splitting a frame of the HDR image with a high bit width into multiple frames of low bit width images, and reducing the bit width by using different splitting gains for different frames of low bit width images in the splitting process.

And 303, performing image processing on the multiple frames of low-bit-width images to obtain multiple frames of low-bit-width images with different brightness, and distinguishing denoising strengths of the different low-bit-width images by using different gains in denoising processing.

For each low-bit-width image after splitting, the low-bit-width image needs to be sequentially input into an image processor for processing.

As mentioned above, the image processor typically has the functions of BLC, AWB, LSC, denoising, demosaicing, etc. It should be noted that the embodiment of the present invention does not limit the specific functions of the image processor, that is, there may be other processing functions besides the above processing functions, and in this embodiment, only the denoising process is improved, and the implementation manner of each function is not limited.

Different from the prior art in which the same image sensor gain is used for denoising images with different low bit widths in denoising processing, in the embodiment of the present invention, different gains are used for distinguishing the denoising strengths for images with different low bit widths, as shown in fig. 4.

Specifically, for each frame of low bit-width image, the image sensor gain plus the gain multiple corresponding to the frame of low bit-width image during splitting may be used for denoising. Of course, the embodiment of the present invention does not limit the specific gain of each frame of low bit width image, and only needs to use different gains to distinguish the denoising strengths.

For example, assuming that the gain of the image sensor of the HDR image with a high bit width is G _ sensor, since the N frames of low bit width images are split from the same HDR image with a high bit width, the N images have different gains in the splitting process, which are G _ a, G _ b, and … G _ N, respectively, and the denoising process of the image processor optimizes the denoising effect of the N frames of images by calling G _ sensor + G _ a, G _ b, and … G _ N.

For example, assuming that the gain of the image sensor of the HDR image with a high bit width is G _ sensor, since the N frames of low bit width images are split from the same HDR image with a high bit width, the N images have different gains in the splitting process, which are G _ a, G _ b, and … G _ N, and the denoising process of the image processor is performed by calling G _ sensor + G _ a × M, G _ b × M, … G _ N × M, where M is an adjustable parameter, so that the denoising effect of the N frames of images is optimal.

For another example, assuming that the gain of the image sensor of the HDR image with a high bit width is G _ sensor, since the N frames of low bit width images are split from the same HDR image with a high bit width, the N images have different gains in the splitting process, which are G _ a, G _ b, and … G _ N, and the denoising process of the image processor achieves the best denoising effect of the N frames of images by calling G _ sensor × G _ a, G _ sensor × G _ b, and … G _ sensor × G _ N.

And step 304, fusing the multiple frames of low bit width images with different brightness into one frame of low bit width HDR image.

The method for improving the HDR image quality provided by the embodiment of the invention can effectively avoid the condition that the dynamic range of the HDR image is damaged in the splitting process and increase the dynamic range of the image. Moreover, when denoising the split multi-frame low bit-width image, the gain of the image sensor is not directly used, but the denoising strength of each frame of low bit-width image is controlled based on the split gain of each frame of low bit-width image, so that the denoising effect of each frame of low bit-width image is optimal, and the noise of the fused high bit-width HDR image is not reduced because the noise is amplified by processing each frame of low bit-width image.

Correspondingly, an embodiment of the present invention further provides an apparatus for improving HDR image quality, as shown in fig. 5, which is a structural block diagram of the apparatus.

A receiving module 501, configured to receive an HDR image with a high bit width;

a splitting module 502, configured to split one frame of the HDR image with a high bit width into multiple frames of low bit width images, and reduce a bit width of the low bit width images using different gains for different frames of the low bit width images in a splitting process;

the image processing module 503 is configured to perform image processing on the multiple frames of low-bit-width images to obtain multiple frames of low-bit-width images with different brightness; the multi-frame low bit width image with different brightness can be an image with YUV or RGB format and the like;

and a fusion module 504, configured to fuse the multiple frames of low-bit-width images with different brightnesses into one frame of low-bit-width HDR image.

According to the device for improving the HDR image quality, when one frame of HDR image with the high bit width is split into multiple frames of HDR images with the low bit width, different splitting gains are used for different frames of HDR images with the low bit width, namely N images in the splitting process have different splitting gains, so that high-brightness details and low-brightness details in an original image are well reserved in the split images. Compared with the splitting mode using the same gain for the low-bit-width image in the prior art, the method can effectively avoid the situation that the dynamic range of the HDR image is damaged in the splitting process, and increase the dynamic range of the image.

In this embodiment of the present invention, the image processing module 503 may sequentially perform image processing on each of the plurality of frames of low-bit-width images.

The image processing module 503 may specifically include, but is not limited to, any one or more of the following processing units: a black level correction unit, an automatic white balance unit, a lens shading correction unit, a denoising processing unit, a demosaicing processing unit, an image format conversion unit, and the like.

In practical applications, the above units may adopt existing manners to complete their functions, and the embodiment of the present invention is not limited thereto.

Further, in another embodiment of the apparatus of the present invention, when denoising the split multiple frames of low-bit-width images, the denoising processing unit may use different gains to distinguish the denoising strengths of different low-bit-width images for each frame of low-bit-width image instead of directly using the gain of the image sensor, for example, using the gain of the image sensor plus the gain multiple of the low-bit-width image for the frame of low-bit-width image during splitting to denoise. Of course, the embodiment of the present invention does not limit the specific gain of each frame of low bit width image, and only needs to use different gains to distinguish the denoising strengths. By adopting the processing mode, the denoising effect of each frame of low-bit-width image can be optimal, and the noise cannot be amplified because each frame of low-bit-width image is processed, so that the noise of the fused high-bit-width HDR image is reduced.

The device for improving HDR image quality of the embodiment of the invention can be applied to various devices, realizes the processing of input images with high bit width and high dynamic range, and is applied to a mobile phone photographing system. The apparatus for improving HDR image quality according to the present invention is further described in detail below with reference to this application.

Fig. 6 is a block diagram of another structure of an apparatus for improving HDR image quality according to an embodiment of the present invention.

The difference from the embodiment shown in fig. 5 is that in this embodiment, the apparatus may further include: an image sensor 601, and an automatic exposure control module 602 connected to the image sensor 601 and the image processing module 503, respectively.

In this embodiment, the image sensor 601 transmits the collected HDR RAW image with a high bit width to the receiving module 502, but may also transmit the collected HDR RAW image to the splitting module 502 through the receiving module 501 in fig. 5, which is not limited in this embodiment of the present invention.

The automatic exposure control module 602 is configured to control the brightness of the HDR RAW image with a high bit width acquired by the image sensor 601 by setting a gain, and transmit the setting gain to the image processing module 503.

Since the process of splitting the high-bit-width image into N frames of low-bit-width images is similar to the action of the digital gain, if the high-bit-width image is multiplied by the digital gain, highlight details of the N frames of images are lost, since the multiplication of the digital gain is equivalent to the multiplication of each pixel value of the image by the same value, each pixel value becomes large, for example, the range of 0-255 is limited, the upper limit is only 255, many pixel values which are not 255 originally become 255, and information corresponding to the values is lost.

Therefore, in this embodiment, when the image processing module 503 performs noise reduction processing on images with different low bit widths, it is further required to disable the set gain transmitted by the automatic exposure control module, and use different gains to distinguish the denoising strengths, so that the denoising effect of each frame of low bit width image is optimal, and noise cannot be amplified because each frame of low bit width image is processed and amplified, thereby reducing noise of the fused high bit width HDR image.

In this embodiment, the fusion module 504 is configured to fuse the multiple frames of low bit-width images with different brightness output by the image processing module 503 into one frame of low bit-width HDR image.

Further, the fusion module 504 may also send the frame of low bit-width HDR image obtained by fusion back to the image processing module 503 again to complete post-processing, convert RAW image data into a YUV image, and finally convert the YUV image into an Jpg format image.

In addition, in other embodiments of the apparatus of the present invention, the apparatus may further include: a storage module (not shown) connected to the image processing module 503, configured to store the frames of images received by the image processing module 503, so as to facilitate processing of the frames of images by the processing units in the subsequent magic image processing module 503.

In a specific implementation, the apparatus for improving HDR image quality may correspond to a Chip in a network device, such as a System-On-a-Chip (SoC), a baseband Chip, a Chip module, and the like.

In a specific implementation, each module/unit included in each apparatus and product described in the foregoing embodiments may be a software module/unit, may also be a hardware module/unit, or may also be a part of a software module/unit and a part of a hardware module/unit.

For example, for each device or product applied to or integrated into a chip, each module/unit included in the device or product may be implemented by hardware such as a circuit, or at least a part of the module/unit may be implemented by a software program running on a processor integrated within the chip, and the rest (if any) part of the module/unit may be implemented by hardware such as a circuit; for each device or product applied to or integrated with the chip module, each module/unit included in the device or product may be implemented by using hardware such as a circuit, and different modules/units may be located in the same component (e.g., a chip, a circuit module, etc.) or different components of the chip module, or at least some of the modules/units may be implemented by using a software program running on a processor integrated within the chip module, and the rest (if any) of the modules/units may be implemented by using hardware such as a circuit; for each device and product applied to or integrated in the terminal, each module/unit included in the device and product may be implemented by using hardware such as a circuit, and different modules/units may be located in the same component (e.g., a chip, a circuit module, etc.) or different components in the terminal, or at least part of the modules/units may be implemented by using a software program running on a processor integrated in the terminal, and the rest (if any) part of the modules/units may be implemented by using hardware such as a circuit.

An embodiment of the present invention further provides a computer-readable storage medium, which is a non-volatile storage medium or a non-transitory storage medium, and a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program performs the steps of the method provided in the embodiment corresponding to fig. 1 or fig. 3. Alternatively, the computer program is executed by a processor to perform the steps of the method provided by the corresponding embodiment of fig. 1.

The embodiment of the present invention further provides another apparatus for improving HDR image quality, which includes a memory and a processor, where the memory stores a computer program executable on the processor, and the processor executes the computer program to perform the steps of the method provided in the embodiment corresponding to fig. 1 or fig. 3.

The embodiment of the present invention further provides an electronic device, which includes a memory and a processor, where the memory stores a computer program executable on the processor, and the processor executes the steps of the method provided in the embodiment corresponding to fig. 1 or fig. 3 when executing the computer program.

In this embodiment of the present invention, the processor may be a Central Processing Unit (CPU), and the processor may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

It will also be appreciated that the memory in the embodiments of the subject application can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash memory. Volatile memory can be Random Access Memory (RAM), which acts as external cache memory. By way of example and not limitation, many forms of Random Access Memory (RAM) are available, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (enhanced SDRAM), SDRAM (SLDRAM), synchlink DRAM (SLDRAM), and direct bus RAM (DR RAM).

It should be understood that the term "and/or" herein is merely one type of association relationship that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" in this document indicates that the former and latter related objects are in an "or" relationship.

The "plurality" appearing in the embodiments of the present application means two or more.

The descriptions of the first, second, etc. appearing in the embodiments of the present application are only for illustrating and differentiating the objects, and do not represent the order or the particular limitation of the number of the devices in the embodiments of the present application, and do not constitute any limitation to the embodiments of the present application.

The term "connect" in the embodiments of the present application refers to various connection manners, such as direct connection or indirect connection, to implement communication between devices, which is not limited in this embodiment of the present application.

Although the present invention is disclosed above, the present invention is not limited thereto. Various changes and modifications may be effected therein by one skilled in the art without departing from the spirit and scope of the invention as defined in the appended claims.