Indication signal recognition method, indication signal recognition apparatus, and computer storage medium

文档序号:8477 发布日期:2021-09-17 浏览:69次 中文

1. An indication signal identification method, the method comprising:

acquiring target video data of target equipment;

performing image recognition on the target video data, and determining a target image feature sequence corresponding to the target video data;

and determining the target indication type of the target equipment according to the target image feature sequence.

2. The method according to claim 1, wherein the performing image recognition on the target video data and determining a target image feature sequence corresponding to the target video data comprises:

determining a plurality of image frames contained in the target video data and timestamps corresponding to the image frames;

respectively carrying out image recognition on each image frame to obtain sub-image characteristics corresponding to each image frame;

and combining the sub-image features according to the time stamp to obtain the target image feature sequence.

3. The method of claim 2, wherein determining the target indication type of the target device from the sequence of target image features comprises:

matching the target image characteristic sequence with a plurality of selectable indication signal characteristic sequences respectively; wherein each selectable indication signal characteristic sequence corresponds to a selectable indication type;

and determining the optional indication type corresponding to the matched optional indication signal characteristic sequence as the target indication type of the target device.

4. The method of claim 3, wherein the combining the sub-image features according to the time stamps to obtain the target image feature sequence comprises:

combining all the sub-image features according to the time stamp sequence to obtain a feature sequence of the image to be processed;

acquiring an indication signal transmission protocol of the target equipment;

determining a sequence period parameter according to the indication signal transmission protocol;

extracting the characteristic sequence of the image to be processed according to the sequence period parameter to obtain the characteristic sequence of the target image; wherein the target image feature sequence comprises at least one sequence output period; the sequence output period is the output period of the selectable indication signal characteristic sequence.

5. The method of claim 4, wherein the sequence period parameter comprises a first flag bit and a second flag bit, and the first flag bit and the second flag bit are respectively used for characterizing the start and the end of the sequence output period; the extracting the feature sequence of the image to be processed according to the sequence period parameter to obtain the feature sequence of the target image comprises:

identifying the first zone bit and the second zone bit in the image feature sequence to be processed;

determining the image feature sequence to be processed between the first flag bit and the second flag bit which are identified to be adjacent to each other as the target image feature sequence.

6. The method of claim 4, wherein the sequence period parameter further comprises a target sequence length; the target sequence length is a sequence length corresponding to one sequence output period; the extracting the image feature sequence to be processed according to the sequence period parameter to obtain the target image feature sequence, further comprising:

detecting adjacent and repeated image features in the image feature sequence to be processed by taking the length of the target sequence as a detection step length;

and determining the target image characteristic sequence according to the detection result.

7. The method of claim 6, wherein the determining a plurality of image frames contained in the target video data and a timestamp corresponding to each of the image frames comprises:

sampling the target video data according to a preset sampling frequency to obtain a plurality of image frames;

and determining the time stamp corresponding to each image frame according to the time stamp of each image frame in the target video data.

8. The method of claim 7, wherein the matching the target image feature sequence with a plurality of selectable indicator signal feature sequences, respectively, comprises:

acquiring an indication signal transmission protocol of the target equipment;

determining the output period duration according to the indication signal transmission protocol; the output period duration is duration corresponding to one sequence output period;

determining a sampling proportion according to the sampling frequency and the output period duration;

restoring the target image feature sequence according to the sampling proportion to obtain an original image feature sequence; wherein, the sequence length of the original image feature sequence is the length of the target sequence;

matching the original image feature sequence with each selectable indication signal feature sequence respectively;

determining the matched optional indication signal characteristic sequence as a target indication signal characteristic sequence;

and determining the indication type corresponding to the target indication signal characteristic sequence as the target indication type.

9. The method of claim 8, wherein matching the target image feature sequence with a plurality of selectable indicator signal feature sequences, respectively, determines a target indication type of the target device, further comprising:

determining a target image characteristic oscillogram according to the target image characteristic sequence; the abscissa of the target image characteristic oscillogram is time, and the ordinate is an image characteristic value;

determining an optional indication signal waveform diagram according to the optional indication signal characteristic sequence; the abscissa of the selectable indication signal waveform diagram is time, and the ordinate is an indication signal characteristic value;

performing waveform matching on the target image characteristic waveform diagram and the optional indication signal waveform diagram;

and determining the optional indication signal characteristic sequence corresponding to the matched optional indication signal waveform diagram as the target indication signal characteristic sequence.

10. An indication signal recognition apparatus, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is used for storing at least one executable instruction which causes the processor to execute the operation of the indication signal identification method according to any one of claims 1-9.

11. A computer-readable storage medium having stored therein at least one executable instruction which, when executed by a processor of an indication signal recognition apparatus, causes the indication signal recognition apparatus to perform the operations of the indication signal recognition method of any one of claims 1 to 9.

Background

At present, different flashing sequences are generated by controlling the turn-off of an indicator lamp on a controller or a system, so that different state information is represented, and the state information such as faults, modes and the like is transmitted to a user or a maintenance worker.

In the prior art, when a flashing sequence is identified, generally, as shown in fig. 1, a sequence is manually timed and recorded, and then a fault table is queried, so as to determine an indication state corresponding to the flashing sequence of an indicator light. The inventor finds out in the process of implementing the invention that: the identification efficiency and accuracy of the indicating signal in the prior art are low.

Disclosure of Invention

In view of the foregoing problems, embodiments of the present invention provide an indication signal identification method, an indication signal identification device, and a computer storage medium, which are used to solve the problems of identification efficiency and accuracy of indication signals in the prior art.

In one aspect, an embodiment of the present invention provides an indication signal identification method, where the method includes: acquiring target video data of target equipment; performing image recognition on the target video data, and determining a target image feature sequence corresponding to the target video data; and determining the target indication type of the target equipment according to the target image feature sequence.

In an optional manner, the method further comprises: determining a plurality of image frames contained in the target video data and timestamps corresponding to the image frames; respectively carrying out image recognition on each image frame to obtain sub-image characteristics corresponding to each image frame; and combining the sub-image features according to the time stamp to obtain the target image feature sequence.

In an optional manner, the method further comprises:

matching the target image characteristic sequence with a plurality of selectable indication signal characteristic sequences respectively; wherein each selectable indication signal characteristic sequence corresponds to a selectable indication type; and determining the optional indication type corresponding to the matched optional indication signal characteristic sequence as the target indication type of the target device.

In an optional manner, the method further comprises:

combining all the sub-image features according to the time stamp sequence to obtain a feature sequence of the image to be processed; acquiring an indication signal transmission protocol of the target equipment; determining a sequence period parameter according to the indication signal transmission protocol; extracting the characteristic sequence of the image to be processed according to the sequence period parameter to obtain the characteristic sequence of the target image; wherein the target image feature sequence comprises at least one sequence output period; the sequence output period is the output period of the selectable indication signal characteristic sequence.

In an optional manner, the sequence period parameter includes a first flag bit and a second flag bit, where the first flag bit and the second flag bit are respectively used to characterize the start and the end of the sequence output period; the method further comprises the following steps: identifying the first zone bit and the second zone bit in the image feature sequence to be processed; determining the image feature sequence to be processed between the first flag bit and the second flag bit which are identified to be adjacent to each other as the target image feature sequence.

In an optional manner, the sequence period parameter further includes a target sequence length; the target sequence length is a sequence length corresponding to one sequence output period; the method further comprises the following steps: detecting adjacent and repeated image features in the image feature sequence to be processed by taking the length of the target sequence as a detection step length; and determining the target image characteristic sequence according to the detection result.

In an optional manner, the method further comprises:

sampling the target video data according to a preset sampling frequency to obtain a plurality of image frames; and determining the time stamp corresponding to each image frame according to the time stamp of each image frame in the target video data.

In an optional manner, the method further comprises:

acquiring an indication signal transmission protocol of the target equipment; determining the output period duration according to the indication signal transmission protocol; the output period duration is duration corresponding to one sequence output period; determining a sampling proportion according to the sampling frequency and the output period duration; restoring the target image feature sequence according to the sampling proportion to obtain an original image feature sequence; wherein, the sequence length of the original image feature sequence is the length of the target sequence; matching the original image feature sequence with each selectable indication signal feature sequence respectively; determining the matched optional indication signal characteristic sequence as a target indication signal characteristic sequence; and determining the indication type corresponding to the target indication signal characteristic sequence as the target indication type.

In an optional manner, the method further comprises: determining a target image characteristic oscillogram according to the target image characteristic sequence; the abscissa of the target image characteristic oscillogram is time, and the ordinate is an image characteristic value; determining an optional indication signal waveform diagram according to the optional indication signal characteristic sequence; the abscissa of the selectable indication signal waveform diagram is time, and the ordinate is an indication signal characteristic value; performing waveform matching on the target image characteristic waveform diagram and the optional indication signal waveform diagram; and determining the optional indication signal characteristic sequence corresponding to the matched optional indication signal waveform diagram as the target indication signal characteristic sequence.

In another aspect, an embodiment of the present invention provides an indication signal identification device, including: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus; the memory is used for storing at least one executable instruction which causes the processor to execute the operation of the indication signal identification method.

In still another aspect, an embodiment of the present invention provides a computer-readable storage medium, in which at least one executable instruction is stored, and the executable instruction causes an indication signal identification apparatus to perform the operation of the indication signal identification method.

The embodiment of the invention obtains the target video data of the target equipment; carrying out image recognition on target video data, and determining a target image characteristic sequence corresponding to the target video data; and finally, determining the target indication type of the target equipment according to the target image feature sequence, wherein the problem that the efficiency and the accuracy of manual identification of the indication signal are low in the prior art is solved.

The foregoing description is only an overview of the technical solutions of the embodiments of the present invention, and the embodiments of the present invention can be implemented according to the content of the description in order to make the technical means of the embodiments of the present invention more clearly understood, and the detailed description of the present invention is provided below in order to make the foregoing and other objects, features, and advantages of the embodiments of the present invention more clearly understandable.

Drawings

The drawings are only for purposes of illustrating embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings.

Fig. 1 shows a schematic flow chart of an indication signal identification method in the prior art.

Fig. 2 is a schematic flow chart illustrating an indication signal identification method according to an embodiment of the present invention.

Fig. 3 is a diagram illustrating an application scenario of the indication signal identification method according to the embodiment of the present invention.

Fig. 4 shows a schematic block diagram of an indication signal identification system according to an embodiment of the present invention.

Fig. 5 is a schematic structural diagram illustrating an indication signal identification device according to an embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein.

Fig. 2 is a flow chart illustrating an indication signal identification method, performed by a computer processing device, according to an embodiment of the present invention. The computer processing device may include a cell phone, a notebook computer, etc.

In one embodiment of the present invention, an application scenario of the indication signal identification method may be as illustrated in fig. 3: and recording or uploading pre-shot target video data in real time by a user through diagnostic software installed on computer processing equipment, wherein a shot object of the target video data is an indicator lamp on a tested system of the target equipment. The diagnostic software determines a target indication type corresponding to the target video data through the indication signal identification method provided by the embodiment of the invention, and returns the target indication type serving as an identification result to a user in the diagnostic software.

The following describes an indication signal identification method provided by an embodiment of the present invention, as shown in fig. 2, the method includes the following steps: step 101: target video data of a target device is acquired.

In one embodiment of the present invention, the target device may be a device such as a vehicle, machine, etc. including an indicating device, which may be a dashboard, indicator light, etc. The target video data comprises video data, multi-shot photo data and the like corresponding to the indicating device in the target sampling time. Wherein the sampling time may be determined according to the sequence period parameter in step 234.

In yet another embodiment of the present invention, the target video data may be obtained in real time, or may be recorded and uploaded by the user in advance.

When the target video data is acquired in real time, the real-time image feature sequence corresponding to the acquired video data may be determined in real time according to step 102, and it is determined whether the real-time image feature sequence meets a preset determination condition. And when the preset judgment condition is met, sending a prompt message to a user to prompt the user to finish the real-time recording of the video. The preset judgment condition may be that the real-time image feature sequence includes at least one sequence output period described in step 234, and the preset judgment condition is used to represent that all information required for judging the target indication type is included in the real-time image feature sequence.

Step 102: and carrying out image recognition on the target video data, and determining a target image feature sequence corresponding to the target video data.

In one embodiment of the present invention, the process of performing image recognition on the target video data may include the following steps: sampling the target video data according to a certain sampling frequency, and extracting a plurality of image frames contained in the target video data.

And extracting image characteristics of each image frame, and identifying image characteristic information such as gray information, brightness information, RGB (Red Green Blue, three primary colors of Red, Green and Blue) information and the like corresponding to the target area in the image frame. And combining the image characteristic information corresponding to each target area according to the time sequence of each image frame in the target video data to obtain a target image characteristic sequence. Wherein the target area may be an area in each image frame where the pointing device is located.

In a further embodiment of the present invention, before performing image feature extraction on each image frame, image preprocessing may also be performed on each image frame, so as to improve the efficiency of image feature extraction.

In yet another embodiment of the present invention, step 102 further comprises at least: step 1021: determining a plurality of image frames contained in the target video data and time stamps corresponding to the image frames.

First, the indication information typically represents the different indication states by a blinking sequence of the indication means, the blinking sequence being a sequence of sub-signals comprising at least one type. The signal characteristic for distinguishing the sub-signal type may be the magnitude of the signal value, such as the level, or the duration of the sub-signal, such as the brightness.

Each blinking sequence is specifically identified by the type of sub-signal included in the sequence, the timing of the occurrence of the various sub-signals, the duration of the various sub-signals, and the blinking frequency, among other things, such that the blinking sequence can be used to characterize various specific indication states. Each character bit in the flashing sequence represents a unit duration, namely a unit flashing period, and the duration of one sub-signal at least comprises one unit flashing period.

In yet another embodiment of the present invention, when the sub-signal types are high and low, the unit flashing period is 1s, and the indication state of "oil low" can be characterized by the flashing sequence 110101, where 1 represents high and 0 represents low. The flashing sequence 110101 corresponds to the actual indication signal output state being high level 2 s-low level 1 s-high level 1 s.

In yet another embodiment of the present invention, when the sub-signal types are long on and short on, the description of the blinking sequence is performed with the embodiment in which the indicating device is an indicator light, the type of the sub-signal having the duration greater than or equal to 2 unit blinking periods is determined as long on, the type of the sub-signal having the duration less than 2 and greater than 0 unit blinking periods is determined as short on, 11 is long on, 1 is short on, 0 is off, and the actual indication information output state corresponding to the blinking sequence 110101 is long on-off-short on.

The indicating device has a certain flicker frequency, and the flicker frequency can be used for representing the indicating state, so that a proper sampling frequency needs to be determined according to the flicker frequency of the indicating device, and a plurality of image frames are extracted from the target video data according to the sampling frequency, so that one or more times of flicker transformation of a missing flicker sequence caused by undersize sampling frequency is avoided, a target image feature sequence determined according to the target video data cannot correspond to the indicating state, and the accuracy of indicating information identification is reduced.

In one embodiment of the present invention, the sampling frequency may be determined according to the duration of the various sub-signals and the signal interval duration between the various sub-signals. Thus, in a further embodiment of the present invention, step 1021 further comprises at least: step 211: and sampling the target video data according to a preset sampling frequency to obtain the plurality of image frames.

In one embodiment of the present invention, the sampling period corresponding to the sampling frequency should cover the minimum time interval of each sub-signal transition in the respective selectable indicator signal characteristic sequence. The selectable indication signal characteristic sequence refers to a preset specific indication signal characteristic sequence, each selectable indication signal characteristic sequence corresponds to one selectable indication state, and each selectable indication signal characteristic sequence comprises at least one signal characteristic corresponding to a selectable sub-signal.

If one image frame is extracted from the target video data every 2s from the start time of the target video data when the sampling frequency is 1/2Hz and the total duration of the target video data is 60s, 31 image frames are finally obtained.

Step 212: and determining the time stamp corresponding to each image frame according to the time stamp of each image frame in the target video data.

Continuing with the previous example, 31 image frames are denoted as P1, P2.... P31, and the time stamps of the image frames P1, P2.... P31 in the target video data are 00:00: 00:00, 00:00:02, and 00:00:60, respectively.

Step 1022: and respectively carrying out image recognition on each image frame to obtain the sub-image characteristics corresponding to each image frame.

In an embodiment of the present invention, gray scale distribution information of an image frame is first obtained, and a background area and a target area in the image frame are determined according to the gray scale distribution information, where the target area is an area where a pointing device is located. And then determining the sub-image characteristics corresponding to each image frame according to the RGB information and the brightness information corresponding to the image frame target area.

In still another embodiment of the present invention, each image frame may be first preprocessed before image recognition, and the image preprocessing may include denoising, graying, binarization, and the like.

In still another embodiment of the present invention, before performing image recognition, the image quality of each image frame may be detected, and when the image quality of the image is not satisfactory with the preset threshold, a prompt message is sent to the client to prompt the user to adjust the camera parameters or to upload the target video data again, thereby improving the accuracy and efficiency of image recognition.

Step 1023: and combining the sub-image features according to the time stamp to obtain the target image feature sequence.

And combining all the sub-image features according to the sequence of the timestamps to obtain a target image feature sequence. In order to improve the delivery rate of the indication signal, the target device generally sends a flashing sequence for a plurality of times in a circulating manner, so that the flashing sequence is conveniently recorded and analyzed by a user.

Therefore, in a further embodiment of the present invention, step 1023 further comprises at least: step 231: and combining all the sub-image features according to the time stamp sequence to obtain a feature sequence of the image to be processed.

And combining all the sub-image features according to the sequence of the timestamps to obtain a feature sequence of the image to be processed.

Step 232: and acquiring an indication signal transmission protocol of the target equipment.

In one embodiment of the present invention, the indication signal transmission protocol is used to characterize the transmission and resolution rules of the indication signal, including at least signal flag bits, flashing frequency, contrast ratio between on and off, unit signal sequence length, and data resolution protocol. The signal flag bit is used for marking redundant information related to the transmission state of the indication signal, such as the transmission start and the transmission end of the indication signal, whether the transmission process is abnormal or not, and the like; the length of the unit signal sequence refers to the number of character bits occupied by the output indicating signal in a unit flashing period; the on-off contrast refers to a change value of the brightness of the indicator lamp when the indicator lamp is turned on relative to when the indicator lamp is not turned on.

In another embodiment of the present invention, the device identifier of the target device may be obtained, and the device manufacturer, the device model, the communication standard, and other related device parameters may be determined according to the device identifier, so as to query the database according to the related device parameters and determine the indication signal transmission protocol.

Step 233: and determining a sequence period parameter according to the indication signal transmission protocol.

In an embodiment of the present invention, the sequence period parameter refers to a parameter related to an output period of the selectable indication signal characteristic sequence, such as start flag bit information of the period, a sequence length corresponding to each output period, and the like.

Step 234: and extracting the characteristic sequence of the image to be processed according to the sequence period parameter to obtain the characteristic sequence of the target image.

In an embodiment of the present invention, the image feature sequence to be processed may be identified according to the sequence period parameter, and the identified image feature sequence including at least one sequence output period is extracted as the target image feature sequence, so as to improve the efficiency of performing indication type judgment according to the target image feature sequence. Wherein the sequence output period is the output period of the optional indication signal characteristic sequence in step 212.

In yet another embodiment of the present invention, consider the situation where real-time changes in device status may occur, such as: the target device firstly sends a first indication signal, and then continuously sends a second indication signal after the first indication signal, and if the first indication signal and the second indication signal both respectively comprise three sequence output periods, and target video data starts to be collected at the starting moment of a third sequence output period of the first indication signal, if a sequence output period is adopted as a target image feature sequence, the target image feature sequence may only correspond to the first indication signal, and the second indication signal after the device state changes is omitted. Therefore, in a further embodiment of the present invention, in order to ensure the correctness of the target image feature sequence, at least two sequence output periods as described above should be included in the target image feature sequence.

In a further embodiment of the present invention, the sequence period parameter includes a first flag bit and a second flag bit, where the first flag bit and the second flag bit are respectively used for characterizing the start and the end of the sequence output period; 234 further includes at least: step 2341: and identifying the first zone bit and the second zone bit in the image feature sequence to be processed.

In one embodiment of the present invention, the first flag and the second flag may be S, E, for example.

Step 2342: determining the image feature sequence to be processed between the first flag bit and the second flag bit which are identified to be adjacent to each other as the target image feature sequence.

For example, the image feature sequence to be processed may be 0110S0101010ES0101010E 0111, and if the adjacent first flag bit and the second flag bit S0101010E are identified, the target image feature sequence is 0101010. In the case that the optional indication signal characteristic sequence is specified to be of a fixed length in the indication signal transmission protocol, in a further embodiment of the present invention, the sequence period parameter further includes a target sequence length; the target sequence length is a sequence length corresponding to one sequence output period;

step 234 further includes at least:

step 2343: and detecting adjacent and repeated image features in the image feature sequence to be processed by taking the length of the target sequence as a detection step length.

In still another embodiment of the present invention, a sampling ratio may be determined according to step 313, a sampling sequence length is determined according to the sampling ratio and a target sequence length, and adjacent and repeated image features in the image feature sequence to be processed are detected with the sampling sequence length as the detection step length. The quotient of the target sequence length and the sample ratio is determined as the sample sequence length, and if the target sequence length is 4 and the sample ratio is 1/2, the sample sequence length is 4 × 2 — 8. Then the image features to be processed are sequentially detected from the first character in the sequence, and whether image features which are 8 character bits in length and occur adjacently and repeatedly exist is searched.

Step 2344: and determining the target image characteristic sequence according to the detection result.

For the sequence BAAC, wherein A is a sequence with the length of 7 character bits, the detected target image feature sequence is A. In connection with the example in step 2342, the image feature sequence to be processed may be 01100101010010101001010100111, and when the sampling sequence length may be, for example, 7 character bits, the target image feature sequence is 0101010.

Step 103: and determining the target indication type of the target equipment according to the target image feature sequence.

In one embodiment of the invention, the target image feature sequence is matched with a plurality of preset optional indication signal feature sequences respectively, and table lookup is carried out according to the matched optional indication signal feature sequences to determine the target indication type.

In yet another embodiment of the present invention, step 103 further comprises at least: step 1031: and respectively matching the target image characteristic sequence with a plurality of selectable indication signal characteristic sequences.

Wherein each of the selectable indication signal characteristic sequences corresponds to a selectable indication type.

In still another embodiment of the present invention, step 1031 further comprises: step 311: and acquiring an indication signal transmission protocol of the target equipment.

Step 311 is the same as step 232 and will not be described again.

Step 312: determining the output period duration according to the indication signal transmission protocol; the output period duration is a duration corresponding to one of the sequence output periods.

In one embodiment of the present invention, the output cycle duration may be previously agreed in the indication signal transmission protocol.

In yet another embodiment of the present invention, in the case that the indication signal is an isochronous signal, the output period duration may also be determined according to the indication signal transmission protocol determination signal duration and the target sequence length. Specifically, the product of the signal duration and the target sequence length is determined as the output period duration. Wherein, the isochronous signal refers to a signal indicating that the duration of each sub-signal in the signal output sequence and the interval duration between the sub-signals are the same.

Step 313: and determining a sampling proportion according to the sampling frequency and the output period duration.

In yet another embodiment of the present invention, a sampling period corresponding to the sampling frequency is first determined. Wherein the sampling period is the inverse of the sampling frequency. And determining the ratio of the sampling period to the output period duration corresponding to one sequence output period as a sampling proportion. For example, if the output period duration is 5s and the sampling period is 2s, the sampling ratio is 2/5-0.4.

Step 314: restoring the target image feature sequence according to the sampling proportion to obtain an original image feature sequence; and the sequence length of the original image feature sequence is the length of the target sequence.

In an embodiment of the present invention, the reduction processing refers to merging adjacent and identical character bits of the target image feature sequence at a sampling ratio, for example, when the sampling ratio is 1/3, merging every 3 adjacent and identical character bits into 1 identical character bit, for example, obtaining 0 after performing reduction processing on 000.

Step 315: and respectively matching the original image feature sequence with each selectable indication signal feature sequence.

Step 316: and determining the matched optional indication signal characteristic sequence as a target indication signal characteristic sequence.

Step 317: and determining the indication type corresponding to the target indication signal characteristic sequence as the target indication type.

Step 1032: and determining the optional indication type corresponding to the matched optional indication signal characteristic sequence as the target indication type of the target device.

In yet another embodiment of the present invention, step 1032 further comprises: step 321: and determining a target image characteristic oscillogram according to the target image characteristic sequence.

In one embodiment of the invention, the target image characteristic waveform map is drawn by taking time as an abscissa and taking an image characteristic value as an ordinate. The image feature value may be a character value on each character bit in the target image feature sequence, and may be used to characterize, for example, a gray value size.

Step 322: and determining a waveform diagram of the selectable indication signal according to the characteristic sequence of the selectable indication signal.

In one embodiment of the invention, the target image characteristic waveform map is drawn by taking time as an abscissa and taking the indicating signal characteristic value as an ordinate. The indication signal characteristic value can be a character value on each character bit in the selectable indication signal characteristic sequence, and can be used for representing, for example, the level signal level.

Step 323: and carrying out waveform matching on the target image characteristic waveform diagram and the optional indication signal waveform diagram.

In one embodiment of the invention, the waveform change characteristics of the target image characteristic waveform map are matched with the waveform change characteristics of the optional indication signal waveform map, wherein the waveform change characteristics comprise phase change frequency, period change, amplitude change and the like.

Step 324: and determining the optional indication signal characteristic sequence corresponding to the matched optional indication signal waveform diagram as the target indication signal characteristic sequence.

When the waveform variation trends of the target image characteristic waveform map and the selectable indication signal waveform map are the same, the target image characteristic waveform map and the selectable indication signal waveform map are regarded as matching.

The indication signal identification method provided by the embodiment of the invention obtains the target video data of the target equipment; carrying out image recognition on target video data, and determining a target image characteristic sequence corresponding to the target video data; and finally, determining the target indication type of the target equipment according to the target image characteristic sequence. Therefore, the method for identifying the indicating signal provided by the embodiment of the invention can automatically determine the target image feature sequence according to the target video data so as to determine the target indicating type corresponding to the target image feature sequence, thereby improving the efficiency and the accuracy of identifying the indicating signal.

Fig. 4 shows a schematic block diagram of an indication signal identification system according to an embodiment of the present invention. As shown in FIG. 4, the instructional signal recognition system 200 is one or more program modules stored in a memory and executed by one or more processors to implement the present application, which means a sequence of computer program instructions that implement the specified functions.

The indication signal recognition system 200 includes: an acquisition module 201, a recognition module 202 and a determination module 203.

In an optional manner, the obtaining module 201 is configured to obtain target video data of a target device. The identifying module 202 is configured to perform image identification on the target video data, and determine a target image feature sequence corresponding to the target video data. A determining module 203, configured to determine a target indication type of the target device according to the target image feature sequence.

In an alternative manner, the identification module 202 is further configured to: determining a plurality of image frames contained in the target video data and timestamps corresponding to the image frames; respectively carrying out image recognition on each image frame to obtain sub-image characteristics corresponding to each image frame; and combining the sub-image features according to the time stamp to obtain the target image feature sequence.

In an alternative manner, the identification module 202 is further configured to: matching the target image characteristic sequence with a plurality of selectable indication signal characteristic sequences respectively; wherein each selectable indication signal characteristic sequence corresponds to a selectable indication type; and determining the optional indication type corresponding to the matched optional indication signal characteristic sequence as the target indication type of the target device.

In an optional manner, the determining module 203 is further configured to: matching the target image characteristic sequence with a plurality of selectable indication signal characteristic sequences respectively; wherein each selectable indication signal characteristic sequence corresponds to a selectable indication type; and determining the optional indication type corresponding to the matched optional indication signal characteristic sequence as the target indication type of the target device.

In an alternative manner, the identification module 202 is further configured to: combining all the sub-image features according to the time stamp sequence to obtain a feature sequence of the image to be processed; acquiring an indication signal transmission protocol of the target equipment; determining a sequence period parameter according to the indication signal transmission protocol; extracting the characteristic sequence of the image to be processed according to the sequence period parameter to obtain the characteristic sequence of the target image; wherein the target image feature sequence comprises at least one sequence output period; the sequence output period is the output period of the selectable indication signal characteristic sequence.

In an optional manner, the sequence period parameter includes a first flag bit and a second flag bit, where the first flag bit and the second flag bit are respectively used to characterize the start and the end of the sequence output period; the identification module 202 is further configured to: identifying the first zone bit and the second zone bit in the image feature sequence to be processed; determining the image feature sequence to be processed between the first flag bit and the second flag bit which are identified to be adjacent to each other as the target image feature sequence.

In an optional manner, the sequence period parameter further includes a target sequence length; the target sequence length is a sequence length corresponding to one sequence output period; the identification module 202 is further configured to: detecting adjacent and repeated image features in the image feature sequence to be processed by taking the length of the target sequence as a detection step length; and determining the target image characteristic sequence according to the detection result.

In an alternative manner, the identification module 202 is further configured to: sampling the target video data according to a preset sampling frequency to obtain a plurality of image frames; and determining the time stamp corresponding to each image frame according to the time stamp of each image frame in the target video data.

In an alternative manner, the identification module 202 is further configured to: acquiring an indication signal transmission protocol of the target equipment; determining the output period duration according to the indication signal transmission protocol; the output period duration is duration corresponding to one sequence output period; determining a sampling proportion according to the sampling frequency and the output period duration; restoring the target image feature sequence according to the sampling proportion to obtain an original image feature sequence; wherein, the sequence length of the original image feature sequence is the length of the target sequence; matching the original image feature sequence with each selectable indication signal feature sequence respectively; determining the matched optional indication signal characteristic sequence as a target indication signal characteristic sequence; and determining the indication type corresponding to the target indication signal characteristic sequence as the target indication type.

In an optional manner, the determining module 203 is further configured to: determining a target image characteristic oscillogram according to the target image characteristic sequence; the abscissa of the target image characteristic oscillogram is time, and the ordinate is an image characteristic value; determining an optional indication signal waveform diagram according to the optional indication signal characteristic sequence; the abscissa of the selectable indication signal waveform diagram is time, and the ordinate is an indication signal characteristic value; performing waveform matching on the target image characteristic waveform diagram and the optional indication signal waveform diagram; and determining the optional indication signal characteristic sequence corresponding to the matched optional indication signal waveform diagram as the target indication signal characteristic sequence.

The indicating signal identification device provided by the embodiment of the invention acquires the target video data of the target equipment; carrying out image recognition on target video data, and determining a target image characteristic sequence corresponding to the target video data; and finally, determining the target indication type of the target equipment according to the target image characteristic sequence. Therefore, the method and the device for identifying the indicating signal are different from the problem that the efficiency and the accuracy of manual identification of the indicating signal are low in the prior art, the indicating signal identifying device provided by the embodiment of the invention can automatically determine the target image feature sequence according to the target video data, so that the target indicating type corresponding to the target image feature sequence is determined, and the efficiency and the accuracy of identification of the indicating signal are improved.

Fig. 5 is a schematic structural diagram of an indication signal identification device according to an embodiment of the present invention, and the specific embodiment of the present invention does not limit the specific implementation of the indication signal identification device.

As shown in fig. 5, the indication signal recognition apparatus may include: a processor (processor)302, a communication Interface 304, a memory 306, and a communication bus 308. Wherein: the processor 302, communication interface 304, and memory 306 communicate with each other via a communication bus 308. A communication interface 304 for communicating with network elements of other devices, such as clients or other servers. The processor 302 is configured to execute the indication signal identification system 200, and may specifically execute the relevant steps in the above-described embodiment of the indication signal identification method.

In particular, the indication signal recognition system 200 may include one or more program modules (refer to fig. 4) composed of program code including computer-executable instructions.

The processor 302 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement an embodiment of the present invention. The one or more processors included in the instruction signal recognition device may be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.

The memory 306 is used for storing the indication signal identification program composing the indication signal identification system 200. Memory 306 may comprise high-speed RAM memory and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

The indication signal recognition program constituting the indication signal recognition system 200 may specifically be invoked by the processor 302 to cause the indication signal recognition apparatus to perform the following operations: acquiring target video data of target equipment; performing image recognition on the target video data, and determining a target image feature sequence corresponding to the target video data; and determining the target indication type of the target equipment according to the target image feature sequence.

In an alternative manner, the instruction signal recognition program that makes up the instruction signal recognition system 200 is invoked by the processor 302 to cause the instruction signal recognition device to: determining a plurality of image frames contained in the target video data and timestamps corresponding to the image frames; respectively carrying out image recognition on each image frame to obtain sub-image characteristics corresponding to each image frame; and combining the sub-image features according to the time stamp to obtain the target image feature sequence.

In an alternative manner, the instruction signal recognition program that makes up the instruction signal recognition system 200 is invoked by the processor 302 to cause the instruction signal recognition device to: matching the target image characteristic sequence with a plurality of selectable indication signal characteristic sequences respectively; wherein each selectable indication signal characteristic sequence corresponds to a selectable indication type; and determining the optional indication type corresponding to the matched optional indication signal characteristic sequence as the target indication type of the target device.

In an alternative manner, the instruction signal recognition program that makes up the instruction signal recognition system 200 is invoked by the processor 302 to cause the instruction signal recognition device to: combining all the sub-image features according to the time stamp sequence to obtain a feature sequence of the image to be processed; acquiring an indication signal transmission protocol of the target equipment; determining a sequence period parameter according to the indication signal transmission protocol; extracting the characteristic sequence of the image to be processed according to the sequence period parameter to obtain the characteristic sequence of the target image; wherein the target image feature sequence comprises at least one sequence output period; the sequence output period is the output period of the selectable indication signal characteristic sequence.

In an optional manner, the sequence period parameter includes a first flag bit and a second flag bit, where the first flag bit and the second flag bit are respectively used to characterize the start and the end of the sequence output period; the indication signal recognition program constituting the indication signal recognition system 200 is called by the processor 302 to cause the indication signal recognition apparatus to perform the following operations: identifying the first zone bit and the second zone bit in the image feature sequence to be processed; determining the image feature sequence to be processed between the first flag bit and the second flag bit which are identified to be adjacent to each other as the target image feature sequence.

In an optional manner, the sequence period parameter further includes a target sequence length; the target sequence length is a sequence length corresponding to one sequence output period; the program 310 is invoked by the processor 302 to cause the signal recognition device to perform the following operations: detecting adjacent and repeated image features in the image feature sequence to be processed by taking the length of the target sequence as a detection step length; and determining the target image characteristic sequence according to the detection result.

In an alternative manner, the instruction signal recognition program that makes up the instruction signal recognition system 200 is invoked by the processor 302 to cause the instruction signal recognition device to: sampling the target video data according to a preset sampling frequency to obtain a plurality of image frames; and determining the time stamp corresponding to each image frame according to the time stamp of each image frame in the target video data.

In an alternative manner, the instruction signal recognition program that makes up the instruction signal recognition system 200 is invoked by the processor 302 to cause the instruction signal recognition device to: acquiring an indication signal transmission protocol of the target equipment; determining the output period duration according to the indication signal transmission protocol; the output period duration is duration corresponding to one sequence output period; determining a sampling proportion according to the sampling frequency and the output period duration; restoring the target image feature sequence according to the sampling proportion to obtain an original image feature sequence; wherein, the sequence length of the original image feature sequence is the length of the target sequence; matching the original image feature sequence with each selectable indication signal feature sequence respectively; determining the matched optional indication signal characteristic sequence as a target indication signal characteristic sequence; and determining the indication type corresponding to the target indication signal characteristic sequence as the target indication type.

In an alternative manner, the instruction signal recognition program that makes up the instruction signal recognition system 200 is invoked by the processor 302 to cause the instruction signal recognition device to: determining a target image characteristic oscillogram according to the target image characteristic sequence; the abscissa of the target image characteristic oscillogram is time, and the ordinate is an image characteristic value; determining an optional indication signal waveform diagram according to the optional indication signal characteristic sequence; the abscissa of the selectable indication signal waveform diagram is time, and the ordinate is an indication signal characteristic value; performing waveform matching on the target image characteristic waveform diagram and the optional indication signal waveform diagram; and determining the optional indication signal characteristic sequence corresponding to the matched optional indication signal waveform diagram as the target indication signal characteristic sequence.

The indication signal identification equipment provided by the embodiment of the invention acquires the target video data of the target equipment; carrying out image recognition on target video data, and determining a target image characteristic sequence corresponding to the target video data; and finally, determining the target indication type of the target equipment according to the target image characteristic sequence. Therefore, the method is different from the problem that the efficiency and the accuracy of manual identification of the indicating signal are low in the prior art, the indicating signal identification equipment provided by the embodiment of the invention can automatically determine the target image feature sequence according to the target video data, so that the target indicating type corresponding to the target image feature sequence is determined, and the efficiency and the accuracy of indicating signal identification are improved.

An embodiment of the present invention provides a computer-readable storage medium, where the storage medium stores at least one executable instruction, and when the executable instruction is executed on an indication signal identification device, the indication signal identification device is caused to execute an indication signal identification method in any method embodiment described above.

The executable instructions may be specifically configured to cause the indication signal recognition device to perform the following operations: acquiring target video data of target equipment; performing image recognition on the target video data, and determining a target image feature sequence corresponding to the target video data; and determining the target indication type of the target equipment according to the target image feature sequence.

In an alternative form, the executable instructions cause the indication signal identification device to: determining a plurality of image frames contained in the target video data and timestamps corresponding to the image frames; respectively carrying out image recognition on each image frame to obtain sub-image characteristics corresponding to each image frame; and combining the sub-image features according to the time stamp to obtain the target image feature sequence.

In an alternative form, the executable instructions cause the indication signal identification device to: matching the target image characteristic sequence with a plurality of selectable indication signal characteristic sequences respectively; wherein each selectable indication signal characteristic sequence corresponds to a selectable indication type; and determining the optional indication type corresponding to the matched optional indication signal characteristic sequence as the target indication type of the target device.

In an alternative form, the executable instructions cause the indication signal identification device to: combining all the sub-image features according to the time stamp sequence to obtain a feature sequence of the image to be processed; acquiring an indication signal transmission protocol of the target equipment; determining a sequence period parameter according to the indication signal transmission protocol; extracting the characteristic sequence of the image to be processed according to the sequence period parameter to obtain the characteristic sequence of the target image; wherein the target image feature sequence comprises at least one sequence output period; the sequence output period is the output period of the selectable indication signal characteristic sequence.

In an optional manner, the sequence period parameter includes a first flag bit and a second flag bit, where the first flag bit and the second flag bit are respectively used to characterize the start and the end of the sequence output period; the executable instructions cause the indication signal identification device to: identifying the first zone bit and the second zone bit in the image feature sequence to be processed; determining the image feature sequence to be processed between the first flag bit and the second flag bit which are identified to be adjacent to each other as the target image feature sequence.

In an optional manner, the sequence period parameter further includes a target sequence length; the target sequence length is a sequence length corresponding to one sequence output period; the executable instructions cause the indication signal identification device to: detecting adjacent and repeated image features in the image feature sequence to be processed by taking the length of the target sequence as a detection step length; and determining the target image characteristic sequence according to the detection result.

In an alternative form, the executable instructions cause the indication signal identification device to: sampling the target video data according to a preset sampling frequency to obtain a plurality of image frames; and determining the time stamp corresponding to each image frame according to the time stamp of each image frame in the target video data.

In an alternative form, the executable instructions cause the indication signal identification device to: acquiring an indication signal transmission protocol of the target equipment; determining the output period duration according to the indication signal transmission protocol; the output period duration is duration corresponding to one sequence output period; determining a sampling proportion according to the sampling frequency and the output period duration; restoring the target image feature sequence according to the sampling proportion to obtain an original image feature sequence; wherein, the sequence length of the original image feature sequence is the length of the target sequence; matching the original image feature sequence with each selectable indication signal feature sequence respectively; determining the matched optional indication signal characteristic sequence as a target indication signal characteristic sequence; and determining the indication type corresponding to the target indication signal characteristic sequence as the target indication type.

In an alternative form, the executable instructions cause the indication signal identification device to: determining a target image characteristic oscillogram according to the target image characteristic sequence; the abscissa of the target image characteristic oscillogram is time, and the ordinate is an image characteristic value; determining an optional indication signal waveform diagram according to the optional indication signal characteristic sequence; the abscissa of the selectable indication signal waveform diagram is time, and the ordinate is an indication signal characteristic value; performing waveform matching on the target image characteristic waveform diagram and the optional indication signal waveform diagram; and determining the optional indication signal characteristic sequence corresponding to the matched optional indication signal waveform diagram as the target indication signal characteristic sequence.

The computer-readable storage medium provided by the embodiment of the invention acquires target video data of target equipment; carrying out image recognition on target video data, and determining a target image characteristic sequence corresponding to the target video data; and finally, determining the target indication type of the target equipment according to the target image characteristic sequence. Therefore, the problem that the efficiency and the accuracy of manual identification of the indication signal are low in the prior art is solved, and the computer-readable storage medium provided by the embodiment of the invention can automatically determine the target image feature sequence according to the target video data so as to determine the target indication type corresponding to the target image feature sequence, thereby improving the efficiency and the accuracy of identification of the indication signal.

The embodiment of the invention provides an indication signal identification device, which is used for executing the indication signal identification method.

Embodiments of the present invention provide a computer program that can be invoked by a processor to cause an indication signal identification device to perform an indication signal identification method in any of the above-described method embodiments.

Embodiments of the present invention provide a computer program product comprising a computer program stored on a computer-readable storage medium, the computer program comprising program instructions that, when run on a computer, cause the computer to perform the method of identifying an indication signal in any of the above-mentioned method embodiments.

The algorithms or displays presented herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. In addition, embodiments of the present invention are not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.

The steps in the above embodiments should not be construed as limiting the order of execution unless specified otherwise. The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application, or which are directly or indirectly applied to other related technical fields, are included in the scope of the present application.

完整详细技术资料下载
上一篇:石墨接头机器人自动装卡簧、装栓机
下一篇:一种基于无线网络的人体姿态识别方法

网友询问留言

已有0条留言

还没有人留言评论。精彩留言会获得点赞!

精彩留言,会给你点赞!