1. Latent fire alarm identification system of power equipment based on machine vision, its characterized in that: the fire disaster detection system comprises an image acquisition module, a fire disaster identification module, an image acquisition range adjustment module and a fire condition confirmation module:

the image acquisition module comprises a plurality of image acquisition devices for respectively acquiring images within an initial distance threshold range;

the fire identification module is used for analyzing and identifying the fire condition in the image and generating a fire identification report, wherein the fire identification report comprises fire occurrence probability and fire position data;

the image acquisition range adjusting module is used for expanding the image acquisition range of the image acquisition device according to the fire identification report;

and the fire confirmation module is used for generating a fire confirmation report according to a fire recognition report generated after the image acquisition range of the image acquisition device is expanded.

2. The machine-vision-based power equipment potential fire alarm identification system of claim 1, wherein:

the image acquisition module stores an initial distance threshold value and a maximum distance threshold value, and also stores a field position range corresponding to a boundary in an image when each image acquisition device acquires the image within the maximum distance threshold value range;

the image acquisition range adjusting module comprises a probability analysis module, a position comparison module and a threshold value expansion module:

the probability analysis module is used for comparing the fire occurrence probability with a probability threshold value to generate a probability comparison result;

the position comparison module is used for comparing the fire position data with the field position range corresponding to each image acquisition device when the fire occurrence probability is higher than a probability threshold value to generate a position comparison result;

and the threshold value expanding module is used for expanding the image acquiring range of the image acquiring device according to the position comparison result.

3. The machine-vision-based power equipment potential fire alarm identification system of claim 2, wherein:

the position comparison result is whether the fire position data is in the corresponding field position range of the image acquisition device or not;

the threshold value expansion module is used for expanding the image acquisition range of the image acquisition device when the fire disaster position data is in the corresponding field position range of the image acquisition device;

the fire identification module is also used for analyzing and identifying the images acquired by the image acquisition devices after the image acquisition range is expanded, and generating fire identification reports corresponding to the images;

and the fire confirmation module is used for generating a fire confirmation report according to the fire identification report corresponding to each image.

4. The machine-vision-based power equipment potential fire alarm identification system of claim 3, wherein: the fire identification module comprises an image cutting module and a flame smoke identification module:

the image cutting module is used for cutting the image acquired by the image acquisition device according to the fire position data to generate a cut image;

and the flame smoke identification module is used for analyzing and identifying the fire condition in the cut image and generating a fire identification report.

5. The machine-vision-based power equipment potential fire alarm identification system of claim 4, wherein: the flame smoke identification module comprises a flame identification module, a smoke identification module, a relative position comparison module and a probability position generation module:

the flame identification module is used for carrying out flame identification on the image and acquiring position data of the flame;

the smoke identification module is used for carrying out smoke identification on the image and acquiring position data of smoke;

the relative position comparison module is used for comparing the relative positions of the flame and the smoke according to the position data of the flame and the position data of the smoke to generate relative position data;

and the probability position generating module is used for generating the fire occurrence probability and fire position data according to the relative position data.

6. The machine-vision-based power equipment potential fire alarm identification system of claim 5, wherein: the fire disaster detection system also comprises a position marking module, a fire disaster detection module and a fire disaster detection module, wherein the position marking module is used for marking the position of the fire disaster and the position of the smoke in an image according to the position data of the fire disaster and the position data of the smoke to generate a fire disaster marking image; the fire confirmation report comprises a fire marking image and fire confirmation information for confirming whether a fire happens or not.

7. The machine-vision-based power equipment potential fire alarm identification system of claim 6, wherein: the labels include circling labels and arrow labels.

8. The machine-vision-based power equipment potential fire alarm identification system of claim 6, wherein: the fire disaster alarming system further comprises an alarming module used for sending alarming information and a fire disaster labeling image to the cloud server when the fire disaster confirming information confirms that a fire disaster occurs.

9. A machine vision-based power equipment potential fire alarm identification method is characterized by comprising the following steps: the method comprises the following steps:

an image acquisition step, wherein images within an initial distance threshold range are acquired;

a fire identification step, wherein the fire condition in the image is analyzed and identified, and a fire identification report is generated, wherein the fire identification report comprises the fire occurrence probability and the fire position data;

an image acquisition range adjusting step of expanding an image acquisition range of an image acquisition device according to the fire identification report;

and a fire confirmation step of generating a fire confirmation report based on the fire recognition report generated after the image acquisition range of the image acquisition device is expanded.

Background

With the development of society and the further expansion of urbanization construction, the problem of preventing indoor and outdoor fires is increasingly outstanding, economic loss and casualties caused by fires are very serious, wherein the fires caused by power equipment faults are numerous, the consequences of the fires caused by the power equipment faults are often beyond the assumption, and sometimes 'fire burning pieces' can be generated to burn a large amount of power equipment, even electric shock casualties can be generated.

Automatic fire alarm systems are currently in widespread use in various fields, such as: smoke alarms are generally adopted for indoor fire detection and alarm, and thermal imaging and infrared combined remote fire protection equipment is generally adopted for forest fire detection. The two fire alarm systems have corresponding defects, firstly, the smoke alarm has requirements on the smoke concentration and the carbon monoxide concentration, the alarm can be carried out and the spray head is started to extinguish a fire only after the fire reaches a certain degree, and for the fire caused by the failure of the power equipment, due to the self characteristics of the power equipment, if the fire is not found in time, the fire rapidly spreads along with the lapse of time, and the consequence is unreasonable; secondly, although the fire detection is carried out by means of thermal imaging and infrared detection, the cost is high, and the cost of a single camera device can reach tens of thousands or even more than hundreds of thousands. Therefore, it is very important to find a fire identification technology which can timely and accurately detect the fire of the electrical equipment and has relatively low manufacturing cost.

Disclosure of Invention

The invention provides a machine vision-based power equipment potential fire alarm recognition system and method, which can detect fire in time and effectively improve the accuracy of fire detection.

The basic scheme provided by the invention is as follows:

latent fire alarm identification system of power equipment based on machine vision acquires module, fire identification module, image acquisition range adjustment module and fire confirmation module including the image:

the image acquisition module comprises a plurality of image acquisition devices for respectively acquiring images within an initial distance threshold range;

the fire identification module is used for analyzing and identifying the fire condition in the image and generating a fire identification report, wherein the fire identification report comprises fire occurrence probability and fire position data;

the image acquisition range adjusting module is used for expanding the image acquisition range of the image acquisition device according to the fire identification report;

and the fire confirmation module is used for generating a fire confirmation report according to a fire recognition report generated after the image acquisition range of the image acquisition device is expanded.

The principle and the advantages of the invention are as follows: in the scheme, the fire disaster condition is identified through the images acquired by the image acquisition devices, and the fire disaster identification report is generated, so that the fire disaster condition can be detected in time, and the aim of early finding and early control is fulfilled; in addition, according to the fire identification report, the image acquisition range of the image acquisition device is expanded, so that the image acquisition range of each image acquisition device can be expanded according to the fire occurrence probability and the fire position data, and therefore, after the image acquisition range is expanded, other image acquisition devices capable of shooting the fire position also acquire images of positions where fire is likely to occur, so that a fire confirmation report is generated according to the fire identification reports generated by the images of the fire occurrence positions acquired by the plurality of image acquisition devices, therefore, when the fire occurrence probability is low, each image acquisition device can be ensured to acquire images only in a small range, the coincidence degree of the images acquired by each image acquisition device is reduced, the workload of a fire identification module is reduced, the working efficiency of the fire identification module is improved, and the fire identification speed of the fire identification module is increased, according to the preliminarily generated fire identification report, the image acquisition range of the image acquisition device is expanded, so that more image acquisition devices can acquire image data of a fire position, the fire condition of the position where the fire possibly occurs can be detected from multiple angles and time points, the detection accuracy is improved, and the fire condition is prevented from being misreported; in addition, compare with the remote fire prevention equipment that adopts thermal imaging and infrared combination to carry out the fire detection, only need in this scheme adopt ordinary image acquisition device can, its cost is lower. To sum up, this scheme of adoption can be timely detect the condition of a fire to effectively improve the accuracy that the condition of a fire detected, its cost adopts the remote fire prevention equipment of thermal imaging and infrared combination relatively to carry out the fire detection lower simultaneously.

Further, the image acquisition module stores an initial distance threshold value and a maximum distance threshold value, and also stores a field position range corresponding to a boundary in an image when each image acquisition device acquires the image within the maximum distance threshold value range;

the image acquisition range adjusting module comprises a probability analysis module, a position comparison module and a threshold value expansion module:

the probability analysis module is used for comparing the fire occurrence probability with a probability threshold value to generate a probability comparison result;

the position comparison module is used for comparing the fire position data with the field position range corresponding to each image acquisition device when the fire occurrence probability is higher than a probability threshold value to generate a position comparison result;

and the threshold value expanding module is used for expanding the image acquiring range of the image acquiring device according to the position comparison result.

Has the advantages that: only when the probability of fire occurrence is higher than the probability threshold, the image acquisition range of the image acquisition device is expanded, so that the identification amount of the fire identification module is reduced, and the efficiency of fire identification is increased. The image acquisition module stores the field position range corresponding to the boundary in the image when each image acquisition device acquires the image within the maximum distance threshold range, so that the maximum range of the image acquired by each image acquisition device in the field can be obtained, and when the image within the maximum distance threshold range is found according to the fire position data in the fire identification report, the image acquisition device capable of acquiring the image at the fire position can be obtained, so that the image acquisition range can be expanded only for the image acquisition device, and the efficiency of fire identification and confirmation can be improved.

Further, the position comparison result is whether the fire position data is in the field position range corresponding to the image acquisition device;

the threshold value expansion module is used for expanding the image acquisition range of the image acquisition device when the fire disaster position data is in the corresponding field position range of the image acquisition device;

the fire identification module is also used for analyzing and identifying the images acquired by the image acquisition devices after the image acquisition range is expanded, and generating fire identification reports corresponding to the images;

and the fire confirmation module is used for generating a fire confirmation report according to the fire identification report corresponding to each image.

Has the advantages that: when the fire position data is in the field position range corresponding to the image acquisition device, the image acquisition range of the image acquisition device is expanded, namely the image acquisition range of the image acquisition device is expanded in a targeted manner, so that the situation that images of positions where fire possibly occurs cannot be acquired and identified is avoided, and the fire identification efficiency is improved.

Further, the fire identification module comprises an image cutting module and a flame smoke identification module:

the image cutting module is used for cutting the image acquired by the image acquisition device according to the fire position data to generate a cut image;

and the flame smoke identification module is used for analyzing and identifying the fire condition in the cut image and generating a fire identification report.

Has the advantages that: after the image acquisition range is expanded, the image area is increased, and if the image with the increased area is subjected to fire identification directly, the area needing identification is large, so that the image acquired by the image acquisition device is cut according to the fire position data, the area of the image is reduced, and the range of fire identification to be carried out is narrowed.

Further, the flame smoke identification module comprises a flame identification module, a smoke identification module, a relative position comparison module and a probability position generation module:

the flame identification module is used for carrying out flame identification on the image and acquiring position data of the flame;

the smoke identification module is used for carrying out smoke identification on the image and acquiring position data of smoke;

the relative position comparison module is used for comparing the relative positions of the flame and the smoke according to the position data of the flame and the position data of the smoke to generate relative position data;

and the probability position generating module is used for generating the fire occurrence probability and fire position data according to the relative position data.

Has the advantages that: the fire and the smoke are identified and position data of the fire and the smoke are respectively obtained, and then the fire occurrence probability and the fire position data are judged according to the relative position data of the fire and the smoke, so that the fire condition false alarm caused by the type conditions of small light flicker, water boiling of an electric kettle and the like is avoided.

The system further comprises a position marking module, a position marking module and a fire disaster marking module, wherein the position marking module is used for marking the position of the flame and the position of the smoke in an image according to the position data of the flame and the position data of the smoke to generate a fire disaster marking image; the fire confirmation report comprises a fire marking image and fire confirmation information for confirming whether a fire happens or not.

Has the advantages that: the positions of the flames and the positions of the smoke are marked, so that the positions of fire disasters can be conveniently checked.

Further, the labels include circling labels and arrow labels.

Has the advantages that: labeling is done in a variety of ways.

And the fire condition confirming information is used for sending alarm information and a fire marking image to the cloud server when confirming that the fire happens.

Has the advantages that: when a fire disaster happens, a user can know the fire disaster condition in time through the alarm information, and the alarm information and the fire disaster marking image can be checked through the cloud server.

A machine vision-based power equipment potential fire alarm identification method is characterized by comprising the following steps: the method comprises the following steps:

an image acquisition step, wherein images within an initial distance threshold range are acquired;

a fire identification step, wherein the fire condition in the image is analyzed and identified, and a fire identification report is generated, wherein the fire identification report comprises the fire occurrence probability and the fire position data;

an image acquisition range adjusting step of expanding an image acquisition range of an image acquisition device according to the fire identification report;

and a fire confirmation step of generating a fire confirmation report based on the fire recognition report generated after the image acquisition range of the image acquisition device is expanded.

Drawings

Fig. 1 is a logic block diagram of a power equipment potential fire alarm recognition system based on machine vision according to an embodiment of the present invention.

Fig. 2 is a flowchart of a method for identifying a potential fire alarm of an electrical device based on machine vision according to an embodiment of the present invention.

Detailed Description

The following is further detailed by way of specific embodiments:

example 1:

example 1 is substantially as shown in figure 1:

latent fire alarm identification system of power equipment based on machine vision acquires module, fire identification module, image acquisition range adjustment module and fire confirmation module including the image:

the image acquisition module comprises a plurality of image acquisition devices for respectively acquiring images within an initial distance threshold range, and in the embodiment, the image acquisition module comprises 4 image acquisition devices arranged in a transverse array manner; the image acquisition module stores an initial distance threshold value and a maximum distance threshold value, and also stores a field position range corresponding to a boundary in an image when each image acquisition device acquires the image within the maximum distance threshold value range;

the fire recognition module is used for analyzing and recognizing the fire condition in the image and generating a fire recognition report, wherein the fire recognition report comprises the fire occurrence probability and fire position data, and the fire position data refers to the fire occurrence point in the image and the position corresponding to the fire occurrence point in the field.

And the image acquisition range adjusting module is used for expanding the image acquisition range of the image acquisition device according to the fire identification report. The image acquisition range adjusting module comprises a probability analysis module, a position comparison module and a threshold value expansion module: the probability analysis module is used for comparing the fire occurrence probability with a probability threshold value to generate a probability comparison result; the position comparison module is used for comparing the position corresponding to the fire occurrence point in the field with the field position range corresponding to each image acquisition device when the fire occurrence probability is higher than a probability threshold value, and generating a position comparison result, wherein the position comparison result is whether the position corresponding to the fire occurrence point in the field is in the field position range corresponding to the image acquisition device or not; the threshold value expanding module is used for expanding the image acquiring range of the image acquiring device when the corresponding position of the fire occurrence point in the field is in the field position range corresponding to the image acquiring device.

The fire identification module is also used for analyzing and identifying the images acquired by the image acquisition devices after the image acquisition range is expanded, and generating fire identification reports corresponding to the images; the fire identification module comprises an image cutting module and a flame smoke identification module: the image cutting module is used for cutting the image acquired by the image acquisition device according to the fire occurrence point in the image to generate a cut image; and the flame smoke identification module is used for analyzing and identifying the fire condition in the cut image and generating a fire identification report. The flame smoke identification module comprises a flame identification module, a smoke identification module, a relative position comparison module and a probability position generation module: the flame identification module is used for carrying out flame identification on the image and acquiring position data of the flame; the smoke identification module is used for carrying out smoke identification on the image and acquiring position data of smoke; the relative position comparison module is used for comparing the relative positions of the flame and the smoke according to the position data of the flame and the position data of the smoke to generate relative position data, and specifically, because the positions of the flame and the smoke have relevance, namely, under a general condition, the position of the flame is below the smoke and the flame and the smoke should have a connection point, in this embodiment, the relative positions of the flame and the smoke are compared, specifically, whether the flame is below the smoke and whether the flame and the smoke have the connection point are analyzed, and a corresponding result is generated; the probability position generating module is used for generating fire occurrence probability and fire position data according to the relative position data, and specifically, when the flame is below the smoke and the flame and the smoke have a connection point, the fire occurrence probability is generated to be 100%; when the flame is above the smoke and the flame and the smoke have no connection point, generating a fire occurrence probability of 20%; the rest of the time, the probability of fire occurrence is 50%.

The fire confirmation module is used for generating a fire recognition report according to the fire recognition report corresponding to each image after the image acquisition range of the image acquisition device is expanded, and generating a fire confirmation report which comprises fire confirmation information for confirming whether the fire happens or not. Specifically, the fire occurrence probability in the fire identification report corresponding to each image is averaged, fire confirmation information for confirming whether a fire occurs is generated according to the average, when the average is higher than 70%, the fire confirmation information for confirming that the fire occurs is generated, otherwise, the fire confirmation information for confirming that the fire does not occur is generated.

The fire disaster identification system further comprises a position marking module, wherein the position marking module is used for marking the position of the flame and the position of the smoke in the image according to the position data of the flame and the position data of the smoke to generate a fire disaster marking image, and the fire disaster confirmation report further comprises the fire disaster marking image. Specifically, in this embodiment, the flame is marked by an arrow, and the smoke is marked by a circle.

The fire disaster alarming system further comprises an alarming module used for sending alarming information and a fire disaster labeling image to the cloud server when the fire disaster confirming information confirms that a fire disaster occurs.

Example 2:

example 2 is substantially as shown in figure 2:

the method for identifying the potential fire alarm of the power equipment based on the machine vision comprises an image acquisition step, a fire identification step, an image acquisition range adjustment step and a fire confirmation step:

in the image obtaining step, a plurality of image obtaining devices are adopted to respectively obtain images within an initial distance threshold range, and in the embodiment, the image obtaining step comprises 4 image obtaining devices arranged in a transverse array mode;

and a fire recognition step of analyzing and recognizing the fire condition in the image and generating a fire recognition report, wherein the fire recognition report comprises the fire occurrence probability and fire position data, and the fire position data refers to the fire occurrence point in the image and the position corresponding to the fire occurrence point in the field.

And the image acquisition range adjusting step is used for expanding the image acquisition range of the image acquisition device according to the fire identification report. The image acquisition range adjusting step comprises a probability analysis step, a position comparison step and a threshold value expanding step: the probability analysis step is to compare the fire occurrence probability with a probability threshold value to generate a probability comparison result; comparing the position corresponding to the fire occurrence point in the field with the field position range corresponding to each image acquisition device when the fire occurrence probability is higher than a probability threshold value, and generating a position comparison result, wherein the position comparison result is whether the position corresponding to the fire occurrence point in the field is in the field position range corresponding to the image acquisition device or not; and a threshold value expansion step of expanding an image acquisition range of the image acquisition device when a position corresponding to the fire occurrence point in the field is within a field position range corresponding to the image acquisition device.

The fire identification step is used for analyzing and identifying the images acquired by the image acquisition devices after the image acquisition range is expanded, and generating fire identification reports corresponding to the images; the fire identification step comprises an image cutting step and a flame smoke identification step: the image cutting step is to cut the image acquired by the image acquisition device according to the fire occurrence point in the image and generate a cut image; and the flame smoke identification step is used for analyzing and identifying the fire condition in the cut image and generating a fire identification report. The flame and smoke identification step comprises a flame identification step, a smoke identification step, a relative position comparison step and a probability position generation step: the flame identification step is to identify the flame of the image and acquire position data of the flame; the smoke identification step is to identify smoke of the image and acquire position data of the smoke; the relative position comparing step compares the relative positions of the flame and the smoke according to the position data of the flame and the position data of the smoke to generate relative position data, and specifically, since the positions of the flame and the smoke have relevance, that is, under a general condition, the position of the flame is below the smoke and the flame and the smoke should have a connection point, in this embodiment, the relative positions of the flame and the smoke are compared, specifically, whether the flame is below the smoke and whether the flame and the smoke have the connection point are analyzed, and a corresponding result is generated; the probability position generating step is to generate fire occurrence probability and fire position data according to the relative position data, and specifically, when the flame is below the smoke and the flame and the smoke have a connection point, the fire occurrence probability is generated to be 100%; when the flame is above the smoke and the flame and the smoke have no connection point, generating a fire occurrence probability of 20%; otherwise, the fire occurrence probability is generated to be 50%.

And a fire confirmation step of generating a fire recognition report including fire confirmation information for confirming whether a fire has occurred, based on the fire recognition report generated based on the fire recognition reports corresponding to the respective images after the image acquisition range of the image acquisition device is expanded. Specifically, the fire occurrence probability in the fire identification report corresponding to each image is averaged, fire confirmation information for confirming whether a fire occurs is generated according to the average, when the average is higher than 70%, the fire confirmation information for confirming that the fire occurs is generated, otherwise, the fire confirmation information for confirming that the fire does not occur is generated.

And a position marking step, marking the position of the flame and the position of the smoke in the image according to the position data of the flame and the position data of the smoke to generate a fire marking image, wherein the fire confirmation report further comprises the fire marking image. Specifically, in this embodiment, the flame is marked by an arrow, and the smoke is marked by a circle.

The method further comprises an alarming step, and when the fire condition confirming information confirms that a fire disaster happens, alarming information and a fire disaster annotation image are sent to the cloud server.

The foregoing are merely exemplary embodiments of the present invention, and no attempt is made to show structural details of the invention in more detail than is necessary for the fundamental understanding of the art, the description taken with the drawings making apparent to those skilled in the art how the several forms of the invention may be embodied in practice with the teachings of the invention. It should be noted that, for those skilled in the art, without departing from the structure of the present invention, several changes and modifications can be made, which should also be regarded as the protection scope of the present invention, and these will not affect the effect of the implementation of the present invention and the practicability of the patent. The scope of the claims of the present application shall be determined by the contents of the claims, and the description of the embodiments and the like in the specification shall be used to explain the contents of the claims.