1. The utility model provides an intelligent home systems based on edge gateway, includes cloud platform, edge computing gateway and task processor, its characterized in that: the cloud platform is a data center used for analyzing, integrating and processing the data uploaded by the intelligent home system, and the edge computing gateway is gateway equipment defined by an edge computing base number; the task processor is a program module with the capability of processing tasks distributed by the edge computing gateway, the cloud platform and the edge computing gateway compress and transmit data in a knowledge distillation mode, and the edge computing gateway is used for realizing the functions of task coordination and information identification and splitting through a scheduling strategy and a related communication protocol.

2. The intelligent home system based on the edge gateway of claim 1, wherein: the edge computing gateway is connected with the sensor nodes and the actuator nodes in a wireless communication mode, and receives information uploaded by the sensor nodes and controls the actuator nodes to drive.

3. The intelligent home system based on the edge gateway of claim 2, wherein: the sensor nodes are a camera, a smoke detection sensor, a vibration sensor and CO₂Any one or a combination of several of the sensors; the actuator node is any one or a combination of a plurality of door control switches, fresh air valves and air conditioner switches; the wireless communication mode is any one of ZigBee, Bluetooth and Wi-Fi.

4. The intelligent housing system based on the edge gateway as claimed in claim 3, wherein: the communication protocol adopts a subscription-release type MQTT communication protocol, and an MQTT server is arranged in the edge computing gateway; the sensor node and the actuator node are clients of the MQTT.

5. The utility model provides an intelligent home systems's application based on edge gateway which characterized in that: the intelligent home system based on the edge gateway, according to claim 4, comprises the following steps:

s1: the cloud platform transmits the initialized prediction model to the edge computing gateway through knowledge distillation;

s2: the edge computing gateway collects data information through the sensor nodes, compresses the model through a knowledge distillation method and transmits the data information to the cloud platform;

s3: the cloud platform receives data information transmitted by the edge computing gateway, optimizes the model after batch modification, and returns a data processing task to the edge computing gateway through network communication transmission;

s4: the edge computing gateway further optimizes the returned model, formulates a scheduling strategy and then dispatches the tasks to the task processor;

s5: the task processor acquires distribution data sent by the edge computing gateway through network connection, processes the distribution task, and then transmits processed information back to the edge computing gateway;

s6: the edge computing gateway integrates the processing information of the task processor, and sends an instruction to an application system in a network connection mode to realize the control of the actuator node.

6. The application of the intelligent home system based on the edge gateway, according to claim 5, is characterized in that: the scheduling policy in S4 is dynamically changed by monitoring the resource space and the working state of the task manager through the edge computing gateway.

7. The application of the intelligent home system based on the edge gateway, according to claim 6, is characterized in that: when a scheduling strategy is executed, the edge computing gateway preferentially distributes tasks to the task processor with the highest data information processing efficiency, when the workload of the task processor with the highest efficiency is saturated, the task processor with the second processing efficiency is distributed, or the task processor with the lower processing efficiency carries out partial data information processing, when the task processor with the high processing efficiency finishes the current task, the data information is preferentially processed, and the task processor with the low processing efficiency assists the task processor with the high processing efficiency.

8. The application of the intelligent home system based on the edge gateway, according to claim 7, is characterized in that: when the scheduling strategy is applied: dividing tasks into a series of flows, and dividing the relation among the flows into parallel or sequence; the flow stages which can be parallel in different tasks are processed simultaneously under the condition of sufficient resource allocation, and scheduling and sequencing are carried out if the resource allocation is insufficient; and setting a degradation threshold value aiming at the parallel flow stages in the same task, and scheduling the information processing of the flow stages by combining the sequence of the task level and the flow level.

9. The application of the intelligent home system based on the edge gateway, according to claim 8, is characterized in that: when information confidentiality is required in the scheduling strategy, the data information in the neural network is segmented from the full-connection layer, and two parts of data information from the same object are distributed to different task processors.

Background

With the acceleration of social informatization, the relation between work, life, communication and information of people is increasingly tight. The information-based society also provides challenges to traditional houses while changing the life style and working habits of people, and the concept of people is changed greatly along with the social, technical and economic progress. People have long required home not only physical space, but also a safe, convenient and comfortable home environment. Therefore, home intelligence and smart homes are gradually popularized, and home intelligence is the capability of realizing home safety, comfort, information interaction and communication through facilities of a home intelligent management system. The household intelligent system comprises the following three aspects: (1) home security precautions (HS); (2) home device automation (HA); (3) home Communications (HC).

The home is intelligent and convenient to live, the traditional gateway directly uploads the data which is not processed to the cloud platform, and the working efficiency of the center end is influenced when a large amount of invalid data aggravates broadband loads.

Disclosure of Invention

The invention aims to solve the technical problems of invalid data accumulation and insufficient working efficiency in the prior art.

In order to achieve the purpose, the invention adopts the following technical scheme:

an intelligent home system based on an edge gateway comprises a cloud platform, an edge computing gateway and a task processor, wherein the cloud platform is a data center used for analyzing, integrating and processing data uploaded by the intelligent home system, and the edge computing gateway is gateway equipment defined by an edge computing base number; the task processor is a program module with the capability of processing tasks distributed by the edge computing gateway, the cloud platform and the edge computing gateway compress and transmit data in a knowledge distillation mode, and the edge computing gateway is used for realizing the functions of task coordination and information identification and splitting through a scheduling strategy and a related communication protocol.

Preferably, the edge computing gateway is connected with the sensor node and the actuator node in a wireless communication mode, and receives information uploaded by the sensor node and controls the actuator node to drive.

Preferably, the sensor node is any one or a combination of a camera, a smoke detection sensor, a vibration sensor and a CO2 sensor; the actuator node is any one or a combination of a plurality of door control switches, fresh air valves and air conditioner switches; the wireless communication mode is any one of ZigBee, Bluetooth and Wi-Fi.

Preferably, the communication protocol adopts a subscription-release type MQTT communication protocol, and an MQTT server is arranged in the edge computing gateway; the sensor node and the actuator node are clients of the MQTT.

The application also provides an application of the intelligent home system based on the edge gateway, and the intelligent home system based on the edge gateway comprises the following steps:

s1: the cloud platform transmits the initialized prediction model to the edge computing gateway through knowledge distillation;

s2: the edge computing gateway collects data information through the sensor nodes, compresses the model through a knowledge distillation method and transmits the data information to the cloud platform;

s3: the cloud platform receives data information transmitted by the edge computing gateway, optimizes the model after batch modification, and returns a data processing task to the edge computing gateway through network communication transmission;

s4: the edge computing gateway further optimizes the returned model, formulates a scheduling strategy and then dispatches the tasks to the task processor;

s5: the task processor acquires distribution data sent by the edge computing gateway through network connection, processes the distribution task, and then transmits processed information back to the edge computing gateway;

s6: the edge computing gateway integrates the processing information of the task processor, and sends an instruction to an application system in a network connection mode to realize the control of the actuator node.

Preferably, the scheduling policy in S4 is dynamically changed by monitoring the resource space and the working state of the task manager through the edge computing gateway.

Preferably, when executing the scheduling policy, the edge computing gateway preferentially assigns the task to the task processor with the highest data information processing efficiency, and when the workload of the task processor with the highest efficiency is saturated, the task processor with the second processing efficiency is assigned, or the task processor with the lower processing efficiency performs partial data information processing, and when the task processor with the high processing efficiency completes the current task, the task processor with the low processing efficiency preferentially processes the data information, and assists the task processor with the high processing efficiency.

Preferably, when the scheduling policy is applied: dividing tasks into a series of flows, and dividing the relation among the flows into parallel or sequence; the flow stages which can be parallel in different tasks are processed simultaneously under the condition of sufficient resource allocation, and scheduling and sequencing are carried out if the resource allocation is insufficient; and setting a degradation threshold value aiming at the parallel flow stages in the same task, and scheduling the information processing of the flow stages by combining the sequence of the task level and the flow level.

Preferably, when information security is required in the scheduling policy, the data information in the neural network is segmented from the fully-connected layer, and two parts of data information from the same object are assigned to different task processors.

Compared with the prior art, the invention has the beneficial effects that:

1. according to the method, the edge computing gateway is used as a coordinator, data information processing work is not completely undertaken, a scheduling strategy is formulated based on task and flow cooperative sensing, task completion time is shortened, and data information processing efficiency is improved;

2. meanwhile, the edge computing gateway and the cloud platform cooperatively adopt a knowledge distillation method to perform compression optimization processing on the model, so that data accumulation is reduced;

3. in the application, the data information in the neural network is segmented from the full connection layer through the edge computing gateway, and the information from the same object is respectively distributed to different task processors, so that the confidentiality of the data information can be realized;

4. according to the method, a subscription-release type MQTT communication protocol is adopted, so that the communication between the sensor nodes, the edge computing gateway and the actuator nodes adopts time-event triggered communication, and the orderliness of data transmission can be ensured.

Drawings

Fig. 1 is a schematic design diagram of an edge gateway-based smart home system in the present application;

fig. 2 is a flowchart of a knowledge distillation method cooperatively adopted by a mid-edge cloud of an edge gateway-based smart home system in the present application;

fig. 3 is a schematic diagram illustrating edge gateway coordinated scheduling design of an edge gateway-based smart home system according to the present application;

FIG. 4 is a simplified diagram of a scheduling strategy based on task and flow cooperative sensing adopted by an edge gateway of an intelligent home system based on the edge gateway in the present application

Fig. 5 is a schematic diagram illustrating segmentation of data information in a neural network at a full connection layer by an edge gateway of an intelligent home system based on the edge gateway in the present application;

fig. 6 is a schematic diagram of an access control device applied in an embodiment of an edge gateway-based smart home system according to the present application;

fig. 7 is a schematic communication diagram of an edge computing gateway, a sensor node, and an actuator node of an edge-gateway-based smart home system according to the present application;

fig. 8 is a time axis of data transmission between an edge computing gateway and a sensor node of an edge-gateway-based smart home system according to the present application.

Illustration of the drawings: 1. a cloud platform; 2. a sensor node; 3. an edge computing gateway; 4. an actuator node; 5. and a task processor.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail with reference to the following embodiments.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and thus the present invention is not limited to the specific embodiments of the present disclosure.

Referring to fig. 1, an intelligent home system based on an edge gateway includes a cloud platform 1, an edge computing gateway 3 and a task processor 5, the cloud platform 1 and the edge computing gateway 3 perform data compression and transmission by a knowledge distillation method, and the edge computing gateway 3 implements functions of task coordination and information identification and splitting by a scheduling policy and a related communication protocol.

In an embodiment, the cloud platform 1 refers to a data center for analyzing, integrating and processing data uploaded by the smart home system, and realizes information correlation with the edge computing gateway 3. The cloud platform 1 is used for realizing data receiving, analyzing and storing functions; after the analysis processing of the data is completed, the teacher network is trained at the cloud, and a prediction model is provided for the edge computing gateway 3 through knowledge distillation.

In one embodiment, the knowledge distillation is used for soft target related to a teacher network as a part of total loss, and is used for guiding student network training and realizing knowledge transfer and divided into a training process and a prediction process. Referring to fig. 2(a), a teacher network in the figure corresponds to a cloud platform 1 of the present application, a student network corresponds to an edge computing gateway 3, the left teacher network performs division operation on a temperature parameter T to complete a distillation process, then soft target is predicted through soft max (flexible maximum transfer function) and is used as a part of total loss, a result is predicted in a step similar to the teacher network in the student network, meanwhile, the student network has normal output without the distillation process and performs cross entropy with hard target to be used as the other part of the total loss, and the two parts are weighted to obtain a final loss result. Fig. 2(b) is a schematic diagram of the prediction process, and after the training is completed, the prediction can be performed according to the transfer function obtained by the training without a distillation process during the prediction. The temperature parameter is to amplify the small probability information, and as the value of T is larger, the soft target is smoother, the information is not distributed on a small number of components in a concentrated manner, which has an amplification effect on the information carried by the small probability component, but may also be interference information, so that it is necessary to select an appropriate temperature parameter T.

The edge computing gateway 3 is gateway equipment defined by an edge computing technology, realizes bidirectional knowledge distillation with the cloud platform 1, performs data acquisition on the intelligent home sensor node 2, drives the actuator node 4, and coordinates and dispatches tasks to the task processor 5. In one embodiment, the edge computing gateway 3 has a bidirectional knowledge distillation function, can optimize a prediction model provided by the cloud platform 1, performs simplified model training, and acquires data of the smart home system sensor node 2 by wireless communication methods such as ZigBee, bluetooth, and Wi-Fi to obtain audio and video, environmental parameters, and the like; and realizes drive control with the actuator node 4 of the smart home through wireless communication.

In one embodiment, referring to fig. 3, the edge computing gateway 3 makes a scheduling policy based on task and flow cooperative sensing by monitoring the resource space and the working state of the task processor 5, and dynamically adjusts task distribution; specifically, the edge computing gateway 3 classifies models and information processing tasks and then distributes the models and the information processing tasks to corresponding task processors 5, a scheduling strategy is formulated according to resource spaces and inherent working states monitored by the edge computing gateway 3, the scheduling sequence of the tasks and the flows in the network is determined, one task is composed of a plurality of flows, the original priority of the flows depends on the sequence of the tasks, and the waste of resources can be generated by independent flow awareness and task awareness application; the inter-stream relation can be divided into parallel and sequence, according to the consumed time of the data stream processing stage, combining task perception, splitting the information processing task, the edge computing gateway 3 makes the scheduling strategy of the task and the stream, and the task processor 5 completes information processing in sequence.

The stream is a basic operation unit, each task is composed of a series of streams, information processing is carried out by taking the streams as a unit, the stream stages of the same type can be processed simultaneously under an unordered condition, and the stream stages of different types cannot be processed simultaneously. The scheduling strategy of task and flow cooperative perception has the advantages that the types of flow stages processed at the same time are not required to be the same, the average flow completion time can be reduced, and the task completion time is shortened.

Referring to fig. 4, taking two tasks as an example, assuming that each task includes two stages 1 and 2, each stage includes two steps a and B, different stream stages have a sequential relationship, different stream stages of the tasks and different stream stages have a parallel relationship, streams in the same stage will equally split resources when processed simultaneously, resulting in an equal ratio increase of processing time, so as to reduce the situation that streams processed simultaneously split resources as much as possible, so that stream sequential processing in the same stage, different stream stages are processed in parallel, i.e. two steps of stream stage 1 are processed sequentially, when processing B step of stream stage 1, the resources of stream stage 2 are idle, and the step before step a of stream stage 2 is completed, in the same unit time, the two steps are performed simultaneously, after the resources of processing a step a in task one are released, step a in stream stage 1 in task two can be processed, and then, the stream stages and steps are processed according to the sequence and the parallel relation, more stream steps are processed in the same time, and the processing efficiency is improved.

In another embodiment, the edge computing gateway 3 may also respectively distribute a single complete data information processing task to the plurality of task processors 5, or may identify and split the collected data information to implement information encryption; specifically, the single and complete collected data information is identified and split in the full connection layer, two parts of data information from the same object are allocated to different task processors 5, and any task processor 5 cannot acquire all data information of the same object, so that information encryption is realized.

Referring to fig. 5, fig. 5(a) is a schematic diagram of a neural network structure, where an implicit layer includes multiple layers, and when each neuron is fully connected to all neurons in a previous layer, the neural network can be a fully connected layer, and the edge computing gateway 3 splits data information in the neural network at the fully connected layer, for example, fig. 5(b) distributes two parts of data information from the same object to different task processors 5, so that any task processor 5 does not have complete data information from the same object, thereby implementing encryption processing of data and ensuring data security.

In an embodiment, the edge computing gateway 3 dynamically changes a scheduling policy by monitoring a resource space and a working state of the task processor 5, so as to realize sensing of a progress of executing tasks of the task processor 5, preferentially dispatch tasks to the task processor 5 with the highest data information processing efficiency, when the workload of the server is saturated, dispatch the tasks to the task processor 5 with the lower processing efficiency, and also enable the task processor 5 with the lower processing efficiency to perform partial data information processing, when the task processor 5 with the higher processing efficiency completes a current task, preferentially process such data information, and the task processor 5 with the lower processing efficiency assists the task processor 5 with the higher processing efficiency to implement round-robin work system, so that the overall operating efficiency can be improved.

For convenience of understanding, the present application provides an example of a specific application, please refer to fig. 6, where fig. 6 is a schematic diagram of the application in an access control system, an access control is connected to an edge computing gateway 3 through a hotspot provided by WiFi, and the edge computing gateway 3 sends an instruction to an access control device according to an information processing result to implement a door opening function, which not only supports a door opening manner of face recognition, but also can adopt door opening manners such as voice control and fingerprint through API.

In one embodiment, the sensor nodes 2 include a camera, a smoke detection sensor, a vibration sensor, a CO2 sensor, and the like; the actuator node 4 comprises an access control switch, a fresh air valve, an air conditioner switch and the like. And in order to ensure that the intelligent home system is convenient to install, the sensor node 2 and the edge computing gateway 3, and the actuator node 4 and the edge computing gateway 3 adopt a wireless communication mode (including Wi-Fi and Bluetooth) to exchange data and transmit commands.

In an embodiment, the communication protocol adopts a subscription-publication MQTT communication protocol, that is, an MQTT server is disposed in the edge computing gateway 3, and the sensor node 2 and the actuator node 4, as MQTT clients, may send data or receive data forwarded by the server. The communication between the sensor nodes 2, the edge computing gateway 3 and the actuator nodes 4 adopts an event-time triggering type communication mode, the communication mode based on event triggering is adopted among the edge computing gateway 3, the sensor nodes 2 and the actuator nodes 4, when abnormal data do not appear in the sensor nodes, the time communication mode is followed, the polling communication period is dynamically programmable, the polling communication period is distributed by a period distribution processing unit in the edge computing gateway 3, when abnormal data appear in the sensor nodes, the abnormal data are processed according to the event communication mode, data transmission is actively carried out to the edge gateway, and when abnormal data appear in a plurality of sensor nodes at the same time, the classified processing is carried out according to the emergency degree, namely the set level.

Referring to fig. 7, an MQTT server is disposed in an edge computing gateway 3, where T is a unit acquisition period, the acquisition periods of each sensor are the same, and after the acquisition period is finished, a sensor node 2 sequentially transmits data information to the edge computing gateway 3, where Tst represents a data information transmission time of a temperature sensor, Tsl represents a data information transmission time of a light intensity meter, Tsg represents a data information transmission time of a gas sensor, Taf represents an instruction transmission time of a fresh air valve, and Tac represents an instruction transmission time of an air conditioner, where, with reference to fig. 8, T is a unit acquisition period, and it is assumed that the transmission times are expressed as follows:

T_st＝T+t₁

T_sl＝T+t₂

T_sg＝T+t₃

after the sensor node 2 detects a period, data information is transmitted to the edge computing gateway 3 at corresponding time points in sequence according to the MQTT instruction, that is, at the time t1, the temperature sensor transmits temperature-related data information, similarly, at the time t2 and the time t3, the information transmission time of the light intensity meter and the gas sensor is respectively, and the edge computing gateway 3 transmits the instruction to the actuator node 4 according to the time sequence, that is, time-triggered communication.

The task processor 5 is a program module having a capability of processing tasks dispatched by the edge computing gateway 3, and in an embodiment, the tasks include image data, temperature and humidity data, light sensation data, and the like. The task processor 5 acquires and processes data information distributed by the edge computing gateway 3 serving as a coordinator through network connection, and returns a processing result to the edge computing gateway 3 through network transmission.

The application also provides an application of the intelligent home system of the edge gateway, and the work flow of the intelligent home system comprises the following steps:

s1: the cloud platform 1 transmits the initialized prediction model to the edge computing gateway 3 through knowledge distillation;

s2: the edge computing gateway 3 acquires data information through the sensor node 2, compresses the model through a knowledge distillation method and transmits the acquired data information to the cloud;

s3: the cloud receives data information transmitted by the edge computing gateway 3, optimizes the model after batch modification, and returns data processing tasks to the edge computing gateway 3 through network communication transmission;

s4: the edge computing gateway 3 further optimizes the returned model, and a scheduling strategy is formulated by monitoring the resource space and the working state of the task processor 5;

s5: the edge computing gateway 3 classifies the data processing tasks, and dispatches the optimized model and the processing tasks according to the configuration performance of the task processor 5 according to the working state of the task processor 5;

s6: the edge computing gateway 3 dynamically monitors the task processor 5 in real time, makes a scheduling strategy, adjusts task allocation according to the task processing process executed by the task processor 5, and performs task scheduling if resources are insufficient.

Specifically, in one embodiment, the edge computing gateway 3 preferentially assigns the task to the task processor 5 with the highest data information processing efficiency, and when the workload of the task processor 5 with the highest efficiency is saturated, assigns the task to the task processor 5 with the second highest processing efficiency, or allows the task processor 5 with the lower processing efficiency to perform partial data information processing, and when the task processor 5 with the higher processing efficiency completes the current task, preferentially processes such data information, and the task processor 5 with the lower processing efficiency assists the task processor 5 with the higher processing efficiency.

When the scheduling strategy is applied, the tasks are divided into a series of flows, and the relationship among the flows can be divided into parallel or sequence; the flow stages which can be parallel in different tasks are processed simultaneously under the condition of sufficient resource allocation, and scheduling and sequencing are carried out if the resource allocation is insufficient; and setting a degradation threshold value aiming at the parallel flow stages in the same task, and scheduling the information processing of the flow stages by combining the sequence of the task level and the flow level.

In one embodiment, the information in the scheduling policy may be kept secret by splitting the data information in the neural network from the fully connected layer, assigning two parts of information from the same object to different task processors 5.

S7: the task processor 5 acquires dispatch data through network connection, processes the distribution task, and then transmits the processed information back to the edge computing gateway 3;

s8: the edge computing gateway 3 integrates the processing information of the task processor 5, sends an instruction to an application system (such as an access control) in a Bluetooth or WiFi wireless communication mode, through an API (application program interface) interface, the actuator node can realize face recognition, the sensor node processes sound or fingerprint image data through information, and the edge computing gateway sends a door opening instruction to the actuator node, so that the sound control and fingerprint door opening functions of the actuator node are realized.

It should be noted that various standard components used in the present invention are commercially available, non-standard components are specially customized, and the connection manner adopted in the present invention, such as bolting, welding, etc., is also a very common means in the mechanical field, and the inventor does not need to describe herein any further.

The above description is only an example of the present invention, and is not intended to limit the present invention, and it is obvious to those skilled in the art that various modifications and variations can be made in the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.