1. A control method based on face recognition is characterized in that: the method specifically comprises the following steps:

step one, face acquisition: the method comprises the steps that information collection is carried out on all people in a cell through a collection unit (3), namely official authentication information of the people in the cell, such as a house property certificate, a house renting certificate and the like, is authenticated through an address determination module (10), information of an identity card, a family account and the like of the people is verified through an identity authentication module (9), after authentication is completed, face information of the user is collected through a face collection module (14) in an emotion recording unit (5), the face emotion is divided into positive emotion and negative emotion through an emotion division module (15), facial expressions of the people under the positive emotion and the negative emotion are collected through an identification collection module (16), and then the user information is stored in a personal storage module (17);

step two, safety early warning: in the process of face recognition, an access control recognition system (1) detects that a person does not carry out face acquisition on the system, the person directly enters a visitor screening module (18) in a safety early warning unit (6), information exchange is carried out between the person and wanted information on a network through a networking synchronization module (19), the person and face information are recorded through a face comparison module (20), when an inosculation condition occurs, an alarm module (21) is directly started, synchronous alarm is carried out through the networking synchronization module (19), and when the inosculation condition does not occur, information such as identity information, a contact mode, a required place and the like is directly signed at a security department of a community;

step three, network message investigation: short videos or short sentences with the emotion relaxing function are gathered on line directly through a network gathering module (25) in a consolation display unit (8), then information gathered from the network is screened through a manual screening module (26), and then classified storage is carried out through a classified storage module (27) according to the modes of videos and characters;

step four, interactive comfort: in the process of face recognition, after the entrance guard recognition system (1) determines that a person belongs to the cell after comparing the face collected in the first step, the face expression of the person at the moment is recognized through a recognition module (22) in a voice interaction unit (7), then the face expression information under different emotions stored in a personal storage module (17) in the first step is compared and verified, the person is recognized to be in a negative emotion state at the moment, short videos or short sentences collected in the third step are directly played, voice in the videos is broadcasted through a voice broadcast module (23), the face expression of the person watching the videos is collected through a delayed camera module (24), an emotion change monitoring module (11) in a person judging unit (4) starts an atmosphere adjusting unit (28), namely, the face expression of the person before watching the videos is recorded through an initial expression recording module (29), the emotion state of a person is comprehensively analyzed through the watching time length, the body action and the emotion change condition of the person by using a data analysis integration module (32), the facial expression change of the person in the watching process is recorded by using a change recording module (31), when the emotion of the person fluctuates and is improved, the video type played in a short video playing module (12) or the phrase type played by a phrase broadcasting module (13) when the emotion of the person is improved is recorded and is associated with the person in a database, and when the emotion of the person fluctuates again, the video type or the phrase type associated with the person is played.

2. The control method based on the face recognition as claimed in claim 1, wherein: entrance guard's identification system (1) and central processing module (2) realize both way junction, central processing module (2) realizes both way junction with acquisition unit (3), personage judge unit (4), emotion entering unit (5), safety precaution unit (6), pronunciation interactive unit (7) and consolation display element (8) respectively, personage judge unit (4) and atmosphere regulation unit (28) realize both way junction, the output of emotion entering unit (5) is connected with personage judge unit (4), safety precaution unit (6) and pronunciation interactive unit's (7) input respectively.

3. The control method based on the face recognition as claimed in claim 1, wherein: the acquisition unit (3) comprises an identity authentication module (9) and an address determination module (10), wherein the output end of the address determination module (10) is connected with the input end of the identity authentication module (9).

4. The control method based on the face recognition as claimed in claim 1, wherein: the character evaluation unit (4) comprises an emotion change monitoring module (11), a short video playing module (12) and a short sentence broadcasting module (13), and the output end of the emotion change monitoring module (11) is connected with the input ends of the short video playing module (12) and the short sentence broadcasting module (13) respectively.

5. The control method based on the face recognition as claimed in claim 1, wherein: the emotion recording unit (5) comprises a face acquisition module (14), an emotion dividing module (15), an identification acquisition module (16) and a personal storage module (17), the output end of the face acquisition module (14) is connected with the input end of the emotion dividing module (15), the output end of the emotion dividing module (15) is connected with the input end of the identification acquisition module (16), and the output end of the identification acquisition module (16) is connected with the input end of the personal storage module (17).

6. The control method based on the face recognition as claimed in claim 1, wherein: safety precaution unit (6) include visitor screening module (18), networking synchronization module (19), people's face and compare module (20) and alarm module (21), the output of visitor screening module (18) is connected with the input of networking synchronization module (19), the output of networking synchronization module (19) is connected with the input that people's face compared module (20), people's face is compared the output of module (20) and is connected with the input of alarm module (21), the output of alarm module (21) is connected with the input of networking synchronization module (19).

7. The control method based on the face recognition as claimed in claim 1, wherein: voice interaction unit (7) are including discerning affirmation module (22), voice broadcast module (23) and time delay camera module (24), the output of discerning affirmation module (22) is connected with the input of voice broadcast module (23), the output of voice broadcast module (23) is connected with the input of time delay camera module (24).

8. The control method based on the face recognition as claimed in claim 1, wherein: the consolation display unit (8) comprises a network collection module (25), a manual screening module (26) and a classification storage module (27), wherein the output end of the network collection module (25) is connected with the input end of the manual screening module (26), and the output end of the manual screening module (26) is connected with the input end of the classification storage module (27).

9. The control method based on the face recognition as claimed in claim 1, wherein: the atmosphere adjusting unit (28) comprises an initial expression recording module (29), an information recording module (30), a change recording module (31) and a data analysis integration module (32), the output end of the initial expression recording module (29) is connected with the input end of the information recording module (30), the output end of the information recording module (30) is connected with the input end of the change recording module (31), and the output end of the change recording module (31) is connected with the input end of the data analysis integration module (32).

Background

Face recognition is a biometric technique for identifying an identity based on facial feature information of a person. The face recognition uses a camera or a video camera to collect images or video streams containing faces, automatically detects and tracks the faces in the images, and further performs a series of related application operations on the detected face images. The technology comprises image acquisition, feature positioning, identity confirmation and search and the like.

The face recognition type entrance guard is widely used, but the conventional community entrance guard can only recognize information-input personnel and other personnel, so that the entrance guard has a single function, along with the development of a smart community, the face recognition is mature prior art, the application in different application scenes is common, an emotion recognition element is added in the smart community, when the personnel have negative emotions, even consolation, the people often cannot achieve effective consolation effect and easily arouses the negative emotions of the personnel because the emotions of the people are complex and changeable and the system is relatively rigid and only mechanically plays instructions output in advance, so that the entrance guard can continuously detect the expression changes of the personnel, thereby obtaining different ways suitable for different personnel, after emotion recognition, the target is consoled, and the consolation effect is guaranteed.

Disclosure of Invention

Technical problem to be solved

Aiming at the defects of the prior art, the invention provides a control method based on face recognition, and solves the problems of single function and rigid entrance guard.

(II) technical scheme

In order to achieve the purpose, the invention is realized by the following technical scheme: a control method based on face recognition specifically comprises the following steps:

step one, face acquisition: the method comprises the steps that information collection is carried out on all people in a cell through a collection unit, namely official authentication information of the people in the cell, such as a house property certificate, a house renting certificate and the like, is authenticated through an address determination module, information of the people, such as an identity card, a family account book and the like, is verified through an identity authentication module, after authentication is completed, facial information of a user is collected through a face collection module in an emotion recording unit, facial emotion is divided into positive emotion (positive emotion such as happiness and excitement) and negative emotion (negative emotion such as sadness, hate, pain and anger) through an emotion division module, facial expressions of the people under the positive emotion and facial expressions under the negative emotion are collected through an identification collection module, and then the user information is stored in a personal storage module;

step two, safety early warning: in the process of face recognition, an access control recognition system detects that a person does not carry out face acquisition on the system, directly enters a visitor screening module in a safety early warning unit, exchanges information with wanted information on a network through a networking synchronization module, records the person and face information through a face comparison module, directly starts an alarm module when an inosculation condition occurs, carries out synchronous alarm through the networking synchronization module, and directly signs information such as identity information, a contact mode and places needing to go to a security department of a community when the inosculation condition does not occur;

step three, network message investigation: short videos or short sentences with the emotion relaxing function are gathered on line directly through a network gathering module in a consolation display unit, then information gathered on the network is screened through a manual screening module, and then classified storage is carried out through a classified storage module according to the modes of videos and characters;

step four, interactive comfort: in the process of face recognition, after determining that a person belongs to the cell after comparing the face collected in the first step, the entrance guard recognition system identifies the face expression of the person at the moment through an identification module in a voice interaction unit, then compares the face expression information with the face expression information under different emotions stored in a personal storage module in the first step, identifies that the person is in a negative emotion state at the moment, directly plays a short piece of video collected in the third step, broadcasts the voice in the video through a voice broadcast module, collects the face expression of the person after watching the video through a delay camera module, starts an atmosphere adjusting unit through an emotion change monitoring module in a person judging unit, namely records the face expression and the face of the person before watching the video through an initial expression recording module, analyzes and integrates the data through the watching duration, the body action and the emotion change condition of the person, the emotion state of a person is comprehensively analyzed, facial expression changes of the person in the watching process are recorded by using a change recording module, when the emotion of the person fluctuates and is improved, the video types played in a short video playing module when the emotion of the person is improved are recorded, then the mood of the person is analyzed by using a data analysis integration module, the mood of the person is analyzed, the video types and the short text types when the emotion of the person is improved are recorded and are associated with the person ID in a database, and when the emotion of the person fluctuates, the corresponding video types or the short text types associated with the person ID are played.

Preferably, the entrance guard identification system is in bidirectional connection with the central processing module, the central processing module is in bidirectional connection with the acquisition unit, the character evaluation unit, the emotion recording unit, the safety early warning unit, the voice interaction unit and the comfort display unit, and the output end of the emotion recording unit is connected with the input ends of the character evaluation unit, the safety early warning unit and the voice interaction unit.

Preferably, the acquisition unit comprises an identity authentication module and an address determination module, and an output end of the address determination module is connected with an input end of the identity authentication module.

Preferably, the character evaluation unit comprises an emotion change monitoring module, a short video playing module and a short sentence broadcasting module, and the output end of the emotion change monitoring module is connected with the input ends of the short video playing module and the short sentence broadcasting module respectively.

Preferably, the emotion recording unit comprises a face acquisition module, an emotion dividing module, an identification acquisition module and a personal storage module, wherein the output end of the face acquisition module is connected with the input end of the emotion dividing module, the output end of the emotion dividing module is connected with the input end of the identification acquisition module, and the output end of the identification acquisition module is connected with the input end of the personal storage module.

Preferably, the safety precaution unit includes visitor screening module, networking synchronization module, people's face comparison module and alarm module, visitor screening module's output and networking synchronization module's input are connected, networking synchronization module's output and people's face comparison module's input are connected, people's face comparison module's output and alarm module's input are connected, alarm module's output and networking synchronization module's input are connected.

Preferably, the voice interaction unit comprises a recognition and identification module, a voice broadcast module and a time-delay camera module, the output end of the recognition and identification module is connected with the input end of the voice broadcast module, and the output end of the voice broadcast module is connected with the input end of the time-delay camera module.

Preferably, the comfort display unit comprises a network collection module, a manual screening module and a classification storage module, wherein the output end of the network collection module is connected with the input end of the manual screening module, and the output end of the manual screening module is connected with the input end of the classification storage module.

Preferably, the atmosphere adjusting unit comprises an initial expression recording module, an information recording module, a change recording module and a data analysis and integration module, wherein the output end of the initial expression recording module is connected with the input end of the information recording module, the output end of the information recording module is connected with the input end of the change recording module, and the output end of the change recording module is connected with the input end of the data analysis and integration module.

(III) advantageous effects

The invention provides a control method based on face recognition. The method has the following beneficial effects:

(1) the control method based on the face recognition records the facial expressions of the personnel under different emotions when the personnel in the community input the face information, identifies the facial expressions of the personnel when the personnel enter the community through an entrance guard, and when the negative emotion of the personnel is detected, the atmosphere adjusting unit consolidates the personnel in the forms of short videos and reciting short texts, monitors the emotion change of the personnel in real time in the consolation process, can timely change the consolation mode when the emotion deteriorates, thereby continuously carrying out heuristic relief on the emotion of the personnel, flexibly generates different consolation modes aiming at different personnel, further effectively improves the probability of the improvement of the emotion of the personnel, ensures that the personnel have positive emotion after entering the community, and simultaneously carries out consolation type saving on the personnel at the doorway of the community, the communication environment can be provided for personnel in the same cell, and convenience conditions are provided for establishment of a harmonious community.

(2) According to the control method based on the face recognition, through the arrangement of the safety early warning unit, on the basis of the face recognition, the personnel which are not recorded are networked for investigation, so that the safety of the internal environment of a cell can be ensured, police can be assisted to accelerate the pursuit of criminals, and the functionality of entrance guard is improved.

(3) According to the control method based on the face recognition, the emotion of a person is judged by the aid of the system and a manual cooperation mode through the setting of the task judging unit, so that the situation that the entrance guard is damaged due to emotional impatience of the person is avoided when the entrance guard recognition system consols, and long-term stable operation of the system is guaranteed.

Drawings

FIG. 1 is a schematic block diagram of the system of the present invention;

FIG. 2 is a system schematic block diagram of an acquisition unit of the present invention;

FIG. 3 is a schematic block diagram of a system of a person evaluation unit according to the present invention;

FIG. 4 is a system schematic block diagram of the emotion entry unit of the present invention;

FIG. 5 is a system schematic block diagram of the safety precaution unit of the present invention;

FIG. 6 is a system schematic block diagram of a voice interaction unit of the present invention;

FIG. 7 is a schematic block diagram of a system of a comfort display unit of the present invention;

FIG. 8 is a system schematic block diagram of an ambience adjusting unit of the present invention.

In the figure, 1, an entrance guard identification system; 2. a central processing module; 3. a collection unit; 4. a character evaluation unit; 5. an emotion recording unit; 6. a safety early warning unit; 7. a voice interaction unit; 8. a comfort display unit; 9. an identity authentication module; 10. an address determination module; 11. an emotion change monitoring module; 12. a short video playing module; 13. a short sentence broadcasting module; 14. a face acquisition module; 15. an emotion classification module; 16. an identification acquisition module; 17. a personal storage module; 18. a visitor screening module; 19. a networking synchronization module; 20. a face comparison module; 21. an alarm module; 22. identifying and confirming the module; 23. a voice broadcasting module; 24. a time-delay camera module; 25. a network collection module; 26. a manual screening module; 27. a classified storage module; 28. an atmosphere adjusting unit; 29. an initial expression recording module; 30. an information recording module; 31. a change recording module; 32. and a data analysis and integration module.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Referring to fig. 1 to 8, an embodiment of the present invention provides a technical solution: a control method based on face recognition specifically comprises the following steps:

step one, face acquisition: all the personnel in the cell are acquired through the acquisition unit 3, namely official authentication information of the personnel in the cell, such as a house property certificate, a house renting certificate and the like, is authenticated through the address determination module 10, the identity card, a house account book and the like of the personnel are verified through the identity authentication module 9, after the authentication is completed, facial information of the user is acquired through the face acquisition module 14 in the emotion recording unit 5, the facial emotion is divided into positive emotion and negative emotion through the emotion division module 15, the facial expression of the personnel under the positive emotion and the facial expression of the personnel under the negative emotion are acquired through the identification acquisition module 16, and then the user information is stored in the personal storage module 17;

step two, safety early warning: in the process of face recognition, the access control recognition system 1 detects that a person does not carry out face acquisition on the system, directly enters a visitor screening module 18 in a safety early warning unit 6, exchanges information with wanted information on a network through a networking synchronization module 19, records the person and face information through a face comparison module 20, directly starts an alarm module 21 when an inosculation condition occurs, carries out synchronous alarm through the networking synchronization module 19, and directly signs information such as identity information, contact way and places needing to go to a security department of a community when the inosculation condition does not occur;

step three, network message investigation: short videos or short sentences with the emotion relaxing function are gathered on line directly through a network gathering module 25 in the consolation display unit 8, then information gathered on the network is screened through a manual screening module 26, and then classified and stored through a classified storage module 27 according to the modes of videos and characters;

step four, interactive comfort: in the process of face recognition, after the entrance guard recognition system 1 determines that a person belongs to the cell after comparing the face collected in the first step, the face expression of the person at the moment is recognized through the recognition module 22 in the voice interaction unit 7, then the face expression information under different emotions stored in the personal storage module 17 in the first step is compared and verified, the person at the moment is recognized to be in a negative emotion state, short video playing collected in the third step is directly performed, voice in the video is broadcasted through the voice broadcast module 23, then the face expression of the person after watching the video is collected through the delayed camera module 24, the atmosphere adjusting unit 28 is started through the emotion change monitoring module 11 in the character judging unit 4, namely the face expression of the person before watching the video is recorded through the initial expression recording module 29, and the data analysis module is integrated 32, comprehensively analyzing the emotional state of a person through the watching time length, the body actions and the emotion change condition of the person, recording the facial expression change of the person in the watching process by using a change recording module 31, recording the video type played in a short video playing module 12 when the person is in good mood when the emotion of the person fluctuates and has a good mood, analyzing the mood of the person by using a data analysis and integration module 32, recording the video type and the short text type when the emotion of the person is good, associating the video type and the short text type with the person ID in a database, and playing the corresponding video type or the short text type associated with the person ID when the emotion of the person fluctuates,

it should be noted that, when analyzing the mood of the person, judging whether the person has a situation of aggravation of negative emotion, the aggravated situation occurs, playing the video type when the recorded emotion is improved, simultaneously starting the short sentence broadcasting module 13 to broadcast the short message, starting the atmosphere adjusting unit 28 to record again, and recording the short message type played in the short sentence broadcasting module 13 when the emotion of the person is improved, playing the short message type when the recorded emotion is improved, simultaneously closing the playing of the short video playing module 12, only playing the short message broadcasting through the short sentence broadcasting module 13, and under the situation that the emotion is always worsened and the improvement fluctuation is not stable, no video and short message is played any more.

As a preferred scheme, the entrance guard identification system 1 is in bidirectional connection with the central processing module 2, the central processing module 2 is in bidirectional connection with the acquisition unit 3, the character judging unit 4, the emotion recording unit 5, the safety early warning unit 6, the voice interaction unit 7 and the comfort display unit 8 respectively, the output end of the emotion recording unit 5 is connected with the input ends of the character judging unit 4, the safety early warning unit 6 and the voice interaction unit 7 respectively, further, the facial expressions of a person under different emotions are recorded when the person enters the district through the entrance guard, the facial expressions of the person are identified when the person enters the district through the entrance guard, the atmosphere adjusting unit 28 consolidates the person in the form of short video and recitation short text when the emotion of the person is detected to be negative, and the emotion change of the person is monitored in real time in the consolation process, when the emotion worsens, the comfort mode can be timely changed, so that the emotion of the person is continuously and tentatively relieved, different comfort modes are flexibly generated for different persons, the emotion improvement probability of the person is effectively improved, the person is guaranteed to have positive emotion after entering the community, meanwhile, the comfort mode is saved for the person at the entrance of the community, an exchange environment is provided for the person in the same community, and convenience is provided for establishment of a harmonious community.

Preferably, the acquisition unit 3 includes an identity authentication module 9 and an address determination module 10, and an output end of the address determination module 10 is connected to an input end of the identity authentication module 9.

As a preferred scheme, the character evaluation unit 4 includes an emotion change monitoring module 11, a short video playing module 12, and a short sentence broadcasting module 13, and an output end of the emotion change monitoring module 11 is connected to input ends of the short video playing module 12 and the short sentence broadcasting module 13, respectively.

As a preferred scheme, the emotion recording unit 5 includes a face acquisition module 14, an emotion classification module 15, an identification acquisition module 16 and a personal storage module 17, an output end of the face acquisition module 14 is connected with an input end of the emotion classification module 15, an output end of the emotion classification module 15 is connected with an input end of the identification acquisition module 16, and an output end of the identification acquisition module 16 is connected with an input end of the personal storage module 17.

As the preferred scheme, the safety precaution unit 6 comprises a visitor screening module 18, a networking synchronization module 19, a human face comparison module 20 and an alarm module 21, wherein the output end of the visitor screening module 18 is connected with the input end of the networking synchronization module 19, the output end of the networking synchronization module 19 is connected with the input end of the human face comparison module 20, the output end of the human face comparison module 20 is connected with the input end of the alarm module 21, and the output end of the alarm module 21 is connected with the input end of the networking synchronization module 19.

As preferred scheme, voice interaction unit 7 is including discerning affirmation module 22, voice broadcast module 23 and time delay camera module 24, and discernment affirmation module 22's output is connected with voice broadcast module 23's input, and voice broadcast module 23's output is connected with time delay camera module 24's input.

Preferably, the comfort display unit 8 comprises a network collection module 25, a manual screening module 26 and a classification storage module 27, wherein an output end of the network collection module 25 is connected with an input end of the manual screening module 26, and an output end of the manual screening module 26 is connected with an input end of the classification storage module 27, so that the network collection can effectively utilize the network effect to improve the quality of short videos and short texts with the comfort negative emotion function.

Preferably, the atmosphere adjusting unit 28 includes an initial expression recording module 29, an information recording module 30, a change recording module 31 and a data analysis and integration module 32, wherein an output end of the initial expression recording module 29 is connected with an input end of the information recording module 30, an output end of the information recording module 30 is connected with an input end of the change recording module 31, and an output end of the change recording module 31 is connected with an input end of the data analysis and integration module 32.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation. The use of the phrase "comprising one of the elements does not exclude the presence of other like elements in the process, method, article, or apparatus that comprises the element.

Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.