1. A cardio-pulmonary resuscitation training system based on AR augmented reality technology is characterized by comprising a user side, an administrator side and a server side; wherein the content of the first and second substances,

the user side is used for training the cardio-pulmonary resuscitation operation and comprises a training module; the training module comprises an on-site processing training submodule, an external chest compression training submodule and an artificial respiration training submodule; the field processing training submodule is used for realizing the training of field processing on the cardiac resuscitation operation; the chest compression training submodule is used for realizing the training of chest compression operation; the artificial respiration training submodule is used for realizing training of artificial respiration operation;

the administrator terminal is used for managing the conventional management of the system by the administrator;

the server comprises a data acquisition module, a virtual scene generation module, an AR glasses display module and a head tracking module; the data acquisition module is used for acquiring data of the cardiac resuscitation sensor; the virtual scene generation module is used for modeling, managing and drawing various dynamic scenes responsible for cardio-pulmonary resuscitation training; the AR glasses display module is used for displaying a virtual reality fusion scene; the head tracking module is used for tracking the sight line change of a user and projecting a virtual scene in a real environment.

2. The AR augmented reality technology-based cardiopulmonary resuscitation training system of claim 1, wherein the cardiac resuscitation sensor data comprises compression sensor data and airflow sensor data.

3. The AR augmented reality technology-based cardio-pulmonary resuscitation training system according to claim 2, wherein the user end further comprises an assessment module for verifying the effect of the assessment user on learning the cardio-pulmonary resuscitation process, the assessment module comprising a viewing sub-module, a video playback sub-module and a score derivation sub-module.

4. The AR augmented reality technology-based CPR training system of claim 3, wherein the user terminal further comprises an identity authentication module, and the identity authentication module is configured to enable user subscription and user verification.

5. The AR augmented reality technology-based cardio-pulmonary resuscitation training system according to claim 4, wherein the administrator side comprises a rights management module, a user management module, a resource management module and an index management module; the authority management module is used for setting and deleting authority; the user management module is used for adding, inquiring and deleting users; the resource management module is used for importing, exporting and backing up resources; the index management module is used for designing and assigning indexes.

6. The AR augmented reality technology-based cardiopulmonary resuscitation training system of claim 5, wherein the on-site processing training submodule for performing on-site processing on the cardiac resuscitation operation comprises: confirming the safety of the field environment; judging the reaction of the falling patient by tapping the shoulders of the patient or calling the patient by loud sound at the ears of the patient; instructing others to help to dial 120 and searching for the AED; touching the carotid artery of the patient, judging the heartbeat, and observing the fluctuation of the thoracic cavity of the patient to make a breathing judgment; if the carotid artery pulsation of the patient disappears and the respiration stops, immediately starting the chest compression training submodule and the artificial respiration training submodule to carry out five groups of combined cyclic rescue; the patients are rechecked immediately after the five groups of combined cycles are finished; if the patient is not resuscitated after the reinspection is finished, the five groups of combined cycle rescue of external chest compression and artificial respiration are continued.

7. The AR augmented reality technology-based cardio-pulmonary resuscitation training system according to claim 6, wherein the on-site processing training sub-module immediately starts defibrillation of the AED if the AED is in place while chest compression is performed by the chest compression training sub-module; and in the process of executing five groups of cycles, the defibrillation electric level chip automatically analyzes the heart rate condition of the patient every 5 minutes, and if the patient has ventricular fibrillation heart rate, the defibrillator automatically gives a prompt.

8. The AR augmented reality technology-based cardiopulmonary resuscitation training system of claim 7, wherein the cardiopulmonary resuscitation sensor data further comprises voice data collected by an acoustic sensor and gesture data collected by an optical sensor.

9. The AR augmented reality technology-based cardiopulmonary resuscitation training system of claim 8, wherein the training module further comprises a clear airway training sub-module and a post-treatment training sub-module; the unblocked airway training submodule is used for realizing training of clearing foreign matters in the mouth and the nose of a patient and enabling an airway to be unblocked; the post-treatment training submodule is used for training to place or placate a patient.

Background

Cardiopulmonary resuscitation is an essential life-saving measure for saving patients with sudden cardiac arrest. Many schools and training institutions have been performing simulation operations by various means to increase the chances of more cardiopulmonary resuscitation simulation training for the public, but the main population receiving cardiopulmonary resuscitation training is focused on the user population in specific specialties such as nursing, medicine and sports. Most of the existing training for simulating cardiopulmonary resuscitation is training through a rubber human body, and the on-site feeling is poor; meanwhile, the positions and angles of the user and the instructor are different when the large user is trained, and the assessment is mainly judged according to the experience of a teacher, so that the assessment objectivity and efficiency are difficult to guarantee. Traditional cardiopulmonary resuscitation training requires the use of a physical model or a human drill. The final training effect of the cardiopulmonary resuscitation of students is influenced by the defects that human body model resources are short, the human body drilling is inconvenient and smooth in artificial respiration and other links, and the objectivity is insufficient due to the fact that teachers check according to experience.

Disclosure of Invention

In view of the above problems, the present invention provides a cardiopulmonary resuscitation training system based on an AR augmented reality technology, so as to solve the problem that the existing cardiopulmonary resuscitation training system has a poor training effect on cardiopulmonary resuscitation operation.

A cardio-pulmonary resuscitation training system based on AR augmented reality technology comprises a user side, an administrator side and a server side; wherein the content of the first and second substances,

the user side is used for training the cardio-pulmonary resuscitation operation and comprises a training module; the training module comprises an on-site processing training submodule, an external chest compression training submodule and an artificial respiration training submodule; the field processing training submodule is used for realizing the training of field processing on the cardiac resuscitation operation; the chest compression training submodule is used for realizing the training of chest compression operation; the artificial respiration training submodule is used for realizing training of artificial respiration operation;

the administrator terminal is used for managing the conventional management of the system by the administrator;

the server comprises a data acquisition module, a virtual scene generation module, an AR glasses display module and a head tracking module; the data acquisition module is used for acquiring data of the cardiac resuscitation sensor; the virtual scene generation module is used for modeling, managing and drawing various dynamic scenes responsible for cardio-pulmonary resuscitation training; the AR glasses display module is used for displaying a virtual reality fusion scene; the head tracking module is used for tracking the sight line change of a user and projecting a virtual scene in a real environment.

Further, the cardiac resuscitation sensor data includes compression sensor data and airflow sensor data.

Furthermore, the user side further comprises an examination module, the examination module is used for examining the effect of the examination user on the study of the cardiopulmonary resuscitation process, and the examination module comprises a viewing submodule, a video playback submodule and a result deriving submodule.

Furthermore, the user side further comprises an identity authentication module, and the identity authentication module is used for realizing user reservation and user verification.

Furthermore, the administrator terminal comprises a permission management module, a user management module, a resource management module and an index management module; the authority management module is used for setting and deleting authority; the user management module is used for adding, inquiring and deleting users; the resource management module is used for importing, exporting and backing up resources; the index management module is used for designing and assigning indexes.

Further, the specific steps of performing on-site treatment on the cardiac resuscitation operation in the on-site treatment training submodule include: confirming the safety of the field environment; judging the reaction of the falling patient by tapping the shoulders of the patient or calling the patient by loud sound at the ears of the patient; instructing others to help to dial 120 and searching for the AED; touching the carotid artery of the patient, judging the heartbeat, and observing the fluctuation of the thoracic cavity of the patient to make a breathing judgment; if the carotid artery pulsation of the patient disappears and the respiration stops, immediately starting the chest compression training submodule and the artificial respiration training submodule to carry out five groups of combined cyclic rescue; the patients are rechecked immediately after the five groups of combined cycles are finished; if the patient is not resuscitated after the reinspection is finished, the five groups of combined cycle rescue of external chest compression and artificial respiration are continued.

Furthermore, when the training submodule for the on-site processing carries out chest compression through the chest compression training submodule, if the AED is in place, the AED is started to carry out defibrillation immediately; and in the process of executing five groups of cycles, the defibrillation electric level chip automatically analyzes the heart rate condition of the patient every 5 minutes, and if the patient has ventricular fibrillation heart rate, the defibrillator automatically gives a prompt.

Further, the cardiac resuscitation sensor data further includes voice data collected by an acoustic sensor and gesture data collected by an optical sensor.

Further, the training module further comprises a smooth airway training sub-module and a post-treatment training sub-module; the unblocked airway training submodule is used for realizing training of clearing foreign matters in the mouth and the nose of a patient and enabling an airway to be unblocked; the post-treatment training submodule is used for training to place or placate a patient.

The beneficial technical effects of the invention are as follows:

the cardio-pulmonary resuscitation training system provided by the invention can enable a user to watch a three-dimensional immersive virtual picture through an augmented reality technology, and can overlay the three-dimensional immersive virtual picture with a scene in the real world, so that the user can have an immersive feeling during cardio-pulmonary resuscitation, and a better training effect is achieved.

The training of cardio-pulmonary resuscitation is converted into the autonomous training by utilizing the augmented reality technology, the training is the combination of the virtual reality technology and the field of medical emergency training, the functional design is carried out through the analysis and design of the augmented reality system, the traditional flow of cardio-pulmonary resuscitation is optimized, and the autonomous training of the cardio-pulmonary resuscitation of a user can be realized by utilizing the system.

Drawings

The invention may be better understood by referring to the following description in conjunction with the accompanying drawings, in which like reference numerals are used throughout the figures to indicate like or similar parts. The accompanying drawings, which are incorporated in and form a part of this specification, illustrate preferred embodiments of the present invention and, together with the detailed description, serve to further explain the principles and advantages of the invention.

FIG. 1 is a schematic structural diagram of a training system for cardiopulmonary resuscitation based on AR augmented reality technology according to the present invention;

FIG. 2 is a diagram of a training system for CPR based on AR augmented reality technology according to an embodiment of the present invention;

FIG. 3 is a schematic view of a Hololens glasses configuration in an embodiment of the present invention;

FIG. 4 is a schematic diagram of a CPR sensor configuration in accordance with an embodiment of the present invention;

FIG. 5 is a schematic diagram of system interaction during cardiac resuscitation training in an embodiment of the present invention;

FIG. 6 is a diagram of an exemplary functional design of a system client in an embodiment of the present invention;

FIG. 7 is an exemplary illustration of cardiac resuscitation training performed in an embodiment of the present invention;

FIG. 8 is an exemplary illustration of cardiac resuscitation training performed in an embodiment of the present invention;

FIG. 9 is an exemplary illustration of cardiac resuscitation training performed in an embodiment of the present invention;

FIG. 10 is an exemplary illustration of cardiac resuscitation training performed in an embodiment of the present invention;

FIG. 11 is an exemplary illustration of cardiac resuscitation training performed in an embodiment of the present invention;

FIG. 12 is an exemplary illustration of cardiac resuscitation training performed in an embodiment of the present invention;

fig. 13 is an exemplary illustration of cardiac resuscitation training performed in an embodiment of the present invention.

Detailed Description

In order that those skilled in the art will better understand the disclosure, exemplary embodiments or examples of the disclosure are described below with reference to the accompanying drawings. It is obvious that the described embodiments or examples are only some, but not all embodiments or examples of the invention. All other embodiments or examples obtained by a person of ordinary skill in the art based on the embodiments or examples of the present invention without any creative effort shall fall within the protection scope of the present invention.

Cardiopulmonary Resuscitation (CPR) is one type of emergency surgery, and is mainly used for emergency treatment of patients with cardiac arrest. Cardiopulmonary resuscitation can keep the brain of a patient to normally function through a series of pressing, artificial respiration and other means when the patient cannot breathe naturally or the blood circulation system is obstructed. Augmented Reality (AR) mainly utilizes AR glasses to perform virtual screen projection, and a synthetic virtual scene is superimposed on an object in the real world to enhance user experience, so that a user interacts in the real world but has a local virtual scene in reality. The user cannot distinguish the authenticity of the virtual scene superposed in the real environment. AR glasses do not enclose the human senses, so a user wearing AR glasses can still generate virtual interactions in the real world. AR glasses holens have its own independent system, which itself is both a sensor system and a display. The system judges the state of the user and the interactive instruction sent by the user by tracking the eye sight line track or voice recognition.

Therefore, the invention provides an AR augmented reality technology-based cardio-pulmonary resuscitation training system, as shown in fig. 1, the system includes a user side 1, an administrator side 2, and a server side 3; the user side 1 is used for training cardio-pulmonary resuscitation operation and comprises a training module 11, an examination module 12 and an identity authentication module 13; the training module 11 comprises a field processing training submodule 111, an external chest compression training submodule 112, a smooth airway training submodule 113, an artificial respiration training submodule 114 and a post-treatment training submodule 115; the field processing training submodule 111 is used for realizing the training of field processing on the cardiac resuscitation operation; the chest compression training submodule 112 is used for training chest compression operation; the unblocked airway training sub-module 113 is used for realizing the training of clearing foreign matters in the mouth and the nose of a patient and ensuring the unblocked operation of an airway; the artificial respiration training submodule 114 is used for realizing training of artificial respiration operation; the post-treatment training submodule 115 is used for training a patient to perform a placement or pacification operation; the examination module 12 is used for examining and verifying the learning effect of the user on the cardiopulmonary resuscitation process, and comprises a viewing sub-module 121, a video playback sub-module 122 and a result deriving sub-module 123; each operation in the examination link is the same as that in the training, but the data flow is mainly whether the action in each examined link is standard or not, and no system prompt is provided. In the field processing process, the voice input of the person calling for help can occur, and meanwhile, the voice can be output by the operation of the user; in the chest compression link, physical information such as compression amplitude, frequency and position generated by the compression of a user on the compression sensor is output and compared, and other actions are the same. In the examination, each link has a specified time range to ensure the fluency of the cardio-pulmonary resuscitation action, virtual image data can be docked in the database, the scene simulation is mainly performed, the scores of all the links are formed in the examination, and finally the scores are summed to obtain the final score information. The video information of the operation is stored locally, so that the user can check the video information afterwards, but the video is not stored locally after the user gets off the phone. The identity authentication module 13 is used for realizing user subscription and user verification.

The administrator terminal 2 is used for managing the conventional management of the system by the administrator; the administrator side comprises a right management module 21, a user management module 22, a resource management module 23 and an index management module 24; wherein, the authority management module 21 is used for setting and deleting authority; the user management module 22 is used for adding, inquiring and deleting users; the resource management module 23 is used for importing, exporting and backing up resources, wherein the resources mainly refer to user identity information, user score information, user pressing operation data, user training and assessment videos, error recording screenshots, virtual reality scene resources, training audio and video resources and the like; the index management module 24 is used for designing and assigning indexes, the indexes refer to an assessment scoring system designed for realizing an automatic scoring function of the system, the first-level indexes and the second-level indexes of the assessment system can be determined, namely, large links of chest compression, airway opening and artificial respiration are disassembled in steps to form detailed system assessment key points, and after assessment scoring is carried out in the disassembling step, the operation steps of interval time, compression interruption time and compression ventilation ratio factors are added for integration scoring.

The server 3 comprises a data acquisition module 31, a virtual scene generation module 32, an AR glasses display module 33 and a head tracking module 34; the data acquisition module 31 is configured to acquire data of a cardiac resuscitation sensor, including data of a compression sensor, data of an airflow sensor, voice data acquired by an acoustic sensor, and gesture data acquired by an optical sensor; the virtual scene generation module 32 is used for modeling, managing and drawing various dynamic scenes responsible for cardio-pulmonary resuscitation training; the AR glasses display module 33 is configured to display a virtual reality fusion scene; the head tracking module 34 is used to track changes in the user's gaze and project a virtual scene in the real environment.

Further, the specific steps of the on-site treatment of the cardiac resuscitation operation in the on-site treatment training submodule 111 include: confirming the safety of the field environment; judging the reaction of the falling patient by tapping the shoulders of the patient or calling the patient by loud sound at the ears of the patient; instructing others to help to dial 120 and searching for the AED; touching the carotid artery of the patient, judging the heartbeat, and observing the fluctuation of the thoracic cavity of the patient to make a breathing judgment; if the carotid artery pulsation of the patient disappears and the respiration stops, immediately starting the chest compression training submodule and the artificial respiration training submodule to carry out five groups of combined cyclic rescue; the patients are rechecked immediately after the five groups of combined cycles are finished; if the patient is not resuscitated after the reinspection is finished, the five groups of combined cycle rescue of external chest compression and artificial respiration are continued; when the training submodule for chest compression is used for chest compression, if the AED is in place, the AED is started to defibrillate immediately; and in the process of executing five groups of cycles, the defibrillation electric level chip automatically analyzes the heart rate condition of the patient every 5 minutes, and if the patient has ventricular fibrillation heart rate, the defibrillator automatically gives a prompt.

Detailed description of the preferred embodiment

The overall architecture of the system adopts a C/S building mode, and can be divided into a presentation layer, an application layer, a service layer, a data layer and a base layer as shown in FIG. 2 based on system requirement analysis. In addition, a system management module is independently established, and the conventional management of a manager on the system is met.

The basic layer mainly comprises various software and hardware, network technical facilities and the like. The wearable device for augmented reality in the system mainly refers to Hololens glasses and data gloves. The Hololens glasses are a sensor system, as shown in FIG. 3, and can capture sound, gesture, and the like, and the sensors in the base layer mainly refer to a press sensor, an airflow sensor, and the like. As shown in fig. 4, the cpr sensor is used for helping the user to complete interaction, collect training data of the user and perform standardized transformation of the training data through the signal conditioner; the data interface of the system is provided by a purchased sensor device provider, and the training data is transmitted to the system for grading;

the user information base in the data layer is mainly used for verifying the user reservation information and storing the basic information of the user; the model standard database stores a series of voice, motion and virtual reality video images of standard operation; the operation training database is used for storing external data which is generated by a user in the operation training and checking process and is transmitted through a corresponding data interface, and can be compared with the standard database so as to send related feedback to the user interface; the achievement library is used for generating and storing achievements, and the comparison results of the basic information of the user, the standard library and the operation library are transmitted in and fed back by the user.

The service layer mainly plays a role of business support. In order to ensure the normal operation of the application layer system, the service layer needs to call various devices to lay a foundation for the acquisition of various information such as voice, action and the like. In addition, various modules are required to be mobilized to collect data, and the data are stored in a related database through a data interface.

The application layer integrates various applications, including a login system before training, a training system for training guidance and an evaluation system for effect inspection. The virtual reality system adopts AR augmented reality technology. As shown in fig. 5, the system configuration is composed of a virtual scene generation unit, an AR glasses display, a head tracking device, and an interaction device. The virtual scene generation unit is responsible for modeling, managing and drawing various dynamic scenes of cardio-pulmonary resuscitation training and managing other peripherals; the transmission type glasses display is responsible for displaying a virtual reality fusion scene, but is also a sensing system, and tracking equipment carried by the transmission type glasses display tracks the sight line change of a user and projects the virtual scene in a real environment; the cardiopulmonary resuscitation sensor is used as an interactive tool of a user and a virtual reality system, and generates input and output of physical operation signals.

When a user carries out cardio-pulmonary resuscitation training, firstly, an AR glasses display collects videos and images of a real scene, the videos and the images are transmitted to a processing unit of a background to be analyzed and reconstructed, the relative positions of a virtual scene and the real scene are analyzed by combining data of head tracking equipment, and alignment of a coordinate system and fusion calculation of the virtual scene are realized; the cardio-pulmonary resuscitation sensor collects training data to realize interactive operation of virtual and real combined scenes. The information fused by the system can be displayed in the helmet display in real time and displayed in the visual field of people.

The presentation layer provides a simple virtual operation interface for a user. After the user wears the glasses, a virtual-real combined system scene can be generated, the virtual display screen is projected through the AR glasses, different system functions can be selected on the virtual display screen, and various returned guidance and feedback information can be seen on the virtual display screen.

And the system is divided into four subsystems of identity authentication, training, assessment and system management by combining the analysis of the functional module and the business process. Each subsystem (module) comprises different functional modules (sub-modules), wherein the functions of the system management subsystem mainly comprise three categories of user management, resource management and index management. The system has the functions of automatic grading, timing, data comparison and the like, and the functions are used in each subsystem. The functional design of the cardiopulmonary resuscitation training system is shown in fig. 6.

Identity authentication subsystem (i.e. identity authentication module): the functions of user reservation and user verification are mainly completed, a user can enter a network terminal or a system terminal for reservation in the early stage, reservation information is filled in, and card swiping verification can be performed by using an identity card and the like.

Training subsystem (i.e. training module): according to the division of the function analysis module, the virtual interface of the cardiopulmonary resuscitation provides the functions of emergency environment simulation, human body simulation, equipment simulation and operation data browsing. When the user operates in the virtual scene, the virtual screen is projected to a proper position in the virtual scene, and various physical data or function options during training are displayed. The training time is 40 minutes, and the interval time and the operation time are also recorded in the training process and used as the basis for checking whether the user operation is standard and whether the rhythm is reasonable. A user has voice output to replace a teacher to carry out training guidance in a training process, and meanwhile, some links need to carry out voice input, such as in the cardio-pulmonary resuscitation process, a field processing link needs to carry out field help calling, and a user voice input content system carries out recording. After the voice is input, the system identifies the voice, compares the voice with the standard voice content, and checks whether the user is finished and meets the voice distress call requirement. The standard action path in the virtual scene helps a user to quickly and accurately master the key points of cardiopulmonary resuscitation, meanwhile, various required postures of the user can be input into the system, and the function is the basis for comparing action postures of the system. Some links in the cardiopulmonary resuscitation link provide requirements for postures, if chest compression is carried out, elbow joints are required to be incapable of bending, the posture input by a user is overlapped and compared with a standard library by a system, and the normative of the action posture of the user can be judged. In the chest compression link in the cardiopulmonary resuscitation, the compression frequency, depth and the like are strictly regulated, standard data are output and put on a virtual screen, and the compression data of a user are systematically input to prepare for comparison of the compression data of the system. The system compares the pressing data generated by the pressing plate in the user training process with the input standard library, and the function can find the action errors of the user in the pressing link. After the system performs voice comparison, action comparison and press data comparison, a voice alarm is provided for the error action or the irregular action of the user, and meanwhile, the voice alarm is projected to a virtual screen to indicate the error type, so that the user can master the training dynamics of the user in real time. When the user is in training, action irregularity or action error occurs in a certain link, and after error alarm, the user can select error steps to replay, jump back to the previous function, and perform secondary training in the link. When a user encounters an emergency during training, the training may be suspended or terminated and quit.

Assessment subsystem (i.e. assessment module): after the examination is selected, the cardio-pulmonary resuscitation examination link can be entered for the study effect examination. The system timing function can record data such as operation rhythm, operation duration and the like. The system inputs and records the voice of the user in the assessment process. After the voice is input, the system identifies the voice, compares the voice with standard voice content and detects whether the score requirement is met. The user's operational movements and operational gestures in the cardiopulmonary resuscitation system are captured by the system and stored in the system. The posture input in the user cardio-pulmonary resuscitation examination is subjected to overlapping comparison with the standard library, and the normalization of the user action posture can be scored. The user presses the data entry system. The system compares the press data input by the user with a standard library and gives a score. And identifying whether the key points of environment confirmation, consciousness confirmation, on-site help calling, posture correcting and breathing judgment are scored through voice recognition of the dictation content of the user and action posture capture of the user, and scoring the link. And according to the score points of the field processing links, scoring a series of operations of the field processing of the user. The scoring points include whether the user checks the carotid pulse, whether the patient's clothing and belt are unfastened, whether the pressing position and operation posture are standard, and whether the pressing amplitude and frequency are up to standard. In the assessment module, the score of the portion of the unblocked airway is mainly whether the action is finished or not and whether the posture is standard or not, and the score of the portion is given. And scoring a series of artificial respiration operations of the user in the assessment link according to the score points of the artificial respiration link. And according to the operation sequence of the subsequent handling links, scoring the subsequent handling operation of the user in the virtual environment. And comprehensively evaluating the action continuity and the fluency of the user according to the interval time of each link of the user and scoring. When the user has the fault of irregular action or improper operation in the examination, the system captures the wrong action for later examination. After the user finishes the examination in the system, the system collects the scores of each link and arranges the final percentile score, and the user can select the score to view. When the user disagrees with the assessment score of a certain step, the user can select the error screenshot to view, and find out the related deduction reason. Besides the screenshot, the whole assessment operation process is also recorded in a video mode, and playback observation can be selected after assessment. After the user examination is finished, the score of the user can be exported.

System management subsystem (i.e. administrator side): the functions of increasing, deleting and modifying authority management, user management and resource management can be realized for an administrator. The system specifically comprises a permission setting function and a permission deleting function in a permission management module; the functions of user addition, user inquiry and user deletion in the user management module are realized; and the resource management module has the functions of resource import, resource export and resource backup. Index management comprises index design and index assignment.

The database mainly comprises a user information base, a cardio-pulmonary resuscitation training resource base and a standard action base. The user information base mainly comprises a user information base and an administrator information base. The cardiopulmonary resuscitation training resource library mainly refers to a complete set of scene resources designed in the Unity3D platform, and comprises videos, audios, models and the like. The standard action library is divided into a sensor, a standard operation table, an operation error table and a scoring rule table. The user utilizes the operation sensor to generate operation data in the operation process, and the operation data can be matched with the standard operation table, the operation error table and the scoring rule table to obtain the score of the user.

Detailed description of the invention

The developed software and hardware basic conditions of the full-flow quantitative cardio-pulmonary resuscitation training system are utilized, the AR augmented reality technology is utilized to carry out technical fusion, and the upgraded full-flow quantitative cardio-pulmonary resuscitation training system with the interaction function of the virtual scene and the real scene is developed.

1. The application environment requirements are as follows:

1) hardware requirements: the method comprises the steps that AR glasses hardware is added under the condition that original full-flow quantitative cardio-pulmonary resuscitation training system hardware is kept unchanged, real-time data communication can be carried out between the AR glasses hardware and the original system hardware, and a virtual scene which is interactive with real scene application is established at an AR glasses end.

2) Software requirements: and constructing data.

3) Network environment: the problem that how to construct a new network environment after adding AR glasses equipment is a problem to be discussed in the prior art is based on a local area network constructed by an independent router.

2. The practical application requirements are as follows:

in the operation process of the student, the contents needing real-time feedback are as follows: confirming site environment safety (fire, highway, toxic, earthquake site); when the patient falls down, judging the reaction of the patient (tapping the shoulders of the patient and calling the patient by loud sound at the left ear and the right ear); instructing others to help to dial 120 and searching for the AED; touching the carotid artery of the patient, judging the heartbeat, and observing the fluctuation of the thoracic cavity of the patient to make a breathing judgment; if the carotid artery pulsation of the patient disappears and the respiration stops, the external chest compression is started immediately; when the patient presses the chest, if the defibrillator is in place, the AED defibrillator is started to defibrillate immediately; after defibrillation is completed, five groups of circulatory rescue combining external chest compression and artificial respiration (30: 2 mode) are started immediately; after the five groups of circulation are finished, the patient should be immediately rechecked; if the patient is not resuscitated after the review, five groups 30 should continue: 2, cyclic compression and artificial respiration; in the process of executing five groups of cycles, the defibrillation level chip automatically analyzes the heart rate condition of the patient every 5 minutes, and if the patient has ventricular fibrillation rate, the defibrillator automatically gives a prompt of 'patient ventricular fibrillation, stop pressing and prepare for defibrillation'

AR interaction scene requirements (including animation and action real-time transmission):

in the student operation process, the flows and contents needing AR real-time feedback include:

1) confirming site environment safety (fire, highway, toxic, earthquake site); indoor rooms (office desks, chairs, carpets, etc.), standing virtual people are attached with clothes;

creating a model: indoor rooms (office desks, chairs, carpets, etc.), standing men (patients), zipper coats, jeans, shoes;

2) the patient was found to fall down and judged to respond (tapping the patient's shoulders, calling the patient with loud sounds on the left and right ears): the head of the virtual human body is suddenly turned to the right (the zipper coat is worn); the first rescuer runs to the right side of the virtual human, and taps the shoulders of the virtual human (synchronizes the actions of the real operator) in a kneeling posture (waiting for the tapping of the shoulder signals); the left and right ears call the patient, what you are? Wake-up quickly (stop animation for two times each); the schematic diagram is shown in FIG. 7;

creating a model: men (emergency responders), short-sleeved shirts, casual pants, shoes;

3) instructing others to help to dial 120 and searching for the AED; the first rescuer yells "quickly dial 120" and "take defibrillator" (once animation) to the surrounding crowd; the schematic diagram is shown in FIG. 8;

creating a model: people (male and female), dressed;

4) touching the carotid artery of the patient, judging the heartbeat, and observing the fluctuation of the thoracic cavity of the patient to make a breathing judgment; the first rescuer bends over immediately, the left ear is close to the mouth and nose of the patient, and simultaneously, the eyes look at the thorax of the patient; the left index finger and the middle finger of the emergency responder are closed and touch the carotid artery of the patient (synchronization), and the loud sound is read for '1001 and 1006', and the schematic diagram is shown in FIG. 9; during the reading, the local anatomical picture of the neck is highlighted, and two carotid arteries blink (skin, artery and heart) (until the reading is finished), and the schematic diagram is shown in fig. 10;

creating a model: skin, heart, two carotid arteries from head to chest;

5) if the carotid artery of the patient disappears, the respiration stops, and the defibrillator is in place, the AED defibrillator is started to defibrillate immediately; first-aid technician pulls open patient's zip fastener, exposes skin, and defibrillator starts (button flicker) + 2 (paster position flicker) of electrode slice, and the flicker cancellation) + defibrillation signal (the button flicker of defibrillating after the laminating presses the button, and the flicker cancellation) + virtual hand presses the key to take place to defibrillate action + the health and shake (once end) pronunciation + word suggestion once: "far away from patient";

6) immediately after defibrillation is completed, five groups of chest compressions and artificial respiration should be initiated (30: 2 mode) combined cycle rescue; chest compressions are initiated in the compression gesture and continued until the actual operator operation continues to synchronize, as shown schematically in fig. 11; after receiving the pressing data, the lower end of the upper arm of the first-aid person and the abdominal cavity and the upper parts of the patient are pushed and reserved by the picture, as shown in figures 12 and 13; after 28 times of pressing, the voice prompts 'preparation for artificial respiration'; after 30 times of +/-2 pressing, starting artificial respiration;

creating a model: skin from head to chest, heart and coronary artery, two carotid arteries, two jugular veins, arteriovenous at the junction of neck and heart, sternum, brain kernel;

7) after the five groups of circulation are finished, the patient should be immediately rechecked, the carotid artery of the patient is touched repeatedly, the heartbeat is judged, and the fluctuation of the thoracic cavity of the patient is observed to make a breathing judgment;

8) the patient was resuscitated successfully, a human care.

While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. The present invention has been disclosed in an illustrative rather than a restrictive sense, and the scope of the present invention is defined by the appended claims.