1. An AR-based data acquisition method in assessment of equal insurance is characterized by comprising the following steps:

binding the on-site processing items with the IM account number of the contact person according to the corresponding relation between the on-site processing items and the contact person set by the user;

acquiring field processing items selected by a user, acquiring an IM account number bound by the field processing items, and generating an instant messaging interactive interface between the user and the contact person;

establishing an augmented reality call between a user and the contact person through the instant messaging interactive interface, and generating augmented reality navigation image output after fusing the live-action image with a virtual object containing navigation enhancement information based on live-action image data shot by the contact person client side in the augmented reality call mode;

and acquiring voice information in the augmented reality conversation process, and generating safety management interview information of the field processing items according to the voice information.

2. The method of claim 1, wherein: and storing the safety management interview information as remark information of the field processing items in a remark information column.

3. The method of claim 1, wherein: the step of generating the safety management interview information of the field processing items according to the voice information comprises,

recognizing the voice information and acquiring character information of the voice information;

semantic analysis is carried out on the text information, and the content corresponding to each interview index in the text information is obtained based on the preset interview index;

and generating an interview table based on the indexes and the corresponding content, and storing the interview table as the safety management interview information of the field processing items to a specified path.

4. The method of claim 3, wherein: the interview indexes comprise interviewee basic information, interview date, interview industry, interview mode, question inquiry, question description and conclusion, and the interviewee basic information at least comprises interviewee job information;

when the interview table is generated, the interview table template corresponding to the interviewee title is obtained according to the interviewee title information, inquiry question information in the interview table template is determined, and text contents related to all inquiry questions are obtained from semantic analysis results of the text information and then filled in question descriptions corresponding to the inquiry questions.

5. The method of claim 4, wherein: analyzing the evaluation tendency of the user side in the text information, acquiring corresponding evaluation item information based on the evaluation tendency, and taking the evaluation item information as the content or partial content corresponding to the conclusion index of the safety management interview information;

the evaluation tendency comprises positive evaluation, neutral evaluation and negative evaluation types, and different evaluation item information is set corresponding to different types of evaluation tendency.

6. The method of claim 4, wherein: acquiring voice information of a user side, identifying emotion information in the voice information, and acquiring an emotion category corresponding to the emotion information; obtaining evaluation item information corresponding to the emotion types, and using the evaluation item information as content or partial content corresponding to conclusion indexes of the safety management interview information;

the method for recognizing the emotion information in the voice information comprises the following steps: analyzing the volume change of the user in the voice information, and analyzing emotion information according to the volume change; and/or analyzing the tone change in the voice information, and analyzing the emotion information according to the tone change; and/or analyzing the speech speed information in the voice information, and analyzing the emotion information according to the voice information; and/or analyzing rhythm change in the voice information and analyzing emotion information according to the rhythm change.

7. The method of claim 1, wherein: presetting field check processing item information related to the equal protection evaluation in a related application platform of the instant messaging tool, wherein the field check processing item information comprises one or more field processing items, and a contact person setting inlet is arranged corresponding to each field processing item;

and acquiring the contact information of the input person of the user through the contact setting entrance, and binding the IM account with the corresponding field processing item after acquiring the IM account in the contact information of the input person.

8. The method of claim 7, wherein: the related application platform is a WeChat public number based on a WeChat public platform, and the WeChat public number comprises a service number, a subscription number or an applet.

9. An AR-based data acquisition device in an equal insurance evaluation is characterized by comprising:

the initialization module is used for binding the field processing items with the IM account numbers of the contacts according to the corresponding relation between the field processing items and the contacts set by the user;

the communication interaction module is used for acquiring field processing items selected by a user, acquiring an IM account number bound by the field processing items and then generating an instant communication interaction interface between the user and the contact; establishing an augmented reality call between a user and the contact person through the instant messaging interactive interface, and generating augmented reality navigation image output after fusing the live-action image with a virtual object containing navigation augmented information based on live-action image data shot by the contact person client side in the augmented reality call mode;

and the interview information processing module is used for acquiring the voice information in the augmented reality conversation process and generating the safety management interview information of the field processing items according to the voice information.

10. The utility model provides a data acquisition system based on AR in evaluation of guaranty, its characterized in that: the system comprises a user client, a contact client and a system server;

the user client is used for binding the field processing items with the IM account number of the contact according to the user setting and collecting the field processing items selected by the user;

the system server is used for generating an instant messaging interactive interface between the user and the contact after acquiring the bound IM account according to the field processing items selected by the user; establishing an augmented reality call between the user and the contact person through the instant messaging interactive interface;

the contact client is used for shooting live-action image data on site in the augmented reality communication mode and sending the live-action image data to the system server;

after receiving the live-action image data, the system server can fuse the live-action image with a virtual object containing navigation enhancement information to generate an augmented reality navigation image and output the augmented reality navigation image; and acquiring voice information in the augmented reality conversation process, and generating safety management interview information of the field processing items according to the voice information.

Background

The network security level protection (also called information security level protection) refers to the hierarchical implementation of security protection on national important information, proprietary information of legal persons and other organizations and citizens, public information, and information systems (network devices) for storing, transmitting and processing the information, the hierarchical implementation of management on information security products used in the information system according to the levels, and the hierarchical response and treatment on information security events occurring in the information system. For this reason, the state sets up the corresponding management standards and technical standards such as "information system safety level protection evaluation requirements". The assessment of the information system security level protection is to make an assessment of the network devices used by the information system with reference to technical data in the information system security level protection assessment requirement.

In conventional peer-to-peer assessments, the field check items typically include a secure physical environment, a secure communication network, a secure zone boundary, a secure computing environment, security management (center/organization/personnel), and the like. Generally, during field check, there will be field interview evaluation, which is mainly to interview related personnel to explain the unappreciated parts and to additionally explain and explain the management process or the execution process, and is also an important link in the evaluation. Taking the safe physical environment evaluation as an example, the corresponding evaluation process is generally as follows: firstly, interviewing related personnel aiming at assessment items of a safe physical environment; secondly, checking the site, the environmental conditions, the equipment and the facility running state on the spot; thirdly, checking the running states of the existing related equipment and facilities in the field; fourthly, checking a detection report or a maintenance log, and checking a design acceptance document of the machine room (which can be finished before entering the machine room); fifthly, visiting related personnel aiming at the uncertain items; and sixthly, arranging the operation instruction book, arranging the result record and confirming the signature. Wherein, when the result records are sorted, an interview table is made based on interview contents to record interview information.

At present, on-site verification items and interviews need professional assessment personnel to go to on-site verification and on-site interviews, and the defects of high execution cost, high human resource occupancy rate, high labor intensity and the like exist.

With the rapid development of computer network technology, remote diagnosis and remote verification technology is gaining more and more attention. However, the traditional remote diagnosis and remote verification have technical and spatial obstacles in environmental perception, personnel communication and remote knowledge transmission, and restrict the practical application effect of the remote diagnosis and remote verification. On the other hand, remote interviews are often based on telephone, e-mail or letter, which is inconvenient for information organization and review, and often also requires manual analysis of interview content, which affects evaluation efficiency.

In summary, how to combine the requirements of the equal protection evaluation and how to provide a technical scheme which is simple in operation, efficient in communication, capable of guiding relevant personnel to perform field data acquisition and capable of intelligently arranging information is a technical problem which needs to be solved at present.

Disclosure of Invention

The invention aims to provide a data acquisition method, a device and a system based on AR in equal insurance evaluation, based on an instant communication tool, the invention combines an augmented reality technology into field check processing items in the equal insurance evaluation, guides related personnel to carry out field data acquisition through augmented reality navigation (AR navigation), and can generate safety management interview information according to augmented reality conversation content, thereby realizing environment perception, efficient communication, remote knowledge transmission and intelligent information arrangement, and remarkably improving the equal insurance evaluation efficiency.

In order to achieve the above object, the present invention provides the following technical solutions:

an AR-based data acquisition method in assessment of equal guaranty comprises the following steps:

binding the on-site processing items with the IM account number of the contact person according to the corresponding relation between the on-site processing items and the contact person set by the user;

acquiring field processing items selected by a user, acquiring an IM account number bound by the field processing items, and generating an instant messaging interactive interface between the user and the contact person;

establishing an augmented reality call between a user and the contact person through the instant messaging interactive interface, and generating augmented reality navigation image output after fusing the live-action image with a virtual object containing navigation enhancement information based on live-action image data shot by the contact person client side in the augmented reality call mode;

and acquiring voice information in the augmented reality conversation process, and generating safety management interview information of the field processing items according to the voice information.

Further, the aforementioned security management interview information is stored in a memo information field as memo information for the field processing item.

Further, the step of generating the safety management interview information of the field processing items according to the voice information comprises,

recognizing the voice information and acquiring character information of the voice information;

semantic analysis is carried out on the text information, and the content corresponding to each interview index in the text information is obtained based on the preset interview index;

and generating an interview table based on the indexes and the corresponding content, and storing the interview table as the safety management interview information of the field processing items to a specified path.

Further, the interview indexes comprise interviewee basic information, interview dates, interview industries, interview modes, question inquiry, question descriptions and conclusions, and the interviewee basic information at least comprises interviewee job information;

when the interview table is generated, the interview table template corresponding to the interviewee title is obtained according to the interviewee title information, inquiry question information in the interview table template is determined, and text contents related to all inquiry questions are obtained from semantic analysis results of the text information and then filled in question descriptions corresponding to the inquiry questions.

Further, analyzing the evaluation tendency of the user side in the text information, acquiring corresponding evaluation item information based on the evaluation tendency, and taking the evaluation item information as the content or partial content corresponding to the conclusion index of the safety management interview information;

the evaluation tendency comprises positive evaluation, neutral evaluation and negative evaluation types, and different evaluation item information is set corresponding to different types of evaluation tendency.

Further, voice information of a user side is obtained, emotion information in the voice information is recognized, and emotion types corresponding to the emotion information are obtained; obtaining evaluation item information corresponding to the emotion types, and using the evaluation item information as content or partial content corresponding to conclusion indexes of the safety management interview information;

the method for recognizing the emotion information in the voice information comprises the following steps: analyzing the volume change of the user in the voice information, and analyzing emotion information according to the volume change; and/or analyzing the tone change in the voice information, and analyzing the emotion information according to the tone change; and/or analyzing the speech speed information in the voice information, and analyzing the emotion information according to the voice information; and/or analyzing rhythm change in the voice information and analyzing emotion information according to the rhythm change.

Further, presetting field check processing item information related to the equal protection evaluation in a related application platform of the instant communication tool, wherein the field check processing item information comprises one or more field processing items, and a contact person setting inlet is arranged corresponding to each field processing item;

and acquiring the contact information of the input person of the user through the contact setting entrance, and binding the IM account with the corresponding field processing item after acquiring the IM account in the contact information of the input person.

Further, the related application platform is a wechat public number based on a wechat public platform, and the wechat public number comprises a service number, a subscription number or an applet.

The invention also provides an AR-based data acquisition device in the equal insurance evaluation, which comprises the following structures:

the initialization module is used for binding the field processing items with the IM account numbers of the contacts according to the corresponding relation between the field processing items and the contacts set by the user;

the communication interaction module is used for acquiring field processing items selected by a user, acquiring an IM account number bound by the field processing items and then generating an instant communication interaction interface between the user and the contact; establishing an augmented reality call between a user and the contact person through the instant messaging interactive interface, and generating augmented reality navigation image output after fusing the live-action image with a virtual object containing navigation augmented information based on live-action image data shot by the contact person client side in the augmented reality call mode;

and the interview information processing module is used for acquiring the voice information in the augmented reality conversation process and generating the safety management interview information of the field processing items according to the voice information.

The invention also provides an AR-based data acquisition system in the equal insurance evaluation, which comprises a user client, a contact client and a system server;

the user client is used for binding the field processing items with the IM account number of the contact according to the user setting and collecting the field processing items selected by the user;

the system server is used for generating an instant messaging interactive interface between the user and the contact after acquiring the bound IM account according to the field processing items selected by the user; establishing an augmented reality call between the user and the contact person through the instant messaging interactive interface;

the contact client is used for shooting live-action image data on site in the augmented reality communication mode and sending the live-action image data to the system server;

after receiving the live-action image data, the system server can fuse the live-action image with a virtual object containing navigation enhancement information to generate an augmented reality navigation image and output the augmented reality navigation image; and acquiring voice information in the augmented reality conversation process, and generating safety management interview information of the field processing items according to the voice information.

Due to the adoption of the technical scheme, compared with the prior art, the invention has the following advantages and positive effects as examples: based on an instant messaging tool, an augmented reality technology is combined into field check processing items in the equal insurance evaluation, relevant personnel are guided to carry out field data acquisition through augmented reality navigation (AR navigation), and safety management interview information can be generated according to augmented reality conversation contents, so that environment perception, efficient communication, remote knowledge transmission and intelligent information arrangement are realized, and the equal insurance evaluation efficiency is remarkably improved.

Drawings

Fig. 1 is a flowchart of an AR-based data acquisition method in the assessment of equal guaranty provided by the embodiment of the present invention.

Fig. 2 is a diagram of an example of a user interface of an enterprise public account according to an embodiment of the present invention.

Fig. 3 is an exemplary diagram of an interface for establishing an augmented reality session through an instant messaging interactive interface according to an embodiment of the present invention.

Fig. 4 is an exemplary diagram of an augmented reality call interface output by a contact client according to an embodiment of the present invention.

Fig. 5 is a diagram of an example of the contents of a generated interview table provided by an embodiment of the invention.

Description of reference numerals:

the system comprises a user service interaction interface 200, a public account head portrait 210, a project name display column 220, a field check item column 230, a processing item list 231, an interview information audio access control 231a, an interview information document access control 231b, an augmented reality conversation interface 240, a live-action image display area 241, a navigation map display area 242, an equipment list display area 243 and an interview table 250;

the instant messaging interactive interface 300, a first party image display area 310 and a second party image display area 320.

Detailed Description

The AR-based data acquisition method, apparatus, and system in the iso-insurance assessment disclosed in the present invention are further described in detail below with reference to the accompanying drawings and specific embodiments. It should be noted that technical features or combinations of technical features described in the following embodiments should not be considered as being isolated, and they may be combined with each other to achieve better technical effects. In the drawings of the embodiments described below, the same reference numerals appearing in the respective drawings denote the same features or components, and may be applied to different embodiments. Thus, once an item is defined in one drawing, it need not be further discussed in subsequent drawings.

It should be noted that the structures, proportions, sizes, and other dimensions shown in the drawings and described in the specification are only for the purpose of understanding and reading the present disclosure, and are not intended to limit the scope of the invention, which is defined by the claims, and any modifications of the structures, changes in the proportions and adjustments of the sizes and other dimensions, should be construed as falling within the scope of the invention unless the function and objectives of the invention are affected. The scope of the preferred embodiments of the present invention includes additional implementations in which functions may be executed out of order from that described or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present invention.

Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate. In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.

Examples

The augmented reality technology is a technology for enhancing a real scene by combining technologies such as computer graphics, image processing, machine vision and the like and utilizing a virtual object, namely, enhancing information such as icons, characters, video information and the like, in an advanced manner, so that the fusion of the real world and the virtual world is realized. The invention combines Instant Messaging (IM) tools and augmented reality technology in the field check items of the equal protection evaluation, can intuitively and efficiently present the spatial position relation of the field physical environment to the user, and can guide the field relevant personnel to acquire field data according to the required line.

Referring to fig. 1, a data acquisition method based on AR in the assessment of equal guaranty provided by an embodiment of the present invention is shown. The method comprises the following steps:

and S100, binding the field processing item with the IM account number of the contact person according to the corresponding relation between the field processing item and the contact person set by the user.

Specifically, the field check processed item information related to the equal protection evaluation may be preset in an associated application platform of an Instant Messaging (IM) tool, where the field check processed item information includes one or more field processed items. And a contact person setting inlet is arranged corresponding to each field processing item and used for collecting contact person information of the input person of the user. After the IM account in the contact information of the loser is obtained, the IM account may be bound to the corresponding field processing item.

The instant messaging tool, generally referred to in the art as a client having instant messaging capabilities. By way of example and not limitation, the instant messaging tool may be a web application, a PC application, or a handheld APP application. After a user logs in an instant messaging tool through a user terminal, such as a mobile phone, a connection between an instant messaging client and an instant messaging server is established. The instant messaging tool outputs a user main interface to the user through a display structure of the user terminal, and the user main interface displays a user head portrait. The user main interface can display a contact list, a group list, a public number list and other applications pushed by the instant messaging server.

In this embodiment, the IM tool is preferably a wechat, and the associated application platform is a wechat public number based on a wechat public platform. The WeChat public number may include a service number, a subscription number, or an applet. The user can set the processing item information related to the equal insurance evaluation based on the WeChat public number. Specifically, an item name, an item number, and/or an item icon are provided for each processing item.

By way of example and not limitation, such as for an existing WeChat public number "or other security assistant," a user may access the WeChat public number by searching public numbers or looking up a list of pushed public numbers. After the user selects the triggering of the WeChat public number, the display structure of the user terminal outputs a user service interaction interface 200 of the public number to the user, as shown in FIG. 2. The user service interactive interface 200 serves as a main interactive interface of a public number equal insurance assistant and is used for the visiting user to perform business operations related to equal insurance construction, such as receiving information of information security products uploaded by the user.

As a typical example, the user service interaction interface 200 may include a public account icon 210, an item name display field 220, and an event field.

The pin print 210 may be set by a service party to which the pin print belongs, a pin name may be displayed behind the pin print 210, and other related information of the pin print, such as a name of a company to which the pin print belongs, newly released product or service information, and the like may be displayed corresponding to the pin print as needed.

The item name display field 220 is used to display the item name of the currently processed item. By way of example, the project name is usually named by the name of the customer's business, such as "Jiangsu technology" in FIG. 2, representing that the user is processing the equitable assessment project information of the customer "Jiangsu technology". Optionally, a plurality of tool buttons may be further disposed in the item name display field 220 for the user to operate, for example, a contact setting button, an item data import button, a delete item button, an item mark button, and the like may be included, and the user may set contact information, import item data, delete item, and mark an important item related to the item by clicking the tool buttons.

The event field is used to display a plurality of pieces of event information related to the level (network security level) corresponding to the item (the item displayed in the item name display field 220), different pieces of event information are associated with different levels, and information such as an event name, an event number, and/or an event icon of the event can be displayed in the event field for each event. For example, the service side to which the wechat community number belongs is a shanghai × iso-insurance company, and the service side shanghai × iso-insurance company may protect the corresponding processing items set for each level of the project in its own wechat community number. The network security level protection can be divided into five levels, namely a first level (user autonomous protection level), a second level (system audit protection level), a third level (security label protection level), a fourth level (structured protection level) and a fifth level (access verification protection level), wherein different levels correspond to different item information.

Optionally, the item information in the item column is displayed in the form of an item list, as shown in fig. 2. Further optionally, when the item list is displayed, the item list may be divided into multiple stages according to needs, in this embodiment, the item list at least includes a first-stage item and a second-stage item, and each stage item corresponds to a stage name. One or more secondary items are arranged under the primary item. In the specific setting, after the processing item information set by the user is acquired, the item list of the user may be generated based on the preset processing item classification rule and the dependency relationship information. Therefore, the user can conveniently maintain and manage the matters with the affiliation.

In the present embodiment, a field check item column 230 is displayed in the item column, and field processed items are output in the form of a processed item list 231 corresponding to a plurality of field processed items, as shown in fig. 2. Optionally, the specific processing items output from the processing item list 231 may be set individually by the user, for example, the field processing items set (selected) by the user in fig. 2 include: a secure physical environment, a secure communication network, a secure zone boundary, a secure computing environment, a secure management center, a secure management authority, and a secure administrator.

In the field check item column 230, an item contact setting option may be set for each field processing item, and the item contact setting option serves as a contact setting entry, and can output a contact setting window after being triggered. The contact information of the input person of the user can be collected through the contact setting window, and the contact information comprises but is not limited to contact names, nicknames, telephones, IM account numbers, positions and the like. After obtaining the IM account in the contact information of the input person, the IM account may be bound to the corresponding field processing item.

As a typical example, the item contact setting option may be set in the form of an icon button behind the item name of the corresponding field processing item, and when the user clicks the icon button, the contact setting window is output.

And S200, collecting the field processing items selected by the user, acquiring the IM account number bound by the field processing items, and generating an instant messaging interactive interface between the user and the contact.

And after acquiring the bound IM account number according to the field processing items selected by the user, establishing instant messaging interaction between the user and the contact person, and generating an instant messaging interaction interface. Specifically, the instant messaging interactive interface can comprise a contact head portrait and a name of a conversation, an interactive information display field, an information input field and a tool bar. The interactive information display column is used for displaying chat information. The information input field is used for collecting the chat information of the user. The toolbar displays common voice chat controls, emoticon controls and more tool options, for example, a user can output a control display bar after triggering more tool options, and the control display bar displays application controls which can be used by the user, such as an album control, a shooting control, a video call control, a voice call control, a position control, a collection control and the like.

In this embodiment, the instant messaging interactive interface has an Augmented Reality (AR) call function, and at this time, the application control may further include an Augmented Reality (AR) call control.

S300, establishing an augmented reality call between a user and the contact through the instant messaging interactive interface, and generating augmented reality navigation image output after fusing the live-action image with a virtual object containing navigation augmented information based on live-action image data shot by the contact client in the augmented reality call mode.

The method for establishing the augmented reality call between the user and the contact through the instant messaging interactive interface can be used for establishing the augmented reality call between the user and the contact when the operation message of triggering the Augmented Reality (AR) call control by the user is collected. Or, the augmented reality call between the user and the contact may be directly established while the instant messaging interactive interface is generated, at this time, preferably, the instant messaging interactive interface with the contact may be embedded in the user service interactive interface 200, as shown in fig. 3, an augmented reality call interface between the user and the contact "li si-jiangsu technology" is displayed.

In the augmented reality communication mode, live-action image data of a scene can be shot based on a contact client, and after the live-action image is fused with a virtual object containing navigation enhancement information, an augmented reality navigation image is generated and output.

In this embodiment, the navigation enhancement information may be one or more of a navigation map, a navigation guidance identifier, and navigation guidance characters, and a navigation route is set corresponding to each field processing item. And for the target field processing item, outputting a target navigation route corresponding to the target field processing item through a navigation map, a navigation guide identifier and/or navigation guide characters in the augmented reality navigation image so as to indicate. As a typical example, for example, in fig. 3, the augmented reality navigation image includes a real image display area 241 and a navigation map display area 242. The live-action image display area 241 is used for outputting live-action image data shot by a camera of the contact client in a recording mode, the navigation map display area 242 displays a navigation map and a navigation route, and simultaneously, the live-action image display area 241 also displays a navigation guide identifier (arrow).

In this embodiment, the virtual object may further include text information for explaining key points in the live-action image, video processing operation mode information (including repeat playing, fast and slow playing, reverse playing, freeze frame, zoom in, measurement, angle change, and the like), marker button information, a virtual object for emphasizing key targets in the real environment, and/or a virtual object for increasing interest of the real environment. Optionally, when the virtual object is output through the augmented reality call interface, collecting interaction operation information of the user and the virtual object, such as interaction of tracking, clicking, moving, and rotating the virtual object, and adjusting the displayed virtual object according to the interaction operation information.

At this time, the instant messaging interactive interface 300 output by the contact client is shown in fig. 4. The instant messaging interactive interface 300 outputs a conversation object "peer-to-peer" and a first party image display area 310 and a second party image display area 320, the first party image display area 310 being used for displaying a current focus video image, and the second party image display area 320 being used for displaying a non-current focus video image. In this embodiment, in order to guide the contact to shoot the field device, the augmented reality navigation image is output through the first-party image display area 310, and a video image of the session object "isosavant assistant-mini" client in a recording state (in a case where the session object opens the camera) or a contact avatar is output through the second-party image display area 320.

In this embodiment, the captured live-action image data of the scene may be stored as the item update content of the target scene processing item.

S400, acquiring voice information in the augmented reality conversation process, and generating safety management interview information of the field processing items according to the voice information.

In this embodiment, the security management interview information may be audio format data, or may be an interview document with a standard data structure, such as an interview table.

In order to facilitate the user to obtain the safety management interview information, after the safety management interview information is generated, the safety management interview information can be stored under a specified path, such as a specified folder, and interview information operation controls are set corresponding to field processing matters so that the user can view interview audio or interview documents in the folder according to needs in the later period.

Referring to fig. 3, it is illustrated that an interview information audio access control 231a and an interview information document access control 231b are set after the event name of the event "secure physical environment" is processed on site to serve as viewing entries for interview audio and interview documents, respectively, and after a user triggers the above controls, the related audio data and document data can be viewed. Optionally, the aforementioned audio data and/or document data are output based on the user service interaction interface 200.

In the augmented reality conversation process, audio data in the augmented reality conversation process is acquired through an audio acquisition structure, such as a sound pickup, so that voice information of a user and a contact person is recorded. Then, generating the security management interview information of the field processing items according to the voice information, wherein the specific steps can be as follows:

s410, recognizing the voice information and acquiring the character information of the voice information.

In specific implementation, an HTK/ATK tool can be adopted to perform voice recognition on the voice input by the user; the speech recognition method may also be used to perform speech recognition on the user input speech in a non-human-specific speech recognition manner, which is not limited herein.

After the voice information input by the user is identified, the character information (or called text information) corresponding to the voice is obtained.

And S420, performing semantic analysis on the text information, and acquiring content corresponding to each interview index in the text information based on the preset interview index.

In semantic analysis, it is considered that most of expression sentences generated when two interactive parties (users and contacts) talk are spoken sentences, and predicates in the sentences may not be found in the semantic analysis process. The semantic analysis can be performed as follows: firstly, segmenting words of text information, and then obtaining L words through word segmentation, wherein L is more than or equal to 1; respectively acquiring the characteristics of the L words; and respectively determining the information content contained in the L words according to the characteristics, and selecting at least one word containing more information content from the L words as a central word. By way of example and not limitation, when the user input information is a chinese language, a chinese word segmentation system, such as ICTCLAS, may be used to segment a text corresponding to the user input speech; when the user inputs the speech in other languages, the word segmentation system corresponding to the language can be used for word segmentation, which is not described herein again. The characteristics of the words can reflect the specific part of speech, representative meaning and other named entity characteristics of the words. By way of example, and not limitation, such as names of people, places, numbers, parts of speech (such as adjectives, adverbs, co-grams, conjunctions, etc.). Then, respectively taking the central words as centers to make windows, and determining context words of the central words; matching the context words with a semantic model obtained by pre-training to obtain a matching result; and analyzing semantics according to the matching result.

And finally, acquiring the content corresponding to each interview index in the text information based on the preset interview index.

The interview index can be preset by a user or a system and can embody the core content of interview. In this embodiment, preferably, the interview index may include basic information of an interviewee, an interview date, an interview industry, an interview mode, a question and question description, and a conclusion. The interviewee basic information can specifically comprise the name of an interviewee, the work unit of the interviewee and the position information of the interviewee.

And S430, generating an interview table based on the indexes and the corresponding contents, and storing the interview table as the safety management interview information of the field processing matters to a specified path.

Preferably, different interview table templates can be preset according to the roles of different interviewees, and different inquiry questions are set in the different interview table templates. At this time, when the interview table is generated, the interview table template corresponding to the interviewee title can be obtained according to the interviewee title information, the question inquiring information in the interview table template is determined, the text content related to each question inquiring is obtained from the semantic analysis result of the text information, and then the text content is filled in the question description corresponding to the question inquiring.

By way of example and not limitation, when the interviewee is deemed to be physically safe, the interviewee's corresponding interview form template preset has 5 question questions, namely "question 1: whether the computer lab is equipped with electronic access control system, whether control, discern and record personnel that get into "," problem 2: whether to set up a machine room burglar alarm system or a video monitoring system of a specially-assigned person on duty ", and" problem 3: whether the machine room is divided into areas for management, whether a physical isolation device is arranged between the areas, and the problem 4: whether there are dampproofing and dewing phenomenon in computer lab ceiling and wall, whether there is the water pipe below the computer lab roof or the activity is done, to the rain-proof measure for opening the window "," problem 5: whether equipment and lines are pasted with marks which are not easy to remove or not. When the role of the interviewee is the physical security person in charge, the number of the inquiry questions in the interview table template preset corresponding to the interviewee is 3, and the inquiry questions are respectively as follows: "problem 1: the equipment is taken away from the machine room or office environment, and the problem 2: which measures are in security management of the important area "," problem 3: how the facility personnel and post personnel are equipped (e.g., security administrator, system administrator, network administrator, auditor) ".

After the question information is obtained, the text content related to each question may be obtained from the semantic analysis result of the text information, and then the text content is filled into the question description of the corresponding question, as shown in fig. 5, which illustrates the generated interview table 250.

In an embodiment of this embodiment, the evaluation tendency of the user in the text information may be analyzed, corresponding evaluation item information may be obtained based on the evaluation tendency, and the evaluation item information may be used as content or partial content corresponding to the conclusion index of the security management interview information. Thus, the conclusion of the evaluation (the evaluation item information is the conclusion) or the partial conclusion (the evaluation item information is a part of the conclusion) of the user can be quickly obtained.

The evaluation tendency specifically comprises a positive evaluation type, a neutral evaluation type and a negative evaluation type, and different evaluation item information is set corresponding to different types of evaluation tendency. By way of example and not limitation, during an augmented reality call, voice information of a user is collected and recognized: ' the physical safety measures of your are perfect and completely meet the evaluation requirement. ", the evaluation tendency included in the above character information is a positive evaluation. Then, based on the evaluation tendency, corresponding evaluation item information is acquired: meets the evaluation requirements of the equal protection. For another example, in the augmented reality communication process, the voice information of the user is collected and recognized: "this aspect needs to be rectified and revised, and the requirement of setting a machine room anti-theft alarm system or setting a video monitoring system of a specially-assigned person in the protection evaluation is met. ", the evaluation tendency included in the above text information is a negative evaluation. Then, based on the evaluation tendency, corresponding evaluation item information is acquired: the aspect of anti-theft alarm needs to be rectified and improved.

In another implementation manner of this embodiment, voice information of a user side is acquired, emotion information in the voice information is recognized, and an emotion category corresponding to the emotion information is acquired; and obtaining the evaluation item information corresponding to the emotion type to serve as the content or partial content corresponding to the conclusion index of the safety management interview information. In this way, the conclusion or partial conclusion of the evaluation by the user can be quickly obtained.

Specifically, the manner of recognizing the emotion information in the speech information is as follows: analyzing the volume change of the user in the voice information, and analyzing emotion information according to the volume change; and/or analyzing the tone change in the voice information, and analyzing the emotion information according to the tone change; and/or analyzing the speech speed information in the voice information, and analyzing the emotion information according to the voice information; and/or analyzing rhythm change in the voice information and analyzing emotion information according to the rhythm change.

This embodiment is different from the foregoing embodiment in that the evaluation item information of the user is acquired based on emotion information included in the speech information, instead of acquiring the evaluation item information based on character information in the speech information. Because the voice can reflect the emotion of a person to some extent, for example, in general, a sharp and loud voice tends to represent that a speaker is more angry, and a cheerful and soft voice tends to represent that a speaker is more happy. Accordingly, the evaluation information of the user can be known by analyzing the emotion information in the user voice information.

Taking the volume as an example, recognizing the volume change in the voice information, acquiring the emotion type according to the volume change, and specifically acquiring the evaluation item information according to the emotion type, wherein the specific steps are as follows: the corresponding relation between the volume, the emotion category and the evaluation item is established in advance. By way of example and not limitation, for example, sound is divided into 3 levels based on volume, and the following are sequentially performed from low to high: bass, mid-range, and treble. And the emotion categories corresponding to the bass, the middle and the treble respectively are as follows in sequence: positive pleasantly, marginally neutral and negative questioning. And the evaluation item information corresponding to the emotion categories sequentially comprises: interviews are satisfied with the requirements, interviews are generally satisfied with a small part of the requirements for modification, and interviews are worse and much of the requirements for modification. In this way, after the volume level of the user in the voice information is identified, the evaluation item information corresponding to the volume level can be obtained based on the corresponding relationship between the volume level, the emotion type and the evaluation item information.

The emotion classification is obtained according to the pitch, the speech rate and the rhythm information, and the manner of obtaining the evaluation item information according to the emotion classification is the same as above.

Optionally, when recognizing emotion information in the speech information, if multiple factors such as volume, pitch, speech rate, rhythm and the like are considered at the same time, scores may be set for each emotion category — for example, a score corresponding to a pleasant positive emotion category is 90 scores, a score corresponding to a barely neutral emotion category is 60 scores, and a score corresponding to a questioned negative emotion category is 40 scores; for a certain voice message, after the scores of the emotion types corresponding to the factors are obtained, the arithmetic mean of the scores of all the factors is obtained, and then the emotion type corresponding to the arithmetic mean is used as the emotion type of the voice message.

In another embodiment of this embodiment, a remark information field may be further provided for each field processing item, at this time, the security management interview information may be stored in the remark information field as remark information of the field processing item, and a user may view the security management interview information through the remark information field.

In another embodiment of this embodiment, the highlight position information of each field processing item may be set based on the field verification requirement of the equal insurance evaluation, and the highlight position information corresponding to each field processing item is obtained, where the navigation route corresponding to the field processing item includes all the highlight positions recorded in the highlight position information. At the moment, when a navigation route is planned, the position moving information of the contact client can be obtained; judging whether the position moving information is matched with a target navigation route; and when mismatching is judged, acquiring the residual key position information according to the current position of the contact client and the key position which is already passed through, planning a new navigation route and outputting the new navigation route.

In another implementation manner of this embodiment, before establishing the augmented reality session between the user and the contact, the method may further include the steps of: an operation control used for inviting the augmented reality call is arranged in the instant communication interactive interface, the triggering information of the user to the operation control is collected, and an augmented reality call inviting message is generated and sent to the contact client; and outputting the invitation message at the contact client and sending out an inquiry, and establishing the augmented reality conversation between the user and the contact when the contact client receives the invitation message.

Optionally, a positioning device is further disposed corresponding to the field device, the contact client is equipped with an automatic mobile laser Dongle (Software Dongle), the automatic mobile laser Dongle includes a laser and a Dongle, and after the Dongle is inserted into a terminal where the contact client is located, such as a mobile phone, the terminal can obtain the person to be transported from the mobile phone and control the laser to point to the corresponding field device. The automatically moving laser dongle can automatically direct a laser at field devices within a range of camera visibility distances associated with the contact client. At this time, the target field device triggered by the contact in the live-action image can be acquired; according to the triggering operation, automatically moving a laser dongle to control a laser to point to a target field device in a real environment; and identifying the target field device through a virtual object in the live-action image, wherein the virtual object contains laser pointing information.

The invention further provides an AR-based data acquisition device in the equal insurance evaluation.

The device comprises an initialization module, a communication interaction module and an interview information processing module.

And the initialization module is used for binding the field processing items with the IM account numbers of the contacts according to the corresponding relation between the field processing items and the contacts set by the user.

The communication interaction module is used for acquiring field processing items selected by a user, acquiring an IM account number bound by the field processing items and then generating an instant communication interaction interface between the user and the contact person; and establishing an augmented reality call between a user and the contact person through the instant messaging interactive interface, and in the augmented reality call mode, fusing the live-action image with a virtual object containing navigation enhancement information to generate augmented reality navigation image output based on live-action image data shot by the contact person client.

And the interview information processing module is used for acquiring voice information in the augmented reality conversation process and generating the safety management interview information of the field processing items according to the voice information.

In this embodiment, the interview information processing module is configured to: recognizing the voice information and acquiring character information of the voice information; semantic analysis is carried out on the text information, and the content corresponding to each interview index in the text information is obtained based on the preset interview index; and generating an interview table based on the indexes and the corresponding content, and storing the interview table as the safety management interview information of the field processing items to a specified path.

Specifically, the interview information processing module can comprise an index setting unit, a semantic analysis unit and an interview table generation unit.

The index setting unit is used for acquiring interview indexes set by a user or a system. In this embodiment, the interviewee basic information at least includes interviewee job information, interview date, interview industry, interview mode, question inquiry, question description and conclusion.

The semantic analysis unit is used for identifying the voice information and acquiring character information of the voice information; semantic analysis is carried out on the text information, and the content corresponding to each interview index in the text information is obtained based on the preset interview index.

And the interview table generating unit is used for generating an interview table based on the indexes and the corresponding contents, and storing the interview table as the safety management interview information of the field processing items to a specified path. When the interview table is generated, the interview table template corresponding to the interviewee title can be obtained according to the interviewee title information, the question inquiring information in the interview table template is determined, the text content relevant to each question inquiring is obtained from the semantic analysis result of the text information, and then the text content is filled in the question description corresponding to the question inquiring.

In this embodiment, the interview table generating unit is further configured to: and acquiring a preset evaluation tendency type, analyzing the evaluation tendency type of the user side in the text information, acquiring corresponding evaluation item information based on the evaluation tendency type, and taking the evaluation item information as content or partial content corresponding to a conclusion index of the safety management interview information.

The evaluation tendency comprises positive evaluation, neutral evaluation and negative evaluation types, and different evaluation item information is set corresponding to different types of evaluation tendency.

Optionally, the interview table generation unit may be further configured to: 6. acquiring voice information of a user side, identifying emotion information in the voice information, and acquiring an emotion category corresponding to the emotion information; and obtaining the evaluation item information corresponding to the emotion type to serve as the content or partial content corresponding to the conclusion index of the safety management interview information.

Wherein the interview table generation unit comprises an emotion category analysis subunit configured to: analyzing the volume change of the user in the voice information, and analyzing emotion type information according to the volume change; and/or analyzing the tone change in the voice information, and analyzing the emotion category information according to the tone change; and/or analyzing the speech speed information in the voice information, and analyzing emotion category information according to the voice information; and/or analyzing rhythm change in the voice information, and analyzing emotion category information according to the rhythm change.

Other technical features refer to the foregoing embodiments, and each module may be configured to perform corresponding information acquisition, information transmission, and information processing processes, which are not described herein again.

The invention further provides an AR-based data acquisition system in the equal insurance evaluation.

The system comprises a user client, a contact client and a system server.

And the user client is used for binding the field processing items with the IM account number of the contact according to the user setting and collecting the field processing items selected by the user.

The system server is used for generating an instant messaging interactive interface between the user and the contact after acquiring the bound IM account according to the field processing items selected by the user; and establishing the augmented reality conversation between the user and the contact person through the instant messaging interactive interface.

And the contact client is used for shooting the live-action image data in the augmented reality communication mode and sending the live-action image data to the system server.

After receiving the live-action image data, the system server can fuse the live-action image with a virtual object containing navigation enhancement information to generate an augmented reality navigation image and output the augmented reality navigation image; and acquiring voice information in the augmented reality conversation process, and generating safety management interview information of the field processing items according to the voice information.

Other technical features refer to the foregoing embodiment, and each end (client and server) may be configured to perform corresponding information acquisition, information transmission, and information processing processes, which are not described herein again.

It should be noted that, the terminal of the present invention, besides the mobile phone, may also be various commonly used mobile terminals such as a palm computer and a tablet computer, and various intelligent wearable electronic devices such as smart glasses and a smart watch, which are not limited herein.

An augmented reality server may be provided corresponding to augmented reality information, and the augmented reality server may perform dedicated database establishment that refers to an information database formed by a combination of POI information and feature points extracted from a photographed real image having actual geographic features (landscape, buildings, roads, etc.). For example, the augmented reality information database, the real image database, and the POI database may be included, and are configured to correspond to the server storage unit of the augmented reality server. Here, the augmented reality information database may be used to store one or more of feature points, GPS coordinates, POI information, and other related information, and interact with a commercial reporting system, a web portal, an advertisement content DB; the real image database may store actual street images and GPS coordinates matching the images; the POI database is used for storing POI information.

In the foregoing description, the disclosure of the present invention is not intended to limit itself to these aspects. Rather, the various components may be selectively and operatively combined in any number within the intended scope of the present disclosure. In addition, terms like "comprising," "including," and "having" should be interpreted as inclusive or open-ended, rather than exclusive or closed-ended, by default, unless explicitly defined to the contrary. All technical, scientific, or other terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs unless defined otherwise. Common terms found in dictionaries should not be interpreted too ideally or too realistically in the context of related art documents unless the present disclosure expressly limits them to that. Any changes and modifications of the present invention based on the above disclosure will be within the scope of the appended claims.