1. An AR auxiliary data processing method in assessment of equal guaranty is characterized by comprising the following steps:

collecting field processing items selected by a user based on an instant messaging tool;

judging whether the field processing item is provided with a relevant contact person, and generating an instant messaging interactive interface between the user and the relevant contact person under the condition of judging the relevant contact person;

establishing an augmented reality call between a user and an associated contact through the instant messaging interactive interface, shooting live-action image data based on an associated contact client under the augmented reality call mode, fusing the live-action image with a virtual object containing navigation augmented information, and generating augmented reality navigation image output;

the field device information in the live-action image data is identified to determine whether the field device is a real device.

2. The method of claim 1, wherein: and for any identified field device, acquiring images of the field device at different shooting angles, analyzing the images at different shooting angles to judge whether the field device has a three-dimensional profile, and judging the field device as a real device when the field device has the three-dimensional profile, or judging the field device as a virtual device if the field device does not have the three-dimensional profile.

3. The method of claim 1, wherein: the steps of setting a positioning device corresponding to the field device to collect the actual position information of the field device and judging whether the field device is a real device include:

for any identified field device, acquiring the name and/or number information of the field device;

acquiring corresponding standard position information according to the name and/or number information of the field equipment;

and judging whether the standard position information is matched with the actual position information acquired by the corresponding positioning device, judging as real equipment when the two pieces of position information are matched, and otherwise, judging as virtual equipment.

4. The method of claim 1, wherein: a thermal sensing device is arranged corresponding to the field device and is arranged on the main body structure of the field device to detect actual temperature data; the step of determining whether the field device is a real device includes:

for any identified field device, acquiring the name and/or number information of the field device;

acquiring standard temperature data corresponding to the field equipment in a normal operation state according to the name and/or number information of the field equipment;

and judging whether the standard temperature data are matched with the actual temperature data detected by the corresponding thermal sensing device, and judging as real equipment when the two temperature data are matched, or judging as false equipment if not.

5. The method according to claim 3 or 4, characterized in that: and a machine-readable code is arranged corresponding to the field device, the machine-readable code is associated with the name and/or the number information of the field device, and the name and/or the number information of the field device is acquired by identifying the machine-readable code.

6. The method of claim 1, wherein: presetting field check processing item information related to the equal protection evaluation in an associated application platform of the instant messaging tool, wherein the field check processing item information comprises one or more field processing items, and setting an associated contact corresponding to each field processing item;

the related application platform is a WeChat public number based on a WeChat public platform, and the WeChat public number comprises a service number, a subscription number or an applet.

7. The method of claim 1, wherein: establishing an augmented reality call of a user with an associated contact further comprises the steps of,

an operation control used for inviting the augmented reality call is arranged in the instant communication interactive interface, the triggering information of the user to the operation control is collected, and an augmented reality call inviting message is generated and sent to the associated contact client;

and outputting the invitation message and sending out an inquiry at the associated contact client, and establishing the augmented reality conversation between the user and the associated contact when the associated contact client receives the invitation message.

8. The method of claim 7, wherein: a positioning device is arranged corresponding to the field equipment, the associated contact client is provided with an automatic mobile laser dongle, and the automatic mobile laser dongle can automatically direct laser to the field equipment within the visible distance range of a camera associated with the associated contact client;

acquiring target field equipment triggered by the associated contact in the live-action image; according to the triggering operation, automatically moving a laser dongle to control a laser to point to a target field device in a real environment; and identifying the target field device through a virtual object in the live-action image, wherein the virtual object contains laser pointing information.

9. An AR auxiliary data processing apparatus in an assessment of equal guaranty, characterized by comprising:

the information acquisition module is used for acquiring field processing items selected by a user based on the instant messaging tool;

the communication interaction module is used for judging whether the field processing item is provided with a relevant contact person or not, and generating an instant communication interaction interface between the user and the relevant contact person under the condition of judging the relevant contact person; establishing an augmented reality call between a user and an associated contact person through the instant messaging interactive interface, shooting live-action image data based on the associated contact person client side in the augmented reality call mode, fusing the live-action image with a virtual object containing navigation enhancement information, and generating augmented reality navigation image output;

and the equipment checking module is used for identifying the field equipment information in the live-action image data so as to judge whether the field equipment is real equipment.

10. An AR auxiliary data processing system in assessment of equal guaranty, characterized by: the system comprises a user client, an associated contact client and a system server;

the user client is used for collecting field processing items selected by the user based on the instant messaging tool;

the system server is used for judging whether the field processing items are provided with the associated contact persons or not, generating an instant messaging interactive interface between the user and the associated contact persons under the condition of judging the associated contact persons, and establishing an augmented reality call between the user and the associated contact persons through the instant messaging interactive interface;

the associated contact client is used for shooting live-action image data on site in the augmented reality communication mode and sending the live-action image data to a system server;

after receiving the live-action image data, the system server can fuse the live-action image with a virtual object containing navigation enhancement information, and generate an augmented reality navigation image to be output in the instant messaging interactive interface; and identifying field device information in the live-action image data to judge whether the field device is a real device.

Background

In the network security and application security industry, security evaluation methods are diversified, and commonly used methods include level protection, penetration testing, vulnerability scanning, baseline checking, risk evaluation and the like, and each method has respective characteristics. The information security level protection is to implement security protection on the national important information, the proprietary information of legal persons and other organizations and citizens, the public information, and the information systems (network devices) for storing, transmitting and processing the information in a grading way, implement management on the information security products used in the information system in a grading way, and implement grading response and treatment on the information security events generated in the information system. For this reason, the state sets up the corresponding management standards and technical standards such as "information system safety level protection evaluation requirements". The assessment of the information system security level protection is to make an assessment of the network devices used by the information system with reference to technical data in the information system security level protection assessment requirement. In conventional peer-to-peer assessments, the field check items typically include a secure physical environment, a secure communication network, a secure zone boundary, a secure computing environment, and the like. At present, on-site verification items generally need to be verified on site by professional assessment personnel, and the defects of high execution cost, high human resource occupancy rate, high labor intensity and the like exist.

With the rapid development of computer network technology, remote diagnosis and remote verification technology is gaining more and more attention. Various automatic evaluation methods suitable for equal-insurance evaluation are also proposed in the prior art. However, the prior art generally has the following defects: the service party needs to manage and track the service of the client of the evaluation party, and the common communication modes comprise instant messaging, short messages, e-mails and the like; among them, the related application platform provided based on the instant communication tool, such as the WeChat public based on WeChat, is a more common way at present. Currently, for the related items of the field check items, the client generally uploads the related recorded information through the related application platform (the client records the video in advance and stores the video, and then uploads the video on the related application platform). The above prior art has the following disadvantages: on one hand, a client needs to log in the associated application platform first, then selects a specific item on a specified user interface, and then inputs related information based on an editing window of the item, so that the operation is complicated. On the other hand, since the recording of the video is performed by the client independently, the recording route is often random, the later stage of the service party needs to spend a long time analyzing whether each item in the video matches or not, and the evaluation requirement of the relevant items for evaluation is guaranteed, and meanwhile, video counterfeiting occurs easily, for example, the client uses a printed product to replace a physical device and then the service party is deceived through image post-processing.

In summary, how to combine the requirements of the equal protection evaluation and how to provide a technical scheme which is simple in operation, efficient in communication, and capable of guiding relevant personnel to perform field data acquisition and identify field devices is a technical problem which needs to be solved at present.

Disclosure of Invention

The invention aims to provide an AR auxiliary data processing method, device and system in the equal insurance evaluation, based on an instant messaging tool, an augmented reality technology is combined into field check processing items in the equal insurance evaluation, relevant personnel are guided to carry out field data acquisition through augmented reality navigation (AR navigation), and field equipment in a live-action image is judged for authenticity, so that the method, device and system have the advantages of being simple in operation, efficient in communication and capable of intelligently distinguishing the field equipment.

In order to achieve the above object, the present invention provides the following technical solutions:

an AR auxiliary data processing method in assessment of equal guaranty comprises the following steps:

collecting field processing items selected by a user based on an instant messaging tool;

judging whether the field processing item is provided with a relevant contact person, and generating an instant messaging interactive interface between the user and the relevant contact person under the condition of judging the relevant contact person;

establishing an augmented reality call between a user and an associated contact through the instant messaging interactive interface, shooting live-action image data based on an associated contact client under the augmented reality call mode, fusing the live-action image with a virtual object containing navigation augmented information, and generating augmented reality navigation image output;

the field device information in the live-action image data is identified to determine whether the field device is a real device.

Further, for any identified field device, different shooting angle images of the field device are obtained, whether the field device has a three-dimensional contour or not is judged by analyzing the different shooting angle images, and if the field device has the three-dimensional contour, the field device is judged to be a real device, otherwise, the field device is judged to be a virtual device.

Further, the step of setting a positioning device corresponding to the field device to collect the actual position information of the field device and judging whether the field device is a real device comprises:

for any identified field device, acquiring the name and/or number information of the field device;

acquiring corresponding standard position information according to the name and/or number information of the field equipment;

and judging whether the standard position information is matched with the actual position information acquired by the corresponding positioning device, judging as real equipment when the two pieces of position information are matched, and otherwise, judging as virtual equipment.

Further, a thermal sensing device is arranged corresponding to the field device, and the thermal sensing device is arranged on the main body structure of the field device to detect actual temperature data; the step of determining whether the field device is a real device includes:

for any identified field device, acquiring the name and/or number information of the field device;

acquiring standard temperature data corresponding to the field equipment in a normal operation state according to the name and/or number information of the field equipment;

and judging whether the standard temperature data are matched with the actual temperature data detected by the corresponding thermal sensing device, and judging as real equipment when the two temperature data are matched, or judging as false equipment if not.

Further, a machine-readable code is provided corresponding to the field device, the machine-readable code is associated with name and/or number information of the field device, and the name and/or number information of the field device is acquired by identifying the machine-readable code.

Further, presetting field check processing item information related to the equal protection evaluation in an associated application platform of the instant communication tool, wherein the field check processing item information comprises one or more field processing items, and setting an associated contact corresponding to each field processing item;

the related application platform is a WeChat public number based on a WeChat public platform, and the WeChat public number comprises a service number, a subscription number or an applet.

Further, the method also comprises the steps of before establishing the augmented reality conversation between the user and the associated contact,

an operation control used for inviting the augmented reality call is arranged in the instant communication interactive interface, the triggering information of the user to the operation control is collected, and an augmented reality call inviting message is generated and sent to the associated contact client;

and outputting the invitation message and sending out an inquiry at the associated contact client, and establishing the augmented reality conversation between the user and the associated contact when the associated contact client receives the invitation message.

Further, a positioning device is arranged corresponding to the field equipment, the associated contact client is provided with an automatic mobile laser dongle, and the automatic mobile laser dongle can automatically direct laser to the field equipment within the range of the visible distance of the camera associated with the associated contact client;

acquiring target field equipment triggered by the associated contact in the live-action image; according to the triggering operation, automatically moving a laser dongle to control a laser to point to a target field device in a real environment; and identifying the target field device through a virtual object in the live-action image, wherein the virtual object contains laser pointing information.

The invention also provides an AR auxiliary data processing device in the equal insurance evaluation, which comprises the following structures:

the information acquisition module is used for acquiring field processing items selected by a user based on the instant messaging tool;

the communication interaction module is used for judging whether the field processing item is provided with a relevant contact person or not, and generating an instant communication interaction interface between the user and the relevant contact person under the condition of judging the relevant contact person; establishing an augmented reality call between a user and an associated contact person through the instant messaging interactive interface, shooting live-action image data based on the associated contact person client side in the augmented reality call mode, fusing the live-action image with a virtual object containing navigation enhancement information, and generating augmented reality navigation image output;

and the equipment checking module is used for identifying the field equipment information in the live-action image data so as to judge whether the field equipment is real equipment.

The invention also provides an AR auxiliary data processing system in the equal insurance evaluation, which comprises a user client, an associated contact client and a system server;

the user client is used for collecting field processing items selected by the user based on the instant messaging tool;

the system server is used for judging whether the field processing items are provided with the associated contact persons or not, generating an instant messaging interactive interface between the user and the associated contact persons under the condition of judging the associated contact persons, and establishing an augmented reality call between the user and the associated contact persons through the instant messaging interactive interface;

the associated contact client is used for shooting live-action image data on site in the augmented reality communication mode and sending the live-action image data to a system server;

after receiving the live-action image data, the system server can fuse the live-action image with a virtual object containing navigation enhancement information, and generate an augmented reality navigation image to be output in the instant messaging interactive interface; and identifying field device information in the live-action image data to judge whether the field device is a real device.

Due to the adoption of the technical scheme, compared with the prior art, the invention has the following advantages and positive effects as examples: based on an instant messaging tool, the augmented reality technology is combined into field check processing items in the equal insurance evaluation, relevant personnel are guided to carry out field data acquisition through augmented reality navigation (AR navigation), and authenticity judgment is carried out on field equipment in a live-action image.

Drawings

Fig. 1 is a flowchart of an AR assistance data processing method in the assessment of equal guaranty according to an embodiment of the present invention.

Fig. 2 is a diagram of an example of a user interface of an enterprise public account according to an embodiment of the present invention.

Fig. 3 is an exemplary diagram of an interface for establishing an augmented reality session and displaying device identification information through an instant messaging interactive interface according to an embodiment of the present invention.

Fig. 4 is an exemplary diagram of an augmented reality call interface output by an associated contact client according to an embodiment of the present invention.

Fig. 5 is a schematic structural diagram of an apparatus according to an embodiment of the present invention.

Fig. 6 is a schematic structural diagram of a system according to an embodiment of the present invention.

Description of reference numerals:

a public number user interface 200, a public number head portrait 210, a project name display column 220, a field check item column 230, a processing item list 231, an augmented reality communication interface 240, a live-action image display area 241, a navigation map display area 242, an equipment list display area 243 and an equipment identification result identifier 244;

the instant messaging interactive interface 300 comprises a first party image display area 310, a device identification result identifier 311 and a second party image display area 320;

the device 400, the information acquisition module 410, the communication interaction module 420 and the equipment checking module 430;

system 500, user client 510, system server 520, and associated contacts client 530.

Detailed Description

The following describes in detail the AR auxiliary data processing method, apparatus, and system in the iso-insurance assessment disclosed in the present invention with reference to the accompanying drawings and specific embodiments. It should be noted that technical features or combinations of technical features described in the following embodiments should not be considered as being isolated, and they may be combined with each other to achieve better technical effects. In the drawings of the embodiments described below, the same reference numerals appearing in the respective drawings denote the same features or components, and may be applied to different embodiments. Thus, once an item is defined in one drawing, it need not be further discussed in subsequent drawings.

It should be noted that the structures, proportions, sizes, and other dimensions shown in the drawings and described in the specification are only for the purpose of understanding and reading the present disclosure, and are not intended to limit the scope of the invention, which is defined by the claims, and any modifications of the structures, changes in the proportions and adjustments of the sizes and other dimensions, should be construed as falling within the scope of the invention unless the function and objectives of the invention are affected. The scope of the preferred embodiments of the present invention includes additional implementations in which functions may be executed out of order from that described or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present invention.

Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate. In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.

Examples

Referring to fig. 1, a method for processing AR auxiliary data in an assessment of equal guaranty according to an embodiment of the present disclosure is provided. The method comprises the following steps:

and S100, collecting field processing items selected by the user based on the instant messaging tool.

The instant communication tool can be provided with a trigger item related to the field processing item so as to collect the selection operation of the user on the field processing item. Specifically, the field check processed item information related to the equal protection evaluation may be preset in the associated application platform of the instant communication tool, where the field check processed item information includes one or more field processed items, and a related contact may be set corresponding to each field processed item.

The Instant Messaging (IM) facility, generally referred to in the art as a client having instant messaging capabilities. By way of example and not limitation, the instant messaging tool may be a web application, a PC application, or a handheld APP application. After a user logs in an instant messaging tool through a user terminal, such as a mobile phone, a connection between an instant messaging client and an instant messaging server is established. The instant messaging tool outputs a user main interface to the user through a display structure of the user terminal, and the user main interface displays a user head portrait. The user main interface can display a contact list, a group list, a public number list and other applications pushed by the instant messaging server.

In this embodiment, the instant messaging tool is preferably a wechat, and the associated application platform is a wechat public number based on a wechat public platform. The WeChat public number may include a service number, a subscription number, or an applet. The user can set the processing item information related to the equal insurance evaluation based on the WeChat public number. Specifically, an item name, an item number, and/or an item icon are provided for each processing item.

By way of example and not limitation, such as for an existing WeChat public number "or other security assistant," a user may access the WeChat public number by searching public numbers or looking up a list of pushed public numbers. After the user selects the triggering of the WeChat public number, the display structure of the user terminal outputs a user service interaction interface 200 of the public number to the user, as shown in FIG. 2. The user service interactive interface 200 serves as a main interactive interface of a public number equal insurance assistant and is used for the visiting user to perform business operations related to equal insurance construction, such as receiving information of information security products uploaded by the user.

As a typical example, the user service interaction interface 200 may include a public account icon 210, an item name display field 220, and an event field.

The pin print 210 may be set by a service party to which the pin print belongs, a pin name may be displayed behind the pin print 210, and other related information of the pin print, such as a name of a company to which the pin print belongs, newly released product or service information, and the like may be displayed corresponding to the pin print as needed.

The item name display field 220 is used to display the item name of the currently processed item. By way of example, the project name is usually named by the name of the customer's business, such as "Jiangsu technology" in FIG. 2, representing that the user is processing the equitable assessment project information of the customer "Jiangsu technology". Optionally, a plurality of tool buttons may be further disposed in the item name display field 220 for the user to operate, for example, a contact setting button, an item data import button, a delete item button, an item mark button, and the like may be included, and the user may set contact information, import item data, delete item, and mark an important item related to the item by clicking the tool buttons.

The event field is used to display a plurality of pieces of event information related to the level (network security level) corresponding to the item (the item displayed in the item name display field 220), different pieces of event information are associated with different levels, and information such as an event name, an event number, and/or an event icon of the event can be displayed in the event field for each event. For example, the service side to which the wechat community number belongs is a shanghai × iso-insurance company, and the service side shanghai × iso-insurance company may protect the corresponding processing items set for each level of the project in its own wechat community number. The network security level protection can be divided into five levels, namely a first level (user autonomous protection level), a second level (system audit protection level), a third level (security label protection level), a fourth level (structured protection level) and a fifth level (access verification protection level), wherein different levels correspond to different item information.

Optionally, the item information in the item column is displayed in the form of an item list, as shown in fig. 2. Further optionally, when the item list is displayed, the item list may be divided into multiple stages according to needs, in this embodiment, the item list at least includes a first-stage item and a second-stage item, and each stage item corresponds to a stage name. One or more secondary items are arranged under the primary item. In the specific setting, after the processing item information set by the user is acquired, the item list of the user may be generated based on the preset processing item classification rule and the dependency relationship information. Therefore, the user can conveniently maintain and manage the matters with the affiliation.

In the present embodiment, a field check item column 230 is displayed in the item column, and field processed items are output in the form of a processed item list 231 corresponding to a plurality of field processed items, as shown in fig. 2. Optionally, the specific processing items output from the processing item list 231 may be set individually by the user, for example, the field processing items set (selected) by the user in fig. 2 include: a secure physical environment, a secure communication network, a secure zone boundary, a secure computing environment, a secure management center, a secure management authority, and a secure administrator.

In the field check item column 230, a trigger item may be provided for each field processing item, and the user may click the trigger item of each field processing item to trigger an operation related to the field processing item. Optionally, the trigger item is a trigger button corresponding to each field processing item, and an operation of clicking the trigger button by a user is used as the trigger operation.

S200, judging whether the field processing item is provided with the associated contact person, and generating an instant messaging interactive interface between the user and the associated contact person under the condition of judging the associated contact person.

When the field processing item triggered (selected) by the user is judged to have the associated contact, the associated contact information, such as an Instant Messaging (IM) communication account, is acquired, the instant messaging interaction between the user and the associated contact is established, and an instant messaging interaction interface is generated. Specifically, the instant messaging interactive interface can comprise a contact head portrait and a name of a conversation, an interactive information display field, an information input field and a tool bar. The interactive information display column is used for displaying chat information. The information input field is used for collecting the chat information of the user. The toolbar displays common voice chat controls, emoticon controls and more tool options, for example, a user can output a control display bar after triggering more tool options, and the control display bar displays application controls which can be used by the user, such as an album control, a shooting control, a video call control, a voice call control, a position control, a collection control and the like.

In this embodiment, the instant messaging interactive interface has an Augmented Reality (AR) call function, and at this time, the application control may further include an Augmented Reality (AR) call control.

S300, establishing an augmented reality call between the user and the associated contact person through the instant messaging interactive interface, shooting live-action image data based on the associated contact person client side in the augmented reality call mode, fusing the live-action image with a virtual object containing navigation enhancement information, and generating an augmented reality navigation image to output.

The method for establishing the augmented reality call between the user and the associated contact through the instant messaging interactive interface can be used for establishing the augmented reality call between the user and the associated contact when the operation message of triggering the Augmented Reality (AR) call control by the user is collected. Or, the augmented reality call between the user and the associated contact may be directly established while the instant messaging interactive interface is generated, at this time, preferably, the instant messaging interactive interface with the associated contact may be embedded in the user service interactive interface 200, as shown in fig. 3, an augmented reality call interface between the user and the associated contact "lie four-jiangsu technology" is displayed.

In the augmented reality communication mode, live-action image data of a scene can be shot based on a related contact client, and after the live-action image is fused with a virtual object containing navigation enhancement information, an augmented reality navigation image is generated and output.

In this embodiment, the navigation enhancement information may be one or more of a navigation map, a navigation guidance identifier, and navigation guidance characters, and a navigation route is set corresponding to each field processing item. And for the target field processing item, outputting a target navigation route corresponding to the target field processing item through a navigation map, a navigation guide identifier and/or navigation guide characters in the augmented reality navigation image so as to indicate. As a typical example, for example, in fig. 3, the augmented reality navigation image includes a real image display area 241 and a navigation map display area 242. The live-action image display area 241 is used for outputting live-action image data shot by a camera of the associated contact client in a recording mode, the navigation map display area 242 displays a navigation map and a navigation route, and simultaneously, the live-action image display area 241 also displays a navigation guide identifier (arrow).

In this embodiment, the virtual object may further include text information for explaining key points in the live-action image, video processing operation mode information (including repeat playing, fast and slow playing, reverse playing, freeze frame, zoom in, measurement, angle change, and the like), marker button information, a virtual object for emphasizing key targets in the real environment, and/or a virtual object for increasing interest of the real environment. Optionally, when the virtual object is output through the augmented reality call interface, collecting interaction operation information of the user and the virtual object, such as interaction of tracking, clicking, moving, and rotating the virtual object, and adjusting the displayed virtual object according to the interaction operation information.

At this time, the instant messaging interactive interface 300 output by the associated contact client is shown in fig. 4. The instant messaging interactive interface 300 outputs a conversation object "peer-to-peer" and a first party image display area 310 and a second party image display area 320, the first party image display area 310 being used for displaying a current focus video image, and the second party image display area 320 being used for displaying a non-current focus video image. In this embodiment, in order to direct the associated contact to shoot the field device, the augmented reality navigation image is output through the first-party image display area 310, and a video image of the session object "isosavant helper-mini" client in a recording state (in a case where the session object opens the camera) or a contact avatar is output through the second-party image display area 320.

In this embodiment, the captured live-action image data of the scene may be stored as the item update content of the target scene processing item.

And S400, identifying the field device information in the live-action image data to judge whether the field device is a real device.

The identification of the field device may be based on a target identification technology of image identification, and image identification may be performed on each frame image in the recorded live-action image data to acquire field device information (target information) in the image.

Preferably, a machine-readable code is provided corresponding to the field device, the machine-readable code is associated with name and/or number information of the field device, and the name and/or number information of the field device is acquired by identifying the machine-readable code.

The manner of determining whether the field device is a real device may be one of the following manners.

The first method is as follows: it is determined whether the field device image has a stereoscopic structure. Specifically, for any identified field device, different shooting angle images of the field device are obtained, whether the field device has a three-dimensional contour or not is judged by analyzing the different shooting angle images, and if the field device has the three-dimensional contour, the field device is judged to be a real device, otherwise, the field device is judged to be a virtual device.

The second method comprises the following steps: and judging whether the position relation meets the standard position information. Specifically, a positioning device is provided corresponding to the field device to acquire actual position information of the field device. At this time, the step of determining whether the field device is a real device includes: for any identified field device, acquiring the name and/or number information of the field device; acquiring corresponding standard position information according to the name and/or number information of the field equipment; and judging whether the standard position information is matched with the actual position information acquired by the corresponding positioning device, judging as real equipment when the two pieces of position information are matched, and otherwise, judging as virtual equipment.

The third method comprises the following steps: and judging whether the equipment is in a normal operation state or not. In particular, a thermal sensing device is provided for the field device, which is mounted on the body structure of the field device to detect the actual temperature data. At this time, the step of determining whether the field device is a real device includes: for any identified field device, acquiring the name and/or number information of the field device; acquiring standard temperature data corresponding to the field equipment in a normal operation state according to the name and/or number information of the field equipment; and judging whether the standard temperature data are matched with the actual temperature data detected by the corresponding thermal sensing device, and judging as real equipment when the two temperature data are matched, or judging as false equipment if not.

Therefore, the probability of video counterfeiting in remote evaluation can be effectively reduced by judging whether the field device is a real device or not.

In a preferred embodiment, the device identification result may be output through an augmented reality call interface output in the instant messaging interactive interface. Specifically, as shown in fig. 3, in the augmented reality navigation image output by the augmented reality call interface 240, an equipment list display area 243 and an equipment identification result identifier 244 are further provided. The device identification result identifier 244 is provided corresponding to the field device displayed in the device list display area 243, and is used to identify the authenticity of the field device. By way of example and not limitation, device identification result identification 244 may include an identification pattern "√" for a real device, an identification pattern for an uncertain device (no non-certain real or false) is an question mark, and an identification pattern "×" for a false device, for example, so that a user can quickly obtain the authenticity of a field device based on an augmented reality navigation image. Correspondingly, as shown in fig. 4, the first-party image display area 310 of the instant messaging interactive interface 300 is also provided with a device identification result identifier 311, which is also set corresponding to the field device displayed in the device list display area and is used for identifying the authenticity of the field device, so that the associated contact can also know the identification condition of the field device.

In another implementation manner of this embodiment, before establishing the augmented reality session between the user and the associated contact, the method may further include the steps of: an operation control used for inviting the augmented reality call is arranged in the instant communication interactive interface, the triggering information of the user to the operation control is collected, and an augmented reality call inviting message is generated and sent to the associated contact client; and outputting the invitation message and sending out an inquiry at the associated contact client, and establishing the augmented reality conversation between the user and the associated contact when the associated contact client receives the invitation message.

Optionally, a positioning device is further disposed corresponding to the field device, the associated contact client is equipped with an automatic mobile laser Dongle (Software Dongle), the automatic mobile laser Dongle includes a laser and a Dongle, and after the Dongle is inserted into a terminal where the associated contact client is located, such as a mobile phone, the terminal can obtain the person to be transported from the mobile phone and control the laser to point to the corresponding field device. The automatically moving laser dongle can automatically direct a laser at field devices within a range of camera visibility distances associated with the associated contact client. At this time, the target field device triggered by the associated contact in the live-action image can be acquired; according to the triggering operation, automatically moving a laser dongle to control a laser to point to a target field device in a real environment; and identifying the target field device through a virtual object in the live-action image, wherein the virtual object contains laser pointing information.

In another embodiment of this embodiment, the highlight position information of each field processing item may be set based on the field verification requirement of the equal insurance evaluation, and the highlight position information corresponding to each field processing item is obtained, where the navigation route corresponding to the field processing item includes all the highlight positions recorded in the highlight position information. At this time, when a navigation route is planned, the position movement information of the client of the associated contact person can be obtained; judging whether the position moving information is matched with a target navigation route; and when mismatching is judged, acquiring the residual key position information according to the current position of the associated contact client and the key position which has passed through, planning a new navigation route and outputting the new navigation route.

Referring to fig. 5, an AR auxiliary data processing apparatus in the assessment of iso-guaranty is provided as another embodiment of the present invention.

The apparatus 400 includes an information collection module 410, a communication interaction module 420, and a device check module 430.

The information collecting module 410 is used for collecting the field processing items selected by the user based on the instant messaging tool.

Specifically, the field check processed item information related to the equal protection evaluation may be preset in the associated application platform of the instant communication tool, where the field check processed item information includes one or more field processed items, and a related contact is set corresponding to each field processed item. The related application platform is a WeChat public number based on a WeChat public platform, and the WeChat public number comprises a service number, a subscription number or an applet.

The communication interaction module 420 is configured to determine whether the field processing item has a related contact, and generate an instant communication interaction interface between the user and the related contact when determining that the related contact exists; and establishing an augmented reality call between the user and the associated contact person through the instant messaging interactive interface, shooting live-action image data based on the associated contact person client side in the augmented reality call mode, fusing the live-action image with a virtual object containing navigation augmented information, and generating an augmented reality navigation image to output.

The device checking module 430 is configured to identify field device information in the live-action image data to determine whether the field device is a real device.

In an implementation manner of this embodiment, the device checking module 430 is configured to: and for any identified field device, acquiring images of the field device at different shooting angles, analyzing the images at different shooting angles to judge whether the field device has a three-dimensional profile, and judging the field device as a real device when the field device has the three-dimensional profile, or judging the field device as a virtual device if the field device does not have the three-dimensional profile.

In another embodiment of this embodiment, a positioning device is provided for the field device to collect actual position information of the field device. At this time, the device checking module 430 is configured to: for any identified field device, acquiring the name and/or number information of the field device; acquiring corresponding standard position information according to the name and/or number information of the field equipment; and judging whether the standard position information is matched with the actual position information acquired by the corresponding positioning device, judging as real equipment when the two pieces of position information are matched, and otherwise, judging as virtual equipment.

In a further embodiment of this embodiment, a thermal sensing device is provided for the field device, which is mounted on the body structure of the field device to detect the actual temperature data. At this time, the device checking module 430 is configured to: for any identified field device, acquiring the name and/or number information of the field device; acquiring standard temperature data corresponding to the field equipment in a normal operation state according to the name and/or number information of the field equipment; and judging whether the standard temperature data are matched with the actual temperature data detected by the corresponding thermal sensing device, and judging as real equipment when the two temperature data are matched, or judging as false equipment if not.

Other technical features refer to the foregoing embodiments, and each module may be configured to perform corresponding information acquisition, information transmission, and information processing processes, which are not described herein again.

Referring to fig. 6, an AR auxiliary data processing system in the assessment of iso-guaranty is provided as another embodiment of the present invention.

The system 500 includes a communicatively connected user client 510, a system server 520, and an associated contacts client 530.

The user client 510 is configured to collect the field processing items selected by the user based on the instant messaging tool.

The system server 520 is configured to determine whether the field processing item has an associated contact, generate an instant messaging interaction interface between the user and the associated contact when determining that the associated contact is present, and establish an augmented reality session between the user and the associated contact through the instant messaging interaction interface.

The associated contact client 530 is configured to capture live-action image data of a scene in the augmented reality mode, and send the live-action image data to a system server.

After receiving the live-action image data, the system server 520 may fuse the live-action image with a virtual object containing navigation enhancement information, and generate an augmented reality navigation image to be output in the instant messaging interactive interface; and identifying field device information in the live-action image data to judge whether the field device is a real device.

Other technical features are referred to in the previous embodiments and are not described herein.

It should be noted that, the terminal of the present invention, besides the mobile phone, may also be various commonly used mobile terminals such as a palm computer and a tablet computer, and various intelligent wearable electronic devices such as smart glasses and a smart watch, which are not limited herein.

An augmented reality server may be provided corresponding to augmented reality information, and the augmented reality server may perform dedicated database establishment that refers to an information database formed by a combination of POI information and feature points extracted from a photographed real image having actual geographic features (landscape, buildings, roads, etc.). For example, the augmented reality information database, the real image database, and the POI database may be included, and are configured to correspond to the server storage unit of the augmented reality server. Here, the augmented reality information database may be used to store one or more of feature points, GPS coordinates, POI information, and other related information, and interact with a commercial reporting system, a web portal, an advertisement content DB; the real image database may store actual street images and GPS coordinates matching the images; the POI database is used for storing POI information.

In the foregoing description, the disclosure of the present invention is not intended to limit itself to these aspects. Rather, the various components may be selectively and operatively combined in any number within the intended scope of the present disclosure. In addition, terms like "comprising," "including," and "having" should be interpreted as inclusive or open-ended, rather than exclusive or closed-ended, by default, unless explicitly defined to the contrary. All technical, scientific, or other terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs unless defined otherwise. Common terms found in dictionaries should not be interpreted too ideally or too realistically in the context of related art documents unless the present disclosure expressly limits them to that. Any changes and modifications of the present invention based on the above disclosure will be within the scope of the appended claims.