1. A city information and service integration system based on big data is characterized in that: the system comprises a massive multi-source heterogeneous data integration module, a multi-dimensional information visualization module, a service registration maintenance module and a city service integration module; the city information refers to data from a plurality of application service databases of a city, and the source and the structure of the city data are different, so that multi-source heterogeneous city data are formed;

the mass multi-source heterogeneous data integration module realizes the functions of loading and integrating mass multi-source heterogeneous data; the data loading is to import data from different data storage platforms and carry out a city data integration process; the data processed by the module is called integrated data, and the integrated data is provided for the multidimensional information visualization module and the service registration maintenance module, so as to provide an available data mode and a general query interface for the multidimensional information visualization module and the service registration maintenance module; the various multi-source heterogeneous data comprise a table name which is the name of a data set, a table attribute which is the field of the data set, a one-to-one correspondence relation which is established and stored in a database; the data integration is carried out on structured data and semi-structured data of each database based on SQL, and various multi-source heterogeneous data are coordinated through constructing a middleware, so that a virtual integrated XML data view, a view-based data mode and a query general interface are provided for a multi-dimensional information visualization module; the structure of the middleware is that based on the conversion between the XML mode and the relation mode, the related information in the relation mode is expressed by the hierarchical relation of the XML document, and the structured data and the semi-structured data based on the SQL are integrated; in the process of data integration, the data of each database is called as a data source, the data sources are still mutually independent, and the middleware provides retrieval service for heterogeneous data; the module further provides a data source for the service registration maintenance module and the multidimensional information visualization module after obtaining the integrated data;

the multi-dimensional information visualization module is used for realizing the presentation of the structure of the integrated data by a chart and carrying out multi-dimensional presentation on the integrated data based on the integrated data provided by the massive multi-source heterogeneous data integration module; based on data acquired by a massive multi-source heterogeneous data integration module, multi-dimensional extraction is carried out on data features to form new data features, mathematical calculation item operation is carried out on the data features formed after extraction, the operated data is graphically presented, and whether data state storage is carried out or not is judged according to presentation effects; the data multi-dimensional extraction comprises the following steps: the time dimension, the space dimension and the multi-element semantic dimension of the data; the mathematical calculation terms include sum, average, maximum and minimum; the graphical presentation comprises: line graphs, bar graphs, pie graphs, funnel graphs, and maps; after the data is subjected to multi-dimensional presentation, whether the data state is stored or not is judged according to the presentation effect;

the service registration maintenance module is used for realizing the description, registration and management of services in the system based on integrated data provided by the massive multi-source heterogeneous data integration module; the description of the semantic level of the interface description of the entity service to be registered in the system mainly comprises the following steps: service description, service parameters and service protocols, wherein the service description is divided into two categories of capability and attribute; the capabilities of the service description above include: service input, service output, service type; the attributes section of the service description includes: non-functional attributes of the service and context information of the service; the non-functional attributes of the service comprise environment information, user information and platform software and hardware information; the service context information comprises service cost, service performance and service reliability parameters; the registration service in the system is managed by adopting a structured distributed method, the service description of a service entity to be registered in the system is represented by adopting a pair of binary groups, and the binary groups comprise two contents of service names and service parameters; meanwhile, the registered service entities in the system are managed, and the operation of management comprises the steps of creating, registering, monitoring, adding, modifying, deleting and editing configuration files;

the urban service integration module is based on a service registration maintenance module and is used for realizing service search and service combination in the system; performing accurate service search based on semantic matching, abstracting a user service request and an entity service into an ontology comprising attributes and operations, and reasoning by using a search algorithm based on the ontology to realize the functions of request decomposition, sub-query management, perception service discovery and effectiveness evaluation management; and processing and executing the user request, finding needed entity service and cloud service through service discovery, selecting a plurality of services, and arranging the services to form an operable Internet of things system so as to complete a specified application task.

2. The big-data-based urban service and information integration system according to claim 1, wherein in the massive multi-source heterogeneous data integration module: through constructing a middleware, coordinating various multi-source heterogeneous data, providing a virtual integrated XML data view and a view-based data mode and a general query interface for a subsequent module, and integrating structured data and semi-structured data based on SQL; the implementation of the integration process relies on the construction of middleware; the middleware realizes the function of expressing the related information in the relation mode by the hierarchical relation of the XML document based on the conversion between the XML mode and the relation mode; in the process of constructing the middleware, firstly, a JDBC connection is established for a database, and a system automatically extracts a view in the database to finish information extraction; according to the field name, type, main key and external key of the extracted information, constructing a DOM tree and completing information synthesis; generating an intermediate DOM document; finally, serializing the DOM document to generate an XML document; query rewriting is carried out on each database, and a unified database query mode is completed; establishing an analysis mode of the XML file; and packaging the integrated data mode and the universal query interface, and outputting an SQL query result analyzed by the XML, wherein the result is the integrated data output by the module.

3. The big data based city service and information integration system of claim 1, wherein the service registration maintenance module: performing semantic level explanation on the service to be registered, wherein the explanation type comprises service description, service parameters and a service protocol; service description is divided into two types of capability and attribute; the capabilities of the service description above include: service input, service output, service type; the attributes section of the service description includes: non-functional attributes of the service and context information of the service; the non-functional attributes of the service comprise environment information, user information and platform software and hardware information; the service context information comprises service cost, service performance and service reliability parameters; the method comprises the steps that registration service in a system is managed through a structured distributed method based on a consistent hash table, registration information is represented by a pair of binary groups, and the binary groups comprise two contents of service names and service parameters; the service name refers to a unique ID of the service in the system and is used for realizing the index of a consistent hash table; the service parameters comprise physical resource information and cloud resource addresses of the service, the cloud resource addresses are formed by IPv4 addresses and port numbers, and calling of the service under distributed provision is achieved; finally, the management function for the registered service entity in the system is realized, and the management function comprises the following steps: create, register, listen, add, modify, delete, and edit configuration files.

4. The big data based city service and information integration system of claim 1, wherein: the city service integration module:

according to the request service description provided by the user, the urban service meeting the application requirement is found by adopting centralized matching search, and necessary support is provided for the user to obtain the required urban service directly or through service combination; performing accurate service search based on semantic matching, abstracting a user service request and an entity service into an ontology comprising attributes and operations, and realizing the functions of request decomposition, sub-query management, perception service discovery and effectiveness evaluation management by using a search algorithm based on the ontology; the request decomposition means that a service request body of a user is decomposed into a plurality of layered sub-bodies; sub-query management refers to creating sub-queries based on sub-ontologies; the perception service discovery means that corresponding perception services are obtained based on the sub-query; the effectiveness evaluation management refers to evaluating the matching effect of the query result and the user request; after the client side obtains the application requirements, the required entity service and cloud service are found through service searching and service combination according to the requirement processing execution plan, and a plurality of services are selected and arranged to form an operable internet of things system so as to complete the specified application task.

5. A method of a big data-based city information and service integration system is characterized by comprising the following steps:

(1) multi-source heterogeneous data integration: the method comprises two steps of data loading and data integration. Firstly, acquiring addresses of multi-source heterogeneous databases, establishing JDBC connection with the databases to obtain views in the databases, and finishing information extraction; and then, data integration is carried out by constructing a middleware, an integrated XML data view and a view-based data mode and a query general interface are established, and integrated data required in the steps of multidimensional information visualization and service registration maintenance come from the query result of the interface. The steps of establishing the integrated XML data view and the data mode and the query general interface based on the view are as follows: extracting field names, types, main keys and external keys of data in the views according to the obtained views in the databases, constructing a DOM tree, and finishing information synthesis; generating an intermediate DOM document, and performing serialization processing on the DOM document to finally generate an XML document; establishing an analysis mode of the XML file; according to the analysis mode, each database SQL statement query is rewritten to complete a uniform database query mode; packaging the integrated data mode and the query universal interface; drawing a display interface of the query result of the SQL statement from the XML analysis;

(2) and (3) multi-dimensional information visualization: firstly, sending a query request to a data mode and a universal query interface established in the multi-source heterogeneous data integration step, and acquiring a data query result of integrated data returned by the interface; drawing a multi-dimensional information visualization interface; extracting data fields and data contents in the data query result of the integrated data; constructing corresponding relations between data fields and bar charts, line graphs, funnel graphs and pie graphs; selecting data fields provided by a list by a user, or selecting data of a corresponding area by drawing a polygon in a map area by using a mouse, dragging the fields to a horizontal coordinate, a vertical coordinate and a filtering item by using the dragging of the mouse, and selecting the type of a diagram to be generated, wherein the type of the diagram comprises a histogram, a broken line diagram, a funnel diagram and a pie diagram;

(3) service registration and maintenance: firstly, sending a query request to a data mode and a query general interface established in the multi-source heterogeneous data integration step to acquire service data in the integrated data; performing semantic level description on the service description, the service parameters and the service agreement based on the service data; the service parameters comprise physical resource information and cloud resource addresses of the service, and the cloud resource addresses are formed by IPv4 addresses and port numbers; the attributes section of the service description includes: non-functional attributes of the service and context information of the service; the non-functional attributes of the service comprise environment information, user information and platform software and hardware information; the service context information comprises service cost, service performance and service reliability parameters; then, the registration information is established, and the registration information is represented by a pair of binary groups, wherein the binary groups comprise two contents of service names and service parameters. The service name refers to a unique ID of the service in the system and is used for realizing the index of a consistent hash table; constructing a consistent hash table as a tool for storing and searching registration information; compiling the management function of the registered service entity in the system, and realizing the management functions of creating, registering, monitoring, adding, modifying, deleting and editing the configuration file by performing creating, adding, inquiring and modifying operations on the consistent hash table;

(4) urban service integration: the method comprises two steps of service searching and service combining; performing accurate service search based on semantic matching, and abstracting both a user service request and an entity service into an ontology comprising attributes and operations; according to the request provided by the user, after the service registration maintenance step, the urban sub-service meeting the application requirement is found by adopting centralized matching search, thereby providing necessary support for the user to obtain the required urban service directly or through service combination; the method comprises the steps that application requirements are obtained from users, required entity services and cloud services are found through a service discovery module according to a requirement processing execution plan, and a plurality of services are selected and arranged to form an operable internet of things system so as to complete a specified application task; the method comprises the steps of giving an initial state and a target state, finding a group of service sequences to enable the initial state to reach the target state, dynamically and adaptively combining services, finding out related entity urban services according to a formal logic model, automatically determining a business flow model, and combining the found related entity services to complete urban application services.

Background

The service facilities in the cities bring living convenience to urban residents, and simultaneously accumulate massive, diversified, heterogeneous, space-time multidimensional, multi-scale and multi-granularity urban big data, the data are various in types, and the specific form of the data is difficult to describe. With the vigorous development of 'information cities', 'digital cities' and 'Internet of things', city databases with different scales and grades are built in cities, and the range of relevant city services provided based on city big data is more and more extensive. However, due to the characteristics of massive, multi-source, heterogeneous and distributed data, although the services based on urban data are gradually established and perfected in recent years, barriers still exist among service applications. Independent and relatively closed urban service applications cannot be interacted and combined, and form an 'information island' among each other.

In order to reduce 'information isolated islands' between the interior and the exterior of each service in a city, optimize city information resource allocation, promote city service resource sharing, improve the utilization efficiency of space information resources, and establish a system for realizing city information and service integration functions, the system has great effect and value on society. Through efficient distribution and service combination optimization of cross-domain heterogeneous urban service data, efficient and reliable convergence of multi-source heterogeneous service main bodies, service data and service resources is achieved, the heterogeneity and the distributivity of the data sources and the services can be shielded by the urban information and service integration system, and transparent access and management services through client operation are achieved.

After receiving a service request submitted by a user, the urban service integration platform decomposes the service through a series of analysis, selects the service meeting the requirement from the service platform according to the requirement of the user and combines the service meeting the requirement to jointly execute the task of the user. Selecting the most satisfactory combined service from a plurality of combined services for service combination is a combined optimization problem with strong NP-hard complexity. According to whether the process of service discovery and service integration is performed during task execution or processing tree or business flow model analysis, service combination in the environment of the Internet of things can be divided into two types of runtime combination and pre-runtime combination. According to a business flow model created by a user through a programming interface, a combined service execution engine dynamically selects and binds entity services or cloud services for each link in a business flow in a running mode by means of a service template, and parameter transmission and parameter mapping between services are set according to data flows in the business flow, so that combined services meeting task requirements are formed. Because the degree of service intellectualization will be increased day by day in the future, most service combinations in the environment of the internet of things are in a runtime combination form. The runtime combination method is divided into a service combination method based on a planning theory and a service combination method based on graph planning. The former and the latter are the same, after formalized conversion is carried out on the service description based on a certain formalized method, the result of the service combination is obtained by a mode capable of meeting a row reasoning mechanism. The former often has low efficiency in solving the service composition problem. The invention provides a service combination method based on graph planning, which is used for converting a combination problem into a planning graph problem and mapping services into actions in the planning graph when modeling services. And mapping the input and output parameters of the service into states, and solving a combination scheme by using the expansion and planning solution of the planning graph. Since the planning graph problem can be constructed in polynomial time, the service composition problem can be solved in a shorter time.

When urban information and services which are in a heterogeneous platform and stored in a distributed mode are integrated, a series of challenges need to be spanned, and key technical problems to be solved are as follows:

(1) multi-granularity structural description difference of multi-source heterogeneous data of massive cities

The method has the advantages that a multi-granularity segmentation and description mechanism of the urban intelligent service data is constructed, application services are used as guidance, multi-source urban service big data are effectively fused, and the understanding degree and the application level of the intelligent urban perception data are improved in depth and breadth. The method is used for constructing a unified multi-scale analysis model and an intelligent fusion method of urban multi-mode data for urban service multi-mode data.

(2) Automatic service data distribution mechanism based on semantics for urban service collaboration

The efficient matching algorithm based on the integration idea is characterized in that a plurality of matching algorithms are integrated, the matching algorithms are optimized and selected according to the state and the working load change of the current system, and the performance and the stability of service data distribution are guaranteed. The method comprises the steps of realizing dynamic on-demand distribution of service data based on a publish/subscribe system, automatically generating subscriptions expressing data distribution requirements among services by analyzing service association relations, automatically realizing deletion operation of the subscriptions after the services complete cooperative operation, and improving the expandability of the system on the premise of keeping a service loose coupling relation.

(3) Composition and optimization of graph-planned heterogeneous urban services

According to the urban service treatment and cooperation model and the specific flow of cross-domain heterogeneous urban service, a service combination method based on graph planning is provided.

Disclosure of Invention

The technical problem of the invention is solved: the method overcomes the multi-granularity structural description difference of the multi-source heterogeneous data of the massive cities, the automatic service data distribution mechanism based on the semantics of the urban service collaboration and the combination and optimization of the heterogeneous urban service based on the graph calculation.

The invention provides a big data-based urban information and service integration system, which aims at the contradiction between the distribution heterogeneity of urban services and the convergence demand of credible services, adopts the technologies of high-efficiency data distribution and service combination optimization, breaks through the obstacles of large-scale urban service main bodies in the aspects of access modes, sealing degrees and load capacities, and realizes the high-efficiency and reliable convergence of multi-source, heterogeneous and distributed service main bodies, service data and service resources. The system comprises a client browser, a data integration server and a service integration server, wherein a B/S framework is utilized to deploy a multi-source heterogeneous data integration module on the data server, a city service integration module is deployed on a service integration management server, the client accesses all modules by utilizing the browser, and the system module comprises a mass multi-source heterogeneous data integration module, a multidimensional information visualization module, a service registration maintenance module and a city service integration module.

According to the urban information and service integration system, the massive multi-source heterogeneous data integration module is used for achieving the function of integrating massive multi-source heterogeneous data, data from different data storage platforms, namely multi-source data, are imported into the urban information and service integration system for urban data integration, and available data modes and general query interfaces are provided for the multi-dimensional information visualization module and the service registration maintenance module. The module functions include: querying an integrated data view, a mode, a structure and content; encapsulating the source data, and converting the data of the multi-source data into the same format which can be processed by the integrated system; constructing an XML data view of the multi-source heterogeneous data set; analyzing the XML view, completing node mapping, and acquiring table, field and data information; establishing JDBC connection with a source database, copying data into a data integration server, and finishing data import; outputting the SQL request result through an integrated data mode and a universal query interface to complete the query of data; the user requests to query data through the client, and the query returned result is the integrated data output by the module.

In the urban information and service integration system, the multidimensional information visualization module realizes presentation of loaded integrated data in a chart based on integrated data provided by a massive multi-source heterogeneous data integration module, and the functions include: customizing data presentation dimensions, filtering data presentation granularity, setting a measurement item calculation item and setting a chart configuration item in a dragging or table filling mode; the calculation items comprise summation, average, maximum and minimum values; the presentation comprises various multi-dimensional presentation types including a line graph, a bar graph, a pie graph and a funnel graph, and all the dimensions of the data can be presented.

According to the urban information and service integration system, the service registration maintenance module is used for realizing description, registration and management of services in the system based on integrated data provided by the massive multi-source heterogeneous data integration module, so that the system can quickly position sub-services required by a user for requesting services; the module uses semantic level description for the interface description of entity service to be registered in the system, and the main description comprises the following steps: service description, service parameters, and service agreement. Service description is divided into two categories of capability and attribute; the capabilities of the service description above include: service input, service output, service type. The attributes section of the service description includes: non-functional attributes of the service and context information of the service; the non-functional attributes of the service comprise environment information, user information and platform software and hardware information; the service context information comprises service cost, service performance and service reliability parameters; the module adopts a structured distributed method based on a consistent hash table to manage the registration service in the system. The service description is used as service registration information in the system and is represented by a pair of binary groups, and the binary groups comprise two contents of service names and service parameters. The service name refers to a unique ID of the service in the system, and can be used for realizing the index of a consistent hash table, and the service parameters include physical resource information and cloud resource addresses of the service. The cloud resource address is composed of an IPv4 address and a port number, and calling of the service under distributed provision is realized; finally, the module realizes the management of the registered service entities in the system, and the management operation comprises the following steps: create, register, listen, add, modify, delete, and edit.

The city information and service integration system comprises a city service integration module, a service registration maintenance module and a service combination module, wherein the city service integration module is based on the service registration maintenance module and is used for realizing service searching and service combination in the system; the module finds out the urban sub-service meeting the application requirement by adopting centralized matching search according to the request service description provided by the user, thereby providing necessary support for the user to obtain the required urban service directly or through service combination; the method specifically realizes accurate service search based on semantics, abstracts user service requests and entity services into an ontology containing attributes and operations, and utilizes a discovery mechanism based on the ontology to carry out reasoning, thereby realizing the functions of request decomposition, sub-query management, perception service discovery and effectiveness evaluation management; the request decomposition specifically means that a service request body of a user is decomposed into a plurality of layered sub-bodies; the sub-query management specifically refers to creating sub-queries based on sub-ontologies; the perception service discovery specifically refers to obtaining corresponding perception services based on the sub-query; the effectiveness evaluation management specifically refers to evaluating the matching effect of the query result and the user request; the module acquires user requirements from a client, finds needed entity services and cloud services through service discovery according to a requirement processing execution plan, selects a plurality of services and arranges the services to form an operable Internet of things system so as to complete a specified application task; the method specifically realizes a map planning-based cross-domain heterogeneous city service combination method, dynamic self-adaptive service combination, finds out related entity city services according to a formal logic model, automatically determines a business flow model and combines the found related entity services to complete city application services.

According to another aspect of the present invention, a method for a big data based city information and service integration system is provided, which comprises the following steps:

step (1) integration of massive multi-source heterogeneous data

Firstly, through constructing a middleware, coordinating various multi-source heterogeneous data, providing a virtual integrated XML data view and a view-based data mode and a general query interface for a subsequent module, and integrating structured data and semi-structured data based on SQL. In the process, all data sources are still mutually independent, and the middleware is equivalent to providing a high-level retrieval service for heterogeneous data; the middleware is realized based on the conversion between the XML mode and the relation mode, and the function of expressing the related information in the relation mode by the hierarchical relation of the XML document is realized; by establishing JDBC connection for the database, the system automatically extracts the view in the database to complete information extraction; according to the field name, type, main key and external key of the extracted information, constructing a DOM tree and completing information synthesis; an intermediate DOM document is generated. Finally, serializing the DOM document to generate an XML document; query rewriting is carried out on each database, and a unified database query mode is completed; establishing an analysis mode of the XML file; packaging the integrated data mode and the universal query interface, and outputting an SQL query result analyzed by XML;

step (2) multidimensional information visualization

Displaying data integrated by massive multi-source heterogeneous data through a list, and then displaying all fields corresponding to the selected data set by selecting a corresponding data set; dragging the field to a measurement item and a filtering and screening area by using a mouse, and selecting the type of the chart to be generated, wherein the type of the chart comprises a bar chart, a line chart, a funnel chart, a pie chart and a configuration item through setting various charts; providing presentation of various types of charts for the loaded data set, the functions comprising: customizing data presentation dimension, filtering data presentation granularity, setting a measurement item, setting calculation items such as summation, average, maximum and minimum, and setting various chart configuration items such as chart titles and reference lines;

step (3) service registration maintenance

Performing semantic level explanation on the service to be registered, wherein the explanation type comprises service description, service parameters and a service protocol; service description is divided into two types of capability and attribute; the capabilities of the service description above include: service input, service output, service type. The attributes section of the service description includes: non-functional attributes of the service and context information of the service; the non-functional attributes of the service comprise environment information, user information and platform software and hardware information; the service context information comprises service cost, service performance and service reliability parameters; a structured distributed method based on consistent hash tables is employed to manage registration services in a system. The registration information is represented by a pair of binary groups, which include both the service name and the service parameter. The service name refers to a unique ID of the service in the system, and can be used for realizing the index of a consistent hash table, and the service parameters include physical resource information and cloud resource addresses of the service. The cloud resource address is composed of an IPv4 address and a port number, and calling of the service under distributed provision is realized; finally, the management function of the registered service entity in the system is realized, and the management function comprises the following steps: creating, registering, monitoring, adding, modifying, deleting and editing a configuration file;

step (4) urban service integration

The city service integration module receives an external service request, extracts demand information according to the request information and calls the demand; receiving an external request, analyzing and extracting service-related demand information; processing the processed demand information, finding out the city sub-service meeting the application demand through centralized matching search, and generating a relevant data request command and a service request command for calling the service; and sending the data request command to the data integration module, acquiring related data, and sending the data to a service called by the service request command.

Compared with the prior art, the invention has the beneficial effects that:

(1) multi-granularity structural description difference of multi-source heterogeneous data of massive cities

The method has the advantages that a multi-granularity segmentation and description mechanism of the urban intelligent service data is constructed, application services are used as guidance, multi-source urban service big data are effectively fused, and the understanding degree and the application level of the intelligent urban perception data are improved in depth and breadth. The method is used for constructing a unified multi-scale analysis model and an intelligent fusion method of urban multi-mode data for urban service multi-mode data.

(2) Automatic service data distribution mechanism based on semantics for urban service collaboration

The efficient matching algorithm based on the integration idea is characterized in that a plurality of matching algorithms are integrated, the matching algorithms are optimized and selected according to the state and the working load change of the current system, and the performance and the stability of service data distribution are guaranteed. The method comprises the steps of realizing dynamic on-demand distribution of service data based on a publish/subscribe system, automatically generating subscriptions expressing data distribution requirements among services by analyzing service association relations, automatically realizing deletion operation of the subscriptions after the services complete cooperative operation, and improving the expandability of the system on the premise of keeping a service loose coupling relation.

(3) Composition and optimization of graph-planned heterogeneous urban services

According to the urban service management and cooperation model and the specific flow of cross-domain heterogeneous urban service, a service combination method based on graph planning is provided, and the optimal service combination result can be solved in polynomial time by the algorithm.

(4) The establishment of an integrated system of the mass multi-source heterogeneous data and the urban service is realized through the functions of mass multi-source heterogeneous data integration, multi-dimensional information visualization, service registration maintenance and service integration management, the data and the service which are respectively dispersed are integrated, isomorphism and unification are carried out through the integrated system, and a transparent and convenient interface is provided for a user to access the urban integrated data and use the urban integrated service;

(5) according to the invention, the urban information resource allocation is optimized through the integration of massive multi-source heterogeneous data and services, the urban service resource sharing is promoted, and the practical application of the urban information and service integration system is promoted.

Drawings

FIG. 1 is a general block diagram of the present invention;

FIG. 2 is a block diagram of the system of the present invention;

FIG. 3 is a process for implementing a mass multi-source heterogeneous data integration module in the system of the present invention;

FIG. 4 is a process for implementing a multidimensional information visualization module in the system of the present invention;

FIG. 5 is a service registration maintenance module implementation in the system of the present invention;

FIG. 6 is a municipal service integration implementation process in the system of the present invention;

FIG. 7 is a flowchart of an algorithm in an expansion phase of a service composition algorithm implemented based on graph planning;

fig. 8 is an algorithm flowchart of a solution phase in a service composition algorithm implemented based on graph planning.

Detailed Description

The following detailed description of embodiments of the present invention is provided in connection with the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.

As shown in fig. 1-8, the big data-based urban information and service integration system is deployed at a server, various multi-source heterogeneous information data are imported into the system, a data server is deployed with a multi-source heterogeneous data integration module and a multi-dimensional information visualization module, and a service integration management server is deployed with a service registration maintenance module and an urban service integration module;

the whole system is realized as follows:

(1) when a service request function occurs in a client, the client and a service integration server record the request, the service integration server completes service description on the service request based on semantic analysis, calls a service combination function based on the result of the service description, decomposes service requirements, calls an integrated data query interface and acquires service data. When the client server communicates with the service integration server and the data integration server, filtering data stream at a TCP/IP port of the client, recording user service behaviors and data resource submission behaviors and forming a recording result file;

(2) the massive multi-source heterogeneous data integration module is used for reading various external multi-source heterogeneous data, inputting a resource address of a data source by importing an Excel file and executing an SQL script mode, and storing the resource address in a system database. And constructing a data structure conversion middleware, integrating multi-source heterogeneous data, packaging the integration process into an integrated data mode and a universal query interface, and allowing each client to acquire related data by requesting a service call interface.

(3) And the multidimensional information visualization module is used for calling an integrated data mode and a general query interface provided by the massive multi-source heterogeneous data integration module according to a user request to acquire the required data. Analyzing the type of the required data, and drawing different data tables according to the calling result of the user; defining the data presentation dimension by user, filtering the granularity of data presentation, setting a measurement item, and setting a calculation item (summation, average, maximum and minimum) of the measurement item.

(4) The service registration maintenance module is used for explaining the semantic hierarchy of the service to be registered, and the explanation type comprises service description, service parameters and a service protocol; service description is divided into two types of capability and attribute; the capabilities of the service description above include: service input, service output, service type. The attributes part of the service description above includes: the attributes section of the service description includes: non-functional attributes of the service and context information of the service; the non-functional attributes of the service comprise environment information, user information and platform software and hardware information; the service context information comprises service cost, service performance and service reliability parameters; a structured distributed method based on consistent hash tables is employed to manage registration services in a system. The registration information is represented by a pair of binary groups, which include both the service name and the service parameter. The service name refers to a unique ID of the service in the system, and can be used for realizing the index of a consistent hash table, and the service parameters include physical resource information and cloud resource addresses of the service. The resource address is composed of an IPv4 address and a port number, and the calling of the service under distributed provision is realized; finally, the management function of the registered service entity in the system is realized, and the management function comprises the following steps: creating, registering, monitoring, adding, modifying, deleting and editing a configuration file;

(5) the urban service integration module is divided into two parts, namely service searching and service combining; performing accurate service search based on semantic matching, abstracting both a user service request and an entity service into an ontology comprising attributes and operations, and realizing the functions of request decomposition, sub-query management, perception service discovery and effectiveness evaluation management by using a discovery algorithm based on the ontology; according to the request service description provided by the user, a centralized semantic matching search algorithm is adopted to provide necessary support for the user to obtain the required urban service directly or through service combination according to the urban sub-service meeting the application requirement; the method comprises the steps of obtaining application requirements from a client, processing according to the requirements, then executing a plan, finding needed entity services and cloud services through a service discovery algorithm, selecting a plurality of services, and arranging the services to form an operable Internet of things system so as to complete a specified application task; the method is particularly based on a graph planning algorithm to realize a cross-domain heterogeneous city service combination method, dynamically self-adapting service combination, finding out related entity city services according to a formal logic model, automatically determining a business flow model and combining the found related entity services to finish city application services.

According to an embodiment of the present invention, the implementation process is implemented as follows:

1. hardware device model selection

The hardware types of the client server and the central server are as follows:

the minimum configuration requirement of the client server is as follows:

CPU main frequency: 1GHz

Memory: 2GB

Hard disk capacity: 1T

An Ethernet card: hundred million

The minimum configuration requirement of the central server is as follows:

CPU main frequency: 128GHz

Memory: 64GB

Hard disk capacity: 128T

An Ethernet card: kilomega

2. Mass multi-source heterogeneous data integration module

The implementation process of the module is shown in FIG. 3: the implementation of the construction middleware is based on the conversion between the XML mode and the relation mode, and the function of expressing the related information in the relation mode by the hierarchical relation of the XML document is realized; by establishing JDBC connection for the database, the system automatically extracts the view in the database to complete information extraction; according to the field name, type, main key and external key of the extracted information, constructing a DOM tree and completing information synthesis; an intermediate DOM document is generated. Finally, serializing the DOM document to generate an XML document; query rewriting is carried out on each database, and a unified database query mode is completed; establishing an analysis mode of the XML file; packaging the integrated data mode and the universal query interface, and outputting an SQL query result analyzed by XML; when a data request occurs, the return of the target data is completed through the data mode and the query general interface.

3. Multidimensional information visualization module

The implementation process of the module is shown in fig. 4: and calling an integrated data mode and a general query interface provided by the massive multi-source heterogeneous data integration module according to a user request to acquire the required data. And analyzing the type of the required data, and drawing different data tables according to the calling result of the user. And when the user selects the refreshing operation, repeatedly calling the integrated data query interface to acquire the latest integrated data visual display. When the user selects the saving operation and needs to save the related parameters, the name of the data set is saved in the corresponding name field of the data set, the data processing state is changed from draft to save, and some descriptive information is written in the description field of the data set.

4. Service registration maintenance module

The module realizes the functions of describing, registering and managing the service, and the realization process is shown in figure 5. The method mainly comprises the following steps:

(1) and constructing a semantic descriptor to describe the service at a semantic level. The description specifically includes a service description, service parameters, and a service agreement. Service descriptions are specifically divided into two categories, capabilities and attributes. The capabilities of the service description above include: service input, service output, service type. The attributes section of the service description includes: non-functional attributes of the service and context information of the service; the non-functional attributes of the service comprise environment information, user information and platform software and hardware information; the service context information comprises service cost, service performance and service reliability parameters;

(2) and constructing a registration service in the consistent hash table management system. The registration information is represented by a pair of binary groups, which include both the service name and the service parameter. The service name refers to a unique ID of the service in the system, and can be used for realizing the index of a consistent hash table, and the service parameters include physical resource information and cloud resource addresses of the service. The resource address is composed of an IPv4 address and a port number, and the calling of the service under distributed provision is realized;

(3) basic operations of the service are realized, including creation, registration, listening, addition, modification, deletion and editing. And the database statement is used for realizing the functions of creating, inserting, deleting and editing the service based on the service registry.

5. City service integrated module

The implementation process of the module is shown in fig. 6: the implementation is mainly divided into two steps, namely service searching and service combining; performing accurate service search based on semantic matching, abstracting a user service request and an entity service into an ontology comprising attributes and operations, and reasoning by using a discovery mechanism based on the ontology to realize the functions of request decomposition, sub-query management, perception service discovery and effectiveness evaluation management; according to the request service description provided by the user, the urban sub-service meeting the application requirement is found by adopting centralized matching search, so that necessary support is provided for the user to obtain the required urban service directly or through service combination; the method comprises the steps of obtaining application requirements from a user side, finding needed entity services and cloud services through a service discovery module according to a requirement processing execution plan, selecting a plurality of services, and arranging the services to form an operable internet of things system so as to complete a specified application task; the method is particularly based on a graph planning algorithm to realize a cross-domain heterogeneous city service combination method, dynamically self-adapting service combination, finding out related entity city services according to a formal logic model, automatically determining a business flow model and combining the found related entity services to finish city application services.

The main process of implementing service combination by the graph planning algorithm is shown in fig. 7 and 8: the graph planning algorithm is divided into two phases, an expansion phase and a solution phase. The algorithm is mainly summarized in that given an initial state and a target state, a group of service sequences are found so that the initial state reaches the target state. The graph planning algorithm is divided into an expansion phase and a solution phase. In the expansion stage, a new service is expanded by using an iteration method according to a given initial state and a new state is obtained until a final target state is unchanged after one-step iteration, and the expansion is finished. If the planning graph enters the static layer, the planning graph shows that no planning solution meeting the requirements is available, and the initial state reaches the target state. Otherwise, a reverse solution stage is started, a group of action sets with the back-drive states meeting the target state are searched for the target state, a new target state is obtained through the group of action sets, and a planning solution of the planning problem is obtained until all the target states are in the initial state, namely a group of service sequences are obtained, so that the initial state can be transferred to the target state.

The specific service combination steps are as follows:

(1) and mapping the service combination problem to a graph planning solution problem, and constructing edges and nodes of a planning graph based on the following steps.

i. Mapping the city service to an action in the graph planning;

mapping the input parameter of the city service to a precursor state pre (action) of the action;

mapping the output parameter of the urban service into a post-driving state pos (action) of the action;

mapping of service requests of users to initial states S in graph planning_initial；

v. mapping the service combination result obtained from the service request of the user to the final state S in the graph plan_final；

Action and state sets and edges and nodes that make up the planning graph.

(2) And completing the building of the extension phase of the planning graph.

And repeating the following steps to construct each layer of state set and action set until the final state is totally appeared in the state set or the state set is not updated any more.

i. Constructing a first-layer state set by taking the content of the user service request as an initial state of a planning graph;

searching the action meeting the service request condition according to the state set of the upper layer and adding the action to a new action set;

traversing the obtained action set, and adding the post-removal state of each action to a state set of a next layer;

(3) and completing the establishment of the solution phase of the planning graph.

For each final state S_finalA set of action sets satisfying the service request condition is searched, and the predecessor state pre (action) of each action in the action set is used as a new final state set.

And repeating the processes to form a new final state set until a group of service combination solutions which are transferred from the initial state to the final state are obtained when the initial state is backtracked.

The above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, several modifications and variations can be made without departing from the technical principle of the present invention, and these modifications and variations should also be regarded as the protection scope of the present invention.