1. A control method for an audio/video acquisition device is characterized by comprising the following steps:

acquiring historical position data of a target user;

constructing a location feature vector based on the historical location data;

judging a first position where the target user appears based on the position feature vector;

determining at least one audio/video device for audio/video acquisition on the first position according to the first position;

and controlling the at least one audio and video device to execute the operation of audio and video acquisition of the target user.

2. The method of claim 1, wherein the method of constructing a location feature vector based on the historical location data comprises:

constructing a first position feature vector, a second position feature vector and a third position feature vector based on the historical position data; wherein the first location feature vector characterizes a feature vector constructed based on historical location data of the target user over different time periods; the second location feature vector characterizes a feature vector constructed based on historical location data of the target user in a different space; the third position feature vector represents a feature vector constructed based on the motion trail of the target user; wherein the motion trail is generated according to historical position data of the target user;

and determining the position feature vector of the target user by utilizing a first preset model according to the first position feature vector, the second position feature vector and the third position feature vector and the first credibility, the second credibility and the third credibility which respectively correspond to the first position feature vector, the second position feature vector and the third position feature vector.

3. The method of claim 2, wherein the method of constructing a first location feature vector based on the historical location data comprises,

constructing a first position feature vector using the following equation (1):

wherein, P₁(u) denotes a first position feature vector, I denotes the ith time dimension of all time dimensions I, | chromatic<u,t,l>∈Cu₁|t＝t_1,iDenotes the historical position data of the target user in the ith time dimension at the 1 st time period, a<u,t,l>∈Cu_n|t＝t_n,iDenotes the historical position data of the target user in the nth time period in the ith time dimension, σ₁A feature importance value, σ, representing historical location data of the target user in the ith time dimension for the 1 st time period_nA characteristic importance value T representing historical location data of the target user in the ith time dimension in the nth time period_MIs a first characteristic parameter, D is a second characteristic parameter, M₀Is the third characteristic parameter.

4. The method of claim 2, wherein the method of constructing a second location feature vector based on the historical location data comprises,

constructing a second position feature vector using the following equation (2):

wherein, P₂(u) represents the second position feature vector, I represents the ith spatial dimension of all spatial dimensions I, | chromatic<u,t,l>∈Cu₁|l＝l_1,iDenotes the historical position data of the target user in the 1 st spatial dimension, | a leaf<u,t,l>∈Cu_n|l＝l_n,iDenotes the historical position data of the target user in the nth spatial dimension, β₁A feature importance value, σ, representing historical location data of a target user in the 1 st spatial dimension in the ith spatial dimension_nRepresenting the historical position of the target user in the nth spatial range in the ith spatial dimensionCharacteristic importance value of data, T_M'is a first characteristic parameter, D' is a second characteristic parameter, M₀' is a third characteristic parameter.

5. The method of claim 2, wherein the method of constructing a third location feature vector based on the historical location data comprises,

constructing a third position feature vector using the following equation (3):

wherein, P₃(u) represents a third location feature vector,represents the motion trajectory of the target user,indicating the location of the target user at a first time,indicating the location of the target user at the nth time, T_M"is a first characteristic parameter, D" is a second characteristic parameter, M₀"is the third characteristic parameter.

6. The method of claim 1, wherein the determining the first location of the target user based on the location feature vector comprises:

acquiring a current position vector of the target user at the current moment;

and determining a first position of the target user at the next moment by utilizing a second preset model based on the current position vector and the position feature vector.

7. The method of claim 1, wherein determining at least one audio-video device for audio-video capture of the first location based on the first location comprises:

determining a first range of the target user for performing activities according to the first position;

acquiring an acquisition area corresponding to each audio device;

determining at least one audio and video device with an intersection between the acquisition area and the first range according to the first range and the acquisition area;

and determining at least one audio/video device with intersection between the acquisition area and the first range as at least one audio/video device for audio/video acquisition of the first position.

8. An audio/video acquisition device control apparatus, comprising:

the acquisition module is used for acquiring historical position data of a target user;

a construction module for constructing a location feature vector based on the historical location data;

the prejudging module is used for judging a first position where the target user appears based on the position feature vector;

the determining module is used for determining at least one audio and video device for audio and video acquisition of the first position according to the first position;

and the control module is used for controlling the at least one audio and video device to start executing audio and video acquisition of the target user.

9. An electronic device, comprising: a processor and a memory for storing a computer program capable of running on the processor; wherein the content of the first and second substances,

the processor is adapted to perform the steps of the method of any one of claims 1 to 7 when running the computer program.

10. A storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, performs the steps of the method of any one of claims 1 to 7.

Background

At present, for some important places, a plurality of audio-video acquisition devices are often arranged to acquire audio-video data. The data collected by each audio-video capture device needs to be stored, and under some conditions, the audio-video data collected within at least a preset time (for example, within one or two years) may even be required to be stored. Because the number of the set audio and video acquisition devices is large and the storage time span is large, users often need to purchase a large memory to store audio and video data.

Based on this, the prior art provides a solution, namely, when there is no monitoring target in the monitoring area, the audio/video acquisition device in the monitoring area is closed, and only when the monitoring target appears in the monitoring area, the audio/video acquisition is performed. Therefore, unnecessary acquisition of audio and video data can be reduced, and the storage space of the audio and video data is reduced.

However, in the above manner, when a monitoring target appears in the monitoring area, the background often needs a long period of time to recognize the appearance of the monitoring target. After the audio and video data are identified, the audio and video acquisition equipment is in a closed state, and a period of time is required from the time the audio and video acquisition equipment is started to the time the audio and video data can be acquired by the audio and video acquisition equipment, so that the audio and video data are acquired in a lagging manner, and important audio and video data can be omitted.

Disclosure of Invention

The invention aims to provide a control method and device of audio and video acquisition equipment, electronic equipment and a storage medium, which can effectively acquire audio and video data and prevent important data from being omitted when the audio and video data are acquired.

The technical scheme of the invention is realized as follows:

the embodiment of the invention provides a control method of audio and video acquisition equipment, which comprises the following steps:

acquiring historical position data of a target user;

constructing a location feature vector based on the historical location data;

judging a first position where a target user appears based on the position feature vector;

determining at least one audio/video device for audio/video acquisition at the first position according to the first position;

and controlling at least one audio and video device to execute the operation of audio and video acquisition of the target user.

In one embodiment, a method for constructing a location feature vector based on historical location data includes:

constructing a first position feature vector, a second position feature vector and a third position feature vector based on the historical position data; wherein the first location feature vector characterizes a feature vector constructed based on historical location data of the target user over different time periods; the second position feature vector represents a feature vector constructed based on historical position data of the target user in different spaces; the third position feature vector represents a feature vector constructed based on the motion track of the target user; the motion trail is generated according to historical position data of the target user;

and determining the position feature vector of the target user by utilizing a first preset model according to the first position feature vector, the second position feature vector and the third position feature vector and the first confidence level, the second confidence level and the third confidence level respectively corresponding to the first position feature vector, the second position feature vector and the third position feature vector.

In one embodiment, a method for constructing a first location feature vector based on historical location data includes,

constructing a first position feature vector using the following equation (1):

wherein, P₁(u) denotes a first position feature vector, I denotes the ith time dimension of all time dimensions I, | chromatic<u,t,l>∈Cu₁|t＝t_1,iDenotes the historical position data of the target user in the ith time dimension at the 1 st time period, a<u,t,l>∈Cu_n|t＝t_n,iDenotes the historical position data of the target user in the nth time period in the ith time dimension, σ₁Representing objects in the ith time dimensionCharacteristic importance value, sigma, of historical location data of user in 1 st time period_nA characteristic importance value T representing historical location data of the target user in the ith time dimension in the nth time period_MIs a first characteristic parameter, D is a second characteristic parameter, M₀Is the third characteristic parameter.

In one embodiment, a method for constructing a second location feature vector based on historical location data includes,

constructing a second position feature vector using the following equation (2):

wherein, P₂(u) represents the second position feature vector, I represents the ith spatial dimension of all spatial dimensions I, | chromatic<u,t,l>∈Cu₁|l＝l_1,iDenotes the historical position data of the target user in the 1 st spatial dimension, | a leaf<u,t,l>∈Cu_n|l＝l_n,iDenotes the historical position data of the target user in the nth spatial dimension, β₁A feature importance value, σ, representing historical location data of a target user in the 1 st spatial dimension in the ith spatial dimension_nA characteristic importance value T representing historical position data of the target user in the nth spatial dimension_M'is a first characteristic parameter, D' is a second characteristic parameter, M₀' is a third characteristic parameter.

In one embodiment, a method for constructing a third location feature vector based on historical location data includes,

constructing a third position feature vector using the following equation (3):

wherein, P₃(u) represents a third location feature vector,represents the motion trajectory of the target user,indicating the location of the target user at a first time,indicating the location of the target user at the nth time, T_M"is a first characteristic parameter, D" is a second characteristic parameter, M₀"is the third characteristic parameter.

In one embodiment, a method for determining a first position where a target user appears at a next time based on a position feature vector includes:

acquiring a current position vector of a target user at the current moment;

and determining a first position where the target user appears at the next moment by utilizing a second preset model based on the current position vector and the position feature vector.

In one embodiment, a method for determining at least one audio-video device for audio-video capture at a first location according to the first location includes:

determining a first range of activities of a target user according to the first position;

acquiring an acquisition area corresponding to each audio device;

determining at least one audio and video device with an intersection between the acquisition area and the first range according to the first range and the acquisition area;

and determining at least one audio and video device with intersection between the acquisition area and the first range as the at least one audio and video device for audio and video acquisition of the first position.

The invention also provides a control device of the audio and video acquisition equipment, which comprises:

the acquisition module is used for acquiring historical position data of a target user;

a construction module for constructing a location feature vector based on historical location data;

the pre-judging module is used for judging a first position where a target user appears at the next moment based on the position feature vector;

the determining module is used for determining at least one audio/video device for audio/video acquisition on the first position according to the first position;

and the control module is used for controlling at least one audio and video device to start executing audio and video acquisition of a target user.

The present invention also provides an electronic device, comprising: a processor and a memory for storing a computer program capable of running on the processor; wherein the content of the first and second substances,

the processor is adapted to perform the steps of any of the methods described above when running the computer program.

The invention also provides a storage medium in which a computer program is stored, which, when executed by a processor, implements the steps of any of the above-described methods.

The control method, the control device, the electronic equipment and the storage medium of the audio and video acquisition equipment provided by the invention are used for acquiring historical position data of a target user; constructing a location feature vector based on the historical location data; judging a first position where a target user appears based on the position feature vector; determining at least one audio/video device for audio/video acquisition at the first position according to the first position; and controlling at least one audio and video device to execute the operation of audio and video acquisition of the target user. The method and the device can pre-judge the position of the user which is possibly generated in advance according to the historical position data of the user, further control the audio and video acquisition equipment corresponding to the position to be started in advance to acquire the audio and video data, and prevent the audio and video acquisition equipment from missing important data when acquiring the data.

Drawings

Fig. 1 is a schematic flow chart of a control method of an audio and video acquisition device according to an embodiment of the present invention;

fig. 2 is a schematic structural diagram of a control device of an audio and video acquisition device according to an embodiment of the present invention;

fig. 3 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples.

The embodiment of the invention provides a control method of an audio and video acquisition device, which comprises the following steps of:

step 101: acquiring historical position data of a target user;

step 102: constructing a location feature vector based on the historical location data;

step 103: judging a first position where a target user appears based on the position feature vector;

step 104: determining at least one audio/video device for audio/video acquisition at the first position according to the first position;

step 105: and controlling at least one audio and video device to execute the operation of audio and video acquisition of the target user.

Specifically, historical position data of the target user can be acquired from audio and video data acquired by the audio and video acquisition device in the past. For example, if the audio/video capture device a has previously captured the target user present at the capture location L1 at time t1, time t2,...... times tn, and the audio/video capture device B has previously captured the target user present at the capture location L2 at time t1 ', time t 2',.... times, and time tn ', respectively, then the historical location data of the target user may be determined to be (t1, L1), (t2, L1),...., (tn, L1), and (t 1', L2), (t2 ', L2),.., (tn', L2).

In addition, different target users correspond to different historical position data because different behavior tracks of different users are different.

After collecting the historical location data of the target user, a location feature vector of the target user may be constructed based on the collected historical location data.

Specifically, in one embodiment, constructing a location feature vector based on historical location data includes:

constructing a first position feature vector, a second position feature vector and a third position feature vector based on the historical position data; wherein the first location feature vector characterizes a feature vector constructed based on historical location data of the target user over different time periods; the second position feature vector represents a feature vector constructed based on historical position data of the target user in different spaces; the third position feature vector represents a feature vector constructed based on the motion track of the target user; the motion trail is generated according to historical position data of the target user;

and determining the position feature vector of the target user by utilizing a first preset model according to the first position feature vector, the second position feature vector and the third position feature vector and the first confidence level, the second confidence level and the third confidence level respectively corresponding to the first position feature vector, the second position feature vector and the third position feature vector.

Because different users tend to have different behavior habits, a first position feature vector representing the behavior habits of the target user can be determined from the time perspective, a second position feature vector representing the behavior habits of the target user can be determined from the space perspective, and a third position feature vector representing the behavior habits of the target user can be determined from the previous motion trajectory of the target user. The behavior habits of the target user are represented from the three angles, and the effect of comprehensive and accurate judgment can be achieved.

Here, since time may be divided into a plurality of dimensions, the first location feature vector characterizing the target user behavior habit may be determined from the plurality of time dimensions. For example, time may be divided into the following dimensions: day and night; spring, summer, autumn and winter; weekdays, holidays, and the like. Determining the first location feature vector characterizing the target user's behavior habits from different time dimensions can be more accurate.

Further, in an embodiment, constructing the first location feature vector based on the historical location data includes:

constructing a first position feature vector using the following equation (1):

wherein, P₁(u) denotes a first position feature vector, I denotes the ith time dimension of all time dimensions I, | chromatic<u,t,l>∈Cu₁|t＝t_1,iDenotes the historical position data of the target user in the ith time dimension at the 1 st time period, a<u,t,l>∈Cu_n|t＝t_n,iDenotes the historical position data of the target user in the nth time period in the ith time dimension, σ₁A feature importance value, σ, representing historical location data of the target user in the ith time dimension for the 1 st time period_nA characteristic importance value T representing historical location data of the target user in the ith time dimension in the nth time period_MIs a first characteristic parameter, D is a second characteristic parameter, M₀Is the third characteristic parameter.

Also, since the space may be divided into multiple dimensions, the second location feature vector characterizing the target user behavior habits may be determined from the multiple spatial dimensions. For example, space can be divided into the following dimensions: a work area and a rest area; loud and quiet locations; public places and personal places, etc. Determining the second location feature vector characterizing the target user behavior habits from different spatial dimensions can be more accurate.

Further, in an embodiment, constructing the second location feature vector based on the historical location data includes:

constructing a second position feature vector using the following equation (2):

wherein, P₂(u) represents the second position feature vector, I represents the ith spatial dimension of all spatial dimensions I, | chromatic<u,t,l>∈Cu₁|l＝l_1,iDenotes the historical position data of the target user in the 1 st spatial dimension, | a leaf<u,t,l>∈Cu_n|l＝l_n,iDenotes the historical position data of the target user in the nth spatial range in the ith spatial dimension，β₁A feature importance value, σ, representing historical location data of a target user in the 1 st spatial dimension in the ith spatial dimension_nA characteristic importance value T representing historical position data of the target user in the nth spatial dimension_M'is a first characteristic parameter, D' is a second characteristic parameter, M₀' is a third characteristic parameter.

Besides analyzing the behavior habits of the target user from time and space, the past behavior habits of the target user can be analyzed from the past motion trajectory of the target user, and a third position feature vector representing the behavior habits of the target user is determined.

In one embodiment, constructing a third location feature vector based on the historical location data includes:

constructing a third position feature vector using the following equation (3):

wherein, P₃(u) represents a third location feature vector,represents the motion trajectory of the target user,indicating the location of the target user at a first time,indicating the location of the target user at the nth time, T_M"is a first characteristic parameter, D" is a second characteristic parameter, M₀"is the third characteristic parameter.

The first position characteristic vector, the second position characteristic vector and the third position characteristic vector represent behavior habits of a target user from the angles of time, space and motion trail, so that the first position which is possibly generated at the next moment of the user can be accurately predicted by utilizing the first position characteristic vector, the second position characteristic vector and the third position characteristic vector, and audio and video acquisition equipment for acquiring audio and video of the first position is started in advance, so that when the target user is generated, audio and video data can be acquired in time, and the acquisition of important audio and video data is avoided from being omitted.

After the first, second and third location feature vectors are obtained, according to the first, second and third location feature vectors, first, second and third confidence levels respectively corresponding to the first, second and third location feature vectors are obtained, and then the first, second, third and first preset models are utilized to determine the location feature vector of the target user.

Here, the first reliability, the second reliability, the third reliability, and the first preset model may be obtained by performing model training on a conventional data sample. The trained first confidence level, second confidence level, third confidence level and first preset model can be used for determining the position feature vector of the target user. The first predetermined model here may be a neural network model.

Because the behavior of the user has a certain rule, the first position of the target user appearing at the next moment can be well predicted by using the past position data of the target user for prediction.

In one embodiment, the determining a first position where the target user appears at the next moment based on the position feature vector includes:

acquiring a current position vector of a target user at the current moment;

and determining a first position where the target user appears at the next moment by utilizing a second preset model based on the current position vector and the position feature vector.

Here, the second preset model may also be a neural network model.

After the current position vector and the position feature vector of the target user are input into the second preset model, the second preset model can output a first position which is possibly appeared by the target user at the next moment. The second preset model can realize higher accuracy of the prediction result through training.

Further, in an embodiment, determining, according to the first location, at least one audio/video device for performing audio/video capture on the first location includes:

determining a first range of activities of a target user according to the first position;

acquiring an acquisition area corresponding to each audio device;

determining at least one audio and video device with an intersection between the acquisition area and the first range according to the first range and the acquisition area;

and determining at least one audio and video device with intersection between the acquisition area and the first range as the at least one audio and video device for audio and video acquisition of the first position.

Here, after the first position is determined, the first range in which the target user performs the activity may be determined according to a preset range. For example, a range within 2 meters of the periphery of the first position may be set as the first range. The first range may also be determined based on actual scene conditions. For example, all sofa positions around a sofa position range is the first range.

After the first range and the acquisition area corresponding to each audio device are determined, at least one audio and video device with the intersection of the acquisition area and the first range is used as at least one audio and video device for audio and video acquisition at the first position, so that the audio and video acquisition device is started in advance to acquire audio and video data.

The control method of the audio and video acquisition equipment provided by the embodiment of the invention is used for acquiring historical position data of a target user; constructing a location feature vector based on the historical location data; judging a first position where a target user appears based on the position feature vector; determining at least one audio/video device for audio/video acquisition at the first position according to the first position; and controlling at least one audio and video device to execute the operation of audio and video acquisition of the target user. According to the scheme of the embodiment of the invention, the position of the user which is possibly generated can be pre-judged in advance according to the historical position data of the user, so that the audio and video acquisition equipment corresponding to the position is controlled to be started in advance to acquire the audio and video data, and important data are prevented from being omitted when the audio and video acquisition equipment acquires the data.

In order to implement the method according to the embodiment of the present invention, an embodiment of the present invention further provides a control device for an audio/video acquisition device, which is disposed on an electronic device, and as shown in fig. 2, the control device 200 for an audio/video acquisition device includes: the device comprises an acquisition module 201, a construction module 202, a prejudgment module 203, a determination module 204 and a control module 205; wherein the content of the first and second substances,

an obtaining module 201, configured to obtain historical location data of a target user;

a construction module 202, configured to construct a location feature vector based on the historical location data;

the prejudging module 203 is configured to judge a first position where the target user appears based on the position feature vector;

the determining module 204 is configured to determine, according to the first location, at least one audio/video device that performs audio/video acquisition on the first location;

the control module 205 is configured to control at least one audio/video device to perform an operation of audio/video capture of a target user.

In practical application, the obtaining module 201, the constructing module 202, the prejudging module 203, the determining module 204 and the controlling module 205 may be implemented by a processor in a control device of the audio/video collecting device.

It should be noted that: the above-mentioned apparatus provided in the above-mentioned embodiment is only exemplified by the division of the above-mentioned program modules when performing operations, and in practical applications, the above-mentioned processing distribution may be completed by different program modules according to needs, that is, the internal structure of the terminal is divided into different program modules to complete all or part of the above-mentioned processing. In addition, the apparatus provided by the above embodiment and the method embodiment belong to the same concept, and the specific implementation process thereof is described in the method embodiment and is not described herein again.

Based on the hardware implementation of the program module, in order to implement the method according to the embodiment of the present invention, an electronic device (computer device) is also provided in the embodiment of the present invention. Specifically, in one embodiment, the computer device may be a terminal, and its internal structure diagram may be as shown in fig. 3. The computer apparatus includes a processor a01, a network interface a02, a display screen a04, an input device a05, and a memory (not shown in the figure) connected through a system bus. Wherein processor a01 of the computer device is used to provide computing and control capabilities. The memory of the computer device comprises an internal memory a03 and a non-volatile storage medium a 06. The nonvolatile storage medium a06 stores an operating system B01 and a computer program B02. The internal memory a03 provides an environment for the operation of the operating system B01 and the computer program B02 in the nonvolatile storage medium a 06. The network interface a02 of the computer device is used for communication with an external terminal through a network connection. The computer program is executed by the processor a01 to implement the method of any of the above embodiments. The display screen a04 of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device a05 of the computer device may be a touch layer covered on the display screen, a button, a trackball or a touch pad arranged on a casing of the computer device, or an external keyboard, a touch pad or a mouse.

Those skilled in the art will appreciate that the architecture shown in fig. 3 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

The device provided by the embodiment of the present invention includes a processor, a memory, and a program stored in the memory and capable of running on the processor, and when the processor executes the program, the method according to any one of the embodiments described above is implemented.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include transitory computer readable media (transmyedia) such as modulated data signals and carrier waves.

It will be appreciated that the memory of embodiments of the invention may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The described memory for embodiments of the present invention is intended to comprise, without being limited to, these and any other suitable types of memory.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.

The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.