5G intelligent rod
1. A5G smart pole, comprising:
the lighting module is used for correspondingly adjusting the lighting brightness of the current lighting environment according to a target instruction which is input by the voice module and corresponds to the target voice signal;
the detection module is used for acquiring a dynamic video of the current lighting environment, detecting and feeding back video lighting information based on the dynamic video, and performing feedback adjustment on corresponding lighting brightness based on the video lighting information;
and the transmission module is used for judging the communication condition between the detection module and the appointed terminal and transmitting the dynamic video, the feedback information and the adjustment result to the appointed terminal for displaying according to the communication condition.
2. The 5G smart bar of claim 1, wherein:
the target instruction includes: one or more of adjusting brightness only, adjusting brightness from high brightness to low brightness, adjusting brightness from low brightness to high brightness, and randomly adjusting brightness instructions.
3. The 5G smart bar of claim 1, wherein:
the voice module consists of a voice acquisition unit and a voice processing unit;
the voice acquisition unit is used for acquiring an environmental sound signal of the current environment of the user when acquiring a target voice signal input by the user;
the voice processing unit is used for determining whether a target voice signal input by a user is a mixed signal or not when the target voice signal is obtained, if so, amplifying the mixed signal by a preset multiple and converting the mixed signal into a mixed audio voice signal;
the voice processing unit is further configured to amplify the environmental sound signal by a preset multiple, convert the environmental sound signal into an environmental audio voice signal, place the environmental audio voice signal in a preset model, perform spectrum analysis on the environmental audio voice signal, obtain a spectrum coefficient sequence, then respectively obtain a first amplitude spectrum and a second amplitude spectrum of the spectrum coefficient sequence, respectively place the first amplitude spectrum and the second amplitude spectrum at positions corresponding to a preset matrix based on the arrangement of the first amplitude spectrum and the second amplitude spectrum, respectively place an element on the preset matrix in a vacancy after the first amplitude spectrum and the second amplitude spectrum are placed in the preset matrix, obtain a mode of data of the first amplitude spectrum and the second amplitude spectrum, and fill the vacancy;
the voice processing unit is further configured to acquire a trace of the preset matrix, separate the environmental audio voice signal into a plurality of signal segments, acquire spectral coefficients corresponding to the signal segments, obtain correlation degrees between the trace of the matrix and the spectral coefficients, sort the corresponding signal segments according to the correlation degrees from high to low, and calculate energy of the environmental audio voice signal;
the voice processing unit is further configured to obtain a first smooth domain and a second smooth domain of the environmental audio voice signal respectively based on the first amplitude spectrum and the second amplitude spectrum, obtain a smooth window function based on the first smooth domain and the second smooth domain, and obtain a value-taking domain of the smooth window function;
the voice processing unit is further configured to establish a test model based on the upper and lower limits of the value-taking domain, define an energy value of the test model as 1, place the environmental audio voice signal in the test model, use the environmental audio voice signal as a test background, use the remaining part as a test foreground, remove the energy value of the environmental audio voice signal, use the remaining energy value as the energy value of the test foreground, and draw a reverse environmental audio voice signal by using a trend curve of the test foreground;
the voice processing unit is further configured to superimpose the reverse environment audio voice signal and the mixed audio voice signal, cancel an environment audio voice signal included in the mixed audio voice signal, and acquire a voice instruction signal;
the voice module is also used for converting the voice instruction signal into a digital control instruction and controlling the lighting module to carry out corresponding work;
wherein, the digital control instruction is a target instruction.
4. The 5G smart bar of claim 1, wherein:
the detection module comprises:
the feedback detection unit is used for detecting video illumination information feedback based on the dynamic video in the current illumination and adjusting the dynamic video according to the illumination information;
and the monitoring unit is used for acquiring the condition of the current lighting environment in real time and generating a dynamic video.
5. The 5G smart bar of claim 4, wherein:
the transmission module consists of a judgment unit and a transmission unit;
the transmission module is also used for acquiring the dynamic video, the feedback information and the adjustment result and generating a transmission instruction;
the transmission module is further used for judging a connection mode between the detection module and the appointed terminal based on the transmission instruction;
the judging unit is used for acquiring the connection condition of wired connection when the connection mode between the detection module and the appointed terminal is effective, switching the connection mode between the detection module and the appointed terminal into wireless connection if the wired connection is in a disconnection state, and otherwise, determining the connection mode between the detection module and the appointed terminal into wired connection;
the transmission unit is used for transmitting the feedback information and the adjustment result to the appointed terminal for display in a wired transmission mode when the connection mode between the detection module and the appointed terminal is wired connection, compressing the dynamic video, transmitting the compressed dynamic video to the appointed terminal in the wired transmission mode and decompressing the compressed dynamic video;
and the transmission unit is also used for transmitting the dynamic video, the feedback information and the adjustment result to the appointed terminal for displaying in a wireless transmission mode when the connection mode between the detection module and the appointed terminal is wireless connection.
6. The 5G smart bar of claim 4,
the transmission module is further used for transmitting the dynamic video, the feedback information and the adjustment result to a specified terminal for displaying based on the transmission instruction;
the detection module is used for sending a detection signal to the specified terminal based on the transmission instruction;
the judgment transmission module is further configured to collect an electric wave signal between the detection module and the designated terminal, and determine that the connection between the detection module and the designated terminal is abnormal when the energy value of the electric wave signal is smaller than a preset energy value;
otherwise, determining that the connection between the detection module and the appointed terminal is normal, and generating a reverse detection instruction;
the detection module is also used for controlling the appointed terminal to respectively transmit wired detection data and wireless detection data to the detection module;
the judging unit is also used for respectively acquiring wired data and wireless data received by the detection module;
the judging unit is further configured to obtain an arrangement structure of the wired data, divide the wired data into different structural domains based on different arrangement structures, extract information of each structural domain, and obtain an original data chain of each structural domain;
similarly, acquiring a wireless data original data chain;
the judging unit is further configured to perform similarity matching on the wired original data chain and the wired detection data, obtain a matched domain value, mark a domain with a domain value of zero, define the domain as a lost region, obtain useful information included in the data chain corresponding to the lost region on the wired detection data, and determine that wired connection between the designated terminal and the detection module is abnormal if the useful information is main information;
the judging unit is further configured to determine that the connection mode between the designated terminal and the detection module is wired connection if the useful information included in the data chain of the lost area belongs to non-main information;
the transmission unit is further configured to change a connection mode between the designated terminal and the detection module to be a wireless connection when the wired connection between the designated terminal and the detection module is abnormal.
7. The 5G smart bar of claim 3, wherein:
the voice module is also used for storing standard voice instructions in advance and classifying all the standard voice instructions according to the control requirements of the standard voice instructions;
the voice processing unit is also used for extracting each keyword in the voice instruction signal and acquiring a corresponding word feature vector;
the voice processing unit is also used for acquiring the voice instruction signal and calculating the inspection type of the voice instruction according to a formula (I);
wherein L isjRepresenting the dispersion of said speech command from the jth of said standard speech command classes, cjqAn instruction feature vector representing the q standard voice instruction in the jth standard voice instruction category, k representing the number of standard voice instructions in the jth standard voice instruction category, ciA word feature vector representing the ith keyword in the voice instruction, n representing the total number of the keywords in the voice instruction, d representing the classification number in the target category, determined according to the classification number of the target instruction, and generally taking 3, and T representing the transposition of the vector;
the voice processing unit is also used for selecting the category with the lowest discrete degree with the keywords in the voice instruction as the inspection category based on the calculation result of the formula (I);
the voice processing unit is also used for calculating a standard voice instruction with the lowest dispersion degree with the voice instruction in the inspection category according to a formula (II);
wherein, wfAn instruction feature vector representing the voice instruction and an f-th entry within the inspection classThe dispersion of the instruction feature vectors of the standard voice instruction, L represents the dispersion of the voice instruction and the detection category, x represents the number of the word feature vectors of the f-th standard voice instruction, cfzThe feature vector of the z th word in the f standard voice command is represented, h represents the number of the standard voice commands in the checking category, and k represents the number of the standard keywords in the checking category;
and the voice processing unit is also used for acquiring the standard voice command matched with the voice command based on the calculation result of the formula (II), determining the purpose of the voice command, transmitting the voice command to the lighting terminal and carrying out corresponding work.
8. The 5G smart bar of claim 5, wherein:
the detection module is further configured to calculate, by using a formula (iii), a signal-to-noise ratio of the dynamic video when the dynamic video is transmitted from the detection module to the designated terminal, when the detection module is connected to the designated terminal in a wired connection manner:
wherein λ represents a signal-to-noise ratio when the dynamic video is transmitted to the designated terminal by the detection module, p represents a transmission power when the dynamic video is transmitted to the designated terminal by the detection module, j represents noise interference in a wired transmission process, t represents a unit time period when the dynamic video is transmitted, r represents a unit time period when the dynamic video is transmitted, andtthe transmission quantity of the dynamic video at the time t is represented, and a represents a wired transmission path loss index;
the judging unit is further configured to generate a retransmission instruction when the signal-to-noise ratio of the dynamic video transmitted to the designated terminal by the detecting module is higher than a standard signal-to-noise ratio based on a calculation result;
and the transmission module is also used for acquiring the fragments of the dynamic video with the signal-to-noise ratio higher than the standard signal-to-noise ratio based on the retransmission instruction, performing secondary transmission and replacing the original dynamic video.
Background
At present, street lamps in China mainly have a lighting function, and with the arrival of the 5G era, street lamps are used as city infrastructure and are the most widely and uniformly distributed Internet of things in cities, so that an intelligent control intelligent rod is expanded on the existing street lamp rods, and the single and limited control mode of the traditional street lamp rods is broken;
at present, the existing control methods mainly include: firstly, through infrared remote control, secondly through close range button control, only can adjust the light in infrared acceptable range or personnel manual operation within range, steerable distance is short, and can only adjust step by step, if need adjust to a certain low luminance from certain hi-lite many times, still there is a control mode, though do not need button or remote control, trigger self auto-induction according to the current luminance condition of external environment, it generally can only maintain a luminance and throw light on, consequently, to the control drawback that exists now, the invention provides a 5G wisdom pole.
Disclosure of Invention
The invention provides a 5G intelligent rod which is used for remotely controlling the brightness of an illumination module and performing feedback adjustment by sending out voice signals, so that the problem of short controllable distance in the traditional control mode is solved, the brightness of the intelligent rod can be adjusted at will, and the adjustment flexibility of the intelligent rod is improved.
The present invention provides a 5G intelligent stick, comprising:
the lighting module is used for correspondingly adjusting the lighting brightness of the current lighting environment according to a target instruction which is input by the voice module and corresponds to the target voice signal;
the detection module is used for acquiring a dynamic video of the current lighting environment, detecting and feeding back video lighting information based on the dynamic video, and performing feedback adjustment on corresponding lighting brightness based on the video lighting information;
and the transmission module is used for judging the communication condition between the detection module and the appointed terminal and transmitting the dynamic video, the feedback information and the adjustment result to the appointed terminal for displaying according to the communication condition.
In one way that can be achieved,
the target instruction includes: the target instruction includes: one or more of adjusting brightness only, adjusting brightness from high brightness to low brightness, adjusting brightness from low brightness to high brightness, and randomly adjusting brightness instructions.
In one way that can be achieved,
the voice module consists of a voice acquisition unit and a voice processing unit;
the voice acquisition unit is used for acquiring an environmental sound signal of the current environment of the user when acquiring a target voice signal input by the user;
the voice processing unit is used for determining whether a target voice signal input by a user is a mixed signal or not when the target voice signal is obtained, if so, amplifying the mixed signal by a preset multiple and converting the mixed signal into a mixed audio voice signal;
the voice processing unit is further configured to amplify the environmental sound signal by a preset multiple, convert the environmental sound signal into an environmental audio voice signal, place the environmental audio voice signal in a preset model, perform spectrum analysis on the environmental audio voice signal, obtain a spectrum coefficient sequence, then respectively obtain a first amplitude spectrum and a second amplitude spectrum of the spectrum coefficient sequence, respectively place the first amplitude spectrum and the second amplitude spectrum at positions corresponding to a preset matrix based on the arrangement of the first amplitude spectrum and the second amplitude spectrum, respectively place an element on the preset matrix in a vacancy after the first amplitude spectrum and the second amplitude spectrum are placed in the preset matrix, obtain a mode of data of the first amplitude spectrum and the second amplitude spectrum, and fill the vacancy;
the voice processing unit is further configured to acquire a trace of the preset matrix, separate the environmental audio voice signal into a plurality of signal segments, acquire spectral coefficients corresponding to the signal segments, obtain correlation degrees between the trace of the matrix and the spectral coefficients, sort the corresponding signal segments according to the correlation degrees from high to low, and calculate energy of the environmental audio voice signal;
the voice processing unit is further configured to obtain a first smooth domain and a second smooth domain of the environmental audio voice signal respectively based on the first amplitude spectrum and the second amplitude spectrum, obtain a smooth window function based on the first smooth domain and the second smooth domain, and obtain a value-taking domain of the smooth window function;
the voice processing unit is further configured to establish a test model based on the upper and lower limits of the value-taking domain, define an energy value of the test model as 1, place the environmental audio voice signal in the test model, use the environmental audio voice signal as a test background, use the remaining part as a test foreground, remove the energy value of the environmental audio voice signal, use the remaining energy value as the energy value of the test foreground, and draw a reverse environmental audio voice signal by using a trend curve of the test foreground;
the voice processing unit is further configured to superimpose the reverse environment audio voice signal and the mixed audio voice signal, cancel an environment audio voice signal included in the mixed audio voice signal, and acquire a voice instruction signal;
the voice module is also used for converting the voice instruction signal into a digital control instruction and controlling the lighting module to carry out corresponding work;
wherein, the digital control instruction is a target instruction.
In one way that can be achieved,
the detection module comprises:
the feedback detection unit is used for detecting video illumination information feedback based on the dynamic video in the current illumination and adjusting the dynamic video according to the illumination information;
and the monitoring unit is used for acquiring the condition of the current lighting environment in real time and generating a dynamic video.
In one way that can be achieved,
the transmission module is also used for acquiring the dynamic video, the feedback information and the adjustment result and generating a transmission instruction;
the transmission module is further used for judging a connection mode between the detection module and the appointed terminal based on the transmission instruction;
the judging unit is used for acquiring the connection condition of wired connection when the connection mode between the detection module and the appointed terminal is effective, switching the connection mode between the detection module and the appointed terminal into wireless connection if the wired connection is in a disconnection state, and otherwise, determining the connection mode between the detection module and the appointed terminal into wired connection;
the transmission unit is used for transmitting the feedback information and the adjustment result to the appointed terminal for display in a wired transmission mode when the connection mode between the detection module and the appointed terminal is wired connection, compressing the dynamic video, transmitting the compressed dynamic video to the appointed terminal in the wired transmission mode and decompressing the compressed dynamic video;
and the transmission unit is also used for transmitting the dynamic video, the feedback information and the adjustment result to the appointed terminal for displaying in a wireless transmission mode when the connection mode between the detection module and the appointed terminal is wireless connection.
In one way that can be achieved,
the transmission module is further used for transmitting the dynamic video, the feedback information and the adjustment result to a specified terminal for displaying based on the transmission instruction;
the detection module is used for sending a detection signal to the specified terminal based on the transmission instruction;
the judgment transmission module is further configured to collect an electric wave signal between the detection module and the designated terminal, and determine that the connection between the detection module and the designated terminal is abnormal when the energy value of the electric wave signal is smaller than a preset energy value;
otherwise, determining that the connection between the detection module and the appointed terminal is normal, and generating a reverse detection instruction;
the detection module is also used for controlling the appointed terminal to respectively transmit wired detection data and wireless detection data to the detection module;
the judging unit is also used for respectively acquiring wired data and wireless data received by the detection module;
the judging unit is further configured to obtain an arrangement structure of the wired data, divide the wired data into different structural domains based on different arrangement structures, extract information of each structural domain, and obtain an original data chain of each structural domain;
similarly, acquiring a wireless data original data chain;
the judging unit is further configured to perform similarity matching on the wired original data chain and the wired detection data, obtain a matched domain value, mark a domain with a domain value of zero, define the domain as a lost region, obtain useful information included in the data chain corresponding to the lost region on the wired detection data, and determine that wired connection between the designated terminal and the detection module is abnormal if the useful information is main information;
the judging unit is further configured to determine that the connection mode between the designated terminal and the detection module is wired connection if the useful information included in the data chain of the lost area belongs to non-main information;
the transmission unit is further configured to, when the wired connection between the designated terminal and the detection module is abnormal, change the connection mode between the designated terminal and the detection module to be wireless connection, and transmit the dynamic video, the feedback information, and the adjustment result to the designated terminal in a wireless transmission mode for display;
and the transmission unit is further configured to transmit the feedback information and the adjustment result to the designated terminal for display when the designated terminal is connected with the detection module in a wired manner, compress the dynamic video to a preset size, and transmit the dynamic video to the designated terminal for decompression.
In one way that can be achieved,
the voice module is also used for storing standard voice instructions in advance and classifying all the standard voice instructions according to the control requirements of the standard voice instructions;
the voice processing unit is also used for extracting each keyword in the voice instruction and acquiring a corresponding word feature vector;
the voice processing unit is also used for acquiring the voice instruction signal and calculating the inspection type of the voice instruction according to a formula (I);
wherein L isjRepresenting the dispersion of said speech command from the jth of said standard speech command classes, cjqAn instruction feature vector representing the q standard voice instruction in the jth standard voice instruction category, k representing the number of standard voice instructions in the jth standard voice instruction category, ciA word feature vector representing the ith keyword in the voice instruction, n representing the total number of the keywords in the voice instruction, d representing the classification number in the target category, determined according to the classification number of the target instruction, and generally taking 3, and T representing the transposition of the vector;
the voice processing unit is also used for selecting the category with the lowest discrete degree with the keywords in the voice instruction as the inspection category based on the calculation result of the formula (I);
the voice processing unit is also used for calculating a standard voice instruction with the lowest dispersion degree with the voice instruction in the inspection category according to a formula (II);
wherein, wfThe dispersion of the instruction characteristic vector of the voice instruction and the instruction characteristic vector of the f-th standard voice instruction in the inspection category is represented, and L represents the dispersion of the voice instruction and the detection categoryX represents the number of word feature vectors of the f-th standard speech instruction, cfzThe feature vector of the z th word in the f standard voice command is represented, h represents the number of the standard voice commands in the checking category, and k represents the number of the standard keywords in the checking category;
and the voice processing unit is also used for acquiring the standard voice command matched with the voice command based on the calculation result of the formula (II), determining the purpose of the voice command, transmitting the voice command to the lighting terminal and carrying out corresponding work.
In one way that can be achieved,
the detection module is further configured to calculate, by using a formula (iii), a signal-to-noise ratio of the dynamic video when the dynamic video is transmitted from the detection module to the designated terminal, when the detection module is connected to the designated terminal in a wired connection manner:
wherein λ represents a signal-to-noise ratio when the dynamic video is transmitted to the designated terminal by the detection module, p represents a transmission power when the dynamic video is transmitted to the designated terminal by the detection module, j represents noise interference in a wired transmission process, t represents a unit time period when the dynamic video is transmitted, r represents a unit time period when the dynamic video is transmitted, andtthe transmission quantity of the dynamic video at the time t is represented, and a represents a wired transmission path loss index;
the judging unit is further configured to generate a retransmission instruction when the signal-to-noise ratio of the dynamic video transmitted to the designated terminal by the detecting module is higher than a standard signal-to-noise ratio based on a calculation result;
and the transmission module is also used for acquiring the fragments of the dynamic video with the signal-to-noise ratio higher than the standard signal-to-noise ratio based on the retransmission instruction, performing secondary transmission and replacing the original dynamic video.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention.
In the drawings:
FIG. 1 is a schematic diagram of a 5G smart stick according to an embodiment of the present invention;
FIG. 2 is a schematic view of a voice control process of a 5G smart stick according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a data transmission process of a 5G smart stick according to an embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
Example 1
An embodiment of the present invention provides a 5G smart stick, as shown in fig. 1, including:
the lighting module is used for correspondingly adjusting the lighting brightness of the current lighting environment according to a target instruction which is input by the voice module and corresponds to the target voice signal;
the detection module is used for acquiring a dynamic video of the current lighting environment, detecting and feeding back video lighting information based on the dynamic video, and performing feedback adjustment on corresponding lighting brightness based on the video lighting information;
and the transmission module is used for judging the communication condition between the detection module and the appointed terminal and transmitting the dynamic video, the feedback information and the adjustment result to the appointed terminal for displaying according to the communication condition.
In this example, the target voice signal represents a voice signal issued by a user to control the lighting module;
in this example, the target instruction represents the purpose of a target speech signal uttered by the user;
in this example, the dynamic video represents the video conditions of the current lighting environment;
in this example, the connection condition indicates a mode between the detection module and the designated terminal, and includes two types, namely wired connection and wireless connection;
in this example, the user can replace the designated terminal as required;
in this embodiment, add new function for the wisdom pole: the detection module detects the current lighting environment condition and transmits the current lighting environment condition to a designated terminal for reference of a user;
in this embodiment, detecting and feeding back video illumination information based on a dynamic video, and performing feedback adjustment on corresponding illumination brightness based on the video illumination information includes:
the method comprises the steps of firstly carrying out frame division on a dynamic video, determining the current brightness of each frame, simultaneously obtaining the overall brightness of the dynamic video, obtaining the corresponding actual brightness from a preset database (a mapping relation table between the brightness of an image and the brightness of ambient illumination and the brightness corresponding to a user instruction) according to the overall brightness, comparing the preset brightness with the actual brightness according to the user instruction, and if the preset brightness is not reached, carrying out feedback adjustment on an illumination module to reach the brightness expected by a user.
In the process of feedback adjustment, if a feedback adjustment prohibition instruction input by a user is received, the lighting module only adjusts according to the target instruction, and if the feedback adjustment prohibition instruction input by the user is not received, the lighting module can perform comprehensive adjustment according to the target instruction and the feedback information.
The beneficial effect of above-mentioned design is: through sending voice signal and coming remote control lighting module's luminance and feedback control, not only solved the problem that the controllable distance of traditional control mode is short, can also adjust the luminance of wisdom pole at will, improve its regulation flexibility ratio.
Example 2
Based on embodiment 1, an embodiment of the present invention provides a 5G smart bar, in a target voice command:
the target instruction includes: the target instruction includes: one or more of adjusting brightness only, adjusting brightness from high brightness to low brightness, adjusting brightness from low brightness to high brightness, and randomly adjusting brightness instructions.
The beneficial effect of above-mentioned design is: the type of the target voice command which can be sent by the user is determined, the brightness of the lamp is convenient to adjust automatically, and the flexibility of intelligent control is improved.
Example 3
Based on embodiment 1, an embodiment of the present invention provides a 5G smart stick, in which a voice module processes a voice command of a user, as shown in fig. 2, the method includes:
the voice module consists of a voice acquisition unit and a voice processing unit;
the voice acquisition unit is used for acquiring an environmental sound signal of the current environment of the user when acquiring a target voice signal input by the user;
the voice processing unit is used for determining whether a target voice signal input by a user is a mixed signal or not when the target voice signal is obtained, if so, amplifying the mixed signal by a preset multiple and converting the mixed signal into a mixed audio voice signal;
the voice processing unit is further configured to amplify the environmental sound signal by a preset multiple, convert the environmental sound signal into an environmental audio voice signal, place the environmental audio voice signal in a preset model, perform spectrum analysis on the environmental audio voice signal, obtain a spectrum coefficient sequence, then respectively obtain a first amplitude spectrum and a second amplitude spectrum of the spectrum coefficient sequence, respectively place the first amplitude spectrum and the second amplitude spectrum at positions corresponding to a preset matrix based on the arrangement of the first amplitude spectrum and the second amplitude spectrum, respectively place an element on the preset matrix in a vacancy after the first amplitude spectrum and the second amplitude spectrum are placed in the preset matrix, obtain a mode of data of the first amplitude spectrum and the second amplitude spectrum, and fill the vacancy;
the voice processing unit is further configured to acquire a trace of the preset matrix, separate the environmental audio voice signal into a plurality of signal segments, acquire spectral coefficients corresponding to the signal segments, obtain correlation degrees between the trace of the matrix and the spectral coefficients, sort the corresponding signal segments according to the correlation degrees from high to low, and calculate energy of the environmental audio voice signal;
the voice processing unit is further configured to obtain a first smooth domain and a second smooth domain of the environmental audio voice signal respectively based on the first amplitude spectrum and the second amplitude spectrum, obtain a smooth window function based on the first smooth domain and the second smooth domain, and obtain a value-taking domain of the smooth window function;
the voice processing unit is further configured to establish a test model based on the upper and lower limits of the value-taking domain, define an energy value of the test model as 1, place the environmental audio voice signal in the test model, use the environmental audio voice signal as a test background, use the remaining part as a test foreground, remove the energy value of the environmental audio voice signal, use the remaining energy value as the energy value of the test foreground, and draw a reverse environmental audio voice signal by using a trend curve of the test foreground;
the voice processing unit is further configured to superimpose the reverse environment audio voice signal and the mixed audio voice signal, cancel an environment audio voice signal included in the mixed audio voice signal, and acquire a voice instruction signal;
the voice module is also used for converting the voice instruction signal into a digital control instruction and controlling the lighting module to carry out corresponding work;
wherein, the digital control instruction is a target instruction.
In this embodiment, the target speech signal is mainly a sound signal emitted by the user, and the ambient sound signal is mainly a sound signal emitted by the ambient environment of the user;
in this example, the mixed signal consists of a sound signal emitted by the user and a noise signal of the surroundings of the user.
In this example, the process of performing spectral analysis on the environmental audio speech signal to transform the environmental audio speech signal into a frequency domain, and then analyzing the frequency of a unit time period;
in this example, the sequence of spectral coefficients of the ambient audio speech signal represents a collection of ratios of frequencies per unit time period to a predetermined frequency;
for example, if the frequency in the unit time period of the P-environment audio speech signal is [2, 6, 4, 2], the preset frequency is 2, and then the corresponding spectral coefficient is [1, 3, 2, 1 ];
when the ratio of the frequency in the unit time period of the environment audio voice signal to the preset frequency is a fraction, rounding the ratio to reserve a valid number;
for example, if the frequency of the Q-environment audio speech signal in the unit time period is [3, 6, 7, 2], the preset frequency is 2, and then the corresponding spectral coefficient is [2, 3, 3, 1 ];
in this example, the first amplitude spectrum represents a difference between one coefficient in the sequence of spectral coefficients and an average value of two adjacent coefficients, and the spectral coefficients may refer to amplitude values at different frequencies;
in this example, the second amplitude spectrum represents the amplitude difference between a certain coefficient in the sequence of spectral coefficients and the corresponding preset standard coefficient at the same frequency, and the coefficient also refers to the amplitude value at different frequencies.
In this example, the trace of the preset matrix represents the sum of the elements on the main diagonal of the preset matrix;
in this example, the correlation degree between the trace of the preset matrix and the spectral coefficient represents the absolute difference value between the trace of the preset matrix and the spectral coefficient, and the smaller the absolute difference value is, the higher the correlation degree between the trace of the preset matrix and the spectral coefficient is, and vice versa;
in this embodiment, the mode of the first magnitude spectrum and the second magnitude spectrum data is obtained and the gap is filled, and when the mode does not exist, the gap is filled with 0.
In this example, the method for obtaining the smooth domain is as follows: and dividing the environment audio signal into a preset number of detection domains, and performing corresponding operation, wherein the smooth domain represents a corresponding domain determined by acquiring the minimum value in the slope formed by the starting point and the end point of each detection domain of the environment audio signal.
In this example, the energy value of the inverse ambient audio speech signal is the same as the residual energy value.
The beneficial effect of above-mentioned design is: through the mixed audio signal when gathering the voice command that the user sent, gather current illumination environment sound signal simultaneously, carry out reverse processing with environment sound signal, acquire the anti-signal of environment sound, and superpose with mixed audio signal, can effectively avoid environmental noise to disturb voice command, influence voice module and judge user's control purpose, utilize the effectual environment sound signal who eliminates in the mixed audio signal of this kind of method, only keep voice command, and can not weaken voice command, furthest keeps voice command's integrality, for follow-up accurate acquisition voice command's purpose, and then control lighting module makes preparation.
Example 4
Based on embodiment 1, an embodiment of the present invention provides a 5G smart stick, wherein in a process of detecting a current lighting environment by a detection module, the detection module further includes:
the detection module comprises:
the feedback detection unit is used for detecting video illumination information feedback based on the dynamic video in the current illumination and adjusting the dynamic video according to the illumination information;
and the monitoring unit is used for acquiring the condition of the current lighting environment in real time and generating a dynamic video.
In this embodiment, the feedback information includes the brightness and resolution of the dynamic video;
in this example, the adjustment result indicates that the brightness of the dynamic video is adjusted within a clear range to the maximum extent according to the current lighting condition without affecting the use of the user;
in this embodiment, the user can collect color dynamic video or black and white dynamic video according to the requirement.
The beneficial effect of above-mentioned design is: the feedback information, the adjusting result and the dynamic video of the current lighting environment are respectively detected by two different units, the condition that only one module collects two different types of data to cause blocking or data loss is avoided, the detection quality can be improved, data confusion cannot occur, and the effectiveness of the lighting is verified in a subsequent reverse mode through obtaining the video.
Example 5
Based on embodiment 4, the embodiment of the present invention provides a 5G smart stick, and the method for transmitting dynamic video, feedback information and adjusting result by the transmission module includes:
the transmission module is also used for acquiring the dynamic video, the feedback information and the adjustment result and generating a transmission instruction;
the transmission module is further used for judging a connection mode between the detection module and the appointed terminal based on the transmission instruction;
the judging unit is used for acquiring the connection condition of wired connection when the connection mode between the detection module and the appointed terminal is effective, switching the connection mode between the detection module and the appointed terminal into wireless connection if the wired connection is in a disconnection state, and otherwise, determining the connection mode between the detection module and the appointed terminal into wired connection;
the transmission unit is used for transmitting the feedback information and the adjustment result to the appointed terminal for display in a wired transmission mode when the connection mode between the detection module and the appointed terminal is wired connection, compressing the dynamic video, transmitting the compressed dynamic video to the appointed terminal in the wired transmission mode and decompressing the compressed dynamic video;
and the transmission unit is also used for transmitting the dynamic video, the feedback information and the adjustment result to the appointed terminal for displaying in a wireless transmission mode when the connection mode between the detection module and the appointed terminal is wireless connection.
In the example, the wired connection mode is preferentially selected to transmit the dynamic video, the feedback information and the adjustment result;
in this example, in a special case, the user may choose to transmit the dynamic video, the feedback information, and the adjustment result to different terminals by using wired transmission and wireless transmission simultaneously.
The beneficial effect of above-mentioned design is: by judging the connection mode between the inspection module and the appointed terminal and then transmitting the dynamic video, the feedback information and the adjustment result according to different connection modes, the transmission speed can be improved, the dynamic video, the feedback information and the adjustment result are synchronized to the appointed terminal to be displayed at zero time difference, and a user can conveniently obtain information.
Example 6
Based on embodiment 4, the embodiment of the present invention provides a method for determining a transmission mode between a detection module and a designated terminal for a 5G smart stick, as shown in fig. 3:
the transmission module is further used for transmitting the dynamic video, the feedback information and the adjustment result to a specified terminal for displaying based on the transmission instruction;
the detection module is used for sending a detection signal to the specified terminal based on the transmission instruction;
the judgment transmission module is further configured to collect an electric wave signal between the detection module and the designated terminal, and determine that the connection between the detection module and the designated terminal is abnormal when the energy value of the electric wave signal is smaller than a preset energy value;
otherwise, determining that the connection between the detection module and the appointed terminal is normal, and generating a reverse detection instruction;
the detection module is also used for controlling the appointed terminal to respectively transmit wired detection data and wireless detection data to the detection module;
the judging unit is also used for respectively acquiring wired data and wireless data received by the detection module;
the judging unit is further configured to obtain an arrangement structure of the wired data, divide the wired data into different structural domains based on different arrangement structures, extract information of each structural domain, and obtain an original data chain of each structural domain;
similarly, acquiring a wireless data original data chain;
the judging unit is further configured to perform similarity matching on the wired original data chain and the wired detection data, obtain a matched domain value, mark a domain with a domain value of zero, define the domain as a lost region, obtain useful information included in the data chain corresponding to the lost region on the wired detection data, and determine that wired connection between the designated terminal and the detection module is abnormal if the useful information is main information;
the judging unit is further configured to determine that the connection mode between the designated terminal and the detection module is wired connection if the useful information included in the data chain of the lost area belongs to non-main information;
the transmission unit is further used for changing the connection mode between the designated terminal and the detection module into wireless connection when the wired connection between the designated terminal and the detection module is abnormal, and transmitting the dynamic video, the feedback information and the adjustment result to the designated terminal in a wireless transmission mode for display;
and the transmission unit is further configured to transmit the feedback information and the adjustment result to the designated terminal for display when the designated terminal is connected with the detection module in a wired manner, compress the dynamic video to a preset size, and transmit the dynamic video to the designated terminal for decompression.
In this example, the detection signal is a frame of short-time signal;
for example, the detection signal is an electrical signal with a duration of 0.2 seconds;
in this example, the purpose of the reverse detection instruction is to detect the connection condition between the designated terminal and the detection module, so as to ensure bidirectional connection and avoid the existence of unidirectional connection;
in this example, the data transmitted by the wired detection is the same as the data transmitted by the wireless detection;
in this example, the arrangement structure indicates an arrangement result of data after data transmission is performed on wired detection data or wireless detection data;
for example: transmitting one wired detection data as 1, 2, 3, and the arrangement result of the wired data after transmission is also 1, 2, 3, at this time, regarding as positive sequence arrangement, and if the arrangement result of the corresponding priority data after transmission is 3, 2, 1, at this time, regarding as negative sequence arrangement;
in this example, the domain means that every three useful data in one wired data or wireless data are a group of domains, when there are less than three useful data domains, the existing one useful data is placed at the second position, if there is a second useful data, the existing one useful data is placed at the first position, and zero padding is performed on the rest positions;
in this example, the method for acquiring the original data chain of the wireless data includes: acquiring an arrangement structure of wireless data, dividing the wireless data into different structural domains based on different arrangement structures, extracting information of each structural domain, acquiring an original data chain of each structural domain, and forming a wireless data original data chain;
in this example, the useful information indicates data other than 0 in wired data or wireless data;
for example, if wireless detection data of 1, 0, -2, 3, 0, 1, 2, 0, -1 is transmitted, then the useful information therein is 1, -2, 3, 1, 2, -1, then the received wireless data can be divided into two groups of domains, which are distributed as: 1, -2, 3 and 1, 2, -1;
in this example, the lost area indicates an area where data is lost due to an unsmooth connection in a process of transmitting corresponding detection data through a corresponding transmission mode by using wired detection data or wireless detection data;
for example, the wired detection data transmitted by the terminal to the detection module is 1, -1, 2, 3, 2, and the wired data received by the detection module is 1, 0, 0, 0, 2, so that the loss area in the transmission process is-1, 2, 3.
The working principle and the beneficial effects of the scheme are as follows: the dynamic video, the feedback information and the adjustment result are transmitted to a designated terminal to be displayed, a user can better acquire the condition of the current lighting environment, in order to ensure the transmission efficiency, two different transmission paths are set in the transmission process, if one of the transmission paths breaks down, the other transmission path can be immediately replaced, the normal connection between two modules is ensured, when the connection mode between the two modules is wired transmission, the condition that the transmission speed and the transmission quality are greatly influenced by the data of the dynamic video is avoided, the dynamic video is compressed and then transmitted so as to improve the transmission efficiency, the time difference of the user is weakened, and zero time difference synchronization is achieved.
Example 7
Based on embodiment 3, an embodiment of the present invention provides a 5G smart stick, and a method for acquiring a user voice command includes:
the voice module is also used for storing standard voice instructions in advance and classifying all the standard voice instructions according to the control requirements of the standard voice instructions;
the voice processing unit is also used for extracting each keyword in the voice instruction and acquiring a corresponding word feature vector;
the voice processing unit is also used for acquiring the voice instruction signal and calculating the inspection type of the voice instruction according to a formula (I);
wherein L isjRepresenting the dispersion of said speech command from the jth of said standard speech command classes, cjqAn instruction feature vector representing the q standard voice instruction in the jth standard voice instruction category, k representing the number of standard voice instructions in the jth standard voice instruction category, ciA word feature vector representing the ith keyword within the voice instruction, n representing the total number of keywords within the voice instruction, d representing the target categoryThe classification number of (2) is determined according to the classification number of the target instruction, generally 3 is taken, and T represents the transposition of a vector;
the voice processing unit is also used for selecting the category with the lowest discrete degree with the keywords in the voice instruction as the inspection category based on the calculation result of the formula (I);
the voice processing unit is also used for calculating a standard voice instruction with the lowest dispersion degree with the voice instruction in the inspection category according to a formula (II);
wherein, wfRepresenting the dispersion of the instruction feature vector of the voice instruction and the instruction feature vector of the f-th standard voice instruction in the inspection category, L representing the dispersion of the voice instruction and the inspection category, x representing the number of word feature vectors of the f-th standard voice instruction, cfzThe feature vector of the z th word in the f standard voice command is represented, h represents the number of the standard voice commands in the checking category, and k represents the number of the standard keywords in the checking category;
and the voice processing unit is also used for acquiring the standard voice command matched with the voice command based on the calculation result of the formula (II), determining the purpose of the voice command, transmitting the voice command to the lighting terminal and carrying out corresponding work.
In this example, the criteria for classifying the standard voice command are: dividing standard voice instructions with similar purposes into one class;
in this example, the control demand represents a user's desired brightness value for the lighting module;
in this example, the criteria for category classification are: the standard voice instruction only adjusting the brightness is of type A, the standard voice instruction only adjusting the brightness is of type B, the standard voice instruction adjusting the brightness from high brightness to low brightness is of type C, the standard voice instruction adjusting the brightness from low brightness to high brightness is of type D, and the standard voice instruction randomly adjusting the brightness instruction is of type E;
wherein, A, B, C, D and E are only used for distinguishing different categories and are not sequenced;
in this example, when the category to which the target voice command belongs contains only one standard voice command, the calculation of formula (ii) is not performed.
The beneficial effect of above-mentioned design is: the purpose of accurately acquiring the voice instruction sent by the user can be achieved, the category to which the voice instruction belongs is determined at first, a large number of calculation steps are reduced, the standard voice instruction matched with the voice instruction is searched in the category, the performability of a matching result is improved, the control requirement of the user on the lighting module is accurately acquired, therefore, the time for the lighting module to work correspondingly can be shortened, the waiting time of the user is shortened, the purpose of the standard voice instruction is very similar to that of the same category of voice instruction, the probability of deviation is reduced, and the intelligence of the intelligent pole can be improved.
Example 8
Based on embodiment 5, the embodiment of the present invention provides a 5G smart stick, wherein the work of the detection module in transmitting data to the designated terminal in a wired transmission manner further includes:
the detection module is further configured to calculate, by using a formula (iii), a signal-to-noise ratio of the dynamic video when the dynamic video is transmitted from the detection module to the designated terminal, when the detection module is connected to the designated terminal in a wired connection manner:
wherein λ represents a signal-to-noise ratio when the dynamic video is transmitted to the designated terminal by the detection module, p represents a transmission power when the dynamic video is transmitted to the designated terminal by the detection module, j represents noise interference in a wired transmission process, t represents a unit time period when the dynamic video is transmitted, r represents a unit time period when the dynamic video is transmitted, andtthe transmission quantity of the dynamic video at the time t is represented, and a represents a wired transmission path loss index;
the judging unit is further configured to generate a retransmission instruction when the signal-to-noise ratio of the dynamic video transmitted to the designated terminal by the detecting module is higher than a standard signal-to-noise ratio based on a calculation result;
and the transmission module is also used for acquiring the fragments of the dynamic video with the signal-to-noise ratio higher than the standard signal-to-noise ratio based on the retransmission instruction, performing secondary transmission and replacing the original dynamic video.
In this example, when performing secondary transmission, the dynamic video is divided into a plurality of transmission segments, and compressed and transmitted respectively.
The beneficial effect of above-mentioned design is: when the connection mode between the detection module and the appointed terminal is wired connection, the data transmission process of the dynamic video is easy to lose, and phenomena such as fuzziness or fragmentation can be generated, so that the signal-to-noise ratio in the transmission process is calculated, the quality of the dynamic video is judged, secondary transmission is timely performed on unqualified dynamic videos, and the situation that the received dynamic video on the appointed terminal is incomplete is prevented.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
- 上一篇:石墨接头机器人自动装卡簧、装栓机
- 下一篇:一种无感调度BI大屏的方法、装置及系统