1. A method for controlling a controlled terminal by using a terminal device, the method comprising:

responding to the voice call indication, and detecting the network environment of the controlled terminal;

if the controlled terminal and the controlled terminal are in the same wireless network, determining the recommended volume of the controlled terminal based on the signal intensity of the wireless network and/or the first distance between the controlled terminal and the controlled terminal;

and sending a volume control instruction to the controlled terminal based on the recommended volume.

2. The method of claim 1, wherein determining the recommended volume of the controlled terminal based on the signal strength of the wireless network and the first distance from the controlled terminal comprises:

determining a signal strength difference with a signal strength of the controlled terminal;

if the signal intensity difference is larger than a first preset value, taking the current volume of the controlled terminal as the recommended volume;

and if the signal intensity difference is smaller than or equal to the first preset value, adopting a volume value corresponding to the first distance as the recommended volume.

3. The method of claim 1, wherein determining the recommended volume of the controlled terminal based on the signal strength of the wireless network and the first distance from the controlled terminal comprises:

if the first distance is greater than the second distance, taking the current volume of the controlled terminal as the recommended volume;

if the first distance is greater than a third distance, taking the current volume of the controlled terminal as the recommended volume; the second distance is greater than the third distance;

and if the first distance is smaller than or equal to the third distance, adopting a volume value corresponding to the signal intensity difference as the recommended volume of the controlled terminal.

4. The method according to claim 3, wherein the adopting the volume value corresponding to the signal strength difference as the recommended volume of the controlled terminal comprises:

if the signal intensity difference is larger than a second preset value, adopting the current volume of the controlled terminal as the recommended volume;

and if the signal intensity difference is smaller than or equal to the second preset value, adopting a volume value corresponding to the first distance as the recommended volume.

5. The method of claim 1, wherein determining the recommended volume of the controlled terminal based on the signal strength of the wireless network comprises:

if the signal intensity difference between the controlled terminal and the current volume of the controlled terminal is larger than a third preset value, taking the current volume of the controlled terminal as the recommended volume;

and if the signal intensity difference between the controlled terminal and the controlled terminal is less than or equal to the third preset value, adopting a volume value corresponding to the signal intensity difference as the recommended volume.

6. The method of claim 1, wherein determining the recommended volume of the controlled terminal based on a first distance from the controlled terminal comprises:

if the first distance is greater than a fourth distance, the current volume of the controlled terminal is used as the recommended volume;

and if the first distance is smaller than or equal to the fourth distance, adopting a volume value corresponding to the first distance as the recommended volume.

7. The method of claim 3, further comprising:

the second distance and the third distance are default distances or distances set by a user.

8. The method of claim 1, wherein after determining the recommended volume of the controlled terminal according to the first distance, the method further comprises:

displaying the recommended volume in a control panel of the controlled terminal;

based on the recommended volume, sending a volume control instruction to the controlled terminal, including:

responding to the selection operation of the recommended volume, and sending a volume control instruction for setting the volume as the recommended volume to the controlled terminal; or the like, or, alternatively,

and if the recommended volume mode is determined to be in the starting state, sending a volume control instruction to instruct the controlled terminal to adjust the volume to the recommended volume.

9. The method of claim 8, wherein the control panel comprises at least one of a virtual volume adjustment control, a virtual screen-recording control, and any one or combination of the following controls: media volume adjusting control, ring volume adjusting control and informing volume adjusting control.

10. A terminal device, characterized in that the device comprises at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-9.

Background

With the development of science and technology and the interconnection of everything, more and more products around us change the form of the self. Many home appliances can be controlled not only by their own physical keys or dedicated remote controllers, but also by terminal devices. The television or television box can be controlled by the mobile phone, for example, by installing a remote control of the television or television box on the mobile phone.

However, in the related art, the terminal device is controlled to passively receive the command and passively output the content. The terminal equipment lacks judgment and interaction on the current situation of the user, so that the terminal equipment is complex to operate in a special scene, and the household equipment cannot be adjusted in real time according to the current situation of the user.

Disclosure of Invention

The application aims to provide a method and equipment for controlling a controlled terminal by adopting terminal equipment, which are used for solving the problem that the control operation of the terminal equipment on the controlled terminal is complex.

In a first aspect, an embodiment of the present application provides a method for controlling a controlled terminal by using a terminal device, including:

responding to the voice call indication, and detecting the network environment of the controlled terminal;

if the controlled terminal and the controlled terminal are in the same wireless network, determining the recommended volume of the controlled terminal based on the signal intensity of the wireless network and/or the first distance between the controlled terminal and the controlled terminal;

and sending a volume control instruction to the controlled terminal based on the recommended volume.

In some embodiments, the determining the recommended volume of the controlled terminal based on the signal strength of the wireless network and the first distance from the controlled terminal includes:

determining a signal strength difference with a signal strength of the controlled terminal;

if the signal intensity difference is larger than a first preset value, taking the current volume of the controlled terminal as the recommended volume;

and if the signal intensity difference is smaller than or equal to the first preset value, adopting a volume value corresponding to the first distance as the recommended volume.

In some embodiments, the determining the recommended volume of the controlled terminal based on the signal strength of the wireless network and the first distance from the controlled terminal includes:

if the first distance is greater than the second distance, taking the current volume of the controlled terminal as the recommended volume;

if the first distance is greater than a third distance, taking the current volume of the controlled terminal as the recommended volume; the second distance is greater than the third distance;

and if the first distance is smaller than or equal to the third distance, adopting a volume value corresponding to the signal intensity difference as the recommended volume of the controlled terminal.

In some embodiments, the using the volume value corresponding to the signal strength difference as the recommended volume of the controlled terminal includes:

if the signal intensity difference is larger than a second preset value, adopting the current volume of the controlled terminal as the recommended volume;

and if the signal intensity difference is smaller than or equal to the second preset value, adopting a volume value corresponding to the first distance as the recommended volume.

In some embodiments, determining the recommended volume of the controlled terminal based on the signal strength of the wireless network comprises:

if the signal intensity difference between the controlled terminal and the current volume of the controlled terminal is larger than a third preset value, taking the current volume of the controlled terminal as the recommended volume;

and if the signal intensity difference between the controlled terminal and the controlled terminal is less than or equal to the third preset value, adopting a volume value corresponding to the signal intensity difference as the recommended volume.

In some embodiments, determining the recommended volume of the controlled terminal based on the first distance from the controlled terminal includes:

if the first distance is greater than a fourth distance, the current volume of the controlled terminal is used as the recommended volume;

and if the first distance is smaller than or equal to the fourth distance, adopting a volume value corresponding to the first distance as the recommended volume.

In some embodiments, the method further comprises:

the second distance and the third distance are default distances or distances set by a user.

In some embodiments, after determining the recommended volume of the controlled terminal according to the first distance, the method further includes:

displaying the recommended volume in a control panel of the controlled terminal;

based on the recommended volume, sending a volume control instruction to the controlled terminal, including:

responding to the selection operation of the recommended volume, and sending a volume control instruction for setting the volume as the recommended volume to the controlled terminal; or the like, or, alternatively,

and if the recommended volume mode is determined to be in the starting state, sending a volume control instruction to instruct the controlled terminal to adjust the volume to the recommended volume.

In some embodiments, the control panel includes at least one of a virtual volume adjustment control, a virtual screen-recording control, and any one or combination of the following controls: media volume adjusting control, ring volume adjusting control and informing volume adjusting control.

In a second aspect, the present application further provides a terminal, where the device includes: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to: responding to the voice call indication, and detecting the network environment of the controlled terminal;

if the controlled terminal and the controlled terminal are in the same wireless network, determining the recommended volume of the controlled terminal based on the signal intensity of the wireless network and/or the first distance between the controlled terminal and the controlled terminal;

and sending a volume control instruction to the controlled terminal based on the recommended volume.

In some embodiments, the determining the recommended volume of the controlled terminal based on the signal strength of the wireless network and the first distance from the controlled terminal includes:

determining a signal strength difference with a signal strength of the controlled terminal;

if the signal intensity difference is larger than a first preset value, taking the current volume of the controlled terminal as the recommended volume;

and if the signal intensity difference is smaller than or equal to the first preset value, adopting a volume value corresponding to the first distance as the recommended volume.

In some embodiments, the determining the recommended volume of the controlled terminal based on the signal strength of the wireless network and the first distance from the controlled terminal includes:

if the first distance is greater than the second distance, taking the current volume of the controlled terminal as the recommended volume;

if the first distance is greater than a third distance, taking the current volume of the controlled terminal as the recommended volume; the second distance is greater than the third distance;

and if the first distance is smaller than or equal to the third distance, adopting a volume value corresponding to the signal intensity difference as the recommended volume of the controlled terminal.

In some embodiments, the using the volume value corresponding to the signal strength difference as the recommended volume of the controlled terminal includes:

if the signal intensity difference is larger than a second preset value, adopting the current volume of the controlled terminal as the recommended volume;

and if the signal intensity difference is smaller than or equal to the second preset value, adopting a volume value corresponding to the first distance as the recommended volume.

In some embodiments, determining the recommended volume of the controlled terminal based on the signal strength of the wireless network comprises:

if the signal intensity difference between the controlled terminal and the current volume of the controlled terminal is larger than a third preset value, taking the current volume of the controlled terminal as the recommended volume;

and if the signal intensity difference between the controlled terminal and the controlled terminal is less than or equal to the third preset value, adopting a volume value corresponding to the signal intensity difference as the recommended volume.

In some embodiments, determining the recommended volume of the controlled terminal based on the first distance from the controlled terminal includes:

if the first distance is greater than a fourth distance, the current volume of the controlled terminal is used as the recommended volume;

and if the first distance is smaller than or equal to the fourth distance, adopting a volume value corresponding to the first distance as the recommended volume.

In some embodiments, the processor is further configured to:

the second distance and the third distance are default distances or distances set by a user.

In some embodiments, after performing the determining the recommended volume of the controlled terminal according to the first distance, the processor is further configured to:

displaying the recommended volume in a control panel of the controlled terminal;

based on the recommended volume, sending a volume control instruction to the controlled terminal, including:

responding to the selection operation of the recommended volume, and sending a volume control instruction for setting the volume as the recommended volume to the controlled terminal; or the like, or, alternatively,

and if the recommended volume mode is determined to be in the starting state, sending a volume control instruction to instruct the controlled terminal to adjust the volume to the recommended volume.

In some embodiments, the control panel includes at least one of a virtual volume adjustment control, a virtual screen-recording control, and any one or combination of the following controls: media volume adjusting control, ring volume adjusting control and informing volume adjusting control.

In a third aspect, another embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and the computer program is configured to cause a computer to execute any one of the methods provided in the first aspect of the present application.

In the embodiment of the application, the use requirement of a call scene can be automatically sensed, the recommended volume of the controlled terminal in the scene is determined, the cooperation intelligence of the controlled terminal and the control equipment is increased, and the step of adjusting the volume by a user is saved, so that the control operation on the controlled terminal is simplified, and the user experience is enhanced.

Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1A is an application scenario diagram of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 1B is a schematic structural diagram of a terminal device according to an embodiment of the present application;

fig. 1C is a schematic diagram of a software architecture of a terminal device according to an embodiment of the present application;

fig. 2 is an overall flowchart of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 3A is a schematic diagram of a voice call interface in the related art of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application, and a schematic diagram of a first control panel according to the present application;

fig. 3B is a schematic diagram of a first control panel of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 4 is a schematic view of a volume adjustment interface of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 5 is a schematic view of screen recording performed by a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 6A is a schematic diagram of a second control panel of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 6B is a schematic diagram of performing television screen recording in a second control panel according to the method for controlling a controlled terminal by using a terminal device according to the embodiment of the present application;

fig. 6C is a schematic diagram of volume adjustment by clicking according to the method for controlling a controlled terminal by using a terminal device provided in the embodiment of the present application;

fig. 7 is a flowchart of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 8 is a flowchart illustrating a recommended volume mode of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 9 is a schematic diagram illustrating a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application to adjust a volume to a recommended volume;

fig. 10 is an overall flowchart of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 11 is a schematic diagram of setting a television to a recommended volume by using a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions of the present application better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

It is noted that the terms "first," "second," and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

The inventor researches and discovers that with the development of science and technology and the interconnection of everything, more and more products change the form of the product. Many home appliances can be controlled not only by their own physical keys or dedicated remote controllers, but also by terminal devices. The television or television box can be controlled by the mobile phone, for example, by installing a remote control of the television or television box on the mobile phone.

For example: the prior television is only an entertainment tool for watching programs of various television stations, the function is single, and the remote controller is the only operation tool. But now, the television slowly increases more intelligent entertainment interaction functions and social functions, and even the television can be completely operated through the terminal equipment. In the current interactive scene of the television and the user, the television can only passively receive commands and passively output contents, and the terminal equipment lacks judgment and interaction on the current situation of the user and cannot control the television according to the current situation of the user.

In view of the above, the present application provides a method, device and storage medium for controlling a controlled terminal by using a terminal device, so as to solve the above problems. The inventive concept of the present application can be summarized as follows: the terminal equipment senses the call requirement of a user, and can display a first control panel of the controlled terminal on a call interface in a call scene; the first control panel is used for controlling the controlled terminal, so that a user can execute operation on the first control panel to realize control on the controlled terminal. Therefore, in the embodiment of the application, the call scene can be intelligently identified, the first control panel is displayed on the call interface in the call scene, and a user can conveniently control the controlled terminal according to the call requirement. For example, when a call comes, the first control panel is displayed in time, and a user does not need to search and switch to an application for controlling a television to adjust the volume of the television temporarily. The volume of the television can be adjusted in the call interface of the incoming call, and for example, if the user is watching an interested interface at present, the user can control the television to record the screen in the call interface of the incoming call.

Fig. 1A is an application scenario diagram of a method for controlling a controlled terminal by using a terminal device in this embodiment of the application. The figure includes: a network 10, a terminal device 20, a controlled terminal 30;

wherein: when there is a voice call, the terminal device 20 may respond to the voice call instruction and display a first control panel of the controlled terminal 30; based on the user operation on the first control panel, the terminal device transmits a control instruction to the controlled terminal through the network 10.

It should be understood that the controlled terminal may be a refrigerator, a television, a sound box, a smart kitchen or other electronic devices with a media playing function.

Only a single terminal device is described in detail in the description of the present application, but it should be understood by those skilled in the art that the controlled terminal 30 and the terminal device 20 shown are intended to represent the operation of controlling the controlled terminal using the terminal device according to the technical aspects of the present disclosure. The detailed description of the individual terminal devices and controlled terminals is at least for convenience of description and does not imply a limitation on the number, type, or location of the terminal devices and controlled terminals. It should be noted that the underlying concepts of the example embodiments of the present application may not be altered if additional modules are added or removed from the illustrated environments.

The following describes in detail a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application with reference to the drawings.

First, fig. 1B shows a schematic configuration diagram of a terminal device 100.

The following specifically describes the embodiment by taking the terminal device 100 as an example. It should be understood that the terminal device 100 shown in fig. 1B is only an example, and the terminal device 100 may have more or less components than those shown in fig. 1B, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

A block diagram of a hardware configuration of the terminal device 100 according to the exemplary embodiment is exemplarily shown in fig. 1B. As shown in fig. 1B, the terminal device 100 includes: a Radio Frequency (RF) circuit 110, a memory 120, a display unit 130, a camera 140, a sensor 150, an audio circuit 160, a Wireless Fidelity (Wi-Fi) module 170, a processor 180, a bluetooth module 181, and a power supply 190.

The RF circuit 110 may be used for receiving and transmitting signals during information transmission and reception or during a call, and may receive downlink data of a base station and then send the downlink data to the processor 180 for processing; the uplink data may be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.

The memory 120 may be used to store software programs and data. The processor 180 performs various functions of the terminal device 100 and data processing by executing software programs or data stored in the memory 120. The memory 120 may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. The memory 120 stores an operating system that enables the terminal device 100 to operate. In the present application, the memory 120 may store an operating system and various application programs, and may also store screen recording files for executing the method described in the embodiments of the present application.

The display unit 130 may be used to receive input numeric or character information and generate signal input related to user settings and function control of the terminal device 100, and particularly, the display unit 130 may include a touch screen 131 disposed on the front surface of the terminal device 100 and may collect touch operations of a user thereon or nearby, such as clicking a button, dragging a scroll box, and the like.

The display unit 130 may also be used to display a Graphical User Interface (GUI) of information input by or provided to the user and various menus of the terminal apparatus 100. Specifically, the display unit 130 may include a display screen 132 disposed on the front surface of the terminal device 100. The display screen 132 may be configured in the form of a liquid crystal display, a light emitting diode, or the like. The display unit 130 may be used to display the first control panel or the second control panel described in this application.

The touch screen 131 may cover the display screen 132, or the touch screen 131 and the display screen 132 may be integrated to implement the input and output functions of the terminal device 100, and after the integration, the touch screen may be referred to as a touch display screen for short. In the present application, the display unit 130 may display the application programs and the corresponding operation steps.

The camera 140 may be used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing elements convert the light signals into electrical signals which are then passed to the processor 180 for conversion into digital image signals.

The terminal device 100 may further comprise at least one sensor 150, such as an acceleration sensor 151, a distance sensor 152, a fingerprint sensor 153, a temperature sensor 154. The terminal device 100 may also be configured with other sensors such as a gyroscope, barometer, hygrometer, thermometer, infrared sensor, light sensor, motion sensor, and the like.

The audio circuitry 160, speaker 161, microphone 162 may provide an audio interface between the user and the terminal device 100. The audio circuit 160 may transmit the electrical signal converted from the received audio data to the speaker 161, and convert the electrical signal into a sound signal for output by the speaker 161. The terminal device 100 may also be provided with a volume button for adjusting the volume of the sound signal. On the other hand, the microphone 162 converts the collected sound signals into electrical signals, which are received by the audio circuit 160 and converted into audio data, which are then output to the RF circuit 110 for transmission to, for example, another end user to output the audio data to the memory 120 for further processing.

Wi-Fi belongs to a short-distance wireless transmission technology, and the terminal device 100 can help a user to send and receive e-mails, browse webpages, access streaming media and the like through the Wi-Fi module 170, and provides wireless broadband internet access for the user.

The processor 180 is a control center of the terminal device 100, connects various parts of the entire terminal device using various interfaces and lines, and performs various functions of the terminal device 100 and processes data by running or executing software programs stored in the memory 120 and calling data stored in the memory 120. In some embodiments, processor 180 may include one or more processing units; the processor 180 may also integrate an application processor, which mainly handles operating systems, user interfaces, applications, etc., and a baseband processor, which mainly handles wireless communications. It will be appreciated that the baseband processor described above may not be integrated into the processor 180. In the present application, the processor 180 may run an operating system, an application program, a user interface display, and a touch response, and the processing method described in the embodiments of the present application. Further, the processor 180 is coupled with the display unit 130.

And the bluetooth module 181 is configured to perform information interaction with other bluetooth devices having a bluetooth module through a bluetooth protocol. For example, the terminal device 100 may establish a bluetooth connection with a wearable electronic device (e.g., a smart watch) having a bluetooth module via the bluetooth module 181, so as to perform data interaction.

The terminal device 100 also includes a power supply 190 (such as a battery) for powering the various components. The power supply may be logically connected to the processor 180 through a power management system to manage charging, discharging, power consumption, etc. through the power management system. The terminal device 100 may further be configured with a power button for powering on and off the terminal, and locking the screen.

Fig. 1C is a block diagram of a software configuration of the terminal device 100 according to the embodiment of the present application.

The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system may be divided into four layers, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, and a kernel layer, from top to bottom, respectively.

The application layer may include a series of application packages.

As shown in fig. 1C, the application package may include applications such as camera, gallery, calendar, phone call, map, navigation, WLAN, bluetooth, music, video, short message, etc.

The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 1C, the application framework layers may include a window manager, content provider, view system, phone manager, resource manager, notification manager, and the like.

The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, dialed and answered calls, browsing history and bookmarks, phone books, short messages, etc.

The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying a picture.

The phone manager is used to provide the communication function of the terminal device 100. Such as management of call status (including on, off, etc.).

The resource manager provides various resources, such as localized strings, icons, pictures, layout files, video files, etc., to the application.

The notification manager allows the application to display notification information (e.g., message digest of short message, message content) in the status bar, can be used to convey notification-type messages, and can automatically disappear after a short dwell without user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, text information is prompted in the status bar, a prompt tone is given, the terminal vibrates, an indicator light flashes, and the like.

The Android Runtime comprises a core library and a virtual machine. The Android runtime is responsible for scheduling and managing an Android system.

The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. And executing java files of the application program layer and the application program framework layer into a binary file by the virtual machine. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface managers (surface managers), Media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), and the like.

The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

A 2D (an animation mode) graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The terminal device 100 in the embodiment of the present application may be a mobile phone, a tablet computer, a wearable device, a notebook computer, or the like.

As shown in fig. 2, a flowchart of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application is provided, where: in step 201: responding to the voice call indication, and displaying a first control panel of the controlled terminal;

in one embodiment, the voice call indication may be an incoming call, an outgoing call of a telephone; the method can also be used for voice call requests and video call requests of instant messaging applications; other indications with call functionality are also applicable to the present application.

In step 202: and sending a control instruction to the controlled terminal based on the user operation of the first control panel.

In some embodiments, when a user goes home from work and watches a television in a living room or listens to a program through the intelligent sound box alone, the user often selects a favorite program or song and appropriately adjusts the volume to be high to relax the mood due to work fatigue in one day, and if the user suddenly calls an important call, the user often searches for the remote controller in a hurry, and then listens to the call after controlling the volume of the television through the remote controller, or calls the intelligent sound box through voice to reduce the volume, or walks to the sound box to manually adjust. This not only lengthens the time to receive the call, but also makes the user feel unquiet when receiving the call, and makes the user miss the program being watched during the telephone communication process, thereby making the user experience poor.

Therefore, in this embodiment of the present application, as shown in fig. 3A, a virtual volume adjustment control is set in the first control panel, and based on a user operation on the first control panel, when sending a control instruction to the controlled terminal, the virtual volume adjustment control may be implemented as: and responding to the user operation of the virtual volume adjusting control, and sending a volume adjusting instruction to the controlled terminal. Wherein, the voice call interface in the related art is shown as the left image in fig. 3A, and the first control panel provided in the embodiment of the present application may be an interface (shown as the right image in fig. 3A) in which the voice call interface in the related art is integrated with the newly added function of the present application; in another embodiment, as shown in fig. 3B, the first control panel may be displayed in the form of a floating window above the voice call interface in the related art, wherein the user may adjust the size and position of the floating window in the voice call interface, such as: if the user presses the floating window for a long time and the scaling mark appears, the floating window can be dragged to change the size of the floating window; the position of the floating window can be changed by long pressing other positions in the floating window except the zooming mark and dragging the floating window, and the floating window can be closed by clicking the cross mark at the upper right corner.

Taking fig. 3A as an example for detailed description, when the user watches tv together with family at home, the volume of the tv is often increased because the number of people watching tv is large or the hearing of some elder elders is not good. When a terminal device calls or a user is in a conversation process, the user often goes to a room or outdoors far away from the television for processing because family members are nearby. Family members can turn down the volume of the television in order to not affect the things of the user, thereby causing bad experience of many people. Therefore, the user may click the tv volume mute button to mute the tv, or the user may not want to mute the tv but only want to turn the tv volume down, as shown in fig. 4, and may slide the tv mute flag to the right to enter the volume adjustment interface shown in fig. 4 (sliding any of the virtual adjustment controls may enter the volume adjustment interface). It should be appreciated that sliding is only one embodiment of entering a volume adjustment interface, and other embodiments such as: double-click, long-press, drag, etc. are also applicable to the present application.

In the application implementation, the volume is adjusted in the call process, the situation that the call is influenced by too large volume and watching of other people is influenced by too small volume is avoided, and the experience of a user is greatly improved.

In order to avoid missing a program being watched during the telephone communication process, in this embodiment of the application, as shown in the right image of fig. 3A, a virtual screen recording control is further set in the first control panel, and based on the user operation on the first control panel, when sending a control instruction to the controlled terminal, the implementation may be: and responding to the user operation of the virtual screen recording control, and sending a screen recording instruction to the controlled terminal. A virtual recording control is further arranged in the first control panel, and a user can click the sound box recording control shown in fig. 3A to control the external sound box to record sound.

For example: the user is playing the story with the loudspeaker box, but at the moment, the mobile phone of the user receives the incoming call, so that the user can record the sound of the motor loudspeaker box during the conversation process or before answering the call, and record the content played by the loudspeaker box at the moment. By the method, the situation that the user misses the concerned content in the call process can be avoided.

For example: as shown in fig. 5, when the user clicks the tv screen, the tv starts to record the screen, and in order to facilitate the user to finish recording the screen, the tv screen is changed to finish recording after the user starts recording the screen, and the recording duration is displayed below the tv screen.

In the embodiment of the application, the virtual screen recording control and the virtual recording control are arranged, so that the screen recording of a television and the recording of a sound box in the call process are realized, the problem that a user misses content due to call is avoided, and the experience of the user is greatly improved.

In the embodiment of the application, the terminal equipment and the controlled terminal can communicate through a communication link, and when the communication requirement with the controlled terminal exists, the communication link which is in communication connection with the controlled terminal is selected; and then, using the communication link, performing an operation of transmitting a control instruction to the controlled terminal.

If no communication link is established, a communication mode can be selected to establish communication connection with the controlled terminal. In the embodiment of the present application, the communication link may be bluetooth communication or wireless communication, and since bluetooth communication has the advantage of fast communication speed and stable signal compared to wireless communication, in the embodiment of the present application, a bluetooth communication mode may be preferentially adopted to establish communication connection with the controlled terminal.

In some embodiments, if the adopted communication mode is a bluetooth communication mode, the terminal device sends a confirmation message to the controlled terminal, and if a reply message sent by the controlled terminal is received, it may be determined that the communication link of the bluetooth communication is successfully established. In order to avoid communication delay caused by long-time waiting for the reply information sent by the controlled terminal, in the embodiment of the application, a waiting time duration is set, and the reply information sent by the controlled terminal is received in the waiting time duration, namely, the communication link is established successfully through the bluetooth communication mode.

Through the Bluetooth communication mode, the communication between the terminal equipment and the controlled terminal is realized, the communication speed is improved by adopting the Bluetooth communication mode, and the signal is stable in the communication process.

In this embodiment of the present application, a communication link may also be established in a wireless network communication manner, and specifically, bluetooth communication may be preferentially used, and when any one of the following two situations is satisfied, wireless network communication may be considered to be used:

1. bluetooth connection timeout

In another embodiment, if the reply of the controlled terminal is not received after the waiting time length is exceeded, and it is determined that the communication with the controlled terminal based on the bluetooth communication mode fails, the communication can be performed by adopting a wireless network communication mode. In the wireless network communication process, firstly, terminal equipment acquires a wireless network address of a controlled terminal; and then determining whether the controlled terminal and the controlled terminal are in the same wireless network based on the wireless network address, if so, establishing a communication link in a communication mode of the wireless network, and then selecting the communication link for communication.

By selecting the wireless network communication mode under the condition of Bluetooth failure, the method for controlling the controlled terminal by using the terminal equipment provided by the embodiment of the application has higher universality and enlarges the application range.

2. N times of Bluetooth connection failure

Since bluetooth communication has a significant advantage over wireless network communication, an upper limit of the number of connection failures of bluetooth communication may also be set in the embodiment of the present application. After the Bluetooth connection fails, the adopted Bluetooth connection mode can be continued until the failure times reach the upper limit and then the wireless communication mode is adopted.

For example: if the upper limit of the connection failure times is set to 5 times, the reconnection is tried again after the first Bluetooth connection failure, and the wireless network communication is selected again until 5 times of failure. By the method, the success probability of Bluetooth communication is greatly increased.

In the embodiment of the present application, in addition to displaying the first control panel by using the above method and adjusting the volume based on the first control panel, the method may further include: and responding to the pressing operation of the entity volume adjusting control, displaying a second control panel, and sending a control instruction to the controlled terminal based on the user operation aiming at the second control panel.

In some embodiments, the controls included in the second control panel and the first control panel may be the same or different. The second control panel comprises at least one of a virtual volume adjustment control and a virtual screen recording control, and any one or combination of the following controls: media volume adjustment controls, ring volume adjustment controls, notification volume adjustment controls, and the like. As shown in fig. 6A, the second control panel may include therein: the virtual screen recording control, the sound box recording control, the television volume adjusting control, the sound box volume adjusting control, the media volume adjusting control, the ringtone volume adjusting control and the notification volume adjusting control. The user can adjust the volume of the controlled terminals such as the television, the sound box and the like in the second control panel through the television volume adjusting control and the sound box volume adjusting control, and can also adjust the volume of the built-in functions such as media, ring, notification and the like of the terminal equipment through other volume adjusting controls; in addition, as shown in fig. 6B, the duration of recording the screen may also be determined by dragging the drag bar of the television recording screen, and the duration of recording may also be determined by dragging the drag bar of the sound box recording. And when dragging, the recorded duration can be displayed for the user to confirm.

The virtual volume adjustment control in the embodiment of the present application may be a button displayed in a screen, as shown in fig. 6C, a volume adjustment key appears when the virtual volume adjustment control is double-clicked, the + button is clicked to increase the volume, and the-button is clicked to decrease the volume. Of course, the virtual volume adjustment control may also be a volume adjustment bar, and dragging the adjustment bar as shown in fig. 6B may implement zooming in or zooming out of the volume.

When the virtual volume adjusting control is a button displayed in a screen, a control instruction is sent to the controlled terminal once within a preset time based on user operation; for example: setting the preset time to one second, and if the user continuously clicks the television for two times for muting in one second, only sending a muting instruction to the television for one time; if the virtual volume adjusting control is a volume adjusting bar, continuously sending a control instruction to the controlled terminal based on user operation; for example: and if the user continuously drags the television volume adjusting bar, a volume adjusting instruction is sent to the television in real time.

By the method, under the condition that the virtual volume adjusting control is a key, if a user continuously clicks the virtual volume adjusting control within the preset time, the control instruction can be sent only once, or the control instruction can be sent n times within the preset time according to the number of clicks of the user, but the controlled terminal is only executed once; by the method, the waste of resources caused by frequently adjusting the equipment according to the control instruction can be effectively saved.

In the embodiment of the present application, in order to determine a reasonable volume recommendation value when wireless network communication is adopted, based on the same inventive concept, a method for controlling a controlled terminal by using a terminal device is also provided, and the following detailed description is provided with reference to the accompanying drawings:

as shown in fig. 7, a flowchart of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application is provided, where:

in step 701: responding to the voice call indication, and detecting the network environment of the controlled terminal;

in some embodiments, when detecting a network environment, a wireless network address prefix of a controlled terminal may be acquired; and if the prefix of the wireless network address is the same as that of the controlled terminal, determining that the wireless network address and the controlled terminal are in the same wireless network.

In step 702: and if the controlled terminal and the controlled terminal are in the same wireless network, determining the recommended volume of the controlled terminal based on the signal intensity of the wireless network and/or the first distance between the controlled terminal and the controlled terminal.

For ease of understanding, the following is detailed in three cases:

1. using signal strength difference and first distance

1) Determining the signal strength difference and then the first distance

In this embodiment of the present application, in order to determine a reasonable volume, in this embodiment of the present application, a recommended volume may be determined based on the signal strength difference and the first distance, and specifically, the recommended volume may be implemented as: determining a signal strength difference with a signal strength of the controlled terminal;

if the signal intensity difference is larger than a first preset value, taking the current volume of the controlled terminal as the recommended volume; and if the signal intensity difference is smaller than or equal to a first preset value, adopting the volume value corresponding to the first distance as the recommended volume.

In the embodiment of the application, the fact that the signal intensity difference is larger than the first preset value indicates that the distance between the current terminal device and the controlled terminal is long, so that the volume of the controlled terminal does not need to be adjusted. When the signal intensity difference is smaller than or equal to the first preset value, the distance between the terminal equipment and the controlled terminal is short, so that the volume value of the controlled terminal needs to be adjusted; when the volume value is adjusted, the recommended volume value corresponding to the current first distance can be determined in a table look-up mode. The table of the first distance corresponding to the recommended volume value may be determined experimentally by an experimenter in advance and stored in a memory for later use.

For example: as shown in the table of the correspondence between the first distance and the recommended volume value in table 1, it should be understood that the data in table 1 are only examples, and are not accurate experimental data.

TABLE 1

2) Determining the first distance and then determining the signal strength difference

In this embodiment of the present application, the order of determining the signal strength difference and the first distance is not limited, and if the first distance is determined first and then the recommended volume is determined according to the signal strength difference, the following steps may be implemented: if the first distance is greater than the second distance, taking the current volume of the controlled terminal as the recommended volume; if the first distance is greater than the third distance, taking the current volume of the controlled terminal as the recommended volume; the second distance is greater than the third distance; and if the first distance is smaller than or equal to the third distance, adopting the volume value corresponding to the signal intensity difference as the recommended volume of the controlled terminal.

In the embodiment of the present application, when the first distance is greater than the second distance and the third distance, it indicates that the current distance between the terminal device and the controlled terminal is relatively long, and the volume of the controlled terminal does not affect the terminal device, so that the current volume may be used as the recommended volume at this time, and when the first distance is less than the third distance, it indicates that the distance between the current terminal device and the controlled terminal is relatively short, but at this time, there are two cases: firstly, the controlled terminal and the terminal device are in one room, secondly, the controlled terminal and the terminal device are not in one room, and the middle is blocked by a wall, so that the situation needs to be determined by determining the signal intensity difference: if the signal intensity difference is larger than a second preset value, the current volume of the controlled terminal is adopted as the recommended volume; and if the signal intensity difference is smaller than or equal to a second preset value, adopting the volume value corresponding to the first distance as the recommended volume.

The signal intensity difference is larger than the second preset value, so that the fact that a wall is arranged between the terminal device and the controlled terminal is indicated, the volume of the controlled terminal does not affect the terminal device, and the current volume can be used as the recommended volume; when the signal intensity difference is smaller than or equal to the second preset value, the controlled terminal and the terminal device are in the same room at the moment, and the recommended volume value corresponding to the current first distance can be determined in a table look-up mode at the moment.

It should be noted that the first preset value and the second preset value are both determined experimentally, and may be the same or different.

For example: as shown in table 2, assuming that the second preset value is 2, the table of the signal strength difference and the recommended volume value is as follows, it should be understood that the data in table 2 is only an example and is not accurate experimental data.

TABLE 2

By the method, the recommended volume can be accurately determined by combining the first distance and the signal intensity difference, so that the volume of the controlled terminal can be adjusted by the user according to the recommended volume, and the experience of the user is greatly improved.

2. Using signal strength only

In order to make the present application more universal, in the embodiment of the present application, the determining the recommended volume may be performed by only using the signal strength, and may specifically be implemented as: if the signal intensity difference with the controlled terminal is larger than a third preset value, taking the current volume of the controlled terminal as the recommended volume; and if the signal intensity difference with the controlled terminal is less than or equal to a third preset value, adopting the volume value corresponding to the signal intensity difference as the recommended volume.

In the embodiment of the application, the signal intensity difference is larger than the third preset value, which indicates that the terminal device is far away from the controlled terminal, so that the current volume of the controlled terminal can be used as the recommended volume; if the signal intensity difference is smaller than or equal to the third preset value, the fact that the distance between the terminal device and the controlled terminal is short is indicated, at the moment, table lookup can be conducted according to the difference value between the terminal device and the controlled terminal so that the recommended volume can be determined, and a table corresponding to the signal intensity difference and the recommended volume value can be determined in advance through experiments by experimenters and stored in a memory for subsequent use.

For example: as shown in table 3, assuming that the third preset value is 2, the table of the signal strength difference and the recommended volume value is as follows, it should be understood that the data in table 3 is only an example and is not accurate experimental data.

Difference in signal strength	Recommended volume
		A	Current volume
B	E decibel
		C	F decibel
D	G decibel

TABLE 3

The recommended volume is determined only by adopting the signal intensity, so that the method has higher universality.

3. Using only the first distance

In this embodiment of the present application, in addition to separately determining the recommended volume by using the signal intensity difference, the recommended volume may also be separately determined by using the first distance, which may specifically be implemented as: if the first distance is greater than the fourth distance, the current volume of the controlled terminal is used as the recommended volume; and if the first distance is smaller than or equal to the fourth distance, adopting the volume value corresponding to the first distance as the recommended volume.

In the embodiment of the application, the fact that the first distance is larger than the fourth distance means that the distance between the terminal device and the controlled terminal is long, and the volume of the controlled terminal does not affect the terminal device, so that the current volume can be used as the recommended volume; the first distance is smaller than or equal to the fourth distance, the fact that the distance between the terminal device and the controlled terminal is short is indicated, table lookup can be conducted according to the first distance between the terminal device and the controlled terminal at the moment, and therefore the recommended volume can be determined, and a table corresponding to the first distance and the recommended volume value can be determined in advance through experiments by experimenters and stored in a memory for subsequent use.

For example: as shown in table 4, assuming that the fourth distance is 8 meters, the table of correspondence between the signal strength difference and the recommended volume value is as follows, and it should be understood that the data in table 4 is only an example and is not accurate experimental data.

First distance	Recommended volume
		A rice	Current volume
B rice	E decibel
		C rice	F decibel
D rice	G decibel

TABLE 4

The second distance, the third distance and the fourth distance may be input by a user or default values may be adopted.

In step 703: and sending a volume control instruction to the controlled terminal based on the recommended volume.

In the embodiment of the present application, as shown in fig. 6B, a recommended volume is shown in a control panel of the controlled terminal; transmitting a volume control command to the controlled terminal based on the recommended volume may be implemented to transmit a volume control command to set the volume to the recommended volume to the controlled terminal in response to a selection operation of the recommended volume. In another embodiment, the recommended volume may be displayed in the call interface in the form of a floating ball, as shown in fig. 3A and 3B.

In an embodiment, in order to save the operation steps of the user, the user may set the volume of the controlled terminal to be the recommended volume mode in the volume setting in advance, and when the voice call is performed next time, the terminal device directly adjusts the volume of the controlled terminal to be the recommended volume, which may specifically be implemented as the steps shown in fig. 8:

in step 801: responding to the voice call indication, and detecting the network environment of the controlled terminal;

in step 802: if the controlled terminal and the controlled terminal are in the same wireless network, determining the recommended volume of the controlled terminal based on the signal intensity of the wireless network and/or the first distance between the controlled terminals;

in step 803: determining that a recommended volume mode is in an enabled state;

in step 804: and based on the recommended volume, sending a volume control instruction to instruct the controlled terminal to adjust the volume to the recommended volume.

By the method, the situation that the volume of the controlled terminal is manually adjusted to the recommended volume by the user every time is avoided, operation steps of the user are saved, and user experience is improved.

For ease of understanding, the control panel-based volume adjustment process of the present application is illustrated below:

for example: the user receives the voice call and displays the first control panel in time, as shown in fig. 9, the user can control the volume in the first control panel, if the user wants to adjust the volume of the television, the user slides the volume mute key displayed in the screen to enter the second control panel, and the user can drag the volume of the television to the recommended volume in the second control panel. Of course, the user may select the recommended volume displayed in the first control panel and in the second control panel to control. The specific flow is shown in fig. 10:

in step 1001: receiving a voice call indication;

in step 1002: judging whether the connection mode between the terminal equipment and the television is Bluetooth connection or not, if so, entering a step 1003, and if not, entering a step 1004;

in step 1003: the terminal equipment sends confirmation information to the television;

in step 1004: determining whether the terminal equipment and the television are in the same network; if the network is in the same network, entering step 1007, and if the network is not in the same network, entering step 1001; if not, the process may return to 1002;

in step 1005: determining whether the terminal equipment receives the reply information of the television within the preset time, if so, entering step 1007, and if so, entering step 1006;

in step 1006: the terminal equipment sends a control instruction to the television;

in step 1007: and determining the recommended volume according to the signal intensity difference and/or the first distance between the terminal equipment and the television.

In step 1008: it is determined whether it is in the recommended volume mode, if so, step 1014 is performed, otherwise, step 1009 is performed.

In step 1009: displaying a first control panel (as shown in fig. 9), wherein the first control panel includes a floating ball, a virtual volume adjustment control, and a virtual screen recording control, and the floating ball is a recommended volume control;

in step 1010: determining the operation type of the user for the first control panel, and if the user is a click operation, entering step 1011; if the user is a drag operation, go to step 1012; if the volume selected by the user is the recommended volume, go to step 1013;

in step 1011: if multiple click operations are received within preset time, a control instruction is sent to the television once, and the volume of the television is adjusted according to the control instruction;

in step 1012: continuously sending a control instruction to the television, and adjusting the volume of the television according to the control instruction;

in step 1013: sending a volume control instruction to the television based on the recommended volume;

in step 1014: based on the recommended volume, the volume of the television is set to the recommended volume, as shown in fig. 11, and the user is prompted in the interface that the television has been adjusted to the recommended volume.

Based on the same inventive concept, the embodiment of the present application further provides a control device of a controlled terminal, where the device includes at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform any of the methods described above.

It should be noted that although several units or sub-units of the apparatus are mentioned in the above detailed description, such division is merely exemplary and not mandatory. Indeed, the features and functions of two or more units described above may be embodied in one unit, according to embodiments of the application. Conversely, the features and functions of one unit described above may be further divided into embodiments by a plurality of units.

Further, while the operations of the methods of the present application are depicted in the drawings in a particular order, this does not require or imply that these operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.