Sony Ericsson patents CAMERA BASED CONTROL

Abstract
A communication device may include a lens and processing logic. The lens may receive a gesture made by a user of the mobile terminal and the processing logic may identify the gesture. The processing logic may also generate a command based on the identified gesture, where the command instructs the mobile terminal or an external device to perform a control action.


Description
--------------------------------------------------------------------------------
TECHNICAL FIELD OF THE INVENTION

[0001]The invention relates generally to performing control actions and, more particularly, to performing control actions using a camera.

DESCRIPTION OF RELATED ART

[0002]Communication devices, such as cellular telephones, have become increasingly versatile. For example, cellular telephones today often include applications that allow users to do more than just make and receive telephone calls, such as send/receive text messages, play music, play video games, take pictures, etc. As a result, cellular telephones have become an increasingly common part of every day life for a large number of users.

SUMMARY

[0003]According to one aspect, a mobile terminal may include a lens and processing logic. The lens is configured to receive a gesture made by a user of the mobile terminal and the processing logic is configured to identify the gesture and generate a command based on the identified gesture, where the command instructs the mobile terminal or an external device to perform a control action.

[0004]Additionally, the mobile terminal may comprise a memory configured to store a plurality of images, where each of the images corresponds to one of a plurality of commands.

[0005]Additionally, each of the plurality of images corresponds to a gesture made using one or more fingers.

[0006]Additionally, when identifying the gesture, the processing logic is configured to compare the gesture to the plurality of images and identify a first one of the plurality of images as corresponding to the gesture.

[0007]Additionally, when generating a command, the processing logic is configured to identify a first command corresponding to the first image.

[0008]Additionally, the gesture may comprises a motion made in front of the lens by the user using at least one hand. When identifying the gesture, the processing logic is configured to identify a first pattern associated with the motion and when generating a command, the processing logic is configured to identify a first command as corresponding to the first pattern.

[0009]Additionally, the mobile terminal may further comprise a transmitter configured to transmit the command to the external device.

[0010]Additionally, the external device may comprise a television, a digital video disc player or a video game system and the command instructs the external device to at least one of increase volume, decrease volume, change a channel, pause the external device or turn off the external device.

[0011]Additionally, the external device may play music and the command instructs the external device to increase volume, decrease volume, skip to another song, go back to a previous song or stop playing a song.

[0012]Additionally, the processing logic may be further configured to perform a control action for an application executed by the mobile terminal in response to the command.

[0013]Additionally, the control action may comprise at least one of increasing volume of a song being played by the mobile terminal or output to the external device, decreasing volume of a song being played by the mobile terminal or output to the external device, skipping to another song, or stopping playing of a song being played by the mobile terminal or output to the external device.

[0014]Additionally, the processing logic may be further configured to provide a user interface configured to allow a user to provide gestures to the mobile terminal, where each of the gestures corresponds to one of a plurality of commands.

[0015]Additionally, when allowing the user to provide gestures, the lens is configured to focus on a first gesture provided by the user in response to a prompt via the user interface, where the first gesture includes at least a portion of the user's hand. The processing logic is also further configured to identify the first gesture and correlate the first gesture to a first one of the plurality of commands.

[0016]Additionally, the mobile terminal may comprise a cellular telephone.

[0017]According to another aspect, a method performed by a communication device may comprise capturing a gesture provided by a user of the communication device and identifying the gesture. The method may also include generating a command based on the first gesture, where the command instructs the communication device to perform a control action.

[0018]Additionally, the gesture may comprise a motion made in front of a lens of the communication device by the user using at least one hand and the identifying the gesture may comprise identifying a first pattern associated with the motion and correlating the first pattern to a first gesture. The generating a command may comprise generating a first command corresponding to the first pattern.

[0019]Additionally, the gesture may comprise an image captured by a lens of the communication device and the method may further comprise storing a plurality of images in the communication device, each of the plurality of images being associated with one of a plurality of commands. The identifying the gesture may comprise comparing the captured image to the plurality of stored images and identifying a first one of the plurality of stored images as corresponding to the captured image.

[0020]Additionally, each of the plurality of stored images includes a gesture made using one or more fingers.

[0021]Additionally, the method may comprise transmitting the command to an external device, where the command instructs the external device to perform a control action on the external device.

[0022]Additionally, the transmitting the command to an external device may comprise transmitting the command to a television, a digital video disc player or a video game system, the command instructing the external device to at least one of increase volume, decrease volume, change a channel or turn off the external device.

[0023]Additionally, the transmitting the command to an external device may comprise transmitting the command to an external device that plays music, the command instructing the external device to increase volume, decrease volume, skip to another song, go back to a previous song, or stop playing a song.

[0024]Additionally, the method may comprise performing a control action in response to the command, the control action comprising at least one of increasing volume of a song being played by the communication device or output to an external device, decreasing volume of a song being played by the communication device or output to the external device, skipping to another song or stopping playing of a song being played by the communication device or output to the external device.

[0025]Additionally, the method may comprise providing a user interface to a user of the communication device, where the user interface is configured to allow the user to provide a plurality of gestures to the communication device and each of the plurality of gestures corresponds to one of a plurality of commands. The method may further comprise receiving a gesture, identifying a first one of the plurality of commands based on the received gesture and performing an action based on the first command.

[0026]Additionally, the performing an action may comprise at least one of increasing volume of a song, decreasing volume of a song, skipping to another song or going back to a previous song.

[0027]According to still another aspect, a device is provided. The device comprises means for capturing an image and means for identifying the captured image. The device also includes means for generating a command based on the identified image, where the command instructs the device to perform a control action.

[0028]Additionally, the device further comprises means for transmitting the command to an external device, the command instructing the external device to perform a control function on the external device.

[0029]In still another aspect, a computer-readable medium having stored thereon a plurality of instructions is provided. The instructions which, when executed by at least one processor, cause the at least one processor to receive an image or a motion captured by a lens. The instructions also cause the at least one processor to identify the image or motion captured by the lens as corresponding to a first image or motion and generate a command based on the first image or motion, where the command instructs a mobile terminal on which the at least one processor resides to perform a control action or transmit the command to an external device.

[0030]Additionally, the received image or motion may comprise an image made by the user and when identifying the image or motion, the at least one processor is configured to compare the image made by the user to a plurality of stored images.

[0031]Additionally, the image or motion may comprise a motion made by the user and when identifying the image or motion, the at least one processor is configured to compare the motion to a plurality of predetermined motions.

[0032]Additionally, the instructions further cause the processor to forward the command for transmission to the external device, where the command instructs the external device to perform a control function on the external device.

[0033]Other features and advantages of the invention will become readily apparent to those skilled in this art from the following detailed description. The embodiments shown and described provide illustration of the best mode contemplated for carrying out the invention. The invention is capable of modifications in various obvious respects, all without departing from the invention. Accordingly, the drawings are to be regarded as illustrative in nature, and not as restrictive.