Nokia patents USER INTERFACE, DEVICE AND METHOD FOR A PHYSICALLY FLEXIBLE DEVICE
Abstract:
A user interface including a flexible display configured to display graphical objects and a controller configured to detect a first bend and determine a resulting first foldline, determine a graphical object being intersected by the first foldline and execute a function associated with the graphical object.
Claims:
1. A user interface comprising a flexible display and a controller configured to:detect a first bend and determine a resulting first foldline,determine a graphical object being intersected by said first foldline andexecute a function associated with said graphical object.
2. A user interface according to claim 1, wherein said controller is further configured to:detect a second bend and determine a resulting second foldline,determine a second graphical object being intersected by said second foldline and wherein said function is associated with or performed on said second graphical object.
3. A user interface according to claim 1, wherein said controller is further configured to determine a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
4. A user interface according to claim 1, wherein said controller is further configured to detect a variation in said first bend and determine a resulting second foldline and determine a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
5. A user interface according to claim 4, wherein said controller is further configured to detect a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
6. A user interface according to claim 1, wherein said display is a touchdisplay and said controller is further configured to detect a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
7. A user interface according to claim 1, wherein said display is configured to display a graphical indication of a foldline.
8. A user interface according to claim 1, wherein said controller is further configured to detect a double bend.
9. A user interface according to claim 1, wherein said controller is further configured to detect a release event and execute said function upon detection of said release event.
10. A user interface according to claim 1, wherein said controller is further configured to detect a characteristic of said bend and determine said associated function according to said a criterion based on said characteristic.
11. A user interface according to claim 10, wherein said criterion is related to one characteristic taken from the group comprising: position of bend, angle of bend, speed of bend, sharpness of bend.
12. A user interface according to claim 1, wherein said controller is further configured to determine that a graphical objected is intersected if a foldline intersects an area surrounding said graphical object.
13. A user interface according to claim 1, wherein said display is configured to display a graphical object.
14. A user interface comprising a flexible display and a controller configured to detect a bend resulting in a shape and execute a function associated with said shape.
15. A user interface according to claim 14, wherein said controller is further configured to detect a movement and execute a function associated with said movement.
16. A user interface according to claim 14, wherein said function is to search for an institution.
17. A user interface according to claim 14, wherein said function is to establish a connection with a device.
18. A user interface comprising a flexible display and a controller configured to detect a bend of a corner of said display and execute a function associated with said corner.
19. A method for executing a function in a device comprising a flexible display, said method comprising:detecting a bend,determine a resulting foldlinedetermine a graphical object being intersected by said foldline and execute a function associated with said graphical object.
20. A method according to claim 19 further comprising detecting a release event and executing said function upon said release event.
21. A method according to claim 19 further comprising determine said function based on a criterion related to a characteristic of said bend.
22. A method according to claim 19 further comprising:detecting a second bend,determining a resulting second foldline,determine a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
23. A method according to claim 19 further comprising:determining a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
24. A method according to claim 19 further comprising detecting a variation in said first bend and determining a resulting second foldline and determining a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
25. A method according to claim 19 further comprising detecting a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
26. A method according to claim 19 wherein said display is a touchdisplay and said method comprises detecting a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
27. A method according to claim 19 further comprising displaying a graphical indication of a foldline.
28. A method according to claim 19 further comprising detecting a double bend.
29. A method according to claim 19 further comprising detecting a release event and executing said function upon detection of said release event.
30. A method according to claim 19, further comprising determining that a graphical objected is intersected if a foldline intersects an area surrounding said graphical object.
31. A method according to claim 19, further comprising displaying said graphical object on said display.
32. A method for executing a function in a device comprising a flexible display, said method comprising detecting a bend of a corner of said display and executing a function associated with said corner.
33. A method for executing a function in a device comprising a flexible device, said method comprising:detecting a bend,determining a resulting shape,determining a function associated with said shape and executing said function.
34. A method according to claim 33, wherein said function is to search for an institution.
35. A method according to claim 33, wherein said function is to establish a connection with a device.
36. A method according to claim 33 further comprising detecting a movement wherein said function is associated with said movement.
37. A method according to claim 33 further comprising detecting a release event and thereupon arrest said execution of said function.
38. A computer readable medium including at least computer program code for controlling a user interface comprising a flexible display, said computer readable medium comprising:software code configured to detect a first bend and determine a resulting first foldline,software code configured to determine a graphical object being intersected by said first foldline andsoftware code configured to execute a function associated with said graphical object.
39. A computer readable medium as in claim 38 further comprising software code configured todetect a second bend and determine a resulting second foldline,determine a second graphical object being intersected by said second foldline and wherein said function is associated with or performed on said second graphical object.
40. A computer readable medium as in claim 38 further comprising software code configured to determine a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
41. A computer readable medium as in claim 38 further comprising software code configured to detect a variation in said first bend and determine a resulting second foldline and determine a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
42. A computer readable medium as in claim 38 further comprising software code configured to detect a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
43. A computer readable medium as in claim 38 further comprising software code configured to wherein said display is a touchdisplay and said controller is further configured to detect a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
44. A computer readable medium as in claim 38 further comprising software code configured to display a graphical indication of a foldline.
45. A computer readable medium as in claim 38 further comprising software code configured to detect a double bend.
46. A computer readable medium as in claim 38 further comprising software code configured to detect a release event and execute said function upon detection of said release event.
47. A computer readable medium as in claim 38 further comprising software code configured to detect a characteristic of said bend and determine said associated function according to said a criterion based on said characteristic.
48. A computer readable medium as in claim 47, wherein said criterion is related to one characteristic taken from the group comprising: position of bend, angle of bend, speed of bend, sharpness of bend.
49. A computer readable medium as in claim 38 further comprising software code configured to determine that a graphical objected is intersected if a foldline intersects an area surrounding said graphical object.
50. A computer readable medium as in claim 38 further comprising software code configured to display said graphical object on said display.
51. A computer readable medium including at least computer program code for controlling a user interface comprising a flexible display, said computer readable medium comprising software code configured to detect a bend resulting in a shape and execute a function associated with said shape.
52. A computer readable medium as in claim 51 further comprising software code configured to detect a movement and execute a function associated with said movement.
53. A computer readable medium including at least computer program code for controlling a user interface comprising a flexible display, said computer readable medium comprising software code configured to detect a bend of a corner of said display and execute a function associated with said corner.
54. A user interface comprising flexible display means and control means for:detecting a first bend and determining a resulting first foldline,determining a graphical object being intersected by said first foldline andexecuting a function associated with said graphical object.
55. A user interface comprising flexible display means and control means for detecting a bend resulting in a shape and control means for executing a function associated with said shape.
56. A device incorporating or configured to incorporate a user interface according to claim 1.
57. A device implementing or configured to implement a method according to claim 19.
58. A device implementing or configured to implement a method according to claim 32.
59. A device implementing or configured to implement a method according to claim 33.
Description
FIELD
[0001]The present application relates to a user interface, a device and a method for an improved user interaction, and in particular to a user interface, a device and a method for an improved user interaction through the use of a flexible display.
BACKGROUND
[0002]In recent years, considerable progress has been made towards the development of thin and flexible displays. For example, it is known to have a display device assembly comprising a flexible display device being rollable around an axis. A range of flexible electronic devices based on these technologies, including full color, high-resolution flexible organic light emitting diode, OLED, displays with a thickness of 0.2 mm are being introduced to the market. The goal of such efforts is to provide displays with superior handling, contrast and flexibility.
[0003]It should be noted that the category of displays to which these disclosed embodiments pertain are very different from the type of rigid-surface Liquid Crystal Display (LCD) displays which can be rotated around their respective axes but not deformed.
[0004]Prior art demonstrates the value of incorporating the deformation of computing objects for use as input for computer processes. However, in this document, we propose methods for interacting with flexible displays that rely on deformations of the surface structure of the display itself.
[0005]Another prior art discloses a credit card sized computer that uses physical deformation of the device for browsing of visual information, it should be noted that said device did not incorporate a flexible material, and did not use deformation of the display. Instead, it relied on the use of touch sensors mounted on a rigid LCD-style display body.
[0006]It is also known to have a sort of digital desk which is a physical desk augmented with electronic input and display. A computer controlled camera and projector are positioned above the desk. Image processing is used to determine which page a user is pointing at. Object character recognition transfers content between real paper and electronic documents projected on the desk. This system blurs the boundaries between the digital and physical world by taking a printed number and transferring it into an electronic calculator.
[0007]It is also known to use normal paper as displays and control means.
[0008]It is further known to use a set of interaction techniques for obtaining input to a computer system based on methods and apparatus for detecting properties of the shape, location and orientation of flexible display surfaces, as determined through manual or gestural interactions of a user with said display surfaces. Such input may be used to alter graphical content and functionality displayed on said surfaces or some other display or computing system. In this system a camera is used to detect the position and shape of a paper.
[0009]The use of a camera to detect the position of a screen and/or a user's hands suffers from the drawback that the system is not mobile and requires that the camera is fixed and steady or the image processing becomes very difficult to achieve correctly. Also, as the camera needs to be placed some distance away from the display that it detects the shape and position of the system becomes cumbersome.
[0010]Also a paper system having multiple papers acting as screens suffers from the disadvantage that the whole setup is vulnerable and sensitive to outer influences such as wind or involuntary movement of a paper/display.
[0011]One prior art solution wherein a flexible display is used to give simple commands similar to a single keypress is known where a bend of the screen activates a pre-specified action. In such a solution the proposed UI is limited to simple actions such as scroll or zoom and will not be sufficient to satisfy all requirements of a modern device being capable of executing a plurality of differing applications.
[0012]Thus a user interface and a device incorporating such user interface having a flexible screen capable of being small and mobile while still allowing several user actions to be taken is desirable.
SUMMARY
[0013]On this background, it would be advantageously to provide a user interface, a device and a method that overcomes or at least reduces the drawbacks indicated above by providing a flexible user interface.
[0014]The disclosed embodiments provide a user interface comprising a flexible display and a controller configured to detect a first bend and determine a resulting first foldline, determine a graphical object being intersected by said first foldline and execute a function associated with said graphical object.
[0015]This allows a user to select an item without moving his hands and without requiring additional keys or external hardware.
[0016]In one embodiment the display is configured to display the graphical object.
[0017]In one embodiment the controller is further configured to detect a second bend and determine a resulting second foldline, determine a second graphical object being intersected by said second foldline and wherein said function is associated with or performed on said second graphical object.
[0018]In one embodiment the controller is further configured to determine a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
[0019]In one embodiment the controller is further configured to detect a variation in said first bend and determine a resulting second foldline and determine a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
[0020]In one embodiment the controller is further configured to detect a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
[0021]These embodiments allow a user to combine several items in one function. For example, it allows for combining one item representing an operation with one or more items representing operands.
[0022]In one embodiment the display is a touchdisplay and said controller is further configured to detect a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
[0023]This allows a user to combine touch input with bending input which increases the number of possible commands. Also, by arranging the touch items close to the edge of the touchdisplay the user won't be required to move his hands during operation of the user interface.
[0024]In one embodiment the display is configured to display a graphical indication of a foldline. This provides a user with visual feedback and allows for a more precise control of the bending input and the selected items.
[0025]In one embodiment the controller is further configured to detect a double bend. This increases the number of available command options.
[0026]In one embodiment the controller is further configured to detect a release event and execute said function upon detection of said release event. This provides increased control as a foldline may be varied to a wanted position before the associated function is executed.
[0027]In one embodiment an informative text or icon is displayed while a foldline intersects a graphical object. This informs a user of which associated function will be executed should that object be selected.
[0028]In one embodiment the controller is further configured to detect a characteristic of said bend and determine said associated function according to said a criterion based on said characteristic. In one embodiment the criterion is related to one characteristic taken from the group comprising: position of bend, angle of bend, speed of bend, sharpness of bend.
[0029]This provides for an increased number of different command options available in the user interface.
[0030]In one embodiment the controller is further configured to determine that a graphical object is intersected if a foldline intersects an area surrounding said graphical object. This provides for a faster input as a foldline does not have to intersect the graphical object precisely.
[0031]The aspects of the disclosed embodiments are also directed to providing a user interface comprising a flexible display and a controller configured to detect a bend resulting in a shape and execute a function associated with said shape. This provides for a fast and intuitive manner of executing a pre-specified function as a shape is easy to remember and is strongly associated to everyday real-life objects and actions.
[0032]In one embodiment the controller is further configured to detect a movement and execute a function associated with said movement. This increases the number of available command options and also further increases the intuitive coupling between the function and the resembling everyday real-life object or action.
[0033]In one embodiment the function is to search for an institution and in one embodiment the function is to establish a connection with a device.
[0034]The aspects of the disclosed embodiments are also directed to providing a user interface comprising a flexible display and a controller configured to detect a bend of a corner of said display and execute a function associated with said corner. This provides a fast and intuitive manner of executing a command or function.
[0035]In one embodiment only the corners of the display are bendable and by only bending the corners a device incorporating such a user interface can be made of cheaper and more common material and also be made more rigid.
[0036]The aspects of the disclosed embodiments are also directed to providing a user interface comprising flexible display means and control means for detecting a first bend and determining a resulting first foldline, determining a graphical object being intersected by said first foldline and executing a function associated with said graphical object.
[0037]The user interface and the embodiments below share the advantages as discussed above.
[0038]In one embodiment the user interface further comprises control means for detecting a second bend and determining a resulting second foldline, determining a second graphical object being intersected by said second foldline and wherein said function is associated with or performed on said second graphical object.
[0039]In one embodiment the user interface further comprises control means for determining a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
[0040]In one embodiment the user interface further comprises control means for detecting a variation in said first bend and determining a resulting second foldline and determining a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
[0041]In one embodiment the user interface further comprises control means for detecting a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
[0042]In one embodiment the display is a touchdisplay and the user interface further comprises control means for detecting a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
[0043]In one embodiment the user interface further comprises display means for displaying a graphical indication of a foldline.
[0044]In one embodiment the user interface further comprises control means for detecting a double bend.
[0045]In one embodiment the user interface further comprises control means for detecting a release event and executing said function upon detection of said release event.
[0046]In one embodiment the user interface further comprises control means for detecting a characteristic of said bend and determining said associated function according to said a criterion based on said characteristic.
[0047]In one embodiment the criterion is related to one characteristic taken from the group comprising: position of bend, angle of bend, speed of bend, sharpness of bend.
[0048]In one embodiment the user interface further comprises control means for determining that a graphical objected is intersected if a foldline intersects an area surrounding said graphical object.
[0049]In one embodiment the user interface further comprises display means for displaying a graphical object.
[0050]The aspects of the disclosed embodiments are also directed to providing a user interface comprising flexible display means and control means for detecting a bend resulting in a shape and executing a function associated with said shape.
[0051]The user interface and the embodiments below share the advantages as discussed above.
[0052]In one embodiment the user interface further comprises control means for detecting a movement and executing a function associated with said movement. In one embodiment the function is to search for an institution. In one embodiment the function is to establish a connection with a device.
[0053]The aspects of the disclosed embodiments are also directed to providing a user interface comprising flexible display means and control means for detecting a bend of a corner of said display and executing a function associated with said corner. The user interface shares the advantages as discussed above.
[0054]The aspects of the disclosed embodiments are also directed to providing a device incorporating or configured to incorporate a user interface according to above.
[0055]The device shares the advantages as discussed above.
[0056]The aspects of the disclosed embodiments are also directed to providing a method for executing a function in a device comprising a flexible display, said method comprising detecting a bend, determine a resulting foldline and determine a graphical object intersected by said foldline and execute a function associated with said graphical object.
[0057]The method and the embodiments below share the advantages as discussed above.
[0058]In one embodiment the graphical object is displayed on the display.
[0059]In one embodiment the method further comprises detecting a release event and executing said function upon said release event.
[0060]In one embodiment the method further comprises determining said function based on a criterion related to a characteristic of said bend.
[0061]In one embodiment the method further comprises detecting a second bend, determining a resulting second foldline, determine a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
[0062]In one embodiment the method further comprises determining a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
[0063]In one embodiment the method further comprises detecting a variation in said first bend and determining a resulting second foldline and determining a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
[0064]In one embodiment the method further comprises detecting a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
[0065]In one embodiment the display is a touchdisplay and the method comprises detecting a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
[0066]In one embodiment the method further comprises displaying a graphical indication of a foldline.
[0067]In one embodiment the method further comprises detecting a double bend.
[0068]In one embodiment the method further comprises detecting a release event and executing said function upon detection of said release event.
[0069]In one embodiment the method further comprises determining that a graphical objected is intersected if a foldline intersects an area surrounding said graphical object.
[0070]The aspects of the disclosed embodiments are also directed to providing a method for executing a function in a device comprising a flexible display, said method comprising detecting a bend of a corner of said display and executing a function associated with said corner.
[0071]The method shares the advantages as discussed above.
[0072]The aspects of the disclosed embodiments are also directed to providing a device implementing or configured to implement a method according above.
[0073]The device shares the advantages as discussed above.
[0074]The aspects of the disclosed embodiments are also directed to providing a method for executing a function in a device comprising a flexible device, said method comprising detecting a bend, determining a resulting shape, determining a function associated with said shape and executing said function.
[0075]The method and the embodiments below share the advantages as discussed above.
[0076]In one embodiment the function is to search for an institution.
[0077]In one embodiment the function is to establish a connection with a device.
[0078]In one embodiment the method further comprises detecting a movement wherein said function is associated with said movement.
[0079]In one embodiment the method further comprises detecting a release event and thereupon arrest said execution of said function.
[0080]The aspects of the disclosed embodiments are also directed to providing a device implementing or configured to implement a method according above.
[0081]The device shares the advantages as discussed above.
[0082]The aspects of the disclosed embodiments are also directed to providing a computer readable medium including at least computer program code for controlling a user interface comprising a flexible display, said computer readable medium comprising software code configured to detect a first bend and determine a resulting first foldline, software code configured to determine a graphical object being intersected by said first foldline and software code configured to execute a function associated with said graphical object.
[0083]The computer readable medium and the embodiments below share the advantages as discussed above.
[0084]In one embodiment the computer readable medium further comprises software code configured to display the graphical object.
[0085]In one embodiment the computer readable medium further comprises software code configured to detect a second bend and determine a resulting second foldline, determine a second graphical object being intersected by said second foldline and wherein said function is associated with or performed on said second graphical object.
[0086]In one embodiment the computer readable medium further comprises software code configured to determine a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
[0087]In one embodiment the computer readable medium further comprises software code configured to detect a variation in said first bend and determine a resulting second foldline and determine a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
[0088]In one embodiment the computer readable medium further comprises software code configured to detect a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
[0089]In one embodiment the computer readable medium further comprises software code configured to wherein said display is a touchdisplay and said controller is further configured to detect a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
[0090]In one embodiment the computer readable medium further comprises software code configured to display a graphical indication of a foldline.
[0091]In one embodiment the computer readable medium further comprises software code configured to detect a double bend.
[0092]In one embodiment the computer readable medium further comprises software code configured to detect a release event and execute said function upon detection of said release event.
[0093]In one embodiment the computer readable medium further comprises software code configured to detect a characteristic of said bend and determine said associated function according to said a criterion based on said characteristic.
[0094]In one embodiment the criterion is related to one characteristic taken from the group comprising: position of bend, angle of bend, speed of bend, sharpness of bend.
[0095]In one embodiment the computer readable medium further comprises software code configured to determine that a graphical objected is intersected if a foldline intersects an area surrounding said graphical object.
[0096]The aspects of the disclosed embodiments are also directed to providing a computer readable medium including at least computer program code for controlling a user interface comprising a flexible display, said computer readable medium comprising software code configured to detect a bend resulting in a shape and execute a function associated with said shape.
[0097]In one embodiment the computer readable medium further comprises software code configured to detect a movement and execute a function associated with said movement.
[0098]The aspects of the disclosed embodiments are also directed to providing a computer readable medium including at least computer program code for controlling a user interface comprising a flexible display, said computer readable medium comprising software code configured to detect a bend of a corner of said display and execute a function associated with said corner.
[0099]The computer readable medium shares the advantages as discussed above.
[0100]The aspects of the disclosed embodiments are also directed to providing a device implementing or configured to implement a computer readable medium according above.
[0101]The device shares the advantages as discussed above.
[0102]In one embodiment any of the devices above is a mobile phone, a Personal Digital Assistant (PDA), a game console, a media player or a personal organizer.
[0103]Further objects, features, advantages and properties of device, method and computer readable medium according to the present application will become apparent from the detailed description.
BRIEF DESCRIPTION OF THE DRAWINGS
[0104]In the following detailed portion of the present description, the teachings of the present application will be explained in more detail with reference to the example embodiments shown in the drawings, in which:
[0105]FIG. 1 is an overview of a telecommunications system in which a device according to the present application is used according to an embodiment,
[0106]FIGS. 2a and b are plane front views of a device according to an embodiment,
[0107]FIG. 3 is a block diagram illustrating the general architecture of a device of FIG. 2 in accordance with the present application,
[0108]FIGS. 4a, b, c, d, e and f are plane front views of a device according to an embodiment,
[0109]FIGS. 5a, b, c, d, e and f are schematic drawings illustrating a bending pattern according to an embodiment,
[0110]FIGS. 6a, b, c and d are flow charts describing each a method according to an embodiment,
[0111]FIGS. 7a and b are front views of a device according to an embodiment,
[0112]FIG. 8 is a flow chart describing a method according to an embodiment,
[0113]FIG. 9 is a flow chart describing a method according to an embodiment,
[0114]FIGS. 10a, b and c are schematic drawings of a device according to an embodiment,
[0115]FIG. 11 is a flow chart describing a method according to an embodiment, and
[0116]FIGS. 12a, b, c and d are plane front views of a device according to an embodiment.
A user interface including a flexible display configured to display graphical objects and a controller configured to detect a first bend and determine a resulting first foldline, determine a graphical object being intersected by the first foldline and execute a function associated with the graphical object.
Claims:
1. A user interface comprising a flexible display and a controller configured to:detect a first bend and determine a resulting first foldline,determine a graphical object being intersected by said first foldline andexecute a function associated with said graphical object.
2. A user interface according to claim 1, wherein said controller is further configured to:detect a second bend and determine a resulting second foldline,determine a second graphical object being intersected by said second foldline and wherein said function is associated with or performed on said second graphical object.
3. A user interface according to claim 1, wherein said controller is further configured to determine a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
4. A user interface according to claim 1, wherein said controller is further configured to detect a variation in said first bend and determine a resulting second foldline and determine a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
5. A user interface according to claim 4, wherein said controller is further configured to detect a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
6. A user interface according to claim 1, wherein said display is a touchdisplay and said controller is further configured to detect a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
7. A user interface according to claim 1, wherein said display is configured to display a graphical indication of a foldline.
8. A user interface according to claim 1, wherein said controller is further configured to detect a double bend.
9. A user interface according to claim 1, wherein said controller is further configured to detect a release event and execute said function upon detection of said release event.
10. A user interface according to claim 1, wherein said controller is further configured to detect a characteristic of said bend and determine said associated function according to said a criterion based on said characteristic.
11. A user interface according to claim 10, wherein said criterion is related to one characteristic taken from the group comprising: position of bend, angle of bend, speed of bend, sharpness of bend.
12. A user interface according to claim 1, wherein said controller is further configured to determine that a graphical objected is intersected if a foldline intersects an area surrounding said graphical object.
13. A user interface according to claim 1, wherein said display is configured to display a graphical object.
14. A user interface comprising a flexible display and a controller configured to detect a bend resulting in a shape and execute a function associated with said shape.
15. A user interface according to claim 14, wherein said controller is further configured to detect a movement and execute a function associated with said movement.
16. A user interface according to claim 14, wherein said function is to search for an institution.
17. A user interface according to claim 14, wherein said function is to establish a connection with a device.
18. A user interface comprising a flexible display and a controller configured to detect a bend of a corner of said display and execute a function associated with said corner.
19. A method for executing a function in a device comprising a flexible display, said method comprising:detecting a bend,determine a resulting foldlinedetermine a graphical object being intersected by said foldline and execute a function associated with said graphical object.
20. A method according to claim 19 further comprising detecting a release event and executing said function upon said release event.
21. A method according to claim 19 further comprising determine said function based on a criterion related to a characteristic of said bend.
22. A method according to claim 19 further comprising:detecting a second bend,determining a resulting second foldline,determine a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
23. A method according to claim 19 further comprising:determining a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
24. A method according to claim 19 further comprising detecting a variation in said first bend and determining a resulting second foldline and determining a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
25. A method according to claim 19 further comprising detecting a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
26. A method according to claim 19 wherein said display is a touchdisplay and said method comprises detecting a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
27. A method according to claim 19 further comprising displaying a graphical indication of a foldline.
28. A method according to claim 19 further comprising detecting a double bend.
29. A method according to claim 19 further comprising detecting a release event and executing said function upon detection of said release event.
30. A method according to claim 19, further comprising determining that a graphical objected is intersected if a foldline intersects an area surrounding said graphical object.
31. A method according to claim 19, further comprising displaying said graphical object on said display.
32. A method for executing a function in a device comprising a flexible display, said method comprising detecting a bend of a corner of said display and executing a function associated with said corner.
33. A method for executing a function in a device comprising a flexible device, said method comprising:detecting a bend,determining a resulting shape,determining a function associated with said shape and executing said function.
34. A method according to claim 33, wherein said function is to search for an institution.
35. A method according to claim 33, wherein said function is to establish a connection with a device.
36. A method according to claim 33 further comprising detecting a movement wherein said function is associated with said movement.
37. A method according to claim 33 further comprising detecting a release event and thereupon arrest said execution of said function.
38. A computer readable medium including at least computer program code for controlling a user interface comprising a flexible display, said computer readable medium comprising:software code configured to detect a first bend and determine a resulting first foldline,software code configured to determine a graphical object being intersected by said first foldline andsoftware code configured to execute a function associated with said graphical object.
39. A computer readable medium as in claim 38 further comprising software code configured todetect a second bend and determine a resulting second foldline,determine a second graphical object being intersected by said second foldline and wherein said function is associated with or performed on said second graphical object.
40. A computer readable medium as in claim 38 further comprising software code configured to determine a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
41. A computer readable medium as in claim 38 further comprising software code configured to detect a variation in said first bend and determine a resulting second foldline and determine a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
42. A computer readable medium as in claim 38 further comprising software code configured to detect a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
43. A computer readable medium as in claim 38 further comprising software code configured to wherein said display is a touchdisplay and said controller is further configured to detect a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
44. A computer readable medium as in claim 38 further comprising software code configured to display a graphical indication of a foldline.
45. A computer readable medium as in claim 38 further comprising software code configured to detect a double bend.
46. A computer readable medium as in claim 38 further comprising software code configured to detect a release event and execute said function upon detection of said release event.
47. A computer readable medium as in claim 38 further comprising software code configured to detect a characteristic of said bend and determine said associated function according to said a criterion based on said characteristic.
48. A computer readable medium as in claim 47, wherein said criterion is related to one characteristic taken from the group comprising: position of bend, angle of bend, speed of bend, sharpness of bend.
49. A computer readable medium as in claim 38 further comprising software code configured to determine that a graphical objected is intersected if a foldline intersects an area surrounding said graphical object.
50. A computer readable medium as in claim 38 further comprising software code configured to display said graphical object on said display.
51. A computer readable medium including at least computer program code for controlling a user interface comprising a flexible display, said computer readable medium comprising software code configured to detect a bend resulting in a shape and execute a function associated with said shape.
52. A computer readable medium as in claim 51 further comprising software code configured to detect a movement and execute a function associated with said movement.
53. A computer readable medium including at least computer program code for controlling a user interface comprising a flexible display, said computer readable medium comprising software code configured to detect a bend of a corner of said display and execute a function associated with said corner.
54. A user interface comprising flexible display means and control means for:detecting a first bend and determining a resulting first foldline,determining a graphical object being intersected by said first foldline andexecuting a function associated with said graphical object.
55. A user interface comprising flexible display means and control means for detecting a bend resulting in a shape and control means for executing a function associated with said shape.
56. A device incorporating or configured to incorporate a user interface according to claim 1.
57. A device implementing or configured to implement a method according to claim 19.
58. A device implementing or configured to implement a method according to claim 32.
59. A device implementing or configured to implement a method according to claim 33.
Description
FIELD
[0001]The present application relates to a user interface, a device and a method for an improved user interaction, and in particular to a user interface, a device and a method for an improved user interaction through the use of a flexible display.
BACKGROUND
[0002]In recent years, considerable progress has been made towards the development of thin and flexible displays. For example, it is known to have a display device assembly comprising a flexible display device being rollable around an axis. A range of flexible electronic devices based on these technologies, including full color, high-resolution flexible organic light emitting diode, OLED, displays with a thickness of 0.2 mm are being introduced to the market. The goal of such efforts is to provide displays with superior handling, contrast and flexibility.
[0003]It should be noted that the category of displays to which these disclosed embodiments pertain are very different from the type of rigid-surface Liquid Crystal Display (LCD) displays which can be rotated around their respective axes but not deformed.
[0004]Prior art demonstrates the value of incorporating the deformation of computing objects for use as input for computer processes. However, in this document, we propose methods for interacting with flexible displays that rely on deformations of the surface structure of the display itself.
[0005]Another prior art discloses a credit card sized computer that uses physical deformation of the device for browsing of visual information, it should be noted that said device did not incorporate a flexible material, and did not use deformation of the display. Instead, it relied on the use of touch sensors mounted on a rigid LCD-style display body.
[0006]It is also known to have a sort of digital desk which is a physical desk augmented with electronic input and display. A computer controlled camera and projector are positioned above the desk. Image processing is used to determine which page a user is pointing at. Object character recognition transfers content between real paper and electronic documents projected on the desk. This system blurs the boundaries between the digital and physical world by taking a printed number and transferring it into an electronic calculator.
[0007]It is also known to use normal paper as displays and control means.
[0008]It is further known to use a set of interaction techniques for obtaining input to a computer system based on methods and apparatus for detecting properties of the shape, location and orientation of flexible display surfaces, as determined through manual or gestural interactions of a user with said display surfaces. Such input may be used to alter graphical content and functionality displayed on said surfaces or some other display or computing system. In this system a camera is used to detect the position and shape of a paper.
[0009]The use of a camera to detect the position of a screen and/or a user's hands suffers from the drawback that the system is not mobile and requires that the camera is fixed and steady or the image processing becomes very difficult to achieve correctly. Also, as the camera needs to be placed some distance away from the display that it detects the shape and position of the system becomes cumbersome.
[0010]Also a paper system having multiple papers acting as screens suffers from the disadvantage that the whole setup is vulnerable and sensitive to outer influences such as wind or involuntary movement of a paper/display.
[0011]One prior art solution wherein a flexible display is used to give simple commands similar to a single keypress is known where a bend of the screen activates a pre-specified action. In such a solution the proposed UI is limited to simple actions such as scroll or zoom and will not be sufficient to satisfy all requirements of a modern device being capable of executing a plurality of differing applications.
[0012]Thus a user interface and a device incorporating such user interface having a flexible screen capable of being small and mobile while still allowing several user actions to be taken is desirable.
SUMMARY
[0013]On this background, it would be advantageously to provide a user interface, a device and a method that overcomes or at least reduces the drawbacks indicated above by providing a flexible user interface.
[0014]The disclosed embodiments provide a user interface comprising a flexible display and a controller configured to detect a first bend and determine a resulting first foldline, determine a graphical object being intersected by said first foldline and execute a function associated with said graphical object.
[0015]This allows a user to select an item without moving his hands and without requiring additional keys or external hardware.
[0016]In one embodiment the display is configured to display the graphical object.
[0017]In one embodiment the controller is further configured to detect a second bend and determine a resulting second foldline, determine a second graphical object being intersected by said second foldline and wherein said function is associated with or performed on said second graphical object.
[0018]In one embodiment the controller is further configured to determine a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
[0019]In one embodiment the controller is further configured to detect a variation in said first bend and determine a resulting second foldline and determine a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
[0020]In one embodiment the controller is further configured to detect a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
[0021]These embodiments allow a user to combine several items in one function. For example, it allows for combining one item representing an operation with one or more items representing operands.
[0022]In one embodiment the display is a touchdisplay and said controller is further configured to detect a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
[0023]This allows a user to combine touch input with bending input which increases the number of possible commands. Also, by arranging the touch items close to the edge of the touchdisplay the user won't be required to move his hands during operation of the user interface.
[0024]In one embodiment the display is configured to display a graphical indication of a foldline. This provides a user with visual feedback and allows for a more precise control of the bending input and the selected items.
[0025]In one embodiment the controller is further configured to detect a double bend. This increases the number of available command options.
[0026]In one embodiment the controller is further configured to detect a release event and execute said function upon detection of said release event. This provides increased control as a foldline may be varied to a wanted position before the associated function is executed.
[0027]In one embodiment an informative text or icon is displayed while a foldline intersects a graphical object. This informs a user of which associated function will be executed should that object be selected.
[0028]In one embodiment the controller is further configured to detect a characteristic of said bend and determine said associated function according to said a criterion based on said characteristic. In one embodiment the criterion is related to one characteristic taken from the group comprising: position of bend, angle of bend, speed of bend, sharpness of bend.
[0029]This provides for an increased number of different command options available in the user interface.
[0030]In one embodiment the controller is further configured to determine that a graphical object is intersected if a foldline intersects an area surrounding said graphical object. This provides for a faster input as a foldline does not have to intersect the graphical object precisely.
[0031]The aspects of the disclosed embodiments are also directed to providing a user interface comprising a flexible display and a controller configured to detect a bend resulting in a shape and execute a function associated with said shape. This provides for a fast and intuitive manner of executing a pre-specified function as a shape is easy to remember and is strongly associated to everyday real-life objects and actions.
[0032]In one embodiment the controller is further configured to detect a movement and execute a function associated with said movement. This increases the number of available command options and also further increases the intuitive coupling between the function and the resembling everyday real-life object or action.
[0033]In one embodiment the function is to search for an institution and in one embodiment the function is to establish a connection with a device.
[0034]The aspects of the disclosed embodiments are also directed to providing a user interface comprising a flexible display and a controller configured to detect a bend of a corner of said display and execute a function associated with said corner. This provides a fast and intuitive manner of executing a command or function.
[0035]In one embodiment only the corners of the display are bendable and by only bending the corners a device incorporating such a user interface can be made of cheaper and more common material and also be made more rigid.
[0036]The aspects of the disclosed embodiments are also directed to providing a user interface comprising flexible display means and control means for detecting a first bend and determining a resulting first foldline, determining a graphical object being intersected by said first foldline and executing a function associated with said graphical object.
[0037]The user interface and the embodiments below share the advantages as discussed above.
[0038]In one embodiment the user interface further comprises control means for detecting a second bend and determining a resulting second foldline, determining a second graphical object being intersected by said second foldline and wherein said function is associated with or performed on said second graphical object.
[0039]In one embodiment the user interface further comprises control means for determining a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
[0040]In one embodiment the user interface further comprises control means for detecting a variation in said first bend and determining a resulting second foldline and determining a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
[0041]In one embodiment the user interface further comprises control means for detecting a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
[0042]In one embodiment the display is a touchdisplay and the user interface further comprises control means for detecting a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
[0043]In one embodiment the user interface further comprises display means for displaying a graphical indication of a foldline.
[0044]In one embodiment the user interface further comprises control means for detecting a double bend.
[0045]In one embodiment the user interface further comprises control means for detecting a release event and executing said function upon detection of said release event.
[0046]In one embodiment the user interface further comprises control means for detecting a characteristic of said bend and determining said associated function according to said a criterion based on said characteristic.
[0047]In one embodiment the criterion is related to one characteristic taken from the group comprising: position of bend, angle of bend, speed of bend, sharpness of bend.
[0048]In one embodiment the user interface further comprises control means for determining that a graphical objected is intersected if a foldline intersects an area surrounding said graphical object.
[0049]In one embodiment the user interface further comprises display means for displaying a graphical object.
[0050]The aspects of the disclosed embodiments are also directed to providing a user interface comprising flexible display means and control means for detecting a bend resulting in a shape and executing a function associated with said shape.
[0051]The user interface and the embodiments below share the advantages as discussed above.
[0052]In one embodiment the user interface further comprises control means for detecting a movement and executing a function associated with said movement. In one embodiment the function is to search for an institution. In one embodiment the function is to establish a connection with a device.
[0053]The aspects of the disclosed embodiments are also directed to providing a user interface comprising flexible display means and control means for detecting a bend of a corner of said display and executing a function associated with said corner. The user interface shares the advantages as discussed above.
[0054]The aspects of the disclosed embodiments are also directed to providing a device incorporating or configured to incorporate a user interface according to above.
[0055]The device shares the advantages as discussed above.
[0056]The aspects of the disclosed embodiments are also directed to providing a method for executing a function in a device comprising a flexible display, said method comprising detecting a bend, determine a resulting foldline and determine a graphical object intersected by said foldline and execute a function associated with said graphical object.
[0057]The method and the embodiments below share the advantages as discussed above.
[0058]In one embodiment the graphical object is displayed on the display.
[0059]In one embodiment the method further comprises detecting a release event and executing said function upon said release event.
[0060]In one embodiment the method further comprises determining said function based on a criterion related to a characteristic of said bend.
[0061]In one embodiment the method further comprises detecting a second bend, determining a resulting second foldline, determine a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
[0062]In one embodiment the method further comprises determining a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
[0063]In one embodiment the method further comprises detecting a variation in said first bend and determining a resulting second foldline and determining a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
[0064]In one embodiment the method further comprises detecting a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
[0065]In one embodiment the display is a touchdisplay and the method comprises detecting a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
[0066]In one embodiment the method further comprises displaying a graphical indication of a foldline.
[0067]In one embodiment the method further comprises detecting a double bend.
[0068]In one embodiment the method further comprises detecting a release event and executing said function upon detection of said release event.
[0069]In one embodiment the method further comprises determining that a graphical objected is intersected if a foldline intersects an area surrounding said graphical object.
[0070]The aspects of the disclosed embodiments are also directed to providing a method for executing a function in a device comprising a flexible display, said method comprising detecting a bend of a corner of said display and executing a function associated with said corner.
[0071]The method shares the advantages as discussed above.
[0072]The aspects of the disclosed embodiments are also directed to providing a device implementing or configured to implement a method according above.
[0073]The device shares the advantages as discussed above.
[0074]The aspects of the disclosed embodiments are also directed to providing a method for executing a function in a device comprising a flexible device, said method comprising detecting a bend, determining a resulting shape, determining a function associated with said shape and executing said function.
[0075]The method and the embodiments below share the advantages as discussed above.
[0076]In one embodiment the function is to search for an institution.
[0077]In one embodiment the function is to establish a connection with a device.
[0078]In one embodiment the method further comprises detecting a movement wherein said function is associated with said movement.
[0079]In one embodiment the method further comprises detecting a release event and thereupon arrest said execution of said function.
[0080]The aspects of the disclosed embodiments are also directed to providing a device implementing or configured to implement a method according above.
[0081]The device shares the advantages as discussed above.
[0082]The aspects of the disclosed embodiments are also directed to providing a computer readable medium including at least computer program code for controlling a user interface comprising a flexible display, said computer readable medium comprising software code configured to detect a first bend and determine a resulting first foldline, software code configured to determine a graphical object being intersected by said first foldline and software code configured to execute a function associated with said graphical object.
[0083]The computer readable medium and the embodiments below share the advantages as discussed above.
[0084]In one embodiment the computer readable medium further comprises software code configured to display the graphical object.
[0085]In one embodiment the computer readable medium further comprises software code configured to detect a second bend and determine a resulting second foldline, determine a second graphical object being intersected by said second foldline and wherein said function is associated with or performed on said second graphical object.
[0086]In one embodiment the computer readable medium further comprises software code configured to determine a second graphical object being intersected by said first foldline and wherein said function is associated with or executed on said second graphical object.
[0087]In one embodiment the computer readable medium further comprises software code configured to detect a variation in said first bend and determine a resulting second foldline and determine a second graphical object being intersected by said second foldline and wherein said function is associated with or executed on said second graphical object.
[0088]In one embodiment the computer readable medium further comprises software code configured to detect a third graphical object being intersected by said first foldline and wherein said function is associated with or executed on said third graphical object.
[0089]In one embodiment the computer readable medium further comprises software code configured to wherein said display is a touchdisplay and said controller is further configured to detect a touch input identifying a graphical object on said display wherein said function is associated with or executed on said second graphical object.
[0090]In one embodiment the computer readable medium further comprises software code configured to display a graphical indication of a foldline.
[0091]In one embodiment the computer readable medium further comprises software code configured to detect a double bend.
[0092]In one embodiment the computer readable medium further comprises software code configured to detect a release event and execute said function upon detection of said release event.
[0093]In one embodiment the computer readable medium further comprises software code configured to detect a characteristic of said bend and determine said associated function according to said a criterion based on said characteristic.
[0094]In one embodiment the criterion is related to one characteristic taken from the group comprising: position of bend, angle of bend, speed of bend, sharpness of bend.
[0095]In one embodiment the computer readable medium further comprises software code configured to determine that a graphical objected is intersected if a foldline intersects an area surrounding said graphical object.
[0096]The aspects of the disclosed embodiments are also directed to providing a computer readable medium including at least computer program code for controlling a user interface comprising a flexible display, said computer readable medium comprising software code configured to detect a bend resulting in a shape and execute a function associated with said shape.
[0097]In one embodiment the computer readable medium further comprises software code configured to detect a movement and execute a function associated with said movement.
[0098]The aspects of the disclosed embodiments are also directed to providing a computer readable medium including at least computer program code for controlling a user interface comprising a flexible display, said computer readable medium comprising software code configured to detect a bend of a corner of said display and execute a function associated with said corner.
[0099]The computer readable medium shares the advantages as discussed above.
[0100]The aspects of the disclosed embodiments are also directed to providing a device implementing or configured to implement a computer readable medium according above.
[0101]The device shares the advantages as discussed above.
[0102]In one embodiment any of the devices above is a mobile phone, a Personal Digital Assistant (PDA), a game console, a media player or a personal organizer.
[0103]Further objects, features, advantages and properties of device, method and computer readable medium according to the present application will become apparent from the detailed description.
BRIEF DESCRIPTION OF THE DRAWINGS
[0104]In the following detailed portion of the present description, the teachings of the present application will be explained in more detail with reference to the example embodiments shown in the drawings, in which:
[0105]FIG. 1 is an overview of a telecommunications system in which a device according to the present application is used according to an embodiment,
[0106]FIGS. 2a and b are plane front views of a device according to an embodiment,
[0107]FIG. 3 is a block diagram illustrating the general architecture of a device of FIG. 2 in accordance with the present application,
[0108]FIGS. 4a, b, c, d, e and f are plane front views of a device according to an embodiment,
[0109]FIGS. 5a, b, c, d, e and f are schematic drawings illustrating a bending pattern according to an embodiment,
[0110]FIGS. 6a, b, c and d are flow charts describing each a method according to an embodiment,
[0111]FIGS. 7a and b are front views of a device according to an embodiment,
[0112]FIG. 8 is a flow chart describing a method according to an embodiment,
[0113]FIG. 9 is a flow chart describing a method according to an embodiment,
[0114]FIGS. 10a, b and c are schematic drawings of a device according to an embodiment,
[0115]FIG. 11 is a flow chart describing a method according to an embodiment, and
[0116]FIGS. 12a, b, c and d are plane front views of a device according to an embodiment.
Posts
No comments: