|Publication number||US6107997 A|
|Application number||US 08/672,093|
|Publication date||Aug 22, 2000|
|Filing date||Jun 27, 1996|
|Priority date||Jun 27, 1996|
|Publication number||08672093, 672093, US 6107997 A, US 6107997A, US-A-6107997, US6107997 A, US6107997A|
|Inventors||Michael J. Ure|
|Original Assignee||Ure; Michael J.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (12), Referenced by (302), Classifications (15), Legal Events (3)|
|External Links: USPTO, USPTO Assignment, Espacenet|
______________________________________QZ ABC DEF1 2 3GHI JKL MNO4 5 6PRS TUV WXY7 8 9 Oper* 0 #.______________________________________
______________________________________QZ ABC DEF1 2 3GHI JKL MNO4 5 6PRS TUV WXY7 8 9 Oper* 0 #.______________________________________
1. Field of the Invention
The present invention relates to computing devices and to computer input devices.
2. State of the Art
Pen-based computers are known. As described in U.S. Pat. No. 5,457,476, incorporated herein by reference, a pen-based computer is typically a small, hand-held computer where the primary method for inputting data includes a "pen" or stylus. A pen-based computer system is commonly housed in a generally rectangular enclosure, and has a dual-function display assembly providing a viewing screen along one of the planar sides of the enclosure. The dual-function display assembly serves as both an input device and an output device. When operating as an input device, the display assembly senses the position of the tip of a stylus on the viewing screen and provides this positional information to the computer's central processing unit (CPU). Some display assemblies can also sense the pressure of the stylus on the screen to provide further information to the CPU. When operating as an output device, the display assembly presents computer-generated images on the screen.
The dual-function display assemblies of pen-based computer system permit users to operate the computer as computerized notepad. For example, graphical images can be input into the pen-based computer by merely moving the stylus on the surface of the screen. As the CPU senses the position and movement of the stylus, it generates a corresponding image on the screen to create the illusion that the stylus is drawing the image directly upon the screen, i.e., that the stylus is "inking" an image on the screen. With suitable recognition software, text and numeric information can also be entered into the pen-based computer system in a similar fashion.
Besides serving as a notepad, pen-based computers can provide a number of useful functions, such as provided in a personal organizer.
A problem with such pen-based computer systems has been the quick, accurate entry of text, especially passages of text longer than a name or phone number. To address this problem, some pen-based computer systems have been provided with optional compact keyboards. The problem with such keyboards, however, is that they defeat the original notion of the pen-based computer as being readily carried on one's person wherever one goes. If only the pen-based computer and not the keyboard is carried about, then the keyboard is unavailable for use the majority of the time. Planned, fixed usage of a keyboard, while marginally useful, does not effectively address the need for an improved method and device allowing for quick and easy input of text to a sub-notebook computing device.
An example of a particularly advantageous touch-sensitive computer input device is found in U.S. Pat. No. 5,194,862 issued Mar. 16, 1993 to Edwards (assigned to U.S. Philips Corporation), incorporated herein by reference. The patent discloses a touch sensor array built in a similar manner as a TFT active matrix liquid crystal display and which may be used as an overlay for the same. The touch sensor array offers comparable resolution as the liquid crystal display. U.S. Pat. No. 4,042,777 to Bequaert et al. (assigned to IBM) discloses a keyboard that uses chord keying. Mention is made of the possibility of realizing the key-board using touch keys rather than mechanical keys. The aforementioned patents, however, are silent regarding the quick and easy input of text to a sub-notebook computing device.
The present invention, generally speaking, provides for a a computer input device and computing device employing the same in which the functions of both a keyboard and a mouse are realized compactly using a touch-sensitive pad. The function of a mouse may be realized in similar manner as known "track pads." The function of a keyboard may be realized using "chord keying," i.e., forming different touch patterns on the touch-sensitive pad corresponding to different characters. In one embodiment, the chord patterns are greatly simplified as compared to known chord-keying arrangements. In particular, most characters may be input by forming a chord with the thumb and forefinger or thumb and middle finger only. A cross-hair pattern identifies nine separate touch areas, such that 36 unique two-touch (thumb and forefinger or middle finger) touch patterns may be formed. Additional sets of 36 characters each may be designated by specifying touch patterns to shift between characters sets. A computing device using the touch-sensitive keyboard/mouse may be made very small while still employing a familiar point-and-click mode of user interaction that further includes keying. Text may be input to the computing device quickly and easily. In another embodiment, a virtual keypad like that of a telephone is represented, with typically three letters assigned to each key. The familiar point-and-click operation of the computing device may be furthered by providing the computing device with two removable-media storage devices of a known type. In this way, the previous requirement of sub-notebook computers that the operating system, application programs and files all be small, may be loosened. In one embodiment, the computing device employs two color flat panel displays each mounted on different halves of a hinged housing. The housing may be closed, opened flat such that the two flat panel displays appear as one large display, or manipulated such that only one flat panel is visible, whereby the device may be held comfortably in one hand.
The present invention may be further understood from the following description in conjunction with the appended drawing. In the drawing:
FIG. 1 is a block diagram of a computer system in accordance with one embodiment of the present invention;
FIG. 2 is a top plan view of the screen, case and touch-sensitive input device of the computer system of FIG. 1;
FIG. 3 is a simplified diagram of the keyboard/mouse of the touch-sensitive input device of FIG. 2;
FIG. 4 is a diagram of a surface of the touch-sensitive input device of FIG. 2;
FIG. 5 is a diagram of a touch sensor array having a touch pattern superimposed thereon;
FIG. 6 is a diagram of a surface of the an input device in accordance with an alternative embodiment of the invention;
FIG. 7 is a diagram of chord assignments in accordance with the keypad layout of FIG. 6;
FIG. 8 is a plan schematic view of one realization of a device capable of sensing multiple simultaneous touches;
FIG. 9 is a perspective view of a computer system of in accordance with another embodiment of the invention, showing a screen display of a program having a User Interface (UI) of a type commonly used with notebook computers;
FIG. 10 is a side view of the computer system of FIG. 9 in a full-open position;
FIG. 11 is a side view of the computer system of FIG. 9 in a closed position;
FIG. 12 is a side view of the computer system of FIG. 9 in a half-open position;
FIG. 13 is a perspective view of one realization of the computer input device used in the computer of FIG. 9.
FIG. 14 is a partial perspective view of the computer system of FIG. 9, wherein text is being input;
FIG. 15 is a partial perspective view of the computer system of FIG. 9, wherein a text bar is being repositioned;
FIG. 16 is a partial perspective view of the computer system of FIG. 9, wherein the new position of the text bar is being designated by clicking;
FIG. 17 is a flowchart illustrating a general processing routine executed by the touch-sensitive keyboard/mouse.
The present invention is well suited for pointer based computer systems such as the pen-based, stylus-based and mouse driven systems that are currently popular.
As shown in FIG. 1, a computer system 10 in accordance with one embodiment of the present invention includes a central processing unit (CPU) 12, read only memory (ROM) 14, random access memory (RAM) 16, input/output (I/O) circuitry 18, and a display assembly 20. The computer system 10 may be "pen-capable," meaning that a stylus or pen may be used for inputting information into the computer system if desired, but that other means of input are also provided. The pen-capable computer system 10 may also optionally include a mass storage unit 22 such as a disk drive unit or nonvolatile memory such as flash memory, a keypad 24, and a clock 26.
The CPU 12 is preferably a commercially available, single chip microprocessor. CPU 12 is coupled to ROM 14 by a unidirectional data bus 28. ROM 14 may contain the basic operating system for the pen-based computer system 10. CPU 12 is connected to RAM 16 by a bi-directional data bus 30 to permit the use of RAM 16 as scratch pad memory. ROM 14 and RAM 16 are also coupled to CPU 12 by appropriate control and address busses, as is well known to those skilled in the art. CPU 12 is also coupled to the I/O circuitry 18 by bi-directional data bus 32 to permit data transfers with peripheral devices.
I/O circuitry 18 typically includes a number of latches, registers and direct memory access (DMA) controllers. The purpose of I/O circuitry 18 is to provide an interface between CPU 12 and such peripheral devices as display assembly 20, mass storage 22, input device 21 and input buttons 24.
Clock 26 preferably compresses a real-time clock to provide real-time information to the system 10. Clock 26 is coupled to CPU 12 by a bus 34.
Display assembly 20 of pen-capable computer system 10 is both an input and a output device. Accordingly, it is coupled to I/O circuitry 18 by a bi-directional data bus 36. When operating as an output device, the display assembly 20 receives data from I/O circuitry 18 via bus 36 and displays that data on a suitable screen. The screen for display assembly 20 is preferably a liquid crystal display (LCD) of the type commercially available from a variety of manufacturers.
The input device of display assembly 20 is preferably a thin, clear membrane which covers the LCD display and which is sensitive to the position of a stylus 38 on its surface. With such a structure, the display assembly 20 can serve as an input "tablet." These position sensitive membranes are also readily available on the commercial market. Combination display assemblies such as display assembly 20 which include both the LCD and the input membrane are commercially available from such vendors as Scriptel Corporation of Columbus, Ohio.
The buttons 24 may comprise "soft buttons," i.e, images generated at convenient locations on the screen 42, each "button" being activated by touching the stylus to the screen over the image of the button. The buttons 24 may include a number of dedicated function buttons 52 and a pair of scroll buttons 54A and 54B, as well as a toolbox button 50.
Some type of mass storage 22 is generally considered desirable. Mass storage 22 can be coupled to I/O circuitry 18 by a bi-directional data bus 37. However, the mass storage 22 can be eliminated by providing a sufficient amount of RAM 16 to store user application programs and data. In that case, the RAM 16 could be provided with a backup battery to prevent the loss of data even when the pen-based computer system 10 is turned off. However, it is generally desirable to have some type of long term storage 22 such as a commercially available miniature hard disk drive, non-volatile memory such as flash memory, battery backed RAM, PC-data cards, or the like.
In operation, information is input into the pen-based computer system 10 by "writing" on the screen of display assembly 20 with a stylus 38. Information concerning the location of the stylus 38 on the screen of the display assembly 20 is input into the CPU 12 via data bus 36 and 1(0 circuitry 18. Typically, this information comprises the Cartesian (i.e., X and Y) coordinates of a pixel of the screen of display assembly 20 over which the tip of the stylus is positioned. Commercially available combination display assemblies such as the aforementioned assemblies available from Scriptel Corporation include appropriate circuitry to provide the stylus location information as digitally encoded data to the I/O circuitry of the present invention. The CPU 12 then processes the data under control of an operating system and possibly an application program stored in ROM 14 and/or RAM 16. The CPU 12 next produces data which is output to the display assembly 10 to produce appropriate images on its screen.
In FIG. 2, the pen-based computer system 10 is shown housed within a generally rectangular enclosure 40. The CPU 12, ROM 14, RAM I/O circuitry 18, mass storage 22, and clock 26 are preferably fully enclosed within the enclosure 40. The display assembly 20 is mostly enclosed within the enclosure 40, but a viewing screen 42 of the display assembly is exposed to the user. As used herein, the term "screen" will refer to the portion of the display assembly 20 which can display an image that can be viewed by a user. Also accessible to the user are the buttons 24.
Upon power-up, pen based computer system 10 displays on screen 42 an initial note area N including a header bar B and a number of guidelines 44. The header bar B preferably includes the date of creation 46 of the note N, a note number 48, and a "toolbox" button 50. The optional guidelines 44 aid a user in entering text, graphics, and data into the pen-based computer system 10.
The screen illustrated in FIG. 2 is referred to as the "notepad," and is an application program running under the operating system of the pen-capable computer system 10. The notepad may be a "base" application which is always available beneath higher level applications. The notepad application, like other applications, runs within a window, which in this instance comprises the entire viewing screen 42. Therefore, as used herein, a "window" is the entire screen or any portion of an entire screen which is dedicated to a particular application program.
A status bar 56 may be provided at the bottom of the notepad application. The status bar 56 may be provided with a number active areas including a real time clock 58, a view button 60, a font button 62, an equations button 64, a text button 66, a graphics button 68, and a nib button 70.
One of the buttons 52 among the buttons 24 may be dedicated to "date" type functions, including a calendar or schedule function and a to-do function. This dedicated button 52 is labeled 52' in FIG. 2.
A known computing device of the same general type as that shown in FIG. 2 has a plastic case including a region below the display screen that serves as a palm rest during writing. In accordance with one aspect of the present invention, there is provided within this region a touch-sensitive input device 21, or "keyboard/mouse." The touch-sensitive input device may serve to provide an alternate method of inputting information to the computing device, in addition to stylus input. Alternatively, the touch-sensitive input device may provide the sole or primary input method, to the exclusion of stylus input.
FIG. 3 shows an exemplary hardware realization of the keyboard/mouse, indicated generally by the reference numeral 21. A touch sensor array 371 overlies a display 373. The touch sensor array may be of the type disclosed in the aforementioned Edwards patent, for example. The touch sensor array 371 and the display 373 are interface through an I/O controller 375 to a microprocessor 377. The microprocessor 377 is connected across a bus to a RAM 378 and a ROM 379. The I/O controller 375, microprocessor 377, RAM 378 and ROM 379 may be the same as or separate from respective elements 18, 12, 16 and 14 in FIG. 1.
Referring to FIG. 4, in an exemplary embodiment, a number of different regions (for example, nine) are indicated on the surface of the touch-sensitive input device. The regions may be indicated by indicia applied by printing, screening, or the like, or may be indicia displayed on a display device underlying the touch-sensitive membrane. In the latter instance, of course the indicia may be variable rather than fixed during the course of using the device. If the indicia are fixed, they may be formed on a thin transparent overlay that may be removed in "expert" mode. Preferably, however, a cross-hair is presented to the user even in expert mode. The two lines of the cross-hair, one at a horizontal coordinate X and another at a vertical coordinate Y, define nine regions as follows:
TABLE 1______________________________________ Horizontal Vertical Touch Touch Position Position Relative to Relative toRegion No. X Y______________________________________1 < <2 = <3 > <4 < =5 = =6 > =7 < >8 = >9 > >______________________________________
In beginning mode, the cross-hair may not be displayed. Instead, the regions may be indicated by the indicia displayed, printed, screened, or otherwise made visible.
Characters are input, for at least more than half of the letters of the English alphabet, by simultaneously touching more than one of the regions, for example two regions. To take a number of examples, the letter A is input, for example, by touching regions 13-4 and 13-6, the letter B is input, for example, by touching regions 13-5 and 13-8, the letter C is input, for example, by touching regions 13-3 and 13-9, etc. Other chord patterns may be used to input other characters. For example, a single touch (using the index finger or middle finger, for example) in any area may be used to designate a space. Three simultaneous touches (using the thumb, index finger and middle finger, for example) may be used to produce the succeeding character in upper case. Three simultaneous touches repeated twice in succession may be used as a cap lock signal. Other touch patterns may be used to designate different fonts or sub-fonts, for example a numerics sub-font, a punctuation sub-font, etc. Since there are 36 possible two-touch combinations, however, and only twenty six letters in the English alphabet, preferably the most common punctuation marks and control characters (period, comma, backspace, return, etc.) are included in the principal or default sub-font. If the touch-sensitive input device includes a display device, the displayed indicia may be changed when the sub-font is changed.
In the example of FIG. 4, it is assumed that each letter is input by touching one region with the thumb and another regions with the index finger or middle finger. The letter indicia appear (in beginning mode) in the region to be touched by the thumb. To avoid clutter, the region to be touched using the index finger of middle finger is indicated by dot symbols. For example, two dots appears to the right of the letter A, indicating that region 13-6, the region two to the right of region 13-4 in which the letter A appears, is the region to be simultaneously touched using the index finger or middle finger. A single dot appears above the letter B, indicating the second region as being the one above where letter B appears, etc. Of course, these particulars are illustrative only. Many other arrangements may be devised to the same end.
By displaying indicia indicating to the user the proper touch patterns, user reluctance to try a new input device may be reduced. Also, by using simple chord patterns, learning may be accelerated and hand fatigue during operation may be reduced. Input speed may also be increased. Another important advantage is that the processing needed is relatively simple.
Various techniques may be used in order to sense multiple simultaneous touches. In accordance with one technique, the input device is constructed in accordance with the teachings of the aforementioned Edwards patent in order to obtain a touch image such as that shown in FIG. 5, which may be processed using suitable image processing techniques. Processing of the touch image of FIG. 5 is more particularly described in copending U.S. application Ser. No. 08/207,469 entitled TOUCH-SENSITIVE KEYBOARD MOUSE, filed Mar. 7, 1994 and incorporated herein by reference.
Further in accordance with FIG. 4, mouse operation may be combined with keyboard operation. The touch-sensitive input device may be placed in a mouse mode of operation by simply beginning to use it as a mouse in like manner as commercially-available touchpad pointing devices. Touchpad pointing devices are commercially available from such companies as Cirque, Inc. of Salt Lake City, Utah, and Alps Electronics and Touche Electronics, both of San Jose, Calif. The manner of operation of such devices is well-known. The user simply moves a finger across the surface of the touch membrane in a direction in which the user desires the cursor to move. Particulars of how the speed at which the cursor is moved is controlled, how clicking and dragging are accomplished, etc., vary from device to device. These particulars are well-known, and are not especially germane to the present invention.
One disadvantage of virtual keyboards is the lack of tactile feedback. To overcome this disadvantage, the entire touchpad, which may be approximately 5×5 cm in size, to form a mechanical key. When the touchpad is used for keying, the same sort of tactile and audible feedback may be provided as with a standard keyboard. When the mechanical key is actuated, the character to be input is determined with reference to the touch pattern of the touchpad. During operation of the touchpad as a mouse, since the touch used is lighter and has only a minimal vertical component, vertical deflection of the touchpad will normally not occur, although a thumb-activated "brake" may be provided if desired. The nature of the touchpad as a mechanical switch is preferably also used during operation as a mouse, to click, double-click, etc. The use of a mechanical switch in conjunction with a touchpad is described in U.S. Pat. No. 5,327,161 to Logan et. al., incorporated herein by reference.
Chording may also be brought into play so as to realize a mouse having 36 or more programmable buttons. For example, a click or double-click using a single finger touch may have the same effect as with a conventional, single-button mouse. A click or double click using one of the aforementioned chord patterns may be used to execute programmed commands-style changes, font changes, size changes, etc.
The touch-sensitive input device, apart from being incorporated within a computing device, may also be packaged as a separate input device, to be coupled to a computing device through a cable. The input device may function solely as a pointing device with multiple programmable "buttons," solely as a keying device, or as a combination of both as previously described.
The layout of the touch-sensitive input device of FIG. 4, because it is unlike existing input devices, is initially unfamiliar. This unfamiliarity may result in some reluctance on the part of new users to adopt such an input device. This unfamiliarity may be overcome at least in part using a layout that mimics in large part that of a standard touch-tone telephone.
Conventionally when using the telephone, words or names may be entered by pressing keys on the keypad. The layout of the keys produces a sort of hash function on the word or name being input. That is, a particular word or name will always map to the same string of digits conveyed by DTMF tones. Different words may map to the same string of digits. Recorded telephone directories are implemented by applying the same hash function to employees names and indexing them within a computer database. Preferably, the names of only one or at most a few employees will map to the same hash function. When that hash function is received from a telephone user, a recording is played to inform the user of the name or names indexed under that hash function and corresponding telephone extensions.
In accordance with one embodiment of the present invention, chord keying is used to enable a word or name to be unambiguously entered using a keypad having a similar layout as that of a conventional telephone keypad. Referring to FIG. 6, a keypad is provided with twelve keys-four rows of three keys each. Beginning with the upper left-hand key, the keys in the first three rows are numbered row-by-row with the digits 1 to 9. The keys will be referred to hereinafter by these numbers. The key directly underneath key number 8 is assigned the number 0.
Beginning with key number 2 and proceeding row-by-row through key number 9, each key is assigned three consecutive letters of the alphabet beginning with the letter "A." In the case of the letters "Q" and "Z," these letters are omitted from the normal sequence and are assigned instead to key number 1 in a known manner.
There remains the final row of keys. The key to the left of key number 0 is assigned "*" and the key to the right of key number 0 is assigned "#" as is conventional. The abbreviation "Oper" for operator may appear above the number 0 on key number 0.
The keypad as thus-far described has the same general layout as a conventional telephone keypad. The layout of the keypad of FIG. 6 differs from a conventional keypad in that three punctuation symbols or other characters or control codes are assigned to each of keys number 1 through number 6, number 0, the * key and the # key. The assignments as shown in FIG. 6 are illustrative only. Key number 1 and the * and # keys are additionally each assigned one further character or control code, namely return, shift, and space, respectively.
A particular letter is input by forming a chord with the key on which the letter appears and one of three adjacent keys. The pattern of which adjacent key is used to form the chord is, to the extent possible, made consistent between keys within the same column of the keypad. Hence, for keys number 1, 4 and 7, the first letter appearing on the key is input by forming a chord with the respective key immediately to the right. Taking key number 4, for example, the letter "G" is input by forming a chord with key number 4 and key number 5. The second letter appearing on the key is input by forming a chord with the respective key immediately beneath. The letter "H" is therefore input by forming a chord with key number 4 and key number 7. The third letter appearing on the key is input by forming a chord with the respective adjacent key in a lower-diagonal direction. The letter "I" is therefore input by forming a chord with key number 4 and key number 8.
For keys number 3, 6 and 9, the first letter appearing on the key is input by forming a chord with the respective key immediately to the left, the second letter appearing on the key is input by forming a chord with the respective adjacent key in a lower-diagonal direction, and the third letter appearing on the key is input by forming a chord with the respective key immediately beneath.
For keys number 2, 5 and 8, the first letter appearing on the key is input by forming a chord with the respective adjacent key in the lower-left-diagonal direction, the second letter appearing on the key is input by forming a chord with the respective adjacent key immediately beneath, and the third letter appearing on the key is input by forming a chord with the respective adjacent key in the lower-right-diagonal direction. Assuming a right-handed user, in the case of each of the keys number 1 through number 9, if the three letters on the key are produced in succession using the thumb and the middle finger to form two-key chords, the thumb begins the farthest toward the left for the first letter, rotates beneath the middle finger toward the right for the second letter, and rotates farther toward the right for the third letter. This commonality simplifies learning. Other schemes may be equally or more suitable. The foregoing scheme is therefore to be regard as illustrative only.
Typically three punctuation symbols may also be assigned to a key. A particular punctuation symbol is input by forming a chord with the key on which the punctuation symbol appears and one of three keys removed by one row. Taking again key number 4, for example, the punctuation symbol "," is input by forming a chord with key number 4 and the * key, the punctuation symbol "." is input by forming a chord with key number 4 and key number 0, and the punctuation symbol "!" is input by forming a chord with key number 4 and the # key.
The * key, key number 0, and the # key, since they have no keys below them, must be treated differently. In an illustrative embodiment, no letters are assigned to these keys (since all twenty-six letter are already assigned to keys number 1 through 9). Punctuation symbols or other characters or control characters may, however, be assigned to these keys. Keys number 1-3 participate in chording with keys *, 0 and # to input these characters. Taking key number 0, for example, the punctuation symbol "!" is input by forming a chord with key number 0 and key number 1, the punctuation symbol "@" is input by forming a chord with key number 0 and key number 2, and the punctuation symbol "$" is input by forming a chord with key number 0 and key number 3.
Of the 66 possible two-key chords possible with a layout such as that of FIG. 6, 13 chords remain. The 66 possible chords and their assignments in accordance with the foregoing illustrative scheme are shown in FIG. 7. Of the 13 remaining chords not previously mentioned, many may be used to advantage, as follows. A shift command may be input by forming a chord with the * key and key number 0. A space may be input by forming a chord with the # key and key number 0. A return of enter command may be input by forming a chord with key number 1 and key number 5.
Since a conventional computer keyboard has 104 keys, to realize the function of all of the keys requires a second "font," or character set. A fourth one of the remaining chords may be used to toggle between characters sets. This chord may be formed by the * key and # key, for example. Assuming that the keypad is realized as a touch-sensitive pad overlying an LCD display, the LCD display may display the characters for one character set or the other character set in accordance with which character set is currently selected.
Chords may also be used to provide "control," "option," and "delete" keys. Rather than "pressing" or chording the control and options keys simultaneously with chording of another key, key sequences may be built up sequentially. For example, the key combination CTL-OPT-DEL may be built up by first keying the chord for control (key number 7 and key number 9), then the chord for option (key number 4 and key number 6) and finally the chord for delete (key number 1 and key number 3).
The device may be used as a conventional telephone pad in the usual manner by simply touching the desired key with a single touch instead of a two-touch or multi-touch chord. Alternatively, special provision may be made for the space key, since it is so commonly used. As described previously, a trackpad may be provided with a mechanism that allows for vertical deflection of the entire trackpad, thus realizing in effect a single oversize key. When inputting text, this key may operate as a space key when actuated with only a single digit in whatever position. That is, if the key is pressed but no valid chord is formed, they a space may be assumed.
As with the previous embodiment, if the keypad is realized using a touchpad as a virtual keypad, the virtual keypad may be operated in a mouse mode of operation. Note, however, that the invention may be applied to mechanical keypads and even to conventional telephone keypads themselves, separate and apart from any pointing function.
Presently existing touchpad used in pointing devices are typically not capable of sensing multiple simultaneous touches. The device of the aforementioned Edwards patent may be used to provided this capability. Other alternative embodiments are also possible. Referring to FIG. 8, for example, a conventional touchpad not capable of sensing multiple simultaneous touches has painted on a surface thereof fine conductive lines each of which begins within one of the areas to be touched and ends at a periphery of the substrate, where contact is made to sensing circuitry. The conductive lines may be of conductive paint, for example. The lines may be clear in color and are made as fine as possible to minimize interference with the normal independent operation of the conventional touchpad device. When two areas are touched simultaneously, a conductive path is formed from one line to another. The sensing circuitry rapidly scans the lines in turn, checking for electrical continuity between a given line and any of the other lines. When continuity is found between a given line and another line, then a chord is determined to have been formed with the two respective areas.
Other implementations are also possible. For example, an image of the touch surface may be imaged on a CCD and the resulting image processed using image processing techniques. The image may be processed using "structured" image processing in which small portions of the image are processed in turn, checking for various conditions, rather than processing all of the image at once. The advantage of using image processing is that it provides a general technique for detecting any number of touches in any configuration, allowing the capabilities of the device to be easily increased if desired. This advantage is obtained whether using the Edwards device or a CCD. However, CCDs are more widely available at the present time.
Although pen computing has developed in part as an attempt to make interaction with a computing device more natural and intuitive, it has also developed by necessity as a result of the physical impossibility of adapting a conventional keyboard and mouse for use with a sub-notebook device. Since the foregoing touch-sensitive input device provides the function of both keyboard and mouse in a very small area, it enables a notebook-style of computer interaction to be migrated to sub-notebook computing devices. That is, the computing device of FIG. 2 or similar device, instead of being pen-driven, may be menu-driven using conventional GUI, OOUI (drag-and-drop) or other technology.
Referring to FIG. 9, a computer system is of a "clamshell configuration." Unlike present notebook computers, however, no keyboard is provided. Instead, two flat-panel displays 901, 903 are provided, arranged to mate together to form in effect a single larger display of roughly comparable dimensions as that of a notebook computer. A connector 905 communicates video information from one half of the display to the other. Arrangements for mating together multiple flat-panel displays to form a single larger display are described in U.S. Pat. Nos. 4,156,833 and 5,067,021, both of which are incorporated herein by reference. The dimensions of the computer system of FIG. 9 may be approximately 15 cm×20 cm×1.8 cm. A hinge mechanism 907 is located on either side of the computer system so as to not interfere with mating of the two halves of the display. As shown more clearly in FIG. 10, FIG. 11, and FIG. 12, respectively, the hinge mechanism allows the computer system to be fully open, fully closed, or half open, allowing it to be operated using a single flat-panel display while being held comfortably with one hand.
The virtual keyboard/mouse 909 in the computer system of FIG. 9 may be provided with a carriage and retention mechanism of a known type that allows it to be housed within the computer during transit and withdrawn during use. The retention mechanism may be such that when it is housed within the computer, pushing in on the virtual keypad/mouse releases it and allows it to be withdrawn on its carriage. Withdrawing the virtual keypad/mouse causes it to be locked in place. Following use, pressing in on the virtual keypad/mouse causes it to be released, and pushing it into the computer housing causes it to be locked within the housing. As described previously, preferably, the surface of the virtual keyboard/mouse is provided with the action of a keyboard key.
Preferably, the computer system of FIG. 9 is provided with at least one, more preferably two or more, PCMCIA or CardBus™ slots 911, 913. Such slots allows one or more PC Card removable-cartridge hard disk drives 915, 917 with associated cartridges 919, 921 to be used in the computer system. An example of such a hard drive is the SQ1100 PC Card Type III Drive sold by SyQuest Technology of Fremont, Calif.
Power for the computer system may be provided by a lithium ion battery 923 of a known type, preferably easily removable, comparable to batteries used in notebook computers.
Referring to FIG. 13, in accordance with a further embodiment of the present invention, the virtual keypad/mouse with the foregoing carriage mechanism is realized as a PC Card™, CardBus™ or PCMCIA device. Approximately one half of the space inside the card is allotted to the carriage mechanism, and the other half of the space inside the card is allotted to the device electronics. This realization allows the device to be easily added to both new and existing devices.
The manner of use of the virtual keyboard/mouse within the computer system of FIG. 9 may be better appreciated with reference to FIG. 14, FIG. 15, and FIG. 16. Referring first to FIG. 14, text is being input to the computer system, with a character to be input being chorded using the thumb and one finger, possible the index finger as shown but more preferably the middle finger. Referring to FIG. 15, a text bar is being repositioned using the virtual keyboard/mouse as a mouse. Referring to FIG. 16, once the text bar has been repositioned to the desired position, a "click" is input using the key action of the virtual keyboard/mouse. Further text may now be input by chording.
Switching between keyboard operation and mouse operation is transparent to the user. That is, code for realizing the keyboard functions and code for realizing the mouse functions is unified and is running continuously. Referring more particulary to FIG. 17, when a touch is sensed, a determination is made, in relation to a time window, whether it is a single touch or multiple touches. If it is a single touch, then mouse operation ensues. If it is multiple touches, then keyboard operation ensues. The appropriate output signals are produced, and flow returns to the beginning.
It will be appreciated by those of ordinary skill in the art that the invention can be embodied in other specific forms without departing from the spirit or essential character thereof. The presently disclosed embodiments are therefore considered in all respects to be illustrative and not restrictive. The scope of the invention is indicated by the appended claims rather than the foregoing description, and all changes which come within the meaning and range of equivalents thereof are intended to be embraced therein.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4042777 *||Nov 15, 1976||Aug 16, 1977||International Business Machines Corporation||One-handed keyboard and its control means|
|US4344069 *||Nov 19, 1979||Aug 10, 1982||International Business Machines Corp.||Method and apparatus for character generation|
|US4891777 *||May 13, 1986||Jan 2, 1990||The Laitram Corporation||Single hand keyboard arrays providing alphanumeric capabilities from twelve keys|
|US5194862 *||Jun 7, 1991||Mar 16, 1993||U.S. Philips Corporation||Touch sensor array systems and display systems incorporating such|
|US5457476 *||May 27, 1993||Oct 10, 1995||Apple Computer, Inc.||Method for controlling a computerized organizer|
|US5635958 *||Dec 3, 1993||Jun 3, 1997||Matsushita Electric Industrial Co., Ltd.||Information inputting and processing apparatus|
|US5730602 *||Apr 28, 1995||Mar 24, 1998||Penmanship, Inc.||Computerized method and apparatus for teaching handwriting|
|US5739814 *||Sep 28, 1992||Apr 14, 1998||Sega Enterprises||Information storage system and book device for providing information in response to the user specification|
|US5764218 *||Jan 31, 1995||Jun 9, 1998||Apple Computer, Inc.||Method and apparatus for contacting a touch-sensitive cursor-controlling input device to generate button values|
|US5856824 *||Jun 25, 1996||Jan 5, 1999||International Business Machines Corp.||Reshapable pointing device for touchscreens|
|US5870083 *||Oct 4, 1996||Feb 9, 1999||International Business Machines Corporation||Breakaway touchscreen pointing device|
|US5917476 *||Sep 24, 1996||Jun 29, 1999||Czerniecki; George V.||Cursor feedback text input method|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US6326947 *||Mar 2, 1999||Dec 4, 2001||Microsoft Corporation||Tactile character input in computer-based devices|
|US6452588||Jul 6, 2001||Sep 17, 2002||Research In Motion Limited||Hand-held e-mail device|
|US6489950||Apr 5, 2000||Dec 3, 2002||Research In Motion Limited||Hand-held electronic device with auxiliary input device|
|US6525715 *||Jan 30, 1998||Feb 25, 2003||Seiko Epson Corporation||Portable information acquisition device|
|US6529195 *||Sep 8, 2000||Mar 4, 2003||James B. Eberlein||Pain migration tracking and display method|
|US6570557 *||Feb 10, 2001||May 27, 2003||Finger Works, Inc.||Multi-touch system and method for emulating modifier keys via fingertip chords|
|US6611254 *||Aug 9, 2000||Aug 26, 2003||Research In Motion Limited||Hand-held electronic device with a keyboard optimized for use with the thumbs|
|US6611255||Jun 11, 2002||Aug 26, 2003||Research In Motion Limited||Hand-held electronic device with a keyboard optimized for use with the thumbs|
|US6657615 *||Mar 30, 2000||Dec 2, 2003||Fujitsu Limited||Input processing method and input processing device for implementing same|
|US6839688||Aug 19, 2002||Jan 4, 2005||Diebold, Incorporated||Method of using an automated banking machine|
|US6867763||Oct 11, 2002||Mar 15, 2005||Research In Motion Limited||Hand-held electronic device with a keyboard optimized for use with the thumbs|
|US6873317||Sep 19, 2000||Mar 29, 2005||Research In Motion Limited||Hand-held electronic device with a keyboard optimized for use with the thumbs|
|US6911608||May 23, 2003||Jun 28, 2005||Digit Wireless, Llc||Keypads and key switches|
|US6919879||Jul 25, 2002||Jul 19, 2005||Research In Motion Limited||Hand-held electronic device with a keyboard optimized for use with the thumbs|
|US6952597 *||Jan 22, 2001||Oct 4, 2005||Wildseed Ltd.||Wireless mobile phone with key stroking based input facilities|
|US6963333 *||Sep 17, 1998||Nov 8, 2005||Diebold, Incorporated||Automated banking machine apparatus and system|
|US6965879||Nov 25, 2002||Nov 15, 2005||Diebold, Incorporated||Automated banking machine system using plural communication formats|
|US6973443||Aug 21, 2002||Dec 6, 2005||Diebold, Incorporated||Automated banking machine apparatus and system|
|US6974903||Nov 25, 2003||Dec 13, 2005||Craig Saunders||Keyboard attachment for disabled persons|
|US6992656||Aug 13, 2003||Jan 31, 2006||Hughes Micheal L||Computer mouse with data retrieval and input functionalities|
|US6992658 *||Oct 31, 2002||Jan 31, 2006||Motorola, Inc.||Method and apparatus for navigation, text input and phone dialing|
|US7027035 *||Oct 7, 2002||Apr 11, 2006||Hewlett-Packard Development Company, L.P.||Image copy to a second display|
|US7030861 *||Sep 28, 2002||Apr 18, 2006||Wayne Carl Westerman||System and method for packing multi-touch gestures onto a hand|
|US7034806 *||Jan 13, 1998||Apr 25, 2006||Sharp Kabushiki Kaisha||Virtual keyboard|
|US7109973||May 14, 2003||Sep 19, 2006||Research In Motion Limited||Mobile device with rotatable keyboard|
|US7126498||Feb 26, 2003||Oct 24, 2006||Digit Wireless, Llc||Keypad construction|
|US7149557||May 12, 2003||Dec 12, 2006||Siemens Communications, Inc.||Mobile communication device having extendable display|
|US7158120||Jun 21, 2002||Jan 2, 2007||Research In Motion Limited||Hand-held electronic device|
|US7162449||Sep 7, 2001||Jan 9, 2007||Diebold, Incorporated||Automated banking machine apparatus and system|
|US7227536||Apr 28, 2003||Jun 5, 2007||Research In Motion Limited||Hand-held electronic device with a keyboard optimized for use with the thumbs|
|US7248248 *||Aug 12, 2002||Jul 24, 2007||Microsoft Corporation||Pointing system for pen-based computer|
|US7251631||Mar 17, 2003||Jul 31, 2007||Diebold, Incorporated||Automated banking machine system using internet address customer input|
|US7253749||Nov 23, 2001||Aug 7, 2007||Xuxu Ltd.||English letter coding method and a small keypad|
|US7333954||Nov 8, 2005||Feb 19, 2008||Diebold, Incorporated||Automated banking machine and system|
|US7391861||May 22, 2001||Jun 24, 2008||Digit Wireless, Llc||Input devices and their use|
|US7405724||May 6, 2005||Jul 29, 2008||Diebold, Incorporated||Automated banking machine and method|
|US7561685||Jun 21, 2004||Jul 14, 2009||Research In Motion Limited||Handheld electronic device with keyboard|
|US7634080||Dec 15, 2009||Research In Motion Limited||Multifunctional keyboard for a mobile communication device and method of operating the same|
|US7653883||Sep 30, 2005||Jan 26, 2010||Apple Inc.||Proximity detector in handheld device|
|US7656393||Jun 23, 2006||Feb 2, 2010||Apple Inc.||Electronic device having display and surrounding touch sensitive bezel for user interface and control|
|US7656394||Feb 2, 2010||Apple Inc.||User interface gestures|
|US7663607||May 6, 2004||Feb 16, 2010||Apple Inc.||Multipoint touchscreen|
|US7669144||Dec 29, 2006||Feb 23, 2010||Research In Motion Limited||Method and arrangment for a primary actions menu including one menu item for applications on a handheld electronic device|
|US7674971||Dec 12, 2005||Mar 9, 2010||Craig Saunders||Keyboard attachment for disabled persons|
|US7689509||Dec 3, 2004||Mar 30, 2010||Diebold, Incorporated||Method of using an automated banking machine|
|US7699219||Aug 12, 2005||Apr 20, 2010||Diebold, Incorporated||Automated banking machine apparatus and system|
|US7705830||Feb 10, 2006||Apr 27, 2010||Apple Inc.||System and method for packing multitouch gestures onto a hand|
|US7708416||Jul 18, 2007||May 4, 2010||Michael Yurochko||Lighting and usability features for key structures and keypads on computing devices|
|US7737950||Jul 28, 2008||Jun 15, 2010||Diebold, Incorporated||Automated banking machine and system|
|US7737958||Dec 28, 2006||Jun 15, 2010||Lg Electronics Inc.||Touch screen device and method of displaying and selecting menus thereof|
|US7764274||Jul 3, 2006||Jul 27, 2010||Apple Inc.||Capacitive sensing arrangement|
|US7782307||Nov 14, 2006||Aug 24, 2010||Apple Inc.||Maintaining activity after contact liftoff or touchdown|
|US7782308 *||Apr 17, 2007||Aug 24, 2010||Lg Electronics Inc.||Touch screen device and method of method of displaying images thereon|
|US7812828||Feb 22, 2007||Oct 12, 2010||Apple Inc.||Ellipse fitting for multi-touch surfaces|
|US7819598||Sep 1, 2005||Oct 26, 2010||Research In Motion Limited||Keyboard arrangement|
|US7844914||Sep 16, 2005||Nov 30, 2010||Apple Inc.||Activating virtual keys of a touch-screen virtual keyboard|
|US7847789||Nov 23, 2004||Dec 7, 2010||Microsoft Corporation||Reducing accidental touch-sensitive device activation|
|US7880727 *||Apr 5, 2006||Feb 1, 2011||Microsoft Corporation||Touch sensitive and mechanical user input device|
|US7881743||Oct 16, 2002||Feb 1, 2011||Research In Motion Limited||Handheld mobile communication device|
|US7916125||Dec 28, 2006||Mar 29, 2011||Lg Electronics Inc.||Touch screen device and method of displaying images thereon|
|US7920131||Aug 28, 2009||Apr 5, 2011||Apple Inc.||Keystroke tactility arrangement on a smooth touch surface|
|US7932897||Aug 15, 2005||Apr 26, 2011||Apple Inc.||Method of increasing the spatial resolution of touch sensitive devices|
|US7938589||Jun 30, 2006||May 10, 2011||Research In Motion Limited||Keyboard arrangement|
|US7952571||Dec 11, 2009||May 31, 2011||Research In Motion Limited||Hand-held electronic device with multiple input mode thumbwheel|
|US7978181||Apr 25, 2006||Jul 12, 2011||Apple Inc.||Keystroke tactility arrangement on a smooth touch surface|
|US7986301||Feb 6, 2007||Jul 26, 2011||Research In Motion Limited||Handheld wireless communication device|
|US8028251||Dec 28, 2006||Sep 27, 2011||Lg Electronics Inc.||Touch screen device and method of selecting files thereon|
|US8064946||Feb 6, 2007||Nov 22, 2011||Research In Motion Limited||Handheld wireless communication device|
|US8094806||May 3, 2007||Jan 10, 2012||Nuance Communications, Inc.||Input devices and their use|
|US8098232 *||Aug 30, 2006||Jan 17, 2012||Research In Motion Limited||Touch sensitive display having tactile structures|
|US8107996||Dec 21, 2010||Jan 31, 2012||Research In Motion Limited||Handheld mobile communication device|
|US8115731||Dec 16, 2005||Feb 14, 2012||Research In Motion Limited||Method of operating a handheld device for directional input|
|US8115739||Apr 17, 2007||Feb 14, 2012||Lg Electronics Inc.||Touch screen device and operating method thereof|
|US8115745||Dec 19, 2008||Feb 14, 2012||Tactile Displays, Llc||Apparatus and method for interactive display with tactile feedback|
|US8125440 *||Nov 18, 2005||Feb 28, 2012||Tiki'labs||Method and device for controlling and inputting data|
|US8125463||Nov 7, 2008||Feb 28, 2012||Apple Inc.||Multipoint touchscreen|
|US8136052||Apr 17, 2007||Mar 13, 2012||Lg Electronics Inc.||Touch screen device and operating method thereof|
|US8144135||May 5, 2011||Mar 27, 2012||Research In Motion Limited||Hand-held electronic device with multiple input mode thumbwheel|
|US8169411||Dec 28, 2006||May 1, 2012||Lg Electronics Inc.||Touch screen device and operating method thereof|
|US8217908||Jun 19, 2008||Jul 10, 2012||Tactile Displays, Llc||Apparatus and method for interactive display with tactile feedback|
|US8219158||Feb 6, 2007||Jul 10, 2012||Research In Motion Limited||Handheld wireless communication device|
|US8239201 *||Oct 24, 2008||Aug 7, 2012||At&T Intellectual Property I, L.P.||System and method for audibly presenting selected text|
|US8239784||Aug 7, 2012||Apple Inc.||Mode-based graphical user interfaces for touch sensitive input devices|
|US8259074||Aug 29, 2008||Sep 4, 2012||Research In Motion Limited||Key arrangement for a keyboard|
|US8271036||Feb 6, 2007||Sep 18, 2012||Research In Motion Limited||Handheld wireless communication device|
|US8279180||May 2, 2006||Oct 2, 2012||Apple Inc.||Multipoint touch surface controller|
|US8302032||Dec 28, 2006||Oct 30, 2012||Lg Electronics Inc.||Touch screen device and operating method thereof|
|US8312391||Apr 17, 2007||Nov 13, 2012||Lg Electronics Inc.||Touch screen device and operating method thereof|
|US8314775||Nov 20, 2012||Apple Inc.||Multi-touch touch surface|
|US8330727||Nov 14, 2006||Dec 11, 2012||Apple Inc.||Generating control signals from multiple contacts|
|US8334846||Dec 18, 2012||Apple Inc.||Multi-touch contact tracking using predicted paths|
|US8350728||Apr 23, 2010||Jan 8, 2013||Hewlett-Packard Development Company, L.P.||Keyboard with integrated and numeric keypad|
|US8373663||Mar 16, 2009||Feb 12, 2013||Hewlett-Packard Development Company, L.P.||Small form-factor keypad for mobile computing devices|
|US8381135||Sep 30, 2005||Feb 19, 2013||Apple Inc.||Proximity detector in handheld device|
|US8384675||Feb 26, 2013||Apple Inc.||User interface gestures|
|US8390570||Jan 6, 2012||Mar 5, 2013||Research In Motion Limited||Method of operating a handheld device for directional input|
|US8391468||Mar 5, 2013||Research In Motion Ltd||Multifunctional keyboard for a mobile communication device and method of operating the same|
|US8416195||Dec 1, 2009||Apr 9, 2013||Research In Motion Limited||Hand-held electronic device with a keyboard optimized for use with the thumbs|
|US8416209||Jan 6, 2012||Apr 9, 2013||Apple Inc.||Multipoint touchscreen|
|US8419303||Sep 16, 2010||Apr 16, 2013||Research In Motion Limited||Keyboard with overlaid numeric phone keypad|
|US8432371||Apr 30, 2013||Apple Inc.||Touch screen liquid crystal display|
|US8441453||Jun 5, 2009||May 14, 2013||Apple Inc.||Contact tracking and identification module for touch sensing|
|US8451244||May 28, 2013||Apple Inc.||Segmented Vcom|
|US8463315||Feb 6, 2007||Jun 11, 2013||Research In Motion Limited||Handheld wireless communication device|
|US8464149||Sep 26, 2011||Jun 11, 2013||Research In Motion Limited||Hand-held electronic device with autopunctuation|
|US8466880||Dec 22, 2008||Jun 18, 2013||Apple Inc.||Multi-touch contact motion extraction|
|US8466881 *||Jun 18, 2013||Apple Inc.||Contact tracking and identification module for touch sensing|
|US8466883||Jun 18, 2013||Apple Inc.||Identifying contacts on a touch surface|
|US8477111||Apr 9, 2012||Jul 2, 2013||Lester F. Ludwig||Advanced touch control of interactive immersive imaging applications via finger angle using a high dimensional touchpad (HDTP) touch user interface|
|US8479122||Jul 30, 2004||Jul 2, 2013||Apple Inc.||Gestures for touch sensitive input devices|
|US8482533||Jun 5, 2009||Jul 9, 2013||Apple Inc.||Contact tracking and identification module for touch sensing|
|US8489400||Aug 6, 2012||Jul 16, 2013||At&T Intellectual Property I, L.P.||System and method for audibly presenting selected text|
|US8493322||May 19, 2011||Jul 23, 2013||Research In Motion Limited||Hand-held electronic device|
|US8493330||Jan 3, 2007||Jul 23, 2013||Apple Inc.||Individual channel phase delay scheme|
|US8509542||Apr 7, 2012||Aug 13, 2013||Lester F. Ludwig||High-performance closed-form single-scan calculation of oblong-shape rotation angles from binary images of arbitrary size and location using running sums|
|US8510481||Jan 3, 2007||Aug 13, 2013||Apple Inc.||Memory access without internal microprocessor intervention|
|US8514183||Nov 14, 2006||Aug 20, 2013||Apple Inc.||Degree of freedom extraction from multiple contacts|
|US8537117||Feb 13, 2007||Sep 17, 2013||Blackberry Limited||Handheld wireless communication device that selectively generates a menu in response to received commands|
|US8542209||Apr 9, 2012||Sep 24, 2013||Lester F. Ludwig||Advanced touch control of interactive map viewing via finger angle using a high dimensional touchpad (HDTP) touch user interface|
|US8552989||Jun 8, 2007||Oct 8, 2013||Apple Inc.||Integrated display and touch screen|
|US8559622||Jul 29, 2011||Oct 15, 2013||Blackberry Limited||Multifunctional keyboard for a mobile communication device and method of operating the same|
|US8576177||Jul 30, 2007||Nov 5, 2013||Apple Inc.||Typing with a touch sensor|
|US8593426||Feb 1, 2013||Nov 26, 2013||Apple Inc.||Identifying contacts on a touch surface|
|US8604364||Aug 15, 2009||Dec 10, 2013||Lester F. Ludwig||Sensors, algorithms and applications for a high dimensional touchpad|
|US8605051||Dec 17, 2012||Dec 10, 2013||Apple Inc.||Multipoint touchscreen|
|US8612856||Feb 13, 2013||Dec 17, 2013||Apple Inc.||Proximity detector in handheld device|
|US8629840||Jul 30, 2007||Jan 14, 2014||Apple Inc.||Touch sensing architecture|
|US8633898||Jul 30, 2007||Jan 21, 2014||Apple Inc.||Sensor arrangement for use with a touch sensor that identifies hand parts|
|US8638312||Mar 5, 2013||Jan 28, 2014||Lester F. Ludwig||Advanced touch control of a file browser via finger angle using a high dimensional touchpad (HDTP) touch user interface|
|US8639037||Mar 18, 2013||Jan 28, 2014||Lester F. Ludwig||High-performance closed-form single-scan calculation of oblong-shape rotation angles from image data of arbitrary size and location using running sums|
|US8643622||Mar 5, 2013||Feb 4, 2014||Lester F. Ludwig||Advanced touch control of graphics design application via finger angle using a high dimensional touchpad (HDTP) touch user interface|
|US8654083||Jun 8, 2007||Feb 18, 2014||Apple Inc.||Touch screen liquid crystal display|
|US8654524||Aug 17, 2009||Feb 18, 2014||Apple Inc.||Housing as an I/O device|
|US8659545||Jan 26, 2011||Feb 25, 2014||Stantum||Device and method for controlling computerized equipment|
|US8665228||Apr 13, 2010||Mar 4, 2014||Tactile Displays, Llc||Energy efficient interactive display with energy regenerative keyboard|
|US8665232||Jan 26, 2011||Mar 4, 2014||Stantum||Device and method for acquiring tactile information with sequential scanning|
|US8665240||May 15, 2013||Mar 4, 2014||Apple Inc.||Degree of freedom extraction from multiple contacts|
|US8674943||Nov 14, 2006||Mar 18, 2014||Apple Inc.||Multi-touch hand position offset computation|
|US8698755 *||Jul 30, 2007||Apr 15, 2014||Apple Inc.||Touch sensor contact information|
|US8702513||Dec 31, 2012||Apr 22, 2014||Lester F. Ludwig||Control of the operating system on a computing device via finger angle using a high dimensional touchpad (HDTP) touch user interface|
|US8717303||Jun 12, 2007||May 6, 2014||Lester F. Ludwig||Sensor array touchscreen recognizing finger flick gesture and other touch gestures|
|US8730177||Jul 30, 2007||May 20, 2014||Apple Inc.||Contact tracking and identification module for touch sensing|
|US8730192||Aug 7, 2012||May 20, 2014||Apple Inc.||Contact tracking and identification module for touch sensing|
|US8736555||Jul 30, 2007||May 27, 2014||Apple Inc.||Touch sensing through hand dissection|
|US8743058||Aug 20, 2010||Jun 3, 2014||Intsig Information Co., Ltd.||Multi-contact character input method and system|
|US8743068 *||Jul 13, 2012||Jun 3, 2014||Lester F. Ludwig||Touch screen method for recognizing a finger-flick touch gesture|
|US8743076||Jan 21, 2014||Jun 3, 2014||Lester F. Ludwig||Sensor array touchscreen recognizing finger flick gesture from spatial pressure distribution profiles|
|US8743300||Sep 30, 2011||Jun 3, 2014||Apple Inc.||Integrated touch screens|
|US8754862||Jul 11, 2011||Jun 17, 2014||Lester F. Ludwig||Sequential classification recognition of gesture primitives and window-based parameter smoothing for high dimensional touchpad (HDTP) user interfaces|
|US8797288||Mar 7, 2012||Aug 5, 2014||Lester F. Ludwig||Human user interfaces utilizing interruption of the execution of a first recognized gesture with the execution of a recognized second gesture|
|US8804056||Dec 22, 2010||Aug 12, 2014||Apple Inc.||Integrated touch screens|
|US8816984||Aug 27, 2012||Aug 26, 2014||Apple Inc.||Multipoint touch surface controller|
|US8824669||Dec 9, 2011||Sep 2, 2014||Blackberry Limited||Handheld electronic device with keyboard|
|US8826113||Nov 6, 2012||Sep 2, 2014||Lester F. Ludwig||Surface-surface graphical intersection tools and primitives for data visualization, tabular data, and advanced spreadsheets|
|US8826114||Nov 9, 2012||Sep 2, 2014||Lester F. Ludwig||Surface-curve graphical intersection tools and primitives for data visualization, tabular data, and advanced spreadsheets|
|US8856690||Oct 31, 2008||Oct 7, 2014||Sprint Communications Company L.P.||Associating gestures on a touch screen with characters|
|US8866752||Apr 10, 2009||Oct 21, 2014||Apple Inc.||Contact tracking and identification module for touch sensing|
|US8866785||Dec 26, 2013||Oct 21, 2014||Lester F. Ludwig||Sensor array touchscreen recognizing finger flick gesture|
|US8872785||Nov 6, 2013||Oct 28, 2014||Apple Inc.||Multipoint touchscreen|
|US8878807||Mar 11, 2013||Nov 4, 2014||Lester F. Ludwig||Gesture-based user interface employing video camera|
|US8878810||Jan 21, 2014||Nov 4, 2014||Lester F. Ludwig||Touch screen supporting continuous grammar touch gestures|
|US8884903||Sep 10, 2012||Nov 11, 2014||Furuno Electric Co., Ltd.||Remote controller for multiple navigation devices|
|US8894489||Mar 5, 2014||Nov 25, 2014||Lester F. Ludwig||Touch user interface supporting global and context-specific touch gestures that are responsive to at least one finger angle|
|US8902175||Apr 10, 2009||Dec 2, 2014||Apple Inc.||Contact tracking and identification module for touch sensing|
|US8928588 *||Jul 12, 2010||Jan 6, 2015||Blackberry Limited||Touch-type key input apparatus|
|US8928618||Jun 18, 2014||Jan 6, 2015||Apple Inc.||Multipoint touchscreen|
|US8957868||Jun 3, 2011||Feb 17, 2015||Microsoft Corporation||Multi-touch text input|
|US8982087||Jun 18, 2014||Mar 17, 2015||Apple Inc.||Multipoint touchscreen|
|US8989822||Sep 8, 2006||Mar 24, 2015||Qualcomm Incorporated||Keypad assembly for use on a contoured surface of a mobile computing device|
|US9001068||Jan 24, 2014||Apr 7, 2015||Apple Inc.||Touch sensor contact information|
|US9019237||Apr 5, 2009||Apr 28, 2015||Lester F. Ludwig||Multitouch parameter and gesture user interface employing an LED-array tactile sensor that can also operate as a display|
|US9025090||Aug 11, 2014||May 5, 2015||Apple Inc.||Integrated touch screens|
|US9035882 *||Dec 31, 2011||May 19, 2015||Peigen Jiang||Computer input device|
|US9035907||Nov 21, 2013||May 19, 2015||Apple Inc.||Multipoint touchscreen|
|US9041658||Apr 17, 2007||May 26, 2015||Lg Electronics Inc||Touch screen device and operating method thereof|
|US9047009||Jun 17, 2009||Jun 2, 2015||Apple Inc.||Electronic device having display and surrounding touch sensitive bezel for user interface and control|
|US9052772||Aug 10, 2012||Jun 9, 2015||Lester F. Ludwig||Heuristics for 3D and 6D touch gesture touch parameter calculations for high-dimensional touch parameter (HDTP) user interfaces|
|US9058099||Dec 28, 2006||Jun 16, 2015||Lg Electronics Inc.||Touch screen device and operating method thereof|
|US9063647||May 12, 2006||Jun 23, 2015||Microsoft Technology Licensing, Llc||Multi-touch uses, gestures, and implementation|
|US9069404||May 22, 2009||Jun 30, 2015||Apple Inc.||Force imaging input device and system|
|US9098142||Nov 25, 2013||Aug 4, 2015||Apple Inc.||Sensor arrangement for use with a touch sensor that identifies hand parts|
|US9117445||Jul 16, 2013||Aug 25, 2015||Interactions Llc||System and method for audibly presenting selected text|
|US9128611||Feb 23, 2010||Sep 8, 2015||Tactile Displays, Llc||Apparatus and method for interactive display with tactile feedback|
|US9134759||Mar 12, 2010||Sep 15, 2015||Blackberry Limited||Dual-mode mobile communication device|
|US9142369||Mar 14, 2005||Sep 22, 2015||Qualcomm Incorporated||Stack assembly for implementing keypads on mobile computing devices|
|US9146414||Mar 23, 2015||Sep 29, 2015||Apple Inc.||Integrated touch screens|
|US9195329||May 4, 2007||Nov 24, 2015||Blackberry Limited||Touch-sensitive device|
|US9235340||Feb 18, 2011||Jan 12, 2016||Microsoft Technology Licensing, Llc||Modal touch input|
|US9239673||Sep 11, 2012||Jan 19, 2016||Apple Inc.||Gesturing with a multipoint sensing device|
|US9239677||Apr 4, 2007||Jan 19, 2016||Apple Inc.||Operation of a computer with touch screen interface|
|US9244561||Feb 6, 2014||Jan 26, 2016||Apple Inc.||Touch screen liquid crystal display|
|US20020025837 *||May 22, 2001||Feb 28, 2002||Levy David H.||Input devices and their use|
|US20020054676 *||Nov 1, 2001||May 9, 2002||Wen Zhao||Multifunctional keyboard for a mobile communication device and method of operating the same|
|US20020095480 *||Sep 7, 2001||Jul 18, 2002||Diebold, Incorporated||Automated banking machine apparatus and system|
|US20020109677 *||Dec 21, 2001||Aug 15, 2002||David Taylor||Touchpad code entry system|
|US20020138155 *||Dec 19, 2001||Sep 26, 2002||Bristol Guy Scott||Implantable medical device management system|
|US20020149567 *||Jun 21, 2002||Oct 17, 2002||Griffin Jason T.||Hand-held electronic device|
|US20030018580 *||Aug 21, 2002||Jan 23, 2003||Diebold, Incorporated||Automated banking machine apparatus and system|
|US20030048262 *||Oct 31, 2002||Mar 13, 2003||Charles Wu||Method and apparatus for navigation, text input and phone dialing|
|US20030073456 *||Oct 16, 2002||Apr 17, 2003||Griffin Jason T.||Handheld mobile communication device|
|US20030078866 *||Nov 25, 2002||Apr 24, 2003||Diebold, Incorporated||Automated banking machine system using plural communication formats|
|US20030154167 *||Aug 19, 2002||Aug 14, 2003||Diebold, Incorporated||Method of using an automated banking machine|
|US20030160712 *||Feb 26, 2003||Aug 28, 2003||Digit Wireless, Llc, A Delaware Corporation||Keypad construction|
|US20030197689 *||Apr 23, 2002||Oct 23, 2003||May Gregory J.||Input device that allows multiple touch key input|
|US20030217004 *||Mar 17, 2003||Nov 20, 2003||Diebold, Incorporated||Automated banking machine system using Internet address customer input|
|US20030221877 *||Jun 3, 2002||Dec 4, 2003||Intel Corporation||Configurable keys for pen-based devices|
|US20040031673 *||May 23, 2003||Feb 19, 2004||Levy David H.||Keypads and key switches|
|US20040070553 *||Oct 7, 2002||Apr 15, 2004||Youden John J.||Image copy to a second display|
|US20040229662 *||May 12, 2003||Nov 18, 2004||Siemens Information||Mobile communication device having extendable display|
|US20040229664 *||Aug 14, 2003||Nov 18, 2004||Siemens Information And Communication Mobile Llc.||Mobile communication device having extendable display|
|US20040239632 *||Nov 23, 2001||Dec 2, 2004||Winhong Lai||English letter coding method and a small keypad|
|US20040242279 *||May 28, 2003||Dec 2, 2004||Costanzo Rito Natale||Implementing direct telephone access on a multi-purpose wireless mobile electronic device|
|US20050035945 *||Aug 13, 2003||Feb 17, 2005||Mark Keenan||Computer mouse with data retrieval and input functonalities|
|US20050053225 *||Jun 21, 2004||Mar 10, 2005||Griffin Jason T.||Handheld electronic device with keyboard|
|US20050097047 *||Dec 3, 2004||May 5, 2005||Diebold, Incorporated||Automated banking machine and system|
|US20050109198 *||Nov 25, 2003||May 26, 2005||Craig Saunders||Keyboard attachment for disabled persons|
|US20050119973 *||Dec 3, 2004||Jun 2, 2005||Diebold, Incorporated||Automated banking machine with record accessibility pre-check|
|US20050129199 *||Feb 6, 2003||Jun 16, 2005||Naoya Abe||Input device, mobile telephone, and mobile information device|
|US20050203847 *||May 6, 2005||Sep 15, 2005||Diebold, Incorporated||Automated banking machine and method|
|US20050216408 *||May 9, 2005||Sep 29, 2005||Diebold, Incorporated||Automated banking machine apparatus and system|
|US20050273427 *||Aug 12, 2005||Dec 8, 2005||Diebold, Incorporated||Automated banking machine apparatus and system|
|US20050289055 *||Jul 11, 2005||Dec 29, 2005||Diebold, Incorporated||Automated banking machine apparatus and system|
|US20060071905 *||Dec 16, 2005||Apr 6, 2006||Research In Motion Limited||Method of operating a handheld device for directional input|
|US20060109252 *||Nov 23, 2004||May 25, 2006||Microsoft Corporation||Reducing accidental touch-sensitive device activation|
|US20060136336 *||Nov 8, 2005||Jun 22, 2006||Diebold, Incorporated||Automated banking machine and system|
|US20060169127 *||Dec 12, 2005||Aug 3, 2006||Craig Saunders||Keyboard attachment for disabled persons|
|US20060238517 *||Jun 23, 2006||Oct 26, 2006||Apple Computer, Inc.||Electronic Device Having Display and Surrounding Touch Sensitive Bezel for User Interface and Control|
|US20070024591 *||Jul 27, 2005||Feb 1, 2007||Tyco Electronics Corporation||Retrofit touch sensor controls|
|US20070188464 *||Jun 13, 2006||Aug 16, 2007||Research In Motion Limited||On-screen diagonal cursor navigation on a handheld communication device having a full alphabetic keyboard|
|US20070236470 *||Apr 5, 2006||Oct 11, 2007||Microsoft Corporation||Touch sensitive and mechanical user input device|
|US20070247440 *||Dec 28, 2006||Oct 25, 2007||Sang Hyun Shin||Touch screen device and method of displaying images thereon|
|US20070252817 *||Feb 6, 2007||Nov 1, 2007||Griffin Jason T||Handheld wireless communication device|
|US20070254690 *||Feb 6, 2007||Nov 1, 2007||Griffin Jason T||Handheld wireless communication device|
|US20070254701 *||Feb 6, 2007||Nov 1, 2007||Griffin Jason T||Handheld wireless communication device|
|US20070254707 *||Feb 6, 2007||Nov 1, 2007||Griffin Jason T||Handheld wireless communication device|
|US20070256915 *||May 3, 2007||Nov 8, 2007||Digit Wireless, Inc.||Input Devices And Their Use|
|US20070259697 *||Feb 6, 2007||Nov 8, 2007||Griffin Jason T||Handheld wireless communication device|
|US20070262964 *||May 12, 2006||Nov 15, 2007||Microsoft Corporation||Multi-touch uses, gestures, and implementation|
|US20070273663 *||Dec 28, 2006||Nov 29, 2007||Ho Joo Park||Touch screen device and operating method thereof|
|US20070273665 *||Apr 17, 2007||Nov 29, 2007||Lg Electronics Inc.||Touch screen device and operating method thereof|
|US20070273666 *||Apr 17, 2007||Nov 29, 2007||Sang Hyun Shin||Touch screen device and operating method thereof|
|US20070273667 *||Apr 17, 2007||Nov 29, 2007||Lg Electronics Inc.||Touch screen device and method of method of displaying images thereon|
|US20070273668 *||Apr 17, 2007||Nov 29, 2007||Lg Electronics Inc.||Touch screen device and method of selecting files thereon|
|US20070273669 *||Apr 17, 2007||Nov 29, 2007||Lg Electronics Inc.||Touch screen device and operating method thereof|
|US20070273673 *||Dec 28, 2006||Nov 29, 2007||Ho Joo Park||Touch screen device and operating method thereof|
|US20070277124 *||Dec 28, 2006||Nov 29, 2007||Sang Hyun Shin||Touch screen device and operating method thereof|
|US20070277125 *||Apr 17, 2007||Nov 29, 2007||Lg Electronics Inc.||Touch screen device and operating method thereof|
|US20070277126 *||Dec 28, 2006||Nov 29, 2007||Ho Joo Park||Touch screen device and method of selecting files thereon|
|US20070279255 *||Apr 20, 2007||Dec 6, 2007||Sherif Danish||Character entry and display method for use with a keypad|
|US20070296707 *||May 17, 2007||Dec 27, 2007||Samsung Electronics Co., Ltd.||Keypad touch user interface method and mobile terminal using the same|
|US20080015115 *||Nov 18, 2005||Jan 17, 2008||Laurent Guyot-Sionnest||Method And Device For Controlling And Inputting Data|
|US20080055255 *||Aug 30, 2006||Mar 6, 2008||Griffin Jason T||Touch Sensitive Display Having Tactile Structures|
|US20080086450 *||Oct 4, 2006||Apr 10, 2008||Steven Noel Bittenson||Interface for on-line database and patent searching|
|US20080150899 *||Nov 21, 2007||Jun 26, 2008||Julius Lin||Virtual workstation|
|US20080162835 *||Jan 3, 2007||Jul 3, 2008||Apple Inc.||Memory access without internal microprocessor intervention|
|US20080202824 *||Feb 12, 2008||Aug 28, 2008||Harald Philipp||Tilting Touch Control Panel|
|US20080273014 *||May 4, 2007||Nov 6, 2008||Robert Lowles||Glass Touch Screen|
|US20080288402 *||Jul 28, 2008||Nov 20, 2008||Diebold, Incorporated||Automated banking machine and system|
|US20080316180 *||Jun 19, 2007||Dec 25, 2008||Michael Carmody||Touch Screen Keyboard With Tactile Feedback, and Associated Method|
|US20090021475 *||Jul 18, 2008||Jan 22, 2009||Wolfgang Steinle||Method for displaying and/or processing image data of medical origin using gesture recognition|
|US20090128504 *||Nov 16, 2007||May 21, 2009||Garey Alexander Smith||Touch screen peripheral device|
|US20090174675 *||May 30, 2008||Jul 9, 2009||Dave Gillespie||Locating multiple objects on a capacitive touch pad|
|US20090201248 *||Jul 2, 2007||Aug 13, 2009||Radu Negulescu||Device and method for providing electronic input|
|US20090201258 *||Feb 13, 2008||Aug 13, 2009||Jason Griffin||Three-dimensional touch-sensitive display device|
|US20090213086 *||Feb 10, 2009||Aug 27, 2009||Ji Suk Chae||Touch screen device and operating method thereof|
|US20090254869 *||Apr 5, 2009||Oct 8, 2009||Ludwig Lester F||Multi-parameter extraction algorithms for tactile images from user interface tactile sensor arrays|
|US20090301795 *||Dec 10, 2009||Acer Incorporated||Electronic device and controlling method thereof|
|US20100044121 *||Feb 25, 2010||Simon Steven H||Sensors, algorithms and applications for a high dimensional touchpad|
|US20100070281 *||Oct 24, 2008||Mar 18, 2010||At&T Intellectual Property I, L.P.||System and method for audibly presenting selected text|
|US20100073300 *||Dec 1, 2009||Mar 25, 2010||Research In Motion Limited||Hand-held electronic device with a keyboard optimized for use with the thumbs|
|US20100090990 *||Dec 11, 2009||Apr 15, 2010||Research In Motion Limited||Hand-held electronic device with multiple input mode thumbwheel|
|US20100115473 *||Oct 31, 2008||May 6, 2010||Sprint Communications Company L.P.||Associating gestures on a touch screen with characters|
|US20100123658 *||Nov 17, 2008||May 20, 2010||Sony Ericsson Mobile Communications Ab||Portable communication device having a touch-sensitive input device with non-linear active areas|
|US20100164872 *||Mar 12, 2010||Jul 1, 2010||Research In Motion Limited||Dual-mode mobile communication device|
|US20110032125 *||Feb 10, 2011||Research In Motion Limited||Multifunctional keyboard for a mobile communication device and method of operating the same|
|US20110043385 *||Feb 24, 2011||Research In Motion Limited||Multifunctional keyboard for a mobile communication device and method of operating the same|
|US20110055722 *||Sep 2, 2010||Mar 3, 2011||Ludwig Lester F||Data Visualization Environment with DataFlow Processing, Web, Collaboration, Advanced User Interfaces, and Spreadsheet Visualization|
|US20110066933 *||Sep 2, 2010||Mar 17, 2011||Ludwig Lester F||Value-driven visualization primitives for spreadsheets, tabular data, and advanced spreadsheet visualization|
|US20110078614 *||May 14, 2010||Mar 31, 2011||Pantech Co., Ltd.||Terminal and method for providing virtual keyboard|
|US20110092256 *||Apr 21, 2011||Research In Motion Limited||Handheld mobile communication device|
|US20110115736 *||May 19, 2011||Stantum||Devices and methods of controlling manipulation of virtual objects on a multi-contact tactile screen|
|US20110119580 *||May 19, 2011||Stantum||Devices and methods of controlling manipulation of virtual objects on a multi-contact tactile screen|
|US20110181546 *||Jul 28, 2011||Stantum||Devices and methods of controlling manipulation of virtual objects on a multi-contact tactile screen|
|US20110181547 *||Jul 28, 2011||Stantum||Devices and methods of controlling manipulation of virtual objects on a multi-contact tactile screen|
|US20110202889 *||Aug 18, 2011||Ludwig Lester F||Enhanced roll-over, button, menu, slider, and hyperlink environments for high dimensional touchpad (htpd), other advanced touch user interfaces, and advanced mice|
|US20110202934 *||Aug 18, 2011||Ludwig Lester F||Window manger input focus control for high dimensional touchpad (htpd), advanced mice, and other multidimensional user interfaces|
|US20110205192 *||Aug 25, 2011||Research In Motion Limited||Hand-held electronic device with multiple input mode thumbwheel|
|US20110215999 *||Sep 8, 2011||Research In Motion Limited||Hand-held electronic device|
|US20110225491 *||Sep 15, 2011||Research In Motion Limited||Hand-held electronic device|
|US20110309954 *||Jul 12, 2010||Dec 22, 2011||Tip Communications Llc||Touch-type key input apparatus|
|US20120235924 *||Mar 16, 2011||Sep 20, 2012||Hochmuth Roland M||Display systems, methods, and apparatus|
|US20120326964 *||Dec 27, 2012||Brother Kogyo Kabushiki Kaisha||Input device and computer-readable recording medium containing program executed by the input device|
|US20130169534 *||Dec 31, 2011||Jul 4, 2013||Peigen Jiang||Computer input device|
|USD497907||Jun 11, 2003||Nov 2, 2004||Research In Motion Limited||Keyboard for use with a handheld electronic device|
|CN101699381B||Apr 14, 2003||May 9, 2012||义隆电子股份有限公司||Capacitive touch pad combining key and handwriting functions|
|CN102841687A *||Mar 21, 2012||Dec 26, 2012||兄弟工业株式会社||An input device and an input method using the input device|
|EP1873618A2||May 22, 2007||Jan 2, 2008||Samsung Electronics Co., Ltd.||Keypad touch user interface method and mobile terminal using the same|
|WO2002103506A1 *||Nov 23, 2001||Dec 27, 2002||Lai Wingfai||English letter coding method and a small keypad|
|WO2003088023A2 *||Mar 25, 2003||Oct 23, 2003||Urs Doerig||Switching and operating system for quickly inputting text using a numeric keypad, particularly in mobile telephones|
|WO2006053991A1 *||Nov 18, 2005||May 26, 2006||Laurent Guyot-Sionnest||Method and device for controlling and inputting data|
|WO2010051452A1 *||Oct 30, 2009||May 6, 2010||Sprint Communications Company L.P.||Associating gestures on a touch screen with characters|
|WO2011026395A1 *||Aug 20, 2010||Mar 10, 2011||Intsig Information Co., Ltd.||Method and system for inputting multi-touch characters|
|U.S. Classification||345/173, 345/157, 345/174, 345/156|
|International Classification||G06F3/048, G06F3/033, G06F3/023|
|Cooperative Classification||G06F3/0235, G06F3/04883, G06F3/0488, G06F3/03547|
|European Classification||G06F3/0354P, G06F3/0488G, G06F3/0488, G06F3/023M4|
|Mar 10, 2004||REMI||Maintenance fee reminder mailed|
|Aug 23, 2004||LAPS||Lapse for failure to pay maintenance fees|
|Oct 19, 2004||FP||Expired due to failure to pay maintenance fee|
Effective date: 20040822