Dwell Selection Mouse Button Emulation

For Fraser Shein, Coordinator, Microcomputer Applications Programme Bloorview MacMillan Centre

Kelly Parkinson

A software package is being developed that enables users of any Microsoft Windows pointing device to perform button actions (clicking, double-clicking, and dragging) by both dwelling (pausing over a spot for some time) and gestures across the entire Windows desktop. A user interface to customize this software for unique user abilities is required in much the same way a mouse control panel permits various settings. Improvements on the user interface as the dwell selection is in use are also required.

The dwell selection works by the user pointing at a target, dwelling briefly, upon which a "trigger frame" is drawn about the pausing location (e.g., 2-cm square). The user then makes a small gesture, moving the cursor across one of the frame borders, and then back inside the trigger frame. Different movements can have different actions assigned to them. For example, down/up movement can make a single left-button click, as in a confirming nod. An up/down movement may be used to double-click. A right/left action may be used to click the right button. Up to four button actions may be associated with each of the trigger frame borders. A latched button action may be achieved by dwelling for a slightly longer time. Both auditory and visual feedback facilitates these actions by cuing the user. The primary limitation of the current prototype is that it lacks a user interface for customizing the usability features (dwell time, dwell area, gesture size and motions, auditory and visual feedback).

Key improvements on the interface include:
* clearer auditory and visual feedback for performing specific gestures
* a user interface (control panel) for customizing features which will be associated with the dwell options
* an easy means to turn the dwell/gesture selection method on and off so that inadvertent selections are not made
* a means to allow repeated button selections

Some features of the control panel include:
* Assignment of the following button actions:
* Left button click
* Left button double-click
* Left button lock on/off
* Right button click
* Assignment of actions to the following triggers:
* Left frame border
* Right frame border
* Top frame border
* Bottom frame border
* Adjustable action trigger frame size
* Adjustable dwell frame size
* Adjustable dwell time to initiate trigger frame
* Adjustable cancel time when pointer moves outside trigger frame

For further information on this project, please contact:
Fraser Shein, Coordinator, Microcomputer Applications Programme Bloorview MacMillan Centre
(416) 424-3855 x3538
Fraser_Shein@msn.com