Mobile User Experience

User experience (UX) research studies the complete relationship between products and users. It adds affective effects to usability, which ranges from short term user satisfaction with a single product to long lasting perception of a product line. My research in UX focuses on mobile products, smartphone applications, touch screen dashboards and web apps. It spans developing new interactions for mobile interfaces, mobile user interface design, mobile development and mobile user interface evaluation.


Comparing user centered design for traditional desktop applications with mobile applications, design, development and evaluation are exasperated by many aspects of mobile application usability and functionality. Mobile user interface design is challenged by more than the obvious design concerns due to small screen real estate and broad pointing devices. Mobile UX designers cannot assume a typical device or ignore the context of their use because of the ubiquitous usage and proliferations of mobile devices. In addition, the UX designer cannot assume that their products will be used in isolation or in an insulated room. Mobile users will use products while outdoors and with other applications and devices. A mobile application typically accomplishes a small portion of the user's goals during their daily activities. The design and usability of mobile applications requires greater understanding of the complete context of the application usage, including the environment, and other actives.

Comparing usability evaluation for traditional desktop applications with mobile applications, the UX evaluator is frustrated by many dimensions of testing. Mobile interface testing is frustrated by more than the obvious challenges of observing user gesturing on small devices while performing tasks. Mobile UX evaluators are not satisfied with tracking just the user's eyes while using a single application; UX evaluators track users interacting with a multitude of applications through the user's environment while the user perform their daily activities. Tracking users extends beyond the moment and context use of a single application; the UX evaluator needs to track the user's perception before the product is released and their satisfaction through years of product use. Mobile user interface design requires evaluating the total usage of application through the environment and time.


Mobile devices have extended and made more meaningful a variety of user interactions. Gesturing with fingers is more meaningful then with a mouse on mobile devices. The application can use the onboard GPS, camera and microphone to determine the user activity and environment. Photographing the environment or object can be part of the interaction that the application uses to eventually inform the user. The application can use vibrations to notify the user or to provide additional dimensions to other user interactions. Wi-Fi, Bluetooth and near field can extend the devices and sensors available to mobile applications. In general, mobile platforms offer a vaster and richer array of interactions then the desktop platforms.

Standard design and evaluation tools can be extended to UX. For example task analysis and even the more formal GOMS analysis can be extend to outline more than the user goals, tasks and operations on the device. Task analysis can relate the goals of the applications to the greater goal of the users in their lives. The analyses can predict the frequency of application usage and the relationship of the new application with other applications that the user interface with.

Although UX evaluator must contend with the invisibleness of many interactions on mobile devices, UX evaluator can take advantage of many of the onboard devices to infer some interaction details and extend their observations. The same sensors on the mobile device that extend the interaction techniques can also be used to infer the user's environment and track the user through the environment. Although eye tracking may be impossible while using a mobile device, users attentions can be inferred from touch and gesture responses. The user facing camera on the device can be used to capture facial expressions and affective response.


My research began with a focus on developing gesturing interaction and modelling pointing effectiveness. The pointing models explored extending Fitts's law to blunt pointers such as fingers and precise pointing with a mouse. The models informed the design of new pointing devices such as gravity mouse, and the combined mouse and scroll wheel precise pointing. My current research focuses on mobile usability, and designing new mobile applications and interactions.

Computer Science and Human Factors graduate students interested in mobile application design, usability and evaluations for their dissertation or thesis should contact me. We can discuss your interests and research opportunities in more detail.