Skip to main content
Contribution to Book
Workload-Based Assessment of a User Interface Design
Foundations of Augmented Cognition: Proceedings of HCI International 2009 (2009)
  • Patrice D. Tremoulet, Rowan University
  • Patrick L. Craven, Lockheed Martin Advanced Technology Laboratories
  • Susan Harkness Regli, Lockheed Martin Advanced Technology Laboratories
  • Saki Wilcox, Lockheed Martin Advanced Technology Laboratories
  • Joyce Barton, Lockheed Martin Advanced Technology Laboratories
  • Kathleeen Stibler, Lockheed Martin Advanced Technology Laboratories
  • Adam Gifford, Lockheed Martin Advanced Technology Laboratories
  • Marianne Clark
Abstract
Lockheed Martin Advanced Technology Laboratories (LM ATL) has designed and developed a tool called Sensor-based Mental Assessment in Real Time (SMART), which uses physiological data to help evaluate human-computer interfaces (HCI). SMART non-intrusively collects and displays objective measures of cognitive workload, visual engagement, distraction and drowsiness while participants interact with HCIs or HCI prototypes. This paper describes a concept validation experiment (CVE) conducted to 1) demonstrate the feasibility of using SMART during user interface evaluations and 2) validate the EEG-based cognitive workload values derived from the SMART system by comparing them to three other measures of cognitive workload (NASA TLX, expert ratings, and expected workload values generated with Design Interactive’s Multimodal Information Decision Support tool). Results from the CVE indicate that SMART represents a valuable tool that provides human factors engineers with a non-invasive, non-interrupting, objective method of evaluating cognitive workload.
Keywords
  • Cognitive workload,
  • human computer interaction,
  • human factors,
  • usability,
  • evaluation,
  • user interface design
Publication Date
July 14, 2009
Editor
Dylan D. Schmorrow, Ivy V. Estabrooke, & Marc Grootjen, Eds.
Publisher
Springer-Verlag
DOI
10.1007/978-3-642-02809-0_36
Citation Information
Patrice D. Tremoulet, Patrick L. Craven, Susan Harkness Regli, Saki Wilcox, et al.. "Workload-Based Assessment of a User Interface Design" San Diego, CA, USAFoundations of Augmented Cognition: Proceedings of HCI International 2009 (2009) p. 333 - 342
Available at: http://works.bepress.com/patrice-tremoulet/4/