Skip to main content
Article
Optimizing Heuristic Evaluation Process in E-Commerce: Use of the Taguchi Method
International Journal of Human-Computer Interaction
  • Chen Ling, The University Of Akron
  • Gavriel Salvendy
Document Type
Article
Publication Date
5-1-2007
Abstract

The heuristic evaluation method, a commonly used usability evaluation method, suffers from variability in evaluation results (Nielsen, 1993). Taguchi's quality-control method was applied to the heuristic evaluation process, and the robust condition of conducting heuristic evaluation that was insensitive to differences in an evaluator's cognitive styles was derived. Three control factors—task type, heuristic set, and evaluation mode—were used in the Taguchi analysis. The noise factor studied was the evaluator's cognitive style. The result of Taguchi analysis showed that if evaluators conducted the evaluations in pairs with the help of e-commerce-specific heuristics, the variability in the result caused by the noise factor was the minimum. The optimized evaluation process produced a 17.6% improvement in evaluation effectiveness over the traditional heuristic evaluation method (Nielsen, 1994) and reduced the variance among the participant's evaluation effectiveness at the same time.

Citation Information
Chen Ling and Gavriel Salvendy. "Optimizing Heuristic Evaluation Process in E-Commerce: Use of the Taguchi Method" International Journal of Human-Computer Interaction Vol. 22 (2007) p. 271 - 287
Available at: http://works.bepress.com/chen_ling/19/