Skip to main content
Feedback Design Considerations for Intelligent Team Tutoring Systems
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
  • Jamiahus Walton, Iowa State University
  • Alec Ostrander, Iowa State University
  • Kaitlyn M. Ouverson, Iowa State University
  • Stephen B. Gilbert, Iowa State University
  • Michael C. Dorneich, Iowa State University
  • Eliot H. Winer, Iowa State University
  • Anne Sinatra, United States Army Research Laboratory
Document Type
Conference Proceeding
Publication Version
Published Version
Publication Date
Conference Title
2018 Human Factors and Ergonomics Society International Annual Meeting
Conference Date
October 1-5, 2018
(39.9525839, -75.16522150000003)

Challenges arise when developing a computer-based Intelligent Team Tutoring System (ITTS) that attempts to deliver feedback to teams as effectively as a human tutor. The purpose of this current work is to outline elements of feedback that should be considered when designing feedback for an ITTS. The authors present the results of a study that consisted of 32 participants grouped into 16 teams of two. Each team conducted a surveillance task where they received individual or team feedback. Feedback content was written using either the bald (direct feedback; no need for interpretation) or off-record (general feedback; interpretation needed) etiquette strategy. The results showed that feedback delivered using the bald etiquette strategy positively correlated with improved performance. The results also showed that team level feedback positively correlated with more accurate self-assessment among participants. This suggests that in an ITTS, direct feedback can lead to better performance, and that feedback provided at the team level can help to align self-interpretation of performance with actual task performance.


This proceeding is published as Walton, Jamiahus, Alec Ostrander, Kaitlyn Ouverson, Stephen B. Gilbert, Michael Dorneich, Eliot Winer, and Anne Sinatra. "Feedback Design Considerations for Intelligent Team Tutoring Systems." Proceedings of the Human Factors and Ergonomics Society Annual Meeting 62, no. 1 (2018): 1977-1981. DOI: 10.1177%2F1541931218621448.

Works produced by employees of the U.S. Government as part of their official duties are not copyrighted within the U.S. The content of this document is not copyrighted.
File Format
Citation Information
Jamiahus Walton, Alec Ostrander, Kaitlyn M. Ouverson, Stephen B. Gilbert, et al.. "Feedback Design Considerations for Intelligent Team Tutoring Systems" Philadelphia, PAProceedings of the Human Factors and Ergonomics Society Annual Meeting Vol. 62 Iss. 1 (2018) p. 1977 - 1981
Available at: