Skip to main content
Article
Automated Waterloo Rubric for Concept Map Grading
School of Computer Science & Engineering Faculty Publications
  • Shresht Bhatia, New York University
  • Sajal Bhatia, Sared Heart University
  • Irfan Ahmed, Virginia Commonwealth University
Document Type
Peer-Reviewed Article
Publication Date
1-1-2021
Abstract

Concept mapping is a well-known pedagogical tool to help students organize, represent, and develop an understanding of a topic. The grading of concept maps is typically manual, time-consuming, and tedious, especially for a large class. Existing research mostly focuses on topological scoring based-on structural features of concept maps. However, the scoring does not achieve comparable accuracy to well-defined rubrics for manual analysis on the quality of content in a concept map. This paper presents Kastor, a new method to automate the Waterloo Rubric of scoring concept maps by quantifying the rubric’s quality assessment parameters. The evaluation is performed on a publicly-available dataset of 39 concept maps of two cybersecurity courses, i.e., digital forensics, and supervisory control and data acquisition (SCADA) system security. The evaluation results show that Kastor achieves the accuracy of around 84% and 95% (at accurate and close-to-accurate levels) for SCADA and forensics concept maps, respectively. Furthermore, Kastor’s comparison with a topological scoring method shows improvement by around 32% and 79% on SCADA and forensics concept maps, respectively.

DOI
10.1109/ACCESS.2021.3124672
Creative Commons License
Creative Commons Attribution 4.0 International
Citation Information

Bhatia, S., Bhatia, S., & Ahmed, I. (2021). Automated waterloo rubric for concept map grading. IEEE Access, 9, 148590-148598. Doi:10.1109/ACCESS.2021.3124672