Using a framework previously applied to other areas of media literacy, this study developed and assessed a measurement scale focused specifically on critical news media literacy. Our scale appears to successfully measure news media literacy as we have conceptualized it based on previous research, demonstrated through assessments of content, construct and predictive validity. Among our college student sample, a separate media system knowledge index also was a significant predictor of knowledge about topics in the news, which suggests the need for a broader framework. Implications for future work in defining and assessing news media literacy are discussed.