Skip to main content
Article
Advantages of Matched Over Unmatched Opt-in Samples for Studying Criminal Justice Attitudes: A Research Note
Crime & Delinquency
  • Amanda Graham, Georgia Southern University
  • Justin T. Pickett, University at Albany
  • Francis T. Cullen, University of Cincinnati
Document Type
Article
Publication Date
12-7-2020
DOI
10.1177/0011128720977439
Abstract

Despite the growing popularity of online opt-in samples in criminology, recent work shows that resultant findings often do not generalize. Not all opt-in samples are alike, however, and matching may improve data quality. Replicating and extending prior work, we compare the generalizability of relational inferences from unmatched and matched opt-in samples. Estimating identical models for four criminal justice outcomes, we compare multivariate regression results from national matched (YouGov) and unmatched (MTurk) opt-in samples to those from the General Social Survey (GSS). YouGov coefficients are almost always in the same direction as GSS coefficients, especially when statistically significant, and are mostly of a similar magnitude; less than 10% of the YouGov and GSS coefficients differ significantly. By contrast, MTurk coefficients are more likely to be in the wrong direction, more likely to be much larger or smaller, and are about three times as likely to differ significantly from GSS coefficients. Matched opt-in samples provide a relatively inexpensive data source for criminal justice researchers, compared to probability samples, and also appear to carry a smaller generalizability penalty than unmatched samples. Our study suggests relational inferences from matched opt-in samples are more likely to generalize than those from unmatched samples.

Copyright

Copyright belongs to SAGE. Information regarding the dissemination and usage of journal articles can be accessed through the following links.

Citation Information
Amanda Graham, Justin T. Pickett and Francis T. Cullen. "Advantages of Matched Over Unmatched Opt-in Samples for Studying Criminal Justice Attitudes: A Research Note" Thousand Oaks, CACrime & Delinquency (2020) ISSN: 1552-387X
Available at: http://works.bepress.com/amanda_k_graham/30/