Evaluating quality for open access (OA) journals has long presented a challenge, complicated by the misperception that OA journals offer a lesser quality than subscription journals. OA journals, however, have a wide variety of publishing models, some of which include rigorous peer review. Numeracy has recently received the DOAJ Seal for Open Access Journals. This editorial discusses what DOAJ is and why this seal is important in the context of evaluating the quality of open access journals.