Skip to main content
Article
Categorizing the content of GitHub README files
Empirical Software Engineering
  • Gede Artha Azriadi PRANA, Singapore Management University
  • Christoph TREUDE
  • Ferdian THUNG, Singapore Management University
  • Thushari ATAPATTU
  • David LO, Singapore Management University
Publication Type
Journal Article
Version
publishedVersion
Publication Date
10-2018
Abstract

README files play an essential role in shaping a developer’s first impression of a software repository and in documenting the software project that the repository hosts. Yet, we lack a systematic understanding of the content of a typical README file as well as tools that can process these files automatically. To close this gap, we conduct a qualitative study involving the manual annotation of 4,226 README file sections from 393 randomly sampled GitHub repositories and we design and evaluate a classifier and a set of features that can categorize these sections automatically. We find that information discussing the ‘What’ and ‘How’ of a repository is very common, while many README files lack information regarding the purpose and status of a repository. Our multi-label classifier which can predict eight different categories achieves an F1 score of 0.746. To evaluate the usefulness of the classification, we used the automatically determined classes to label sections in GitHub README files using badges and showed files with and without these badges to twenty software professionals. The majority of participants perceived the automated labeling of sections based on our classifier to ease information discovery. This work enables the owners of software repositories to improve the quality of their documentation and it has the potential to make it easier for the software development community to discover relevant information in GitHub README files.

Keywords
  • Classification,
  • GitHub README files,
  • Documentation
Identifier
10.1007/s10664-018-9660-3
Publisher
Springer Verlag (Germany)
Copyright Owner and License
Authors
Creative Commons License
Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International
Additional URL
https://doi.org/10.1007/s10664-018-9660-3
Citation Information
Gede Artha Azriadi PRANA, Christoph TREUDE, Ferdian THUNG, Thushari ATAPATTU, et al.. "Categorizing the content of GitHub README files" Empirical Software Engineering (2018) p. 1 - 32 ISSN: 1382-3256
Available at: http://works.bepress.com/david_lo/209/