Skip to main content
Contribution to Book
Taming the Metadata Mess
Data Engineering Workshops (ICDEW), 2013 IEEE 29th International Conference on (2013)
  • Veronika M. Megler, Portland State University
  • David Maier, Portland State University
Abstract

The rapid growth of scientific data shows no sign of abating. This growth has led to a new problem: with so much scientific data at hand, stored in thousands of datasets, how can scientists find the datasets most relevant to their research interests? We have addressed this problem by adapting Information Retrieval techniques, developed for searching text documents, into the world of (primarily numeric) scientific data. We propose an approach that uses a blend of automated and “semi-curated” methods to extract metadata from large archives of scientific data, then evaluates ranked searches over this metadata. We describe a challenge identified during an implementation of our approach: the large and expanding list of environmental variables captured by the archive do not match the list of environmental variables in the minds of the scientists. We briefly characterize the problem and describe our initial thoughts on resolving it.

Keywords
  • Metadata -- Analysis,
  • Information retrieval -- Technological innovations,
  • Information technology -- Management,
  • Database management
Publication Date
April, 2013
Publisher
IEEE
ISBN
978-1-4673-5303-8
Publisher Statement
Copyright ©2013 by IEEE.
Citation Information
Veronika M. Megler and David Maier. "Taming the Metadata Mess" Piscataway, NJData Engineering Workshops (ICDEW), 2013 IEEE 29th International Conference on (2013)
Available at: http://works.bepress.com/veronika_megler/14/