Federated Computing for the Masses – Aggregating Resources to Tackle Large-scale Engineering ProblemsComputing in Science & Engineering
Publication VersionAccepted Manuscript
AbstractThe complexity of many problems in science and engineering requires computational capacity exceeding what average user can expect from a single computational center. While many of these problems can be viewed as a set of independent tasks, their collective complexity easily requires millions core-hours on any state-of-the-art HPC resource, and throughput that cannot be sustained by a single multi-user queuing system. In this paper we explore the use of aggregated HPC resources to solve large-scale engineering problems. We show it is possible to build a computational federation that is easy to use by end-users, and is elastic, resilient and scalable. We argue that the fusion of federated computing and real-life engineering problems can be brought to average user if relevant middleware is provided. We report on the use of federation of 10 distributed heterogeneous HPC resources to perform a large-scale interrogation of the parameter space in the microscale fluid flow problem.
Rights“© 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.”
Citation InformationJavier Diaz-Montes, Yu Xie, Ivan Rodero, Jaroslaw Zola, et al.. "Federated Computing for the Masses – Aggregating Resources to Tackle Large-scale Engineering Problems" Computing in Science & Engineering Vol. 16 Iss. 4 (2014) p. 62 - 72
Available at: http://works.bepress.com/baskar-ganapathysubramanian/26/