uu.seUppsala University Publications
Change search
ReferencesLink to record
Permanent link

Direct link
The IceProd framework: Distributed data processing for the IceCube neutrino observatory
Show others and affiliations
2015 (English)In: Journal of Parallel and Distributed Computing, ISSN 0743-7315, E-ISSN 1096-0848, Vol. 75, 198-211 p.Article in journal (Refereed) Published
Abstract [en]

IceCube is a one-gigaton instrument located at the geographic South Pole, designed to detect cosmic neutrinos, identify the particle nature of dark matter, and study high-energy neutrinos themselves. Simulation of the IceCube detector and processing of data require a significant amount of computational resources. This paper presents the first detailed description of IceProd, a lightweight distributed management system designed to meet these requirements. It is driven by a central database in order to manage mass production of simulations and analysis of data produced by the IceCube detector. IceProd runs as a separate layer on top of other middleware and can take advantage of a variety of computing resources, including grids and batch systems such as CREAM, HTCondor, and PBS. This is accomplished by a set of dedicated daemons that process job submission in a coordinated fashion through the use of middleware plugins that serve to abstract the details of job submission and job management from the framework. (C) 2014 Elsevier Inc. All rights reserved.

Place, publisher, year, edition, pages
2015. Vol. 75, 198-211 p.
Keyword [en]
Data management, Grid computing, Monitoring, Distributed computing
National Category
Physical Sciences Computer Science
URN: urn:nbn:se:uu:diva-241950DOI: 10.1016/j.jpdc.2014.08.001ISI: 000346552500017OAI: oai:DiVA.org:uu-241950DiVA: diva2:782207
Available from: 2015-01-20 Created: 2015-01-19 Last updated: 2015-01-20Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full text

Search in DiVA

By author/editor
Botner, OlgaHallgren, Allande los Heros, Carlos PerezStröm, Rickard
By organisation
High Energy Physics
In the same journal
Journal of Parallel and Distributed Computing
Physical SciencesComputer Science

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 407 hits
ReferencesLink to record
Permanent link

Direct link