The IceProd Framework: distributed data processing for the IceCube neutrino observatory
Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt
Standard
The IceProd Framework : distributed data processing for the IceCube neutrino observatory. / Aartsen, M.G.; Abbasi, R.; Ackermann, M.; Adams, J.; Aguilar, J.A.; Ahlers, M.; Altmann, D.; Arguelles, C.; Auffenberg, J.; Bai, X.; Baker, M.; Barwick, S.W.; Baum, V.; Bay, R.; Koskinen, David Jason; Sarkar, Subir.
I: Journal of Parallel and Distributed Computing, Bind 75, 2015, s. 198-211.Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - JOUR
T1 - The IceProd Framework
T2 - distributed data processing for the IceCube neutrino observatory
AU - Aartsen, M.G.
AU - Abbasi, R.
AU - Ackermann, M.
AU - Adams, J.
AU - Aguilar, J.A.
AU - Ahlers, M.
AU - Altmann, D.
AU - Arguelles, C.
AU - Auffenberg, J.
AU - Bai, X.
AU - Baker, M.
AU - Barwick, S.W.
AU - Baum, V.
AU - Bay, R.
AU - Koskinen, David Jason
AU - Sarkar, Subir
PY - 2015
Y1 - 2015
N2 - IceCube is a one-gigaton instrument located at the geographic South Pole, designed to detect cosmic neutrinos, iden- tify the particle nature of dark matter, and study high-energy neutrinos themselves. Simulation of the IceCube detector and processing of data require a significant amount of computational resources. IceProd is a distributed management system based on Python, XML-RPC and GridFTP. It is driven by a central database in order to coordinate and admin- ister production of simulations and processing of data produced by the IceCube detector. IceProd runs as a separate layer on top of other middleware and can take advantage of a variety of computing resources, including grids and batch systems such as CREAM, Condor, and PBS. This is accomplished by a set of dedicated daemons that process job submission in a coordinated fashion through the use of middleware plugins that serve to abstract the details of job submission and job management from the framework.
AB - IceCube is a one-gigaton instrument located at the geographic South Pole, designed to detect cosmic neutrinos, iden- tify the particle nature of dark matter, and study high-energy neutrinos themselves. Simulation of the IceCube detector and processing of data require a significant amount of computational resources. IceProd is a distributed management system based on Python, XML-RPC and GridFTP. It is driven by a central database in order to coordinate and admin- ister production of simulations and processing of data produced by the IceCube detector. IceProd runs as a separate layer on top of other middleware and can take advantage of a variety of computing resources, including grids and batch systems such as CREAM, Condor, and PBS. This is accomplished by a set of dedicated daemons that process job submission in a coordinated fashion through the use of middleware plugins that serve to abstract the details of job submission and job management from the framework.
U2 - 10.1016/j.jpdc.2014.08.001
DO - 10.1016/j.jpdc.2014.08.001
M3 - Journal article
VL - 75
SP - 198
EP - 211
JO - Journal of Parallel and Distributed Computing
JF - Journal of Parallel and Distributed Computing
SN - 0743-7315
ER -
ID: 129935186