Detailed Information
Cited 0 time in 
Cited 0 time in 
Cited 0 time in
Metadata Downloads
The IceProd framework: Distributed data processing for the IceCube neutrino observatoryopen access
- Authors
- Aartsen, M.G.; Abbasi, R.; Ackermann, M.; Adams, J.; Aguilar, J.A.; Ahlers, M.; Altmann, D.; Arguelles, C.; Auffenberg, J.; Bai, X.; Baker, M.; Barwick, S.W.; Baum, V.; Bay, R.; Beatty, J.J.; Becker, Tjus J.; Becker, K.-H.; Benzvi, S.; Berghaus, P.; Berley, D.; Bernardini, E.; Bernhard, A.; Besson, D.Z.; Binder, G.; Bindig, D.; Bissok, M.; Blaufuss, E.; Blumenthal, J.; Boersma, D.J.; Bohm, C.; Bose, D.; Böser, S.; Botner, O.; Brayeur, L.; Bretz, H.-P.; Brown, A.M.; Bruijn, R.; Casey, J.; Casier, M.; Chirkin, D.; Christov, A.; Christy, B.; Clark, K.; Classen, L.; Clevermann, F.; Coenders, S.; Cohen, S.; Cowen, D.F.; Cruz, Silva A.H.; Danninger, M.; Daughhetee, J.; Davis, J.C.; Day, M.; De, Clercq C.; De, Ridder S.; Desiati, P.; De, Vries K.D.; De, With M.; Deyoung, T.; Díaz-Vélez, J.C.; Dunkman, M.; Eagan, R.; Eberhardt, B.; Eichmann, B.; Eisch, J.; Euler, S.; Evenson, P.A.; Fadiran, O.; Fazely, A.R.; Fedynitch, A.; Feintzeig, J.; Feusels, T.; Filimonov, K.; Finley, C.; Fischer-Wasels, T.; Flis, S.; Franckowiak, A.; Frantzen, K.; Fuchs, T.; Gaisser, T.K.; Gallagher, J.; Gerhardt, L.; Gladstone, L.; Glüsenkamp, T.; Goldschmidt, A.; Golup, G.; Gonzalez, J.G.; Goodman, J.A.; Góra, D.; Grandmont, D.T.; Grant, D.; Gretskov, P.; Groh, J.C.; Groß, A.; Ha, C.; Haj, Ismail A.; Hallen, P.; Hallgren, A.; Halzen, F.; Hanson, K.; Hebecker, D.; Heereman, D.; Heinen, D.; Helbing, K.; Hellauer, R.; Hickford, S.; Hill, G.C.; Hoffman, K.D.; Hoffmann, R.; Homeier, A.; Hoshina, K.; Huang, F.; Huelsnitz, W.; Hulth, P.O.; Hultqvist, K.; Hussain, S.; Ishihara, A.; Jacobi, E.; Jacobsen, J.; Jagielski, K.; Japaridze, G.S.; Jero, K.; Jlelati, O.; Kaminsky, B.; Kappes, A.; Karg, T.; Karle, A.; Kauer, M.; Kelley, J.L.; Kiryluk, J.; Kläs, J.; Klein, S.R.; Köhne, J.-H.; Kohnen, G.; Kolanoski, H.; Köpke, L.; Kopper, C.; Kopper, S.; Koskinen, D.J.; Kowalski, M.; Krasberg, M.; Kriesten, A.; Krings, K.; Kroll, G.; Kunnen, J.; Kurahashi, N.; Kuwabara, T.; Labare, M.; Landsman, H.; Larson, M.J.; Lesiak-Bzdak, M.; Leuermann, M.; Leute, J.; Lünemann, J.; Macías, O.; Madsen, J.; Maggi, G.; Maruyama, R.; Mase, K.; Matis, H.S.; McNally, F.; Meagher, K.; Merck, M.; Merino, G.; Meures, T.; Miarecki, S.; Middell, E.; Milke, N.; Miller, J.; Mohrmann, L.; Montaruli, T.; Morse, R.; Nahnhauer, R.; Naumann, U.; Niederhausen, H.; Nowicki, S.C.; Nygren, D.R.; Obertacke, A.; Odrowski, S.; Olivas, A.; Omairat, A.; O'Murchadha, A.; Paul, L.; Pepper, J.A.; Pérez, De Los Heros C.; Pfendner, C.; Pieloth, D.; Pinat, E.; Posselt, J.; Price, P.B.; Przybylski, G.T.; Quinnan, M.; Rädel, L.; Rae, I.; Rameez, M.; Rawlins, K.; Redl, P.; Reimann, R.; Resconi, E.; Rhode, W.; Ribordy, M.; Richman, M.; Riedel, B.; Rodrigues, J.P.; Rott, C.; Ruhe, T.; Ruzybayev, B.; Ryckbosch, D.; Saba, S.M.; Sander, H.-G.; Santander, M.; Sarkar, S.; Schatto, K.; Scheriau, F.; Schmidt, T.; Schmitz, M.; Schoenen, S.; Schöneberg, S.; Schönwald, A.; Schukraft, A.; Schulte, L.; Schultz, D.; Schulz, O.; Seckel, D.; Sestayo, Y.; Seunarine, S.; Shanidze, R.; Sheremata, C.; Smith, M.W.E.; Soldin, D.; Spiczak, G.M.; Spiering, C.; Stamatikos, M.; Stanev, T.; Stanisha, N.A.; Stasik, A.; Stezelberger, T.; Stokstad, R.G.; Stößl, A.; Strahler, E.A.; Ström, R.; Strotjohann, N.L.; Sullivan, G.W.; Taavola, H.; Taboada, I.; Tamburro, A.; Tepe, A.; Ter-Antonyan, S.; Tešić, G.; Tilav, S.; Toale, P.A.; Tobin, M.N.; Toscano, S.; Tselengidou, M.; Unger, E.; Usner, M.; Vallecorsa, S.; Van, Eijndhoven N.; Van, Overloop A.; Van, Santen J.; Vehring, M.; Voge, M.; Vraeghe, M.; Walck, C.; Waldenmaier, T.; Wallraff, M.; Weaver, C.; Wellons, M.; Wendt, C.; Westerhoff, S.; Whitehorn, N.; Wiebe, K.; Wiebusch, C.H.; Williams, D.R.; Wissing, H.; Wolf, M.; Wood, T.R.; Woschnagg, K.; Xu, D.L.; Xu, X.W.; Yanez, J.P.; Yodh, G.; Yoshida, S.; Zarzhitsky, P.; Ziemann, J.; Zierke, S.; Zoll, M.
- Issue Date
- Jan-2015
- Publisher
- Academic Press Inc.
- Keywords
- Data management; Distributed computing; Grid computing; Monitoring
- Citation
- Journal of Parallel and Distributed Computing, v.75, pp 198 - 211
- Pages
- 14
- Journal Title
- Journal of Parallel and Distributed Computing
- Volume
- 75
- Start Page
- 198
- End Page
- 211
- ISSN
- 0743-7315
1096-0848
- Abstract
- IceCube is a one-gigaton instrument located at the geographic South Pole, designed to detect cosmic neutrinos, identify the particle nature of dark matter, and study high-energy neutrinos themselves. Simulation of the IceCube detector and processing of data require a significant amount of computational resources. This paper presents the first detailed description of IceProd, a lightweight distributed management system designed to meet these requirements. It is driven by a central database in order to manage mass production of simulations and analysis of data produced by the IceCube detector. IceProd runs as a separate layer on top of other middleware and can take advantage of a variety of computing resources, including grids and batch systems such as CREAM, HTCondor, and PBS. This is accomplished by a set of dedicated daemons that process job submission in a coordinated fashion through the use of middleware plugins that serve to abstract the details of job submission and job management from the framework. © 2014 Elsevier Inc. All rights reserved.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Natural Sciences > Department of Physics > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.