HEP Applications Experience with the European DataGrid Middleware and Testbed

Content:
The European DataGrid (EDG) project ran from 2001 to 2004, with the aim of producing middleware which could form the basis of a production Grid, and of running a testbed to demonstrate the middleware. HEP experiments (initially the four LHC experiments and subsequently BaBar and D0) were involved from the start in specifying requirements, and subsequently in evaluating the performance of the middleware, both with generic tests and through increasingly complex data challenges. A lot of experience has therefore been gained which may be valuable to future Grid projects, in particular LCG and EGEE which are using a substantial amount of the middleware developed in EDG. We report our experiences with job submission, data management and mass storage, information and monitoring systems, Virtual Organisation management and Grid operations, and compare them with some typical Use Cases defined in the context of LCG. We also describe some of the main lessons learnt from the project, in particular in relation to configuration, fault-tolerance, interoperability and scalability, as well as the software development process itself, and point out some areas where further work is needed. We also make some comments on how these issues are being addressed in LCG and EGEE.

Primary Authors:
Dr. BURKE, Stephen (Rutherford Appleton Laboratory)
Dr. HARRIS, Frank (CERN/Oxford)

Co-authors:
TSAREGORODTSEV, A (Marseille)
BOS, K (NIKHEF)
GROEP, D (NIKHEF)
VAN LEEUWEN, W (NIKHEF)
TEMPLON, J (NIKHEF)
CAPILUPPI, P (INFN Bologna)
FANFANI, A (INFN Bologna)
GRANDI, C (INFN Bologna)
LUVISETTO, M (INFN Bologna)
MURA, D (INFN Cagliari)
AUGUSTIN, I (CERN)
BARBERA, R (INFN Catania)
LUPPI, E (INFN Ferrara)
NEGRI, G (INFN Milan)
PERINI, L (INFN Milan)
RESCONI, S (INFN Milan)
REALE, M (INFN Rome 1)
DE SALVO, A (INFN Rome 1)
BAGNASCO, S (INFN Turin)
CERELLO, P (INFN Turin)
SMIRNOVA, O (Lund)
CARMINATI, F (CERN)
MARONEY, O (Bristol)
BROCHU, F (Cambridge)
COLLING, D (Imperial)
STOKES-REES, I (Oxford)
CLOSIER, J (CERN)
VAN HERWIJNEN, E (CERN)
SCIABA, A (CERN)
BOUTIGNY, D (LAPP Annecy)
BLAISING, J J (LAPP Annecy)
GARONNE, V (Marseille)

Abstract speakers:
Dr. BURKE, Stephen

Track classification:
Track 4 - Distributed Computing


Last modified Thu 29 April 2004 . View page history
Switch to HTTPS . Website Help . Print View . Built with GridSite 1.4.3
For more about GridPP please contact Neasan O'Neill