Cargando…
Ganga: a tool for computational-task management and easy access to Grid resources
We present the computational task-management tool Ganga, which allows for the specification, submission, bookkeeping and post processing of computational tasks on a wide set of distributed resources. Ganga effectively provides a homogeneous environment for processing data on heterogeneous resources....
| Autores principales: | , , , , , , , , , , , , , , , , , , , |
|---|---|
| Lenguaje: | eng |
| Publicado: |
2009
|
| Materias: | |
| Acceso en línea: | https://dx.doi.org/10.1016/j.cpc.2009.06.016 http://cds.cern.ch/record/1162099 |
| _version_ | 1780915930267648000 |
|---|---|
| author | Mościcki, J.T. Brochu, F. Ebke, J. Egede, U. Elmsheuser, J. Harrison, K. Jones, R.W.L. Lee, H.C. Liko, D. Maier, A. Muraru, A. Patrick, G.N. Pajchel, K. Reece, W. Samset, B.H. Slater, M.W. Soroko, A. Tan, C.L. van der Ster, D.C. Williams, M. |
| author_facet | Mościcki, J.T. Brochu, F. Ebke, J. Egede, U. Elmsheuser, J. Harrison, K. Jones, R.W.L. Lee, H.C. Liko, D. Maier, A. Muraru, A. Patrick, G.N. Pajchel, K. Reece, W. Samset, B.H. Slater, M.W. Soroko, A. Tan, C.L. van der Ster, D.C. Williams, M. |
| author_sort | Mościcki, J.T. |
| collection | CERN |
| description | We present the computational task-management tool Ganga, which allows for the specification, submission, bookkeeping and post processing of computational tasks on a wide set of distributed resources. Ganga effectively provides a homogeneous environment for processing data on heterogeneous resources. We give examples from High Energy Physics, demonstrating how an analysis can be developed on a local system and then transparently moved to a Grid system for processing of all available data. Ganga has an API that can be used via an interactive interface, in scripts, or through a GUI. Specific knowledge about types of tasks or computational resources is provided at run-time through a plugin system, making new developments easy to integrate. We give an overview of the Ganga architecture, give examples of current use, and demonstrate how Ganga can be used in many different areas of science. |
| id | cern-1162099 |
| institution | Organización Europea para la Investigación Nuclear |
| language | eng |
| publishDate | 2009 |
| record_format | invenio |
| spelling | cern-11620992021-09-17T02:58:29Zdoi:10.1016/j.cpc.2009.06.016http://cds.cern.ch/record/1162099engMościcki, J.T.Brochu, F.Ebke, J.Egede, U.Elmsheuser, J.Harrison, K.Jones, R.W.L.Lee, H.C.Liko, D.Maier, A.Muraru, A.Patrick, G.N.Pajchel, K.Reece, W.Samset, B.H.Slater, M.W.Soroko, A.Tan, C.L.van der Ster, D.C.Williams, M.Ganga: a tool for computational-task management and easy access to Grid resourcesComputing and ComputersWe present the computational task-management tool Ganga, which allows for the specification, submission, bookkeeping and post processing of computational tasks on a wide set of distributed resources. Ganga effectively provides a homogeneous environment for processing data on heterogeneous resources. We give examples from High Energy Physics, demonstrating how an analysis can be developed on a local system and then transparently moved to a Grid system for processing of all available data. Ganga has an API that can be used via an interactive interface, in scripts, or through a GUI. Specific knowledge about types of tasks or computational resources is provided at run-time through a plugin system, making new developments easy to integrate. We give an overview of the Ganga architecture, give examples of current use, and demonstrate how Ganga can be used in many different areas of science.In this paper, we present the computational task-management tool Ganga , which allows for the specification, submission, bookkeeping and post-processing of computational tasks on a wide set of distributed resources. Ganga has been developed to solve a problem increasingly common in scientific projects, which is that researchers must regularly switch between different processing systems, each with its own command set, to complete their computational tasks. Ganga provides a homogeneous environment for processing data on heterogeneous resources. We give examples from High Energy Physics, demonstrating how an analysis can be developed on a local system and then transIn this paper, we present the computational task-management tool Ganga, which allows for the specification, submission, bookkeeping and post-processing of computational tasks on a wide set of distributed resources. Ganga has been developed to solve a problem increasingly common in scientific projects, which is that researchers must regularly switch between different processing systems, each with its own command set, to complete their computational tasks. Ganga provides a homogeneous environment for processing data on heterogeneous resources. We give examples from High Energy Physics, demonstrating how an analysis can be developed on a local system and then transparently moved to a Grid system for processing of all available data. Ganga has an API that can be used via an interactive interface, in scripts, or through a GUI. Specific knowledge about types of tasks or computational resources is provided at run-time through a plugin system, making new developments easy to integrate. We give an overview of the Ganga architecture, give examples of current use, and demonstrate how Ganga can be used in many different areas of science.arXiv:0902.2685oai:cds.cern.ch:11620992009-02-17 |
| spellingShingle | Computing and Computers Mościcki, J.T. Brochu, F. Ebke, J. Egede, U. Elmsheuser, J. Harrison, K. Jones, R.W.L. Lee, H.C. Liko, D. Maier, A. Muraru, A. Patrick, G.N. Pajchel, K. Reece, W. Samset, B.H. Slater, M.W. Soroko, A. Tan, C.L. van der Ster, D.C. Williams, M. Ganga: a tool for computational-task management and easy access to Grid resources |
| title | Ganga: a tool for computational-task management and easy access to Grid resources |
| title_full | Ganga: a tool for computational-task management and easy access to Grid resources |
| title_fullStr | Ganga: a tool for computational-task management and easy access to Grid resources |
| title_full_unstemmed | Ganga: a tool for computational-task management and easy access to Grid resources |
| title_short | Ganga: a tool for computational-task management and easy access to Grid resources |
| title_sort | ganga: a tool for computational-task management and easy access to grid resources |
| topic | Computing and Computers |
| url | https://dx.doi.org/10.1016/j.cpc.2009.06.016 http://cds.cern.ch/record/1162099 |
| work_keys_str_mv | AT moscickijt gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT brochuf gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT ebkej gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT egedeu gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT elmsheuserj gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT harrisonk gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT jonesrwl gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT leehc gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT likod gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT maiera gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT murarua gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT patrickgn gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT pajchelk gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT reecew gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT samsetbh gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT slatermw gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT sorokoa gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT tancl gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT vandersterdc gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources AT williamsm gangaatoolforcomputationaltaskmanagementandeasyaccesstogridresources |