Academic Grid infrastructures
-
Upload
michael-gindonis -
Category
Documents
-
view
491 -
download
0
description
Transcript of Academic Grid infrastructures
![Page 1: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/1.jpg)
Academic Grid infrastructuresAcademic Grid infrastructures
Michael GindonisOlli TourunenOlli Tourunen
CSC – Tieteen tietotekniikan keskus Oy CSC – IT Center for Science Ltd.
![Page 2: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/2.jpg)
Part 1: From Science to e-Science
![Page 3: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/3.jpg)
Towards Computational Science
Theoretical
Computational
• Evolution of science [1]
– From being primarily Empirical to grow an Empirical
Theoretical
– Theoretical component and today also include a
– Computational component
• PITAC report 2005– Defines and emphasizes the advancement of Computational
Science“Advances in computing and connectivity make it possible to develop computational models and capture and analyze unprecedented amounts of experimental and observational data to address problems previously deemed intractable or
[1] J. Gray, G. Bell and A. Szalay, Petascale Computational Systems:Balanced CyperInfrastructure in a Data-Centric World, Report to NSF October 2005
p p ybeyond imagination.”
![Page 4: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/4.jpg)
Evolution of Computational S iScience• Computational needs continuouslyComputational needs continuously
growingR h iti d j t h• Research communities and projects have become global
• The need to share data and resources
![Page 5: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/5.jpg)
Evolution of Computational SScience
• Unified view of theory, experiments and numerical simulation e-Science or
e Research• Advances in computing and
t ki e Infrastructure
e-Research
networking e-Infrastructure
![Page 6: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/6.jpg)
Building a Distributed Research I f t tInfrastructure• Sharing resources allows load balancingSharing resources allows load balancing• Better use of funding• Eases collaboration
![Page 7: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/7.jpg)
Globus issuesGlobus issues
![Page 8: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/8.jpg)
Part 2: Current production infrastructures
![Page 9: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/9.jpg)
DEISA
![Page 10: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/10.jpg)
DEISADEISA• A grid consisting of several European supercomputers, g g p p p
including CSC's Louhi.• A European grid project that shares computing
resources for demanding scientific applicationsresources for demanding scientific applications• Yearly applications for computing time (DECI call)• EU FP6: DEISA May 1st 2004 April 30th 2008• EU FP6: DEISA May 1st, 2004 – April 30th, 2008• EU FP7: DEISA2 May 1st, 2008 – April 30th, 2011• Most DEISA sites are connected via 10 Gb/s lines• Most DEISA sites are connected via 10 Gb/s lines• DEISA Global File System - eliminates need for file
staging
![Page 11: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/11.jpg)
DEISA NetworkDEISA Network
Provided by GEANT2 and the National Research and Education Networks
![Page 12: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/12.jpg)
EGEE
![Page 13: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/13.jpg)
EGEEEGEE• EGEE processes up to 300,000 jobs per dayp p , j p y• more than 80,000 CPU cores• several tens petabytes of storageseveral tens petabytes of storage • available 24 hours a day, seven days a week
4000050000600007000080000
No. Cores
010000200003000040000
hti.0
4nä
.04
oka.
04m
i.05
hti.0
5nä
.05
oka.
05m
i.06
hti.0
6nä
.06
oka.
06m
i.07
hti.0
7nä
.07
oka.
07m
i.08
hti.0
8
hu hei l o
tam hu hei l o
tam hu hei l o
tam hu hei l o
tam hu
![Page 14: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/14.jpg)
Grids in EuropeGrids in Europewww.eu-egi.eu
www.eu-egi.eu
![Page 15: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/15.jpg)
Grids in Finland?Grids in Finland?• CSC is the key playery p y• Participation in large European projects
– DEISADEISA– EGEE
• Influencing the next generation of gridInfluencing the next generation of grid infrastructures– PRACE– EGI
• Coordinates national level grid infrastructureg
![Page 16: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/16.jpg)
Some grid use cases in Finland• CERN Large Hadron ColliderCERN Large Hadron Collider
– ALICE and CMS experiments– Computational and storage facilities accessed
through grid– Finnish resources are hosted at CSC for the
Helsinki Institute of Physics
![Page 17: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/17.jpg)
Some grid use cases in Finland, contd.• DEISA DECIDEISA DECI
– LIPOS - Study of Low Density Lipoproteins to Prevent Heart Attacksto Prevent Heart Attacks
• http://www.deisa.eu/science/deci/projects2007-2008/Lipos
DEISA Vi t l C it• DEISA Virtual Community– Planck satellite first light study
• http://www.esa.int/SPECIALS/Planck/SEM5CMFWNZF_0.html
![Page 18: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/18.jpg)
Some grid use cases in Finland, contd.• PairsDB updatesPairsDB updates
– Gaining throughput without impacting local resourcesresources
– http://pairsdb.csc.fi/
![Page 19: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/19.jpg)
Part 3: OutlookPart 3: Outlook
![Page 20: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/20.jpg)
European CommissionEuropean Commission
“…for Grids we would like to see the move towardsthe move towards
long-term sustainable initiativesless dependent upon p p
EU-funded project cycles”
Viviane Reding, Commissioner, European Commission, at the EGEE’06 Conference, September 25, 2006
20www.eu-egi.eu
![Page 21: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/21.jpg)
EvolutionEvolutionNational
European e-Infrastructure
EuropeanTestbeds Utility
Productive UseEuropean
21www.eu-egi.eu
![Page 22: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/22.jpg)
Grids in EuropeGrids in Europewww.eu-egi.eu
www.eu-egi.eu
![Page 23: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/23.jpg)
Grids in EuropeGrids in Europewww.eu-egi.eu
Each National Grid Initiative … should be a recognized national body with a single point-of-contact… should mobilize national funding and resources… should ensure the operation of a national e-Infrastructurep… should support user communities… should contribute and adhere to intl. standards and policiespolicies
www.eu-egi.eu
![Page 24: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/24.jpg)
EGIEGI
• Ensure pan-European grid coordinationEnsure pan European grid coordination and integrityAi f t d di ti h ibl• Aims for standardization where possible
• National Grid Initiatives (NGIs) will operate National Grid Infrastructures
• EGI will link existing and new NGIsEGI will link existing and new NGIs• Operation starts January 2010• http://web.eu-egi.eu/
![Page 25: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/25.jpg)
Partnership for Advanced pComputing in Europe
![Page 26: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/26.jpg)
PRACE• Prepares for the creation of a persistent pan-European HPC service
PRACE
• Requires a periodic renewal of the systems and a continuous upgrade of the infrastructure
• Aims to provide European researchers with access to petaflop scale computers and form the top level of the European HPC ecosystemcomputers and form the top level of the European HPC ecosystem.
• The service will comprise three to five petaflop class supercomputing centres strengthened by regional and national HPC centres working in collaboration
• Current phase is undertaking all the necessary technical preparations, including the evaluation of components, systems and facilities, porting key scientific applications, and the developing training infrastructure
• Should be in a position to deploy and exploit the first petaflop/s systems in• Should be in a position to deploy and exploit the first petaflop/s systems in 2009/2010.
• CSC is in charge Dissemination, Outreach and Training• Funded by the European Commission’s 7th Framework Programme• Funded by the European Commission s 7th Framework Programme.
![Page 27: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/27.jpg)
CSC and the CloudCSC and the Cloud
• Currently working with ”A data intensiveCurrently working with A data intensive customer”– Close collaboration to find suitable technologies fromClose collaboration to find suitable technologies from
Clouds and Grid to meet their needs.
• Enhancing the existing software products to g g pbetter support distributed computing– Chipster: user friendly DNA microarray analysis p y y y
software developed by CSC offers an intuitive graphical user interface to a comprehensive collection of up-to-date analysis methodsof up to date analysis methods
![Page 28: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/28.jpg)
CSC and the CloudCSC and the Cloud
• Building Internal ExpertiseBuilding Internal Expertise• Following developments• Keen on involving customers as partners
in projects• Interested in Customer needs
![Page 29: Academic Grid infrastructures](https://reader030.fdocument.pub/reader030/viewer/2022020306/54c1c1694a79595c2a8b4575/html5/thumbnails/29.jpg)
Questions commentsQuestions, comments
Thank you!