Post on 02-Jan-2016
1
CERN Tier-1 Computing Collaboration
2010 8 10
Jonghu LEE Haengjin JANG
GSDC KISTI
1APCTP LHC Workshop Konkuk University
Contents
Introduction to GSDC Project
Activities in 2009
Strategies and Plans in 2010
GSDC office opening ceremony
CERN Tier1 Computing Collaboration
Appendix - Resources of GSDC
2APCTP LHC Workshop Konkuk University
3
Introduction to GSDC Project
Introduction to GSDCHistories
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 4
Introduction
bull Planned by Governmentndash A project to build a strategic plan and a model of NSDC
bull MEST (Ministry of Education Science and Technology)bull 2008 02 ~ 2008 05bull ldquo 사이버 RampD 인프라 구축 활용방안 기획연구rdquo
bull Most important things for this project isndash The contribution to Korean researchersrsquo study
This project is a part of
GOVERNMENTrsquoS MASTER PLAN FOR SCIENCE AND TECHNOLOGY DEVELOPMENT
( 과학기술기본계획 2009~)
Global Science experimental Data hub Center
5APCTP LHC Workshop Konkuk University
GSDC
APCTP LHC Workshop Konkuk University 6
Data Intensive Researches
Bio-informaticsAstrophysicsEarth Science
High Energy Physics
CDF Belle ALICE
2009 ~
Next ~
Activities in 2009
ALICE Tier2 CenterBelleCDF
DMRC amp Neuroimaging
APCTP LHC Workshop Konkuk University 7
APCTP LHC Workshop Konkuk University 8
KISTI ALICE Tier2
2007 Oct KICOS-CERN MoU
ndash Signing Partybull CERN Dr Jos Engelen (CSO of CERN)bull KICOS Chun Il Eom (KICOS)
Dr Haengjin JANG ALICE Tier2 Center Leader
Dr Soonwook HWANG WLCG Collaboration Representative
Dr Beob Kyun KIM
Dr Christophe BONNAUD
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
Resources
ndash 10 services for ALICE(WMS+LB PX RGMA BDII VOMS LFC VOBOX CREAMCE UI)
ndash 240 core 27048 kSI2kbull Dell 1U (20GHz Quad 2) x 6 set 48 core 516 kSI2kbull HP Blade (25GHz Quad 2) x 16 set 128 core 21888 kSI2k
9
2008 2009 Provided Comments
CPU (kSI2K) 100 150 27048 CREAM-CE
Storage (TB) 30 TB 50 TB 30 56TB Physical
Network (Gbps) 10 10 10
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
10
Site Availability to EGEE
983 (Feb2009~)
CREAM-CE support
- First 3 sites in the world
APCTP LHC Workshop Konkuk University
Belle Experiment Support
11
317 at KEK Japan Belle(KEK-IPNS) provides their data to KISTI KISTI will use this data for Korean Belle Researchers KISTI provides computing resources for Belle MC
Production(Grid)
MoU between KEK-KISTI
Belle Grid Construction 219 Application amp Grid Env were enabled for Belle 31 1st Belle job at GSDCKISTI e39 e65 Belle MC Production was done at GSDCKISTI
Belle MC Production by GSDCKISTI
APCTP LHC Workshop Konkuk University
Belle MC Production by NSDC
12
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
Contents
Introduction to GSDC Project
Activities in 2009
Strategies and Plans in 2010
GSDC office opening ceremony
CERN Tier1 Computing Collaboration
Appendix - Resources of GSDC
2APCTP LHC Workshop Konkuk University
3
Introduction to GSDC Project
Introduction to GSDCHistories
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 4
Introduction
bull Planned by Governmentndash A project to build a strategic plan and a model of NSDC
bull MEST (Ministry of Education Science and Technology)bull 2008 02 ~ 2008 05bull ldquo 사이버 RampD 인프라 구축 활용방안 기획연구rdquo
bull Most important things for this project isndash The contribution to Korean researchersrsquo study
This project is a part of
GOVERNMENTrsquoS MASTER PLAN FOR SCIENCE AND TECHNOLOGY DEVELOPMENT
( 과학기술기본계획 2009~)
Global Science experimental Data hub Center
5APCTP LHC Workshop Konkuk University
GSDC
APCTP LHC Workshop Konkuk University 6
Data Intensive Researches
Bio-informaticsAstrophysicsEarth Science
High Energy Physics
CDF Belle ALICE
2009 ~
Next ~
Activities in 2009
ALICE Tier2 CenterBelleCDF
DMRC amp Neuroimaging
APCTP LHC Workshop Konkuk University 7
APCTP LHC Workshop Konkuk University 8
KISTI ALICE Tier2
2007 Oct KICOS-CERN MoU
ndash Signing Partybull CERN Dr Jos Engelen (CSO of CERN)bull KICOS Chun Il Eom (KICOS)
Dr Haengjin JANG ALICE Tier2 Center Leader
Dr Soonwook HWANG WLCG Collaboration Representative
Dr Beob Kyun KIM
Dr Christophe BONNAUD
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
Resources
ndash 10 services for ALICE(WMS+LB PX RGMA BDII VOMS LFC VOBOX CREAMCE UI)
ndash 240 core 27048 kSI2kbull Dell 1U (20GHz Quad 2) x 6 set 48 core 516 kSI2kbull HP Blade (25GHz Quad 2) x 16 set 128 core 21888 kSI2k
9
2008 2009 Provided Comments
CPU (kSI2K) 100 150 27048 CREAM-CE
Storage (TB) 30 TB 50 TB 30 56TB Physical
Network (Gbps) 10 10 10
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
10
Site Availability to EGEE
983 (Feb2009~)
CREAM-CE support
- First 3 sites in the world
APCTP LHC Workshop Konkuk University
Belle Experiment Support
11
317 at KEK Japan Belle(KEK-IPNS) provides their data to KISTI KISTI will use this data for Korean Belle Researchers KISTI provides computing resources for Belle MC
Production(Grid)
MoU between KEK-KISTI
Belle Grid Construction 219 Application amp Grid Env were enabled for Belle 31 1st Belle job at GSDCKISTI e39 e65 Belle MC Production was done at GSDCKISTI
Belle MC Production by GSDCKISTI
APCTP LHC Workshop Konkuk University
Belle MC Production by NSDC
12
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
3
Introduction to GSDC Project
Introduction to GSDCHistories
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 4
Introduction
bull Planned by Governmentndash A project to build a strategic plan and a model of NSDC
bull MEST (Ministry of Education Science and Technology)bull 2008 02 ~ 2008 05bull ldquo 사이버 RampD 인프라 구축 활용방안 기획연구rdquo
bull Most important things for this project isndash The contribution to Korean researchersrsquo study
This project is a part of
GOVERNMENTrsquoS MASTER PLAN FOR SCIENCE AND TECHNOLOGY DEVELOPMENT
( 과학기술기본계획 2009~)
Global Science experimental Data hub Center
5APCTP LHC Workshop Konkuk University
GSDC
APCTP LHC Workshop Konkuk University 6
Data Intensive Researches
Bio-informaticsAstrophysicsEarth Science
High Energy Physics
CDF Belle ALICE
2009 ~
Next ~
Activities in 2009
ALICE Tier2 CenterBelleCDF
DMRC amp Neuroimaging
APCTP LHC Workshop Konkuk University 7
APCTP LHC Workshop Konkuk University 8
KISTI ALICE Tier2
2007 Oct KICOS-CERN MoU
ndash Signing Partybull CERN Dr Jos Engelen (CSO of CERN)bull KICOS Chun Il Eom (KICOS)
Dr Haengjin JANG ALICE Tier2 Center Leader
Dr Soonwook HWANG WLCG Collaboration Representative
Dr Beob Kyun KIM
Dr Christophe BONNAUD
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
Resources
ndash 10 services for ALICE(WMS+LB PX RGMA BDII VOMS LFC VOBOX CREAMCE UI)
ndash 240 core 27048 kSI2kbull Dell 1U (20GHz Quad 2) x 6 set 48 core 516 kSI2kbull HP Blade (25GHz Quad 2) x 16 set 128 core 21888 kSI2k
9
2008 2009 Provided Comments
CPU (kSI2K) 100 150 27048 CREAM-CE
Storage (TB) 30 TB 50 TB 30 56TB Physical
Network (Gbps) 10 10 10
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
10
Site Availability to EGEE
983 (Feb2009~)
CREAM-CE support
- First 3 sites in the world
APCTP LHC Workshop Konkuk University
Belle Experiment Support
11
317 at KEK Japan Belle(KEK-IPNS) provides their data to KISTI KISTI will use this data for Korean Belle Researchers KISTI provides computing resources for Belle MC
Production(Grid)
MoU between KEK-KISTI
Belle Grid Construction 219 Application amp Grid Env were enabled for Belle 31 1st Belle job at GSDCKISTI e39 e65 Belle MC Production was done at GSDCKISTI
Belle MC Production by GSDCKISTI
APCTP LHC Workshop Konkuk University
Belle MC Production by NSDC
12
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University 4
Introduction
bull Planned by Governmentndash A project to build a strategic plan and a model of NSDC
bull MEST (Ministry of Education Science and Technology)bull 2008 02 ~ 2008 05bull ldquo 사이버 RampD 인프라 구축 활용방안 기획연구rdquo
bull Most important things for this project isndash The contribution to Korean researchersrsquo study
This project is a part of
GOVERNMENTrsquoS MASTER PLAN FOR SCIENCE AND TECHNOLOGY DEVELOPMENT
( 과학기술기본계획 2009~)
Global Science experimental Data hub Center
5APCTP LHC Workshop Konkuk University
GSDC
APCTP LHC Workshop Konkuk University 6
Data Intensive Researches
Bio-informaticsAstrophysicsEarth Science
High Energy Physics
CDF Belle ALICE
2009 ~
Next ~
Activities in 2009
ALICE Tier2 CenterBelleCDF
DMRC amp Neuroimaging
APCTP LHC Workshop Konkuk University 7
APCTP LHC Workshop Konkuk University 8
KISTI ALICE Tier2
2007 Oct KICOS-CERN MoU
ndash Signing Partybull CERN Dr Jos Engelen (CSO of CERN)bull KICOS Chun Il Eom (KICOS)
Dr Haengjin JANG ALICE Tier2 Center Leader
Dr Soonwook HWANG WLCG Collaboration Representative
Dr Beob Kyun KIM
Dr Christophe BONNAUD
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
Resources
ndash 10 services for ALICE(WMS+LB PX RGMA BDII VOMS LFC VOBOX CREAMCE UI)
ndash 240 core 27048 kSI2kbull Dell 1U (20GHz Quad 2) x 6 set 48 core 516 kSI2kbull HP Blade (25GHz Quad 2) x 16 set 128 core 21888 kSI2k
9
2008 2009 Provided Comments
CPU (kSI2K) 100 150 27048 CREAM-CE
Storage (TB) 30 TB 50 TB 30 56TB Physical
Network (Gbps) 10 10 10
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
10
Site Availability to EGEE
983 (Feb2009~)
CREAM-CE support
- First 3 sites in the world
APCTP LHC Workshop Konkuk University
Belle Experiment Support
11
317 at KEK Japan Belle(KEK-IPNS) provides their data to KISTI KISTI will use this data for Korean Belle Researchers KISTI provides computing resources for Belle MC
Production(Grid)
MoU between KEK-KISTI
Belle Grid Construction 219 Application amp Grid Env were enabled for Belle 31 1st Belle job at GSDCKISTI e39 e65 Belle MC Production was done at GSDCKISTI
Belle MC Production by GSDCKISTI
APCTP LHC Workshop Konkuk University
Belle MC Production by NSDC
12
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
5APCTP LHC Workshop Konkuk University
GSDC
APCTP LHC Workshop Konkuk University 6
Data Intensive Researches
Bio-informaticsAstrophysicsEarth Science
High Energy Physics
CDF Belle ALICE
2009 ~
Next ~
Activities in 2009
ALICE Tier2 CenterBelleCDF
DMRC amp Neuroimaging
APCTP LHC Workshop Konkuk University 7
APCTP LHC Workshop Konkuk University 8
KISTI ALICE Tier2
2007 Oct KICOS-CERN MoU
ndash Signing Partybull CERN Dr Jos Engelen (CSO of CERN)bull KICOS Chun Il Eom (KICOS)
Dr Haengjin JANG ALICE Tier2 Center Leader
Dr Soonwook HWANG WLCG Collaboration Representative
Dr Beob Kyun KIM
Dr Christophe BONNAUD
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
Resources
ndash 10 services for ALICE(WMS+LB PX RGMA BDII VOMS LFC VOBOX CREAMCE UI)
ndash 240 core 27048 kSI2kbull Dell 1U (20GHz Quad 2) x 6 set 48 core 516 kSI2kbull HP Blade (25GHz Quad 2) x 16 set 128 core 21888 kSI2k
9
2008 2009 Provided Comments
CPU (kSI2K) 100 150 27048 CREAM-CE
Storage (TB) 30 TB 50 TB 30 56TB Physical
Network (Gbps) 10 10 10
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
10
Site Availability to EGEE
983 (Feb2009~)
CREAM-CE support
- First 3 sites in the world
APCTP LHC Workshop Konkuk University
Belle Experiment Support
11
317 at KEK Japan Belle(KEK-IPNS) provides their data to KISTI KISTI will use this data for Korean Belle Researchers KISTI provides computing resources for Belle MC
Production(Grid)
MoU between KEK-KISTI
Belle Grid Construction 219 Application amp Grid Env were enabled for Belle 31 1st Belle job at GSDCKISTI e39 e65 Belle MC Production was done at GSDCKISTI
Belle MC Production by GSDCKISTI
APCTP LHC Workshop Konkuk University
Belle MC Production by NSDC
12
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University 6
Data Intensive Researches
Bio-informaticsAstrophysicsEarth Science
High Energy Physics
CDF Belle ALICE
2009 ~
Next ~
Activities in 2009
ALICE Tier2 CenterBelleCDF
DMRC amp Neuroimaging
APCTP LHC Workshop Konkuk University 7
APCTP LHC Workshop Konkuk University 8
KISTI ALICE Tier2
2007 Oct KICOS-CERN MoU
ndash Signing Partybull CERN Dr Jos Engelen (CSO of CERN)bull KICOS Chun Il Eom (KICOS)
Dr Haengjin JANG ALICE Tier2 Center Leader
Dr Soonwook HWANG WLCG Collaboration Representative
Dr Beob Kyun KIM
Dr Christophe BONNAUD
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
Resources
ndash 10 services for ALICE(WMS+LB PX RGMA BDII VOMS LFC VOBOX CREAMCE UI)
ndash 240 core 27048 kSI2kbull Dell 1U (20GHz Quad 2) x 6 set 48 core 516 kSI2kbull HP Blade (25GHz Quad 2) x 16 set 128 core 21888 kSI2k
9
2008 2009 Provided Comments
CPU (kSI2K) 100 150 27048 CREAM-CE
Storage (TB) 30 TB 50 TB 30 56TB Physical
Network (Gbps) 10 10 10
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
10
Site Availability to EGEE
983 (Feb2009~)
CREAM-CE support
- First 3 sites in the world
APCTP LHC Workshop Konkuk University
Belle Experiment Support
11
317 at KEK Japan Belle(KEK-IPNS) provides their data to KISTI KISTI will use this data for Korean Belle Researchers KISTI provides computing resources for Belle MC
Production(Grid)
MoU between KEK-KISTI
Belle Grid Construction 219 Application amp Grid Env were enabled for Belle 31 1st Belle job at GSDCKISTI e39 e65 Belle MC Production was done at GSDCKISTI
Belle MC Production by GSDCKISTI
APCTP LHC Workshop Konkuk University
Belle MC Production by NSDC
12
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
Activities in 2009
ALICE Tier2 CenterBelleCDF
DMRC amp Neuroimaging
APCTP LHC Workshop Konkuk University 7
APCTP LHC Workshop Konkuk University 8
KISTI ALICE Tier2
2007 Oct KICOS-CERN MoU
ndash Signing Partybull CERN Dr Jos Engelen (CSO of CERN)bull KICOS Chun Il Eom (KICOS)
Dr Haengjin JANG ALICE Tier2 Center Leader
Dr Soonwook HWANG WLCG Collaboration Representative
Dr Beob Kyun KIM
Dr Christophe BONNAUD
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
Resources
ndash 10 services for ALICE(WMS+LB PX RGMA BDII VOMS LFC VOBOX CREAMCE UI)
ndash 240 core 27048 kSI2kbull Dell 1U (20GHz Quad 2) x 6 set 48 core 516 kSI2kbull HP Blade (25GHz Quad 2) x 16 set 128 core 21888 kSI2k
9
2008 2009 Provided Comments
CPU (kSI2K) 100 150 27048 CREAM-CE
Storage (TB) 30 TB 50 TB 30 56TB Physical
Network (Gbps) 10 10 10
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
10
Site Availability to EGEE
983 (Feb2009~)
CREAM-CE support
- First 3 sites in the world
APCTP LHC Workshop Konkuk University
Belle Experiment Support
11
317 at KEK Japan Belle(KEK-IPNS) provides their data to KISTI KISTI will use this data for Korean Belle Researchers KISTI provides computing resources for Belle MC
Production(Grid)
MoU between KEK-KISTI
Belle Grid Construction 219 Application amp Grid Env were enabled for Belle 31 1st Belle job at GSDCKISTI e39 e65 Belle MC Production was done at GSDCKISTI
Belle MC Production by GSDCKISTI
APCTP LHC Workshop Konkuk University
Belle MC Production by NSDC
12
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University 8
KISTI ALICE Tier2
2007 Oct KICOS-CERN MoU
ndash Signing Partybull CERN Dr Jos Engelen (CSO of CERN)bull KICOS Chun Il Eom (KICOS)
Dr Haengjin JANG ALICE Tier2 Center Leader
Dr Soonwook HWANG WLCG Collaboration Representative
Dr Beob Kyun KIM
Dr Christophe BONNAUD
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
Resources
ndash 10 services for ALICE(WMS+LB PX RGMA BDII VOMS LFC VOBOX CREAMCE UI)
ndash 240 core 27048 kSI2kbull Dell 1U (20GHz Quad 2) x 6 set 48 core 516 kSI2kbull HP Blade (25GHz Quad 2) x 16 set 128 core 21888 kSI2k
9
2008 2009 Provided Comments
CPU (kSI2K) 100 150 27048 CREAM-CE
Storage (TB) 30 TB 50 TB 30 56TB Physical
Network (Gbps) 10 10 10
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
10
Site Availability to EGEE
983 (Feb2009~)
CREAM-CE support
- First 3 sites in the world
APCTP LHC Workshop Konkuk University
Belle Experiment Support
11
317 at KEK Japan Belle(KEK-IPNS) provides their data to KISTI KISTI will use this data for Korean Belle Researchers KISTI provides computing resources for Belle MC
Production(Grid)
MoU between KEK-KISTI
Belle Grid Construction 219 Application amp Grid Env were enabled for Belle 31 1st Belle job at GSDCKISTI e39 e65 Belle MC Production was done at GSDCKISTI
Belle MC Production by GSDCKISTI
APCTP LHC Workshop Konkuk University
Belle MC Production by NSDC
12
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
Resources
ndash 10 services for ALICE(WMS+LB PX RGMA BDII VOMS LFC VOBOX CREAMCE UI)
ndash 240 core 27048 kSI2kbull Dell 1U (20GHz Quad 2) x 6 set 48 core 516 kSI2kbull HP Blade (25GHz Quad 2) x 16 set 128 core 21888 kSI2k
9
2008 2009 Provided Comments
CPU (kSI2K) 100 150 27048 CREAM-CE
Storage (TB) 30 TB 50 TB 30 56TB Physical
Network (Gbps) 10 10 10
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
10
Site Availability to EGEE
983 (Feb2009~)
CREAM-CE support
- First 3 sites in the world
APCTP LHC Workshop Konkuk University
Belle Experiment Support
11
317 at KEK Japan Belle(KEK-IPNS) provides their data to KISTI KISTI will use this data for Korean Belle Researchers KISTI provides computing resources for Belle MC
Production(Grid)
MoU between KEK-KISTI
Belle Grid Construction 219 Application amp Grid Env were enabled for Belle 31 1st Belle job at GSDCKISTI e39 e65 Belle MC Production was done at GSDCKISTI
Belle MC Production by GSDCKISTI
APCTP LHC Workshop Konkuk University
Belle MC Production by NSDC
12
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University
KISTI ALICE Tier2
10
Site Availability to EGEE
983 (Feb2009~)
CREAM-CE support
- First 3 sites in the world
APCTP LHC Workshop Konkuk University
Belle Experiment Support
11
317 at KEK Japan Belle(KEK-IPNS) provides their data to KISTI KISTI will use this data for Korean Belle Researchers KISTI provides computing resources for Belle MC
Production(Grid)
MoU between KEK-KISTI
Belle Grid Construction 219 Application amp Grid Env were enabled for Belle 31 1st Belle job at GSDCKISTI e39 e65 Belle MC Production was done at GSDCKISTI
Belle MC Production by GSDCKISTI
APCTP LHC Workshop Konkuk University
Belle MC Production by NSDC
12
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University
Belle Experiment Support
11
317 at KEK Japan Belle(KEK-IPNS) provides their data to KISTI KISTI will use this data for Korean Belle Researchers KISTI provides computing resources for Belle MC
Production(Grid)
MoU between KEK-KISTI
Belle Grid Construction 219 Application amp Grid Env were enabled for Belle 31 1st Belle job at GSDCKISTI e39 e65 Belle MC Production was done at GSDCKISTI
Belle MC Production by GSDCKISTI
APCTP LHC Workshop Konkuk University
Belle MC Production by NSDC
12
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University
Belle MC Production by NSDC
12
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University
CDF Experiment Support
13
From Sep 2009 operates on OSG
GSDCKISTI resources were used for CDFSoft Development Currently almost finished
SL5 compatible CDFSoft Development
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
CDF - Interoperability
APCTP LHC Workshop Konkuk University 14
Multi-grid-operation (EGEE amp OSG) by single resourcebull Basically GSDC resources operate on EGEEbull GSDC resources also operate with OSG to support CDF
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
15
Strategies and Plans in 2010
ALICEBelle2 LSDH Test
CDF SAM Support amp DevelopmentLIGO Neuroimaging
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University 16
2010 ndash Strategies and Plans
ALICE Associate Membership
ALICE Tier1 Testbed
Testbed of Asian CAF for ALICE
Build collaboration network with experts at CERN and other institutes
ALICE Tier2
ALICE
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
17
Belle2 Data Handling Software Developmentbull Construction for Belle2 data analysisbull Field test of Belle2 data handling software
( use Belle data that is archived at GSDCKISTI ) Initiative Belle research using GSDC resources
bull optimize resources for Bellebull survey hidden issues to extend research domain
Belle amp Belle2
2010 ndash Strategies and Plans
APCTP LHC Workshop Konkuk University
SL5 compatible CDF software developmentbull 2009 ~
SAM for CDF Collaborative development of SAM with FNAL
CDF
LIGO
GBRAIN
STAR SACC (STAR Asian Computing Center)
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
18
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University 19
박항식 국장 ( 교육과학기술부 기초연구국장 ) 최영진 사무관 ( 교육과학기술부 기초연구국 )
나상원 팀장 ( 연구재단 ) 전성진 연구원 ( 연구재단 )
오선근 교수 ( 건국대학교 GSDC 사용자대표 )
박영서 원장 (KISTI) 김중권 (KISTI 선임연구부장 ) 이지수 본부장 (KISTI
슈퍼컴퓨팅본부 )
At 723
GSDC office opening ceremony
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University 20
GSDC office opening ceremony
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
21
CERN Tier1 Computing Collaboration
ALICE Tier1 TestbedALICE CAF (CERN Analysis Farm)
Experts exchange between CERN amp GSDC
ALICE Tier2
APCTP LHC Workshop Konkuk University
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
22
ALICE Tier1 Testbed - Resources
100TB disk space amp 100TB tape emulationbull We donrsquot use tape we will emulate tape function with disk
Storage
36 blade servers HS22 (from IBM Blade machine)bull Xeon X5650 6 core x2 RAM 24GB HD 146GB
Computing
Between storage and computingbull Basically all computing resource have 1G dedicated con-
nectionbull To enhance access speed Parallel File System is adaptedbull Special nodes like storage will have 10G connection to
storage
Internal Networking
APCTP LHC Workshop Konkuk University
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
23
U600TBNAS NetAppFAS6080 A-1
NAS NetAppFAS2050 NAS NetApp
FAS6080 A-2
IBM server ldquox3550rdquo x 14
Dell 1U Server ldquoPE1950rdquo x 16
HP Blade ldquoBL460crdquo x 16
Y 2008 Install
IBM 1U server ldquox3550rdquo x 38
Y 2009 Install
IBM Blade Server ldquox5650rdquo x 36
Y 2010 Install
To Backbone Network
Public Network
Data Network
1Gb
10Gb
8Gb FC SAN
Intensive IO Servers
SMC8848M
Juniper EX2500
Cisco 3560E
HP IBRIX9300 (x5)
10 links4 links
HP StorageworksX9300(SAN Switch)
2 links
ALICE Tier1 Testbed - Resources
APCTP LHC Workshop Konkuk University
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
24
ALICE Tier1 Testbed - Management
Storage powered by IBRIXbull Disk 100TB
bull Managed by xrootd (redirector amp pool)bull Tape (emulation) 100TB
bull We donrsquot use tapebull Tape function will be emulated with disks
Resource Management
14 members but only 9 for ITbull 4 members affected to Tier1 testbedbull Network power management and aircooling are managed
by other team within KISTI 1 more person with strong experiences in Tier1 management
will be recruited from any other countries
Human resources
APCTP LHC Workshop Konkuk University
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
25
Asian CAF for ALICE
To cover all ALICE analysis demand from Asian Areabull Korea Japan India hellipbull Negotiated with CERN
In 2010 it will be a kind of testbed of CAF
From 823 one expert will visit GSDCKISTI
Resourcesbull Will use shared resources from existing facilitybull From next year dedicated resources will be used
Asian CAF (CERN Analysis Farm)
APCTP LHC Workshop Konkuk University
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
26
Expert exchange
Federico Carminatibull Co-chair of ALICE Computingbull in October
Marco Meonibull Experts in CAF PROOF AliEnbull August - September
Any experts in computing related to CERN are welcome
From September 1 month To understand Tier1 service and technologies To develop new issues
Visiting Research of GSDC people to CERN
APCTP LHC Workshop Konkuk University
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
27
ALICE Tier2
From 2007
Experts in Tier2 will be core-people in Tier1 Testbed
Will be provided by GSDC continuously
ALICE Tier2 Service
APCTP LHC Workshop Konkuk University
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
Appendix ndash Resources of GSDC
HardwaresGrid Middleware Deployment
APCTP LHC Workshop Konkuk University 28
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University 29
Resources ndash Hardware
Cluster 544 core 981 kSI2k
Storage
Service nodes for Grid amp Application ~30 nodes (including VM)
Cluster Spec node nodes cores kSI2k
ce-al-ice
Dell Intel Xeon E5405 x2 (20GHz Quad) 16GB
14 112 112
ce01 HP Intel Xeon E5420 x2 (25Ghz Quad) 16GB
16 128 219
ce02 IBM Intel Xeon E5450 x2 (30GHz Quad) 16GB
38 304 650
-- Intel Xeon X5650 x2 (266GHz Hex) 24GB 36 432 -
Total 114 976 -Model Capacity Physi-
callyCapacity Usable
NetApp FAS2050 (SAN only RAID6 HA) 48TB 30TB
NetApp FAS6080 (SAN amp NAS RAID6 HA) 334TB 200TB
Hitachi (SAN only) + IBRIX 950TB 600TB
Total 13TB 830TB
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University 30
Newly delivered storage system in June
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University
Grid Middleware Deployment
31
VOBOXs
VOBOXs
Storage Pool
VOBOXs
ALICE
GS
DC
Computing Resourcesbull 60node (480core)
6 node 48 core- Xeon E5405 (20GHz) 2GB RAMcore- 1075 si2kcore AVG
DELL 1U + BladeWN
16 node 128 core- Xeon E5420 (25GHz) 2GB RAMcore- 1710 si2kcore AVG
HP BladeWN
10G38 node 304 core- Xeon E5450 (30GHz) 2GB RAMcore- 2177 si2kcore AVG
IBM 1U (x3350)WN
Retiredlcg-RB
CREAM-CE
lcg-CE
UIs
WMS+LB
RGMA
BDII-top
BDII-site
MyProxy
VOMS
VOBOXs
GUMS-OSG
CE-OSG
LFC
dgassdfarmkrNagios
repositorysdfarmkrRepository
SMURF
NetApp FAS6080Hitachi USP-V
IBRIX
Belle
LDG Server LIGO
SAM
36 node 432 core- Xeon X5650 (266GHz) 2GB RAMcore
IBM BladeWN
NetApp FAS2050
Belle db
bull 1349TB (830 TB usable)
Xrd head
Xrd head
SEDPM
Xrootd (t1)
Xrootd (t2)
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon
APCTP LHC Workshop Konkuk University 3232
General Contact nsdcnsdckr Speaker Jonghu LEE jlee206kistirekr
Project Leader Haengjin JANG hjjangkistirekr
httpgsdckr will be available in soon