ByungGu CheonSungkyunkwan University

(On the behalf of HEP DataGrid Working Group)

22~23 August, 20032nd Int. Workshop on HEP Data GridKyungpook National Univ., Daegu

BELLE Data Grid in Korea

Why does BELLE ?

outlineKEKB/BELLE in generalBELLE Computing & Data GridKorBELLE* Data Grid Summary & Plan

* KorBELLE : Korean BELLE group

To study matter-antimatter asymmetry in B meson decays

KEKB / BELLE

BELLE detector

3.5GeV e+ & 8GeV e- Asymmetric Collider3km circumference, 11mrad Xing angleLmax = 1.06 X 1034 cm–2s–1 (world record)Ldt(6/99-6/03) = 158 fb–1 @{(4S)+off(~10%)} (140fb-1 : 1.52x108 BB pair

s)Super-KEKB(L > 1035 cm–2s–1 ) project has be

en prepared !!

KEKB ColliderKEK, Tsukuba-city,JAPAN

~350 scientists, 55 institutions, many nations

BELLE 2003 highlights

54 abstracts submitted to LP2003 (Fermilab)CPV and Beauty related time-dependent CP measurements

o update of BJ/KS (1)o with BJ/), D*+KS(1)

new method for 3 : Dalitz plot analysiso BD0K+ {D0KS -}

evidence/observationo BK(*)l+l-, , D+D-,

Charm related new processes/particles

o new excited DS+ states

o new charmoniumo first radiative: D0

different of CP lifetime in D0 (yCP)

BELLE 2003 highlights

S

S

KB

KJB

→

→0

11.009.0

1

01

50.096.02sin

/028.0057.0733.02sin

First Indication of Beyond Standard Model in quark sectorSee more detail at http://belle.kek.jp

140 fb-1

Theoretically cleanest example:

In the absence of New Physics, S= sin21

BELLE analysis framework

The only framework for all processing stages (from DAQ to final analysis)Event parallelism on SMP (1995~) Using fork (for legacy Fortran common blocks)

Event parallelism on multi-compute servers (dbasf, 2001~)User analysis code/reconstruction code are dynamically loaded.

= BASF =

Data storage : 0.5 ~ 3PB Raw Data : ~200trig*50KB*240days ~200TB DST,MDST,MC(x10MDST) Data

CPU speed : few ~ 20 TFLOTS DST/Skim (re-)processing, MC prod., Physics analyses 47 4CPU 500MHz Sparc (Solaris2.7) History of PC-farm (Linux RH7.3) CPU increment

’99/06: 16 4CPU 500MHz Pen III ’00/04: 20 4CPU 550MHz Pen III ’00/10: 20 2CPU 800MHz Pen III ’00/10: 20 2CPU 933MHz Pen III ’01/03: 60 4CPU 700MHz Pen III ’02/01: 127 2CPU 1.26GHz Pen III ’02/12: 113 2CPU Athlon 2000 ’03/03: 84 2CPU 2.8GHz Pen IV

Hard to manage the needs of over-capacity How to slove in the future Grid project !!

BELLE Computing Needs

0

400

800

1200

1600

Ldt

Computing resource

Status of BELLE Data Grid

BELLE is now working with several research groups on Data Grid.Austrelia/Korea Groupswhoelse??For research purpose onlyEventually for us to use the vast resource on computers outside BELLE, we may distribute our data.

Computing for KorBelle Data Grid

Data processing resource @KNU Computing node : 10 2CPU 1.7GHz AMD Batch job server : 1 2CPU 1.7GHz AMD

Data storage : 5 TB @KNUOS/c++ : RedHat 7.3 w/ gcc3.0.4Latest Belle library version(20030716)Batch job system : OpenPBS-2.3KorBelle PC cluster software Job distribution system developed by jhkim@SKKU

Other KorBelle institutions have own resources. SKKU : 550GB Raid storage & 4 2CPU 1GHz Pen III

Job Distribution System

Purpose Fast run time MC prod. factory HEP Data Grid R&D

KorBELLE PC cluster Based on gcc3.0.4 All nodes have BASF cod

e & Linux/Globus V1.0/V2.0

KorBELLE PC cluster V2.0

QQ(EvtGen)

GEANT (DetSim)

Skim Analysis

QQConfig

QQProcess

Node01

RUNConfig

RUNProcess

Node02 Node03 Node04

Batch Job System

KNU Data Storage (Real/MC data)

Belle-lib server(BASF)

KorBELLE PC cluster test

200K MC events BJ/KS decays

Several distributions were compared with different situation. mass, momentum, etc

The cluster run-time ~1/N * single node

KorBELLE JDS works fine.

J/ mass distribution

KorBELLE Data Grid

Globus Toolkit v2.2 has been adopted. Belle-lib(BASF) has been performed with it. Gsim event display test was successful. Linkage of JDS is under study.

CA (Certification Authority) Primitive CA is functional to allow accessing to GT.

Belle-lib(BASF) server

users job

Job Distribution System

Batch Job System

NODES

Globus Toolkit

Gsim event display under GT

1. Script for CA to access GT environment

2. Interactive executable under GT env.

1

2

BASF outputs

KorBELLE Data Grid

Gridbus project @Melbourne

Australian group has been working on Grid prototype

for Belle physics analyses.

Summary & Plan

BELLE starts thinking of Data Grid as official.Austrelia/Korea group have been involved in it.KorBELLE JDS has been established for it.We have adopted GT v2.2 for the testbed.Grid-base GUI software will be prepared for easy use/access.

KorBelle PC cluster V1.0

GbE Network : KNU-KEK

1Gbps