1 Grid2Win: porting of gLite middleware to Windows Dario Russo INFN Catania ([email protected])

1

Grid2Win: porting of gLite Grid2Win: porting of gLite middleware to Windowsmiddleware to Windows

Dario Russo Dario Russo INFN CataniaINFN Catania

([email protected])([email protected])

OverviewOverview

Job Workflow in gLite

gLite Porting on Windows

Grid2Win crossplatform GUI

Computing Farms on Windows

MS-CCS video running gLite jobs

Next Steps

Job Workflow in gLite

gLite Porting on Windows

Grid2Win crossplatform GUI

Computing Farms on Windows

MS-CCS video running gLite jobs

Next Steps

Job Workflow in gLiteJob Workflow in gLite

WMProxyUser

Interface

Computing Element

Information Index

Logging & Bookkeeping

Job

sub

mit e

ven

t

Authentication & authirization

(GSI)

Input Sandbox

Output Sandbox

Publish

Storage Element

Logical File Catalogue

Ou

tpu

t S

an

db

ox

Inp

ut

Sa

nd

bo

x

Grid files info

Computing power

Grid Terminal

User Interaface

LRMS

Gatekeeper

Grid Infrastructure

Site administration

Worker Nodes

WMProxy

Local user

Grid userUser Interaface

LRMS

Gatekeeper

Grid Infrastructure

Site administration

Worker Nodes

WMProxy

Local user

Grid user

More on Computing Elements (CE)More on Computing Elements (CE)Computing Element

Service oriented

Local Resource Manager (LRMS)

It is NOT a Grid component

Local administration

Dispatches job across Worker Nodes

Accessed by local users

Faces computing power to the grid

Gatekeeper

Access point of the CE

Manages one or more job queues

Wraps the LRMS

Worker Nodes

More than one (cluster)

Execute both local and grid jobs

Computing Element

Service oriented

Local Resource Manager (LRMS)

It is NOT a Grid component

Local administration

Dispatches job across Worker Nodes

Accessed by local users

Faces computing power to the grid

Gatekeeper

Access point of the CE

Manages one or more job queues

Wraps the LRMS

Worker Nodes

More than one (cluster)

Execute both local and grid jobs

To execute grid jobs, a specific

environment must be set

GoalsGoalsgLite on Linux

Grid users use the gLite middleware from Linux-based User Interfaces via CLI

(almost) All gLite resources are Linux-based

This impliesGrid users need to be trained

Only Linux-based applications can be deployed onto the Grid

Porting of gLite to WindowsUser Interface

Computing Element (farm)

gLite on LinuxGrid users use the gLite middleware from Linux-based User Interfaces via CLI

(almost) All gLite resources are Linux-based

This impliesGrid users need to be trained

Only Linux-based applications can be deployed onto the Grid

Porting of gLite to WindowsUser Interface

Computing Element (farm)

Gatekeeper + LRMS

User Interface

Linux WNs

WMProxy

User Interface

WindowsXP Wns

new users come in to the grid !

windows applications can run on the grid !

gLite porting on WindowsgLite porting on WindowsUser Interface

Client toolsGrid Security Infrastructue (GSI)

Workload Management Service (WMS)

Logging and Bookkeeping (L&B)

Data Management Service (DMS)

Information System (BDII)

Grid2Win Graphical User Interface

Computing ElementMonitoring

Grid Resource Information Index (GRIS) server

Torque/MAUI (PBS)Linux head node

Windows XP Worker Nodes

Microsoft Compute Cluster Server (CCS)Linux auxiliary node

Windows XP CCS farm

User InterfaceClient tools

Grid Security Infrastructue (GSI)

Workload Management Service (WMS)

Logging and Bookkeeping (L&B)

Data Management Service (DMS)

Information System (BDII)

Grid2Win Graphical User Interface

Computing ElementMonitoring

Grid Resource Information Index (GRIS) server

Torque/MAUI (PBS)Linux head node

Windows XP Worker Nodes

Microsoft Compute Cluster Server (CCS)Linux auxiliary node

Windows XP CCS farm

Done !!!

Done !!!

Prototyped !!!

Done !!!

Grid2Win GUI PrototypeGrid2Win GUI PrototypeGrid2Win GUI

wxWindowsCross platformOpen sourceIndipendent of underlying CLIInstaller 11Mbytes (including the cygwin DLL)

gLite Command Line Interface

Recompiled via Cygwin tools under Windows XP

CygwinEmulates POSIX environment on WindowsOnly the Cygwin DLL must be installed

Grid2Win GUIwxWindowsCross platformOpen sourceIndipendent of underlying CLIInstaller 11Mbytes (including the cygwin DLL)

gLite Command Line Interface

Recompiled via Cygwin tools under Windows XP

CygwinEmulates POSIX environment on WindowsOnly the Cygwin DLL must be installed

LinuxWinXP

ygwin

gLite CLI gLite CLI

Win2Grid GUIPlatform independent

Grid2Win GUI snapshots (1/5)Grid2Win GUI snapshots (1/5)

GSI credentialsAuto detection of the validity of the stored proxyGeneration of a new proxy via the insertion of the passphraseVirtual Organization Membership Service (VOMS) extensions support

GSI credentialsAuto detection of the validity of the stored proxyGeneration of a new proxy via the insertion of the passphraseVirtual Organization Membership Service (VOMS) extensions support


File Catalogue

browsing !!!Local file system explorer

Grid File Catalogue

explorer (LFC)

You can navigate the remote Grid File Catalogue as it was local !!!


You can copy and paste a file from the local explorer to the catalogue browser and viceversa. Drag & drop is under development.

Upload/download of files to/from grid


Job Management

A job is submitted just by double-clicking

You can check job status and download job’s output just by double-clicking on the Job Identifier !!!


Information Index (BDII) Navigation

You can navigate the remote Information Index (BDII) as you navigate any other local information trees !!!

Porting PBS based CE to Windows XPPorting PBS based CE to Windows XP

Computing Element (CE)Scientific LinuxPBS server

Worker Nodes (WNs)MS Windows XPPBS momgLite clientsauto-installer provided!

Computing Element (CE)Scientific LinuxPBS server

Worker Nodes (WNs)MS Windows XPPBS momgLite clientsauto-installer provided!

gLite CLI

WinXP

Cygwin

PBS

job run

Gatekeeper

PBS

CE on PBS

WinXP WNs

WMProxy

Integrating CCS into gLite CEIntegrating CCS into gLite CE

CCSMicrosoft CCS farm with a head node an more worker nodes

Auxiliary NodesGlobus Gatekeeper (Linux)

Service interface to the grid

CCSJob Client ServerTo put in communication the Gatekeeper (Linux) with the CCS head node (Windows)

To call CCS primitives

SSL channel

CCSMicrosoft CCS farm with a head node an more worker nodes

Auxiliary NodesGlobus Gatekeeper (Linux)

Service interface to the grid

CCSJob Client ServerTo put in communication the Gatekeeper (Linux) with the CCS head node (Windows)

To call CCS primitives

SSL channel

Gatekeeper

CCSJobClient

CCSJobServer

CCS head node

WinXP x64

WNs

Auxiliary node

CCS Farm

CCS primitives tunnelling

MS-CCS running jobs ClipMS-CCS running jobs Clip

gLite site publishing windowsgLite site publishing windows

Next stepsNext steps

Grid2WinRefactoring of some pieces of the codeAdding many featuresIntegrating a JDL editor currently under developmentIntegrating CCS GUI for direct submissions

CCS based CEMerging LCG CE (linux) and CCS HeadNode (windows) by porting the Gatekeeper to Windows XPUsing Windows POSIX subsystem instead of CygwinRunning MPI-2 jobs on CCS

Grid2WinRefactoring of some pieces of the codeAdding many featuresIntegrating a JDL editor currently under developmentIntegrating CCS GUI for direct submissions

CCS based CEMerging LCG CE (linux) and CCS HeadNode (windows) by porting the Gatekeeper to Windows XPUsing Windows POSIX subsystem instead of CygwinRunning MPI-2 jobs on CCS

ReferencesReferences

• The Grid2Win project Homepagehttp://jessica.trigrid.it/grid2win

• The Grid Group of INFN-Catania Homepagehttp://grid.ct.infn.it

• CCS HeadNode DemoDownload a live demo of a CCS headnode executing a gLite job(Camtasia player) or (TSCC Codec)

• The Cygwin Homepagehttp://www.cygwin.org

• The gLite middleware Homepagehttp://www.glite.org

1 Grid2Win: porting of gLite middleware to Windows Dario Russo INFN Catania ([email protected])

Documents

Transcript of 1 Grid2Win: porting of gLite middleware to Windows Dario Russo INFN Catania ([email protected])