8/9/2019 Satya Priya
1/27
8/9/2019 Satya Priya
2/27
Problem
Lack of uniform and friendly accessibility fromany location within secure networktopologies to utilize the high performance
computing resources efficiently
8/9/2019 Satya Priya
3/27
Solution
Construct complex scripts which chain
together multiple applications withslow I/O-bound file system interfaces
8/9/2019 Satya Priya
4/27
Web Services and IntegratedTechnologies for Large Scale Dataservices
Presented by:
Satya Priya Patnala
8/9/2019 Satya Priya
5/27
About the paper. . .
Integrating Web Service and Grid Enabling Technologies to ProvideDesktop Access to High-Performance Cluster-Based Components forLarge-Scale Data Services byVictor P. Holmes, Wilbur R.Johnson, David J. Miller atSandia National Laboratories
8/9/2019 Satya Priya
6/27
Goal Of The Authors
Web services technologyWeb services technology
Grid enabling softwareGrid enabling software
Component framework for parallel computingComponent framework for parallel computing
Service Oriented ArchitectureService Oriented Architecture
8/9/2019 Satya Priya
7/27
Birds eye view . . .
Web
Services
Grid Technology
Data Services
8/9/2019 Satya Priya
8/27
Web Services
8/9/2019 Satya Priya
9/27
Web Services
Definition:Aweb service is an application or application
component accessible on the web and intendedfor use by another application a client application
8/9/2019 Satya Priya
10/27
Web Services HTTP protocol acts as the base for the running
of web services
Use XML as a standard language They follow a set of standardized rules and
specifications, making it more portable
Unique from CORBA, RMI,COM
Eureka No learning Curve !!!!!
8/9/2019 Satya Priya
11/27
Web Services
Component Technology
Web services provide a set of XML-based protocols andprocesses for service discovery (UDDI), description(WSDL), and interaction (SOAP).
In general, we can say
SOAP + UDDI + WSDL = Web Services
8/9/2019 Satya Priya
12/27
Component Technology in Web
Services
SOAP (Simple Object Access Protocol) Sendsmessage across different modules
UDDI (Universal Description, Discovery andIntegration) is the global lookup for locating theservices
WSDL (Web Service Definition Language)method through which different services aredescribed
8/9/2019 Satya Priya
13/27
Grid Technologies According to Gartner AGrid is a collection
of resources owned by multiple organizations
which are coordinated to allow them to solvea common problem
To provide a rich set of Data Services,
common grid environments arebeginning to accommodate dataintensive, application-specific, needs
8/9/2019 Satya Priya
14/27
Grid Technologies Grid services provides access to
distributed resources, such as a high-
performance computing cluster forexecution of individual Data Services, in amanner that is independent of theapplications or computing systems being
utilized.
8/9/2019 Satya Priya
15/27
Grid Technologies Any application that wishes to use grid services does so by
submitting one or more workflow definitions to a workflowmanager service that knows how to:
Locate and construct a request specific to a resource.
Discover what services are available on a resource.
Construct a request for a service on a resource.
Reliably manage one or more requests once it has beensubmitted.
Transfer data between resources in a single request.
8/9/2019 Satya Priya
16/27
Data ServicesData Services = Web services + Grid Services
Transform large data sets to visualize criticaldata areas within large simulation outputs
Take very large data sets as input andreduce them to produce data sets that aresmaller
8/9/2019 Satya Priya
17/27
Data Services
Parallel processing services which sharedata objects in memory and minimizedisk I/O
Common thread among users = intranet
8/9/2019 Satya Priya
18/27
Data Services
8/9/2019 Satya Priya
19/27
Component Framework for High
Performance Cluster Based Data Services
Common ComponentArchitecture
Services on the cluster are implemented asCCA components
One component = Data Service algorithm
8/9/2019 Satya Priya
20/27
Ccaffeine Framework Common ComponentArchitectures existing
framework is Ccaffeine
Ccaffeine consists of - Command line controller
Muxer
Framework itself
8/9/2019 Satya Priya
21/27
Ccaffeine Framework Command line controller Accepts
commands on standard input and passes
them to the muxer Muxer- provide a mechanism for fanning out
the commands to each of the computenodes associated with a particular parallelrun of the framework
Framework on the whole
8/9/2019 Satya Priya
22/27
WSDL (Web Service Description Languages )
Uses XML document for describing webservices
Basic Elements Data description
Abstract interface definitions
Binding to actual implementations
8/9/2019 Satya Priya
23/27
Elements In Network Definition
Types a container for data type definitions usingsome type system (such as XSD).
Message an abstract, typed definition of the data
being communicated. Operation an abstract description of an action
supported by the service. Port Typean abstract set of operations supported
by one or more endpoints. Binding a concrete protocol and data format
specification for a particular port type. Port a single endpoint defined as a combination of
a binding and a network address. Service a collection of related endpoints
8/9/2019 Satya Priya
24/27
Data Service for large scale data
manipulation and visualization
8/9/2019 Satya Priya
25/27
End Results To provide end users the ability to
manage and understandsimulation results from very largecomplex problems
Integration of hardware andsoftware components to supportlarge scale simulations to analysis
and ensure safety and reliability ofthe nations nuclear weaponstockpile
8/9/2019 Satya Priya
26/27
Future Work To populate the suite of Data Services
demanded by the end users
To augment the architecture for multiplecluster deployment, fault tolerance andmulti-site access
8/9/2019 Satya Priya
27/27
Thank you