Grid Engine State of the Union
-
Upload
insidehpc -
Category
Technology
-
view
424 -
download
4
description
Transcript of Grid Engine State of the Union
Grid Engine “State of the Union”
Evolve Save money Get more value Accelerate
Who is Univa?
• Data Center Automa4on Experts • Based in Chicago, global reach • Dras4c growth Y/Y in 2011 & 2012
• # of customers, bookings, etc • Unique Posi4oning – Home of Grid Engine
• Sun Grid Engine core development team works for Univa • 4 of Top 5 Grid Engine sites by core counts • 4 of Top 5 Commercial Grid Engine sites • 4 of Top 7 Research Grid Engine sites • 2 of the Top Oil and Gas companies • Add-‐on products and technologies • Where Grid Engine evoluIon happens:
• 26 releases with close to 500 enhancements and fixes in 24 months
© Univa Corporation 2013. All Rights Reserved. 2
Grid Engine - 20 Years of History
• 1992: Initial developments @ Genias in Regensburg • 1993: First Customer Shipment (as CODINE) • 1996: Addition of GRD policy module
• Collaboration with Raytheon & Instrumental Inc • 1999: Merger with Chord Systems into Gridware • 2000: Acquisition through Sun
• Re-launch as Sun Grid Engine • 2001: Open Sourcing • Until 2010: Massive growth in adoption (>10,000 sites) • 2010: Acquisition through Oracle
• Open Source gets orphaned • 2011: Key engineering team joins Univa • Now: 3rd product release of Univa Grid Engine
3 © Univa Corporation 2013. All Rights Reserved.
Situation
• In 2010 Oracle changed the game • Gone are the days - subsidy from a multi-billion company
• Development in the open • Features • Support • Bug fixes • Qualified binaries
• Choice remains • Stay with open source • Evolve forward
4 © Univa Corporation 2013. All Rights Reserved.
Grid Engine: Paid Development
97%
3%
Sun Grid Engine Code Contributions
(check-ins since day 1 in 2001) Sun
The community offered configuration and “how to” support. It was not a development oriented community
97% of Sun Grid Engine checkins were contributed by Sun. Those contributions ceased in 2010 with 6.2u5 The core development team now works for Univa.
Time
Open Source Grid Engine
Univa Grid Engine
6.2U5 8.0
8.0.1
8.1
We cannot predict the slope of this line. The past can help predict the future.
Future?
Jan 2011 May 2011 Oct, 2011 Aug, 2012
Line
s of
Cod
e C
hang
ed
Salaried Developers
5 © Univa Corporation 2013. All Rights Reserved.
Single largest contribution to open source outside of Sun by Univa. 20x larger than all combined 2001-2010.
Optimizes Resources Help organizations play a
better game of Tetris
• Univa provides Grid Engine users with • Active development of Grid
Engine features • Active Technical Support • Third party integrations • Add-on products that increase the
value of existing systems • Univa leads Scalability
• Support large cluster capacity with customers above 100,000 cores
• Univa offers Training • Offer user and admin training to
customers • Univa has partnered with leading HPC
hardware and software companies • Univa leads the industry in Hadoop +
Grid Engine deployments • 5 customers in production with Cloudera and
Univa
Univa Grid Engine
“[Univa] Grid Engine certainly allows us to go live with a new component called Aggregator on Hadoop without a major investment. If we didn't have [Univa] Grid Engine, it would be a major investment to go live on Hadoop because we would have to build a new cluster and incur all the costs around that.”
- Katrina Montinola, VP Engineering, Archimedes Model 6
Accomplishments:
• We lead the HPC industry in delivery and execution • Significant investment in support of customer needs • Feature Evolution - Targeted at saving time and money
• Three production release of Grid Engine in a year • >25 production patch releases • Approximately 450 improvements to Grid Engine
• Product Evolution - Targeted at improving TCO of Grid Engine
• Delivered advanced reporting – UniSight • Cluster analytics
• About to release License Orchestrator • Optimizes expensive application licenses
• UniCloud • Optimizes the availability of local and cloud servers needed to
support application workload
“There is little competition for Univa's Grid Engine business strategy. It knows its target customer base (which is very well qualified), makes its pitch (by phone), and either takes an order or walks away.” John Barr, The 451 Group
7 © Univa Corporation 2013. All Rights Reserved.
Customer Traction
Market Leading Workflow Management Sample Wins – 82% Revenue from Enterprise
© Univa Corporation 2013. All Rights Reserved. 8
What Univa Offers Grid Engine Users • Univa Grid Engine Customer Program
• Univa Grid Engine is a drop in replacement for Sun and Oracle Grid Engine users
• Migration is an upgrade • Technical Support from experienced team
• What you need when you need it • Security and maintenance patches
• Hot fixes, configuration help, tuning guidance • Continued Product Development
• New, ground-breaking features and improvements – Examples: Hadoop Integration, Job Classes
• Support for new hardware (GPU, Phi, ARM) and Operating Systems • Access to add-on products - Example: UniSight • Access to improved documentation
• New Products • UniCloud • License Orchestrator • Native Windows implementation
• Indemnification from open source technologies used in Grid Engine 9 © Univa Corporation 2013. All Rights Reserved.
Feature How
Job Classes ✔ ✔ ✔ Templates providing ease of use, control and best fit
Resource Maps ✔ ✔ OpImal mapping of resources to jobs Core / NUMA Binding
✔ ✔ ✔ Tuned uIlizaIon of CPU and memory architectures
Database Spooling
✔ ✔ ✔ Increased upIme @ top performance
Fair Urgency ✔ ✔ Balanced uIlizaIon of criIcal resources
MPI IntegraIons ✔ ✔ ✔ Tuned, out-‐of-‐the-‐box integraIon with MPI versions
Improved DiagnosIcs
✔ ✔ Faster Ime to resoluIon of issues
Major 8.1 Features & Benefits
10 © Univa Corporation 2013. All Rights Reserved.
• Univa Grid Engine 8.1 released in Aug 2012 • Current: v8.1.3 (Nov ‘12) - Planned: 8.1.4 (April ’13)
Evolve with Univa
• Lower TCO with our innovative new features • Improved value is delivered with our new products for
Grid Engine sites • Global enterprise support when and where you need it • Peace of mind: Univa Grid Engine is an upgrade
11 © Univa Corporation 2013. All Rights Reserved.
Thank You
For more information check out http://www.univa.com Or contact me at [email protected] Watch out for more insideHPC Slidecasts to follow-on topics like • Univa enabling Big Data and Big Compute conversion • Resource management challenges in light of HPC architecture evolution and
Univa‘s solutions • Univa‘s advanced license management (cross-org, cross-geo) • Univa Grid Engine feature specifics