Splunk*&*the*DevOps* KnowledgeCyclein* …of*experience*to*guide* ... (local,*int, qa,*stage)*! ......
Transcript of Splunk*&*the*DevOps* KnowledgeCyclein* …of*experience*to*guide* ... (local,*int, qa,*stage)*! ......
Copyright © 2014 Splunk Inc.
Jim Nichols Cloud Architect, EnerNOC
Splunk & the DevOps Knowledge Cycle in Energy Intelligence
Disclaimer
2
During the course of this presentaIon, we may make forward-‐looking statements regarding future events or the expected performance of the company. We cauIon you that such statements reflect our current expectaIons and
esImates based on factors currently known to us and that actual events or results could differ materially. For important factors that may cause actual results to differ from those contained in our forward-‐looking statements,
please review our filings with the SEC. The forward-‐looking statements made in the this presentaIon are being made as of the Ime and date of its live presentaIon. If reviewed aSer its live presentaIon, this presentaIon may not contain current or accurate informaIon. We do not assume any obligaIon to update any forward-‐looking statements we may make. In addiIon, any informaIon about our roadmap outlines our general product direcIon and is subject to change at any Ime without noIce. It is for informaIonal purposes only, and shall not be incorporated into any contract or other commitment. Splunk undertakes no obligaIon either to develop the features or funcIonality described or to
include any such feature or funcIonality in a future release.
Agenda
! About presenter and EnerNOC ! EnerNOC DevOps ! Splunk and the DevOps Knowledge Cycle ! Q and A (15 minutes) ! Next Steps
3
Jim Nichols joined EnerNOC shortly aSer the company’s IPO in 2007. StarIng as a performance engineer, his first task was to insure stability and performance of the company’s newly created
Energy InformaIon System. Moving into the Enterprise Architect role in 2009, he led the technology team in the development of mission criIcal, fault tolerant, highly available, and scalable systems to support the company’s exponenIal growth, starIng with 3 servers monitoring ~500 energy sensors deployed around New England in 2007, to hundreds of servers managing 30,000+ sensors worldwide today. With the large scale and diversity of the systems under management, he has constantly sought, purchased and deployed the best tools for managing performance, change
configuraIon and logs/operaIonal data. While at EnerNOC, he established the Performance Engineering and ProducIon OperaIons teams. His current assignment is to establish a CloudOps
team to standardize process, streamline, and enhance operaIons in the cloud. He has been using Splunk since 2011.
Updated 8.2014 5
Presenter Bio
EnerNOC at a Glance ! A leading provider of SaaS-‐based Energy Intelligence SoSware (EIS) and related soluIons
! Market leading posiIon in demand response (DR) fuels negaIve customer acquisiIon costs
! Serves ~6,000 uIlity, grid operator, and enterprise customers
! Global company (over 1,000 employees in more than a dozen countries) with headquarters in Boston, MA
$278
$383
2012 2013
Revenue Growth of 38% YoY $ in Millions
6
We Are a Global Company
Conduct business in 100+ countries
Support 15 languages
Manage one million bills annually
Worldwide currencies and measurements
7
More than 30,000 sites and devices are streaming real-‐Ime energy data into EnerNOC’s energy intelligence soSware plakorm
Over 6,000 companies globally rely on EnerNOC to drive energy savings
Increase Use of Enterprise Energy Intelligence SoSware EnerNOC is transforming energy management across industries
Demonstrated experMse trusted by the largest companies in the world:
8
UIlity and Grid Operator Partnerships EnerNOC has extensive experIse working with uIliIes and grid operators globally
Our uMlity partners include:
We also operate in wholesale markets:
9
Knowledge Sharing
! As an energy company, we really like to measure things – Staff of HVAC experts with
decades of experience to guide what to measure (air flow, temperature inside and out)
– Data science – As needed based on customer
needs
! As a technology company, we really like to measure things – Performance engineers,
architects and developers with years of experience to guide what to measure
– Data science – As needed based on what Ops
needs
Directly between teams, feedback loops, measurements
13
Shared Metrics ! # of readings processed per second, minute, hour, month, year (billions and billions)
! # of logins ! How many users are using feature xyz? ! Everything and anything about caching, replicaIon queue size, retransmission rates
! # of errors or problems of varying types that only appear in the log ! # of errors for external cloud services (CRM, others) ! Performance measured at every level: ApplicaIon, Web Layer, Network, Infrastructure
14
Before Splunk
! Slick emails with nice charts and Powerpoint ! Huge mysql databases ! Perl scripts to process log files, insert data ! Cron jobs ! Files being copied all over ! Ran out of disk one day…
“The Log Database”
15
Knowledge Lifecycle
16
Shared Dashboards ! Find the key metrics ! Put it on the dashboard ! Talk about it ! Metrics develop language ! Same dashboard between prod and staging
! Develop key alerts; playbooks for busy days
How we do it
Screenshot here
Summary
! Splunk data throughout the development lifecycle (local, int, qa, stage)
! Build monitoring dashboard as soon as possible ! Use the dashboards to communicate between operaIons and development
22
Next Steps
! Get in touch on LinkedIn – Jim Nichols at EnerNOC or email [email protected]
! DevOps group on LinkedIn ! etsy blog, highscalability.com ! Find us at the networking event
24
Special Offer: Try Splunk MINT Express for Free! Splunk MINT offers a fast path to mobile intelligence. How fast?
Find out with a 6-‐month trial*
• Register for your free trial: hyp://mint.splunk.com/conf2014offer
• Download the Splunk MINT SDKs • Add the Splunk MINT line of SDK code and publish**
• Start gezng digital intelligence at your fingerIps!
*Offer valid for .conf2014 a<endees and coworkers of a<endees only.
**Trial allows monitoring of up to 750,000 monthly acGve users (MAUs).
25