Splunk*&*the*DevOps* KnowledgeCyclein* …of*experience*to*guide* ... (local,*int, qa,*stage)*! ......

26
Copyright © 2014 Splunk Inc. Jim Nichols Cloud Architect, EnerNOC Splunk & the DevOps Knowledge Cycle in Energy Intelligence

Transcript of Splunk*&*the*DevOps* KnowledgeCyclein* …of*experience*to*guide* ... (local,*int, qa,*stage)*! ......

Copyright  ©  2014  Splunk  Inc.  

Jim  Nichols  Cloud  Architect,  EnerNOC  

Splunk  &  the  DevOps  Knowledge  Cycle  in  Energy  Intelligence    

Disclaimer  

2  

During  the  course  of  this  presentaIon,  we  may  make  forward-­‐looking  statements  regarding  future  events  or  the  expected  performance  of  the  company.  We  cauIon  you  that  such  statements  reflect  our  current  expectaIons  and  

esImates  based  on  factors  currently  known  to  us  and  that  actual  events  or  results  could  differ  materially.  For  important  factors  that  may  cause  actual  results  to  differ  from  those  contained  in  our  forward-­‐looking  statements,  

please  review  our  filings  with  the  SEC.  The  forward-­‐looking  statements  made  in  the  this  presentaIon  are  being  made  as  of  the  Ime  and  date  of  its  live  presentaIon.  If  reviewed  aSer  its  live  presentaIon,  this  presentaIon  may  not  contain  current  or  accurate  informaIon.  We  do  not  assume  any  obligaIon  to  update  any  forward-­‐looking  statements  we  may  make.  In  addiIon,  any  informaIon  about  our  roadmap  outlines  our  general  product  direcIon  and  is  subject  to  change  at  any  Ime  without  noIce.  It  is  for  informaIonal  purposes  only,  and  shall  not  be  incorporated  into  any  contract  or  other  commitment.  Splunk  undertakes  no  obligaIon  either  to  develop  the  features  or  funcIonality  described  or  to  

include  any  such  feature  or  funcIonality  in  a  future  release.  

Agenda  

!   About  presenter  and  EnerNOC  !   EnerNOC  DevOps  !   Splunk  and  the  DevOps  Knowledge  Cycle  !   Q  and  A  (15  minutes)  !   Next  Steps  

3  

About  the  Presenter  

Jim  Nichols  joined  EnerNOC  shortly  aSer  the  company’s  IPO  in  2007.  StarIng  as  a  performance  engineer,  his  first  task  was  to  insure  stability  and  performance  of  the  company’s  newly  created  

Energy  InformaIon  System.    Moving  into  the  Enterprise  Architect  role  in  2009,  he  led  the  technology  team  in  the  development  of  mission  criIcal,  fault  tolerant,  highly  available,  and  scalable  systems  to  support  the  company’s  exponenIal  growth,  starIng  with  3  servers  monitoring  ~500  energy  sensors  deployed  around  New  England  in  2007,  to  hundreds  of  servers  managing  30,000+  sensors  worldwide  today.    With  the  large  scale  and  diversity  of  the  systems  under  management,  he  has  constantly  sought,  purchased  and  deployed  the  best  tools  for  managing  performance,  change  

configuraIon  and  logs/operaIonal  data.  While  at  EnerNOC,  he  established  the  Performance  Engineering  and  ProducIon  OperaIons  teams.    His  current  assignment  is  to  establish  a  CloudOps  

team  to  standardize  process,  streamline,  and  enhance  operaIons  in  the  cloud.    He  has  been  using  Splunk  since  2011.  

Updated  8.2014  5  

Presenter  Bio  

EnerNOC  at  a  Glance  !   A  leading  provider  of  SaaS-­‐based  Energy  Intelligence  SoSware  (EIS)  and  related  soluIons  

!   Market  leading  posiIon  in  demand  response  (DR)  fuels  negaIve  customer  acquisiIon  costs  

!   Serves  ~6,000  uIlity,  grid  operator,  and  enterprise  customers  

!   Global  company  (over  1,000  employees  in  more  than  a  dozen  countries)  with  headquarters  in  Boston,  MA  

$278  

$383  

2012   2013  

Revenue  Growth  of  38%  YoY  $  in  Millions  

6  

We  Are  a  Global  Company    

Conduct  business  in    100+  countries  

Support  15      languages    

Manage  one  million    bills  annually  

Worldwide  currencies    and  measurements  

7  

More  than  30,000  sites  and  devices  are  streaming  real-­‐Ime  energy  data  into  EnerNOC’s  energy  intelligence  soSware  plakorm  

Over  6,000  companies  globally  rely  on  EnerNOC  to  drive  energy  savings  

Increase  Use  of  Enterprise  Energy  Intelligence  SoSware  EnerNOC  is  transforming  energy  management  across  industries  

Demonstrated  experMse  trusted  by  the  largest  companies  in  the  world:  

8  

UIlity  and  Grid  Operator  Partnerships  EnerNOC  has  extensive  experIse  working  with  uIliIes  and  grid  operators  globally  

Our  uMlity  partners  include:  

We  also  operate  in  wholesale  markets:  

9  

EnerNOC’s  Approach  to  Energy  Intelligence  

Energy  Cost  Drivers  

10  

EnerNOC  DevOps  

What  is  DevOps?  

Knowledge  Sharing  

!   As  an  energy  company,  we  really  like  to  measure  things  –  Staff  of  HVAC  experts  with  

decades  of  experience  to  guide  what  to  measure  (air  flow,  temperature  inside  and  out)  

–  Data  science    –  As  needed  based  on  customer  

needs  

!   As  a  technology  company,  we  really  like  to  measure  things  –  Performance  engineers,  

architects  and  developers  with  years  of  experience  to  guide  what  to  measure  

–  Data  science  –  As  needed  based  on  what  Ops  

needs  

Directly  between  teams,  feedback  loops,  measurements  

13  

Shared  Metrics  !   #  of  readings  processed  per  second,  minute,  hour,  month,  year  (billions  and  billions)  

!   #  of  logins  !   How  many  users  are  using  feature  xyz?  !   Everything  and  anything  about  caching,  replicaIon  queue  size,  retransmission  rates  

!   #  of  errors  or  problems  of  varying  types  that  only  appear  in  the  log  !   #  of  errors  for  external  cloud  services  (CRM,  others)  !   Performance  measured  at  every  level:    ApplicaIon,  Web  Layer,  Network,  Infrastructure  

14  

Before  Splunk  

!   Slick  emails  with  nice  charts  and  Powerpoint  !   Huge  mysql  databases  !   Perl  scripts  to  process  log  files,  insert  data  ! Cron  jobs  !   Files  being  copied  all  over  !   Ran  out  of  disk  one  day…  

“The  Log  Database”  

15  

Knowledge  Lifecycle  

16  

Shared  Dashboards  !   Find  the  key  metrics  !   Put  it  on  the  dashboard  !   Talk  about  it  !   Metrics  develop  language  !   Same  dashboard  between  prod  and  staging  

!   Develop  key  alerts;  playbooks  for  busy  days  

How  we  do  it  

Screenshot  here  

17  

18  

19  

Demo  

Summary  &  Key  Takeaways  

Summary  

! Splunk  data  throughout  the  development  lifecycle    (local,  int,  qa,  stage)  

!   Build  monitoring  dashboard  as  soon  as  possible  !   Use  the  dashboards  to  communicate  between  operaIons  and  development  

22  

What’s  Next?    Breakout  Session?  Demo,  BoF?  Ask  the  Expert?  

Next  Steps  

!   Get  in  touch  on  LinkedIn  –  Jim  Nichols  at  EnerNOC  or  email  [email protected]  

! DevOps  group  on  LinkedIn  ! etsy  blog,  highscalability.com  !   Find  us  at  the  networking  event  

24  

Special  Offer:  Try  Splunk  MINT  Express  for  Free!  Splunk  MINT  offers  a  fast  path  to  mobile  intelligence.  How  fast?    

Find  out  with  a  6-­‐month  trial*  

•  Register  for  your  free  trial:  hyp://mint.splunk.com/conf2014offer  

•  Download  the  Splunk  MINT  SDKs  •  Add  the  Splunk  MINT  line  of  SDK  code  and  publish**    

•  Start  gezng  digital  intelligence  at  your  fingerIps!    

*Offer  valid  for  .conf2014  a<endees  and  coworkers  of  a<endees  only.  

**Trial  allows  monitoring  of  up  to  750,000  monthly  acGve  users  (MAUs).  

 

25  

THANK  YOU  

26