Neo4j - Rik Van Bruggen

34
Exploi’ng Big Data with Graphs Rik Van Bruggen Regional Director, Neo Technology @rvanbruggen

description

Slides from Rik Van Bruggen's talk on Exploiting Big Data with Graphs at the 18th Big Data London meetup.

Transcript of Neo4j - Rik Van Bruggen

Page 1: Neo4j - Rik Van Bruggen

Exploi'ng  Big  Data  with  Graphs  

Rik  Van  Bruggen  Regional  Director,  Neo  Technology  

@rvanbruggen  

Page 2: Neo4j - Rik Van Bruggen

Roadmap  

•  The  Rela'onal  Crossroads  •  The  NOSQL  answer  – The  volume  answer  – The  complexity  answer  

•  Exploi'ng  Complexity  with  Graphs  •  Ques'ons  /  Answers  

Page 3: Neo4j - Rik Van Bruggen
Page 4: Neo4j - Rik Van Bruggen
Page 5: Neo4j - Rik Van Bruggen

The    “Big  Data”  problem  

The    big    

“Data  Problem”  

Page 6: Neo4j - Rik Van Bruggen

NOT  ONLY  SQL  

Page 7: Neo4j - Rik Van Bruggen

The    “Big  Data”  problem  

Page 8: Neo4j - Rik Van Bruggen

hLp://www.flickr.com/photos/crazyneighborlady/355232758/  

Page 9: Neo4j - Rik Van Bruggen

hLp://gallery.nen.gov.uk/image82582-­‐.html  

Page 10: Neo4j - Rik Van Bruggen

hLp://www.xtranormal.com/watch/6995033/mongo-­‐db-­‐is-­‐web-­‐scale  

Page 11: Neo4j - Rik Van Bruggen

Large  amounts  of  simple  data  

Page 12: Neo4j - Rik Van Bruggen

Aggregate-­‐Oriented  Data  hLp://mar'nfowler.com/bliki/AggregateOrientedDatabase.html  

“There is a significant downside - the whole approach works really well when data access is aligned with the aggregates, but what if you want to look at the data in a different way? Order entry naturally stores orders as aggregates, but analyzing product sales cuts across the aggregate structure. The advantage of not using an aggregate structure in the database is that it allows you to slice and dice your data different ways for different audiences. This is why aggregate-oriented stores talk so much about map-reduce.”

Page 13: Neo4j - Rik Van Bruggen

BUT  HOW  TO  EXPLOIT    BIG  DATA    in  the  face  of  

COMPLEXITY?  

Page 14: Neo4j - Rik Van Bruggen

The    big    

“Data  Problem”  

Page 15: Neo4j - Rik Van Bruggen

complexity = f(size, connectedness, variability)

Page 16: Neo4j - Rik Van Bruggen
Page 17: Neo4j - Rik Van Bruggen

hLp://en.wikipedia.org/wiki/File:Leonhard_Euler_2.jpg  

Meet  Leonhard  Euler  •  Swiss  mathema'cian  •  Inventor  of  Graph  Theory  (1736)  

Page 18: Neo4j - Rik Van Bruggen

Königsberg  (Prussia)  -­‐  1736  

Page 19: Neo4j - Rik Van Bruggen

A  

B  

D  

C  

Page 20: Neo4j - Rik Van Bruggen

A  

B  

D  

C  

1"

2"

3"

4"

7"

6"

5"

Page 21: Neo4j - Rik Van Bruggen

hLp://www.bbc.co.uk/london/travel/downloads/tube_map.html  

Page 22: Neo4j - Rik Van Bruggen

Property  graphs  

•  Property  graph  model:  – Nodes  with  proper'es  – Named,  directed  rela'onships  with  proper'es  – Rela'onships  have  exactly  one  start  and  end  node  

• Which  may  be  the  same  node  

Page 23: Neo4j - Rik Van Bruggen

Property  Graph  Model  

Page 24: Neo4j - Rik Van Bruggen

Property  graphs  are  very  whiteboard-­‐friendly  

Page 25: Neo4j - Rik Van Bruggen

Exploi'ng  data:    

Cypher  query  language  •  Declara've  graph  paLern  matching  language  – “SQL  for  graphs”  – Columnar  results  

•  Supports  graph  matching  commands  and  queries  – Find  me  stuff  like  this…  – Aggrega'on,  ordering  and  limit,  etc.  

Page 26: Neo4j - Rik Van Bruggen

Matching  paLerns  

Page 27: Neo4j - Rik Van Bruggen

Pathfinding  

Page 28: Neo4j - Rik Van Bruggen

Logis'cs  

Page 29: Neo4j - Rik Van Bruggen

En'tlements  

Page 30: Neo4j - Rik Van Bruggen

Impact  

Page 31: Neo4j - Rik Van Bruggen

BIG  INSIGHTS  FROM    COMPLEX  DATA  

Page 32: Neo4j - Rik Van Bruggen

The    “Big  Data”  problem  

The    big    

“Data  Problem”  

Page 33: Neo4j - Rik Van Bruggen

Free  O’Reilly  eBook!  

Visit:  hLp://GraphDatabases.com  

 

Ian Robinson, Jim Webber & Emil Eifrem

Graph Databases

h

Compliments

of Neo Technology

Page 34: Neo4j - Rik Van Bruggen

Thanks  for  listening  Neo4j:  hIp://neo4j.org  Me:  @rvanbruggen  ,  rik[at]neotechnology[dot]com