Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data...
Transcript of Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data...
![Page 1: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/1.jpg)
Ruggero Tonelli - DataOps Barcelona 2019
![Page 2: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/2.jpg)
Ruggero Tonelli - DataOps Barcelona 2019
![Page 3: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/3.jpg)
Ruggero Tonelli - DataOps Barcelona 2019
![Page 4: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/4.jpg)
![Page 5: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/5.jpg)
5
![Page 6: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/6.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
ArangoDB
ClickHousePostgreSQLAeroSpike
MySQL MongoDB
6
TiDB
![Page 7: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/7.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
ClickHouse is faster than MySQL in OLAP
7
PostgreSQL is faster!!!
Our workload is OLTP!!!
MySQL handles everything
MongoDB can do SQL!
Aurora is better!
![Page 8: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/8.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
RUN A BENCHMARK !!!
8
please?..
![Page 9: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/9.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
9
Shouldn't we get all the requirements, constraints and restrictions before even start?
Do we know what’s the expected load and performance?
![Page 10: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/10.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
10
So… are you telling me that choosing a DB is not about faith, dogmas or bullying the others?
...we should run Vitesse!
![Page 11: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/11.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
11
Humans are so boring… the correct answer is ORA * * E, always!
![Page 12: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/12.jpg)
Of requirements, constraints and restrictions
![Page 13: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/13.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
Of requirements, constraints and restrictions
# Budget
13
# Time to Market, MVP or PoC
# Internal know-how
# Coding languages (support maturity)
![Page 14: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/14.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
Of requirements, constraints and restrictions
# Paid support
14
# Adoption level (maturity)
# Software licensing
# Workload types
![Page 15: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/15.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
Of requirements, constraints and restrictions
# Resiliency
15
# Scalability
# Performance
# Encryption at rest and on-the-fly
![Page 16: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/16.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
Of requirements, constraints and restrictions
# Vendor lock-in
16
# Mind the Cloud
# SW/HW “limitations”
# Eventual migration path
![Page 17: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/17.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
Of requirements, constraints and restrictions
# Ease of management
17
# Documentation
# Known users and specific cases
# Maturity ....did we say maturity enough?
![Page 18: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/18.jpg)
Benchmarking definition, criteria and tools
![Page 19: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/19.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
Benchmarking definition, criteria and tools
# Essential requirements for “experiments”
19
# Product’s best practices
# “Coding” your own (benchmark)
# Open Source benchmarks
![Page 20: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/20.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
Benchmarking definition, criteria and tools
# SysBench
20
# YCSB
# Your own workload
# Your peers connections
![Page 21: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/21.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
Benchmarking definition, criteria and tools
# Benchmarks you find in the Internet
21
# Researching “matching” issues
# Drawing your own conclusions
# Document processes and trade-offs
![Page 22: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/22.jpg)
Data Engineering and Experience
![Page 23: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/23.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
Data Engineering and Experience
# Know your enemies or RTFM
23
# Capacity planning & forecasting
# Think BIG
# Monitoring and Observability
# Plan for the worst
![Page 24: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/24.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
Data Engineering and Experience
# Polyglot Persistence
24
# Multi-model DBs
# Data integration
# Multiverse databases!
![Page 25: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/25.jpg)
![Page 26: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/26.jpg)
@ru
gger
oto
nel
li -
Dat
aOp
s 20
19
Recap
Requirements and restriction are not that hard.
Benchmarking is difficult, you better have an objective and consistent results.
Reaching consensus on choosing a DB Engine is better when you have numbers.
26
![Page 27: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/27.jpg)
Thank You@ruggerotonelli
![Page 28: Ruggero Tonelli - DataOps Barcelona 2019 · # Polyglot Persistence 24 # Multi-model DBs # Data integration # Multiverse databases! @ruggerotonelli - DataOps 2019 Recap Requirements](https://reader035.fdocument.pub/reader035/viewer/2022081611/5f02a7007e708231d40555a3/html5/thumbnails/28.jpg)
Q&A
Images
Page 1-3 1 2 3 R F
Page 6 - 11 Dilbert by Scott Adams