Empowering Your Software-Defined Transformation Bigtera.pdf · 2018-10-26 · satisfy all...

Copyright © 2015 Bigtera limited. All rights reserved. Proprietary and confidential. Do not distribute.

極存無限軟體定義組合未來

Bigtera – Leander Yu

Empowering Your Software-Defined Transformation

Storage Journey from SDDC, HCI to Composable Infrastructure

Software Defined Datacenter

What’s the SDDC About?

I need a datacenter with : • 6 servers(2 CPU, 10G

NICx2 2TB HDD) • 1G network with IP

address 192.168.x.x • 100TB SAN/NAS

storage

VM VM VM

VM VM VM

Issues that SDDC Want to Address

Current Situation – Hard to Scale Scale-Up

Performance

Disk I/O performance bottleneck as scale-up disk capacity

Performance Performance

Current Situation – Application Silo

1000 IOPS RAID 5 100 TB SAN

APP 3


1000 IOPS RAID 6 30 TB NAS

APP 2



APP 1


Different storage requirement from application create Storage Islands.

Current Situation – Complex Design for Durability

RAID 5

Backup

APP 1

Secondary Storage

Primary Storage

APP 2 APP 3

Datacenter 2 Datacenter 1

Remote Sync

Complex data durability design due to application requirement introduced more storage island and high OPEX

Customer's Behavior

• Purchase a new storage for a new application

• New application require a different storage requirement

• Storage type(NAS, SAN)

• Performance

• Durability

• Purchase a more powerful storage when existing workloads grow

• Require migrate data to new storage

• Cause service downtime

• Complex storage infrastructure management and design for SLA

• Different storage island and different availability design for each vendor

• Labor intensive for resource provisioning, workload changes and HW life cycle management

IT Challenge – Quick Response to Business demand

• Different Workload different storage requirement

• Performance

• Capacity

• Access protocols

• Recovery

• Future expansion

• ……

• Ends up building another storage for new workload demand

• Purchase new storage requires longer purchase process

IT Challenge - Time-consuming storage migration

● Costly array replacements

● Time-consuming data movement time

● Service down time for data migration

● Extra metadata/data migration server

New storage systems

Legacy storage systems

Metadata / Data

migration server

Applications server

IT Challenge – Storage Utilization

• In average, datacenters storage utilization are lower than 50%

Over half of the free capacity remains idle and unused, even while requisitions for new storage systems continue to be filled.

IT Challenge – Storage Management

• Current storage infrastructure are mixed with

• Various storage vendor

• Various storage type

• Various storage design

• Various storage with different performance

• Various storage management system

• Different age of storage

Hyper-converged Infrastructure

What is HCI

• Hyper-converged infrastructure (HCI) is a software-defined IT

infrastructure that virtualizes all of the elements of conventional

"hardware-defined" systems. HCI includes, at a minimum, virtualized

computing (a hypervisor), a virtualised SAN (software-defined

storage) and virtualized networking (software-defined networking).

Why HCI

• Agility

• Can I use the storage capacity on compute servers?

• Can I use the compute power from storages?

• More efficient to bring storage closer to application

• Reduce the network latency

• Disk is slow, the compute resource can be re-used

Problems of HCI

• Even storage is closed to application but cross server data protection

still introduce extra latency(network).

• Applications need a “external” share storage not only VM disks

• Applications require different type of storage and SLA

Software Composable Infrastructure

What is Software Composable Infrastructure

• In composable infrastructure, compute, storage, and networking

resources are abstracted from their physical locations, and can be

managed by software

Why SCI not HCI?

• Flash become affordable and it’s too fast that consume all CPU

resources to drive it

• What about network latency?

• RDMA, RoCE, iWAP

• 25G, 40G, 100G and 200G

• NVMeoF

• Network disk can runs almost the same with local disk

Challenge of SCI

• Applications require external share storage

• Block, file and object

• New architecture to replace legacy

• Workload that has different performance and SLA requirement

• SDS vendor lock-in

Bigtera VirtualStor™ Family Idea SDS for SCI

Bigtera VirtualStor™ Family

Name VirtualStor™ Scaler VirtualStor™ Converger

Picture

Disk types SATA, SAS, NL SAS, SSD SATA, SAS, NL SAS, SSD

Network Connections Dual 10Gb or Quad 10Gb 2x1Gb RJ45

Dual 10Gb or Quad 10Gb 2x1Gb RJ45

Data Protection RAID 1/5/6/10 Multiple replicas N+M Erasure coding

RAID 1/5/6/10 Multiple replicas N+M Erasure coding

Storage Protocols iSCSI/FC CIFS/NFS Amazon S3/Swift

iSCSI/FC CIFS/NFS Amazon S3/Swift

Storage pool

Utilize Every Resources

24

APP 3



APP 2



APP 1


Virtual Storage Device 1



Data Durability That Fits

• Realtime replication

• Cross-datacenter replication

• Software-defined durability

• Plug-n-play storage life cycle management

APP 1 APP 2 APP 3

Local EC N+2 Cross datacenter

EC N+1 2 replica

Other DC

A Software Composable Storage Infrastructure

NetApp NAS EMC SAN VirtualStor All-flash Array Hyper Converge

Legacy storage pool

Virtual Storage Device (SAN)

Virtual Storage Device

(Object)

Virtual Storage Device (NAS)

Database APP APP APP APP APP APP

Productivity applications

Backup & Archiving systems

Management systems

All flash + Hyper-converged + Legacy

A New Way of Scaling

Performance

VM VM VM VM

Scale out capacity and performance with heterogeneous storage

Bigtera’s Unique Technology

· Provides NAS, SAN, and Object storage to satisfy

mode of user applications needs

· Provides standard iSCSI, FC, NFS, CIFS. Compatible

with AWS S3, OpenStack Swift and Cinder RBD

Unify storage protocols

01

· High-performance backend storage

engine – BigteraStore

· Volume Snapshot, Volume Clone, Dedup and Compress

· Real-time data replication and asynchronized remote

replication. N+M Erasure coding.

Performance with Protection

02

· Logical and even physical data isolation between tenants · Tenants can use different gateways, IP addresses to access different storage resources · Can provide pools of performance classes for different tenants

Software composable

03

· Consolidate the empty spaces on existing storage

to build a new storage virtual pool

· Seamless migrate data on old storage, with almost

no down time

Consolidate and Migrate

04

Bigtera VirtualStor™ Extreme

Name VirtualStor™ Scaler VirtualStor™ Converger

Picture

Disk types SATA, SAS, NL SAS, SSD SATA, SAS, NL SAS, SSD

Network Connections Dual 10Gb or Quad 10Gb 2x1Gb RJ45

Dual 10Gb or Quad 10Gb 2x1Gb RJ45

Data Protection RAID 1/5/6/10 Multiple replicas N+M Erasure coding

RAID 1/5/6/10 Multiple replicas N+M Erasure coding

Storage Protocols iSCSI/FC CIFS/NFS Amazon S3/Swift


VirtualStor™ Extreme

SATA SSD

Dual 10Gb or Dual 25/40Gb

Multiple replicas N+M Erasure coding


Bigtera’s Unique Strength

• Provides NAS, SAN, and Object storage to

satisfy all applications needs

• Provides standard iSCSI, FC, NFS, CIFS.

Compatible with AWS S3, OpenStack

Swift and Cinder RBD

Unify storage protocols

01

• Compose your storage for all environments – virtual, container, and bare metal

Software Composable

02

• Consolidate the empty spaces on existing storage to build a new storage resource pool

• Seamless migrate data on old storage, with almost no down time

Consolidate and Migrate

03

• High-performance with very low latency

response, and stable.

Low latency performance

04

• Minimize the write amplification on flash to extend SSD life, and save cost

Minimum Write Amplify

05

VirtualStor Extreme, Performance That Fit

Scale-out architecture and hyper–convergence

• Scale as you grow. Scale

up to 10M IOPS with 12

chassis

• Suitable for AI, machine

learning and virtualization

• All-flash hyper-converged

with comprehensive

storage features

Key Benefit

800K IOPS / 90TB

10M IOPS / 1PB

VirtualStor Extreme, Use Cases That Fit

Composable storage that fit all environments & applications

• Compose your storage with

any protocol for any

application on virtual,

container, or bare metal

• Compose your storage with

QoS control, quota control,

access control, and isolation

Key Benefit

Application 1 Application 2 Application 3

NFS / CIFS / iSCSI / FC / Amazon S3 / OpenStack Swift / Cinder RBD

Software Composable Infrastructure

VirtualStor Extreme, Transformation That Fit

VirtualStor Extreme

Seamless Migration

Storage Consolidatio

n Bigtera VirtualStor cluster

Existing legacy storage like SAN and NAS

• Consolidate your existing

legacy storage (SAN and

NAS)

• Seamlessly migration your

application data without

service downtime

Key Benefit

Consolidate and seamless migration to save TCO

Minimum Write Amplification (WA)

7.31

1.05 0

2

4

6

8

Ceph FileStore VirtualStor

Extreme

● Write amplification (WA) is an

undesirable phenomenon with flash

where the actual amount of data

physically written to the media is a

multiple of the logical amount

intended to be written. It will make

SSD life reduced.

● Compared with other SDS like Ceph,

VirtualStor Extreme significantly

minimize WA to 1.05. Almost 7X of

SSD life than other SDS.

Source: “The savior of SSD endurance in CEPH”, Bigtera at Flash Memory Summit 2018


SSD life, Capacity and Performance prediction

• Monitor SSD health and issue early

warning before the SSD wears out.

• Analyze the historical capacity usage

and performance data to predict when

space may be depleted.

• Through SSD life, capacity and

performance prediction, storage admin

can proactively plan the replacement

and expansion beforehand.

AI and Prediction

Summary

Hard to scale Unlimited scales on demand

Storage islands

Consolidated storage infrastructure to use every

resource

Low utilization due to different workload requirements

Software defined virtual storage that fits workloads

Long time to provision Storage as service provisioning

model

Complex management One infrastructure to manage

all storage and to serve all workloads

Before After

True SDDC with SDS

True software composable infrastructure

• Define a data center instantly from the resource pool

38

Resource pool

Data Center #1 Data Center #2

VM VM VM VM VM VM

VM VM VM VM VM VM

VM VM VM VM VM VM

VM VM VM VM VM VM

Network

Network

SAN SAN

SAN NAS

VM VM VM VM VM VM

VM VM VM VM VM VM

VM VM VM VM VM VM

VM VM VM VM VM VM

Network

Network

SAN SAN

SAN NAS

Bigtera – The Future of SDS

www.bigtera.com

Copyright © 2015 Bigtera limited. All rights reserved.

The Bigtera is trademarks or registered trademarks of Bigtera limited.

All other products, services and company names mentioned herein may be trademarks of their respective owners.


Thank You

Empowering Your Software-Defined Transformation Bigtera.pdf · 2018-10-26 · satisfy all...

Documents

Transcript of Empowering Your Software-Defined Transformation Bigtera.pdf · 2018-10-26 · satisfy all...