Introduction to AWS Database Migration

Service김일호, Solutions Architect

What to Expect from the Session

• Learn about migrating databases with minimal downtime to Amazon RDS, Amazon Redshift and Amazon Aurora

• Discuss database migrations to same and different engines

• Learn about the converting schemas and stored code from Oracle and SQL Server to MySQL and Aurora

• One more thing~

Embracing the cloud demands a cloud data strategy

• How will my on-premises data migrate to the cloud?

• How can I make it transparent to my customers?

• Afterwards, how will on-premises and cloud data interact?

• How can I integrate my data assets within AWS?

• Can I get help moving off of commercial databases?

Historically, Migration = Cost, Time

• Commercial Migration / Replication software

• Complex to setup and manage

• Legacy schema objects, PL/SQL or T-SQL code

• Application downtime

IntroducingAWS Database Migration Service

Purposes of data migration

One-time data migration

Between on premises and AWS

Between Amazon EC2 and Amazon RDS

Ongoing Replication

Replicate on premises to AWS

Replicate AWS to on premises

Replicate OLTP to BI

Replicate for query offloading

Ways to migrate data

Bulk Load

AWS Database Migration Service

Oracle Import/ExportOracle Data Pump Network ModeOracle SQL*LoaderOracle Materialized ViewsCTAS / INSERT over dblink

Ongoing Replication

AWS Database Migration Service

Oracle Data Pump Network ModeOracle Materialized ViewsOracle GoldenGate

High-speed database migration prior to AWS DMS

EC2 Instance

Linux Host

On-Premises AWS Availability Zone

Oracle DBRDS

Oracle

Tsunami Tsunami

DATA_PUMP_DIR

500GB175GB

~2.5 hours~2.5 hoursTotal Time~7 hours

~3.5 hours~4 hours

Start your first migration in 10 minutes or less

Keep your apps running during the migration

Replicate within, to or from Amazon EC2 or RDS

Move data to the same or different database engine

Sign up for preview at aws.amazon.com/dms

AWS

Database Migration

Service

10 minutes or less to migration

Customer

Premises

Application Users

AWS

Internet

VPN

• Start a replication instance

• Connect to source and target databases

• Select tables, schemas, or databases

Let AWS Database Migration Service

create tables, load data, and keep

them in sync

Switch applications over to the target

at your convenience

Keep your apps running during the migration

AWS

Database Migration Service

After migration, use for replication and data integration

• Replicate data in on-premises databases to AWS

• Replicate OLTP data to Amazon Redshift

• Integrate tables from third-party software into your reporting or core OLTP systems

• Hybrid cloud is a stepping stone in migration to AWS

Cost-effective and no upfront costs

• T2 pricing starts at $0.018 per Hour for T2.micro

• C4 pricing starts at $0.154 per Hour for C4.large

• 50GB GP2 storage included with T2 instances

• 100GB GP2 storage included with C4 instances

•

• Data transfer inbound and within AZ is free

• Data transfer across AZs starts at $0.01 per GB

SwapLogsCache

Migrate and replicate between database engines

IntroducingAWS Schema Conversion Tool

Migrate off Oracle and SQL Server

Move your tables, views, stored procedures and DML to MySQL, MariaDB, and Amazon Aurora

Know exactly where manual edits are needed

Download at aws.amazon.com/dms

AWS

Schema Conversion

Tool

Get help with converting tables, views, and code

SchemasTablesIndexesViews

PackagesStored ProceduresFunctionsTriggers

SequencesUser Defined TypesSynonyms

Move your database schema and code

Know exactly where manual edits are needed

One more thing.

RAC on Amazon EC2 would be useful

• Test / dev / non-prod; allow testing to cover RAC-related regression cases

• Scale out and back elastically; a good match for the cloud

• Scale beyond the largest instances

• High-RTO redundancy at the host/instance level; App continuity for near zero downtime

• Test scaling limits; a given workload scales only to n nodes on RAC

• Some applications “require” RAC

• Some customers don’t want to re-engineer everything just to move to AWS

• Customers want it!

Why no RAC on EC2?

EBS Volume

Shared StorageEC2

Instance

X

Shared storage with iSCSI

EBS Volume

EC2Instance

EC2Instance

iSCSI Target

ASM

ASM

ASM

EC2Instance

iSCSI Target

open-iscsi-2.0-873Open iSCSI Projectopen-iscsi.org

Why no RAC on EC2?

Multicast Network

EC2Instance

EC2Instance

EC2Instance

Multica

st

Multicast on EC2EC2

Instance

EC2Instance

EC2Instance

Multica

st

EC2Instance

N2N Edgeedge0

N2N Edgeedge0

N2N Edgeedge0

N2NSupernode

N2n VPNntopntop.org/n2n

RAC on EC2 prototype: aws.amazon.com/articles

iSCSI Target 1 (i2.8xl)

Subnet

Placement Group (dedicated instances)

VPC

Route 53Private Hosted Zone

• DNS• SCAN• VIPs• Etc.

6400G Ephemeral SSD

4800G DATA LVM Vol

tgtd

iSCSI Target 2 (i2.8xl)

RAC Node 1 (c3.8xl)

RAC Node 2 (c3.8xl)

600G Flash Cache

edge

ASM (normal

redund.)

GridInfra.

DB12c

supernode

800GRECO

800Gfree

640G Ephemeral SSD

iscsid600G Flash Cache

edge

ASM (normal

redund.)

GridInfra.

DB12c

640G Ephemeral SSD

iscsid

6400G Ephemeral SSD

4800G DATA LVM Vol

tgtd

800GRECO

800Gfree

Sign Up for AWS Database Migration Service

• Sign up for AWS Database Migration Service Preview now:

• aws.amazon.com/dms

• Download the AWS Schema Conversion Tool:

• aws.amazon.com/dms

Thank you