Chicago Market Data Backup & Virtualization Overview.

Chicago Market

Data Backup&

Virtualization Overview

Backups

The path to a better way in the world of VTL

Agenda• Old Environment - Infrastructure• Old Environment – Challenges• Existing Environment• Advantages of Existing Environment• Put the Puzzle Together• The Future of our Backups• Backup Best Practices

Agenda

• Old Environment- Infrastructure• Old Environment – Challenges• Existing Environment• Advantages of Existing Environment• Put the Puzzle Together• The Future of our Backups• Backup Best Practices

Old Environment - Infrastructure• Backup Infrastructure

– Veritas Netbackup Datacenter version 4.5– 2 Master 3 Media Servers– 5 Tape Libraries which hold 110 tapes– 10 DLT 8000 tape drives which are capable of backing up

79.2 GB per hour• Backup Policies

– Backup schedule: bi-monthly full backups and daily incrementals

– Retention period: all data was retained for 2 weeks– Full backups totaled 1.8 Tb of data and took up to 18

hours to complete

Old Environment –Infrastructure

Schaumburg

ElmhurstMount Prospect

Oak Brook

100 Mb

100 Mb

100

Mb

Proliant DL 360 G2

Proliant DL 360 G2

Proliant DL 360 G2 Proliant DL 360 G2

Proliant DL 360 G2

Compaq MSL50002 DLT 8000 Drives




StorageWorks MSL5030 Library




STORAGE WORKS

EnterEscape

FaultLoaderReady Use

Cleaner FaultDrive

TL891 MINILIBRARY

Compaq TL8912 DLT 8000 Drives (NAS Bkup)

NetBackup 5.0 Master

NetBackup 5.0 Media


NetBackup 5.0 Media

NetBackup 4.5 Media

All NetBackup servers are Compaq DL360's w/ (2) 1.4 Ghz Pentium III Processors and 2 Gb RAM

100 Mb

100 Mb

CISCO STORAGE NETWORK 5428S T O R A G E R O U T E R

LI NK

T X

RX

G E 1LI NK

T X

RX

G E 2F AULT

STATUS

POWER

ACT

LO G

ACT

LO G

ACT

LO G

ACT

LO G

ACT

LO G

ACT

LO G

ACT

LO G

ACT

LO G

GIGABIT ETHERNET CONSO LE MGMT 10/100 HA 10/100

ACT SPEED ACT SPEEDF C 1 F C 2 F C 3 F C 4 F C 5 F C 6 F C 7 F C 8

FIBRE CHANNEL 1Gb/2gB


LI NK

T X

RX

G E 1LI NK

T X

RX

G E 2F AULT

STATUS

POWER

ACT

LO G

ACT

LO G

ACT

LO G

ACT

LO G

ACT

LO G

ACT

LO G

ACT

LO G

ACT

LO G


ACT SPEED ACT SPEEDF C 1 F C 2 F C 3 F C 4 F C 5 F C 6 F C 7 F C 8


Cisco 9216 2Gb Fiber Switchs (x2)

EMC NS600G (SAN/NAS)

1000 Mb

Clients

Clients

Clients

100 Mb 100 M

b

100 Mb

Agenda• Old Environment - Infrastructure

• Old Environment – Challenges• Existing Environment• Advantages of Existing Environment• Put the Puzzle Together• The Future of our Backups• Backup Best Practices

Old Environment - Challenges• Daily admin tasks required an abundance of time

• No central management point

• Restores required multiple tape handlings, inventory operations, and take on average 25 minutes

Old Environment – Challenges

• Client backups were missed due to limitations of the drive speeds which caused exceeding backup windows

• Tapes proved unreliable for full system restore.

• Retention period was decreased from 1 month to 2 weeks due to increased data growth

Agenda• Old Environment - Infrastructure• Old Environment – Challenges

• Existing Environment• Advantages of Existing Environment• Put the Puzzle Together• The Future of our Backups• Backup Best Practices

Existing Environment

• Backup Infrastructure– Veritas Netbackup Datacenter version 5.0– 1 Master 4 Media Servers– 2 Disk based backup units “VTL”– 1 Tape Library can hold up to 1000 tapes– 2 LTO-2 fiber attached tape drives are capable of

245 GB per hour– Network Attached Storage (NAS) backup using

NDMP– Netbackup Shared Storage Option (SSO)


• Backup Policy Changes– Backup schedule: weekly full backups and daily

incrementals. – Retention period: all data are retained for 2

weeks on disk and 3 months of full backups on tape

– Full backups are averaging 2.5 Tb within an 8 hour backup window

– Backup speeds are limited to the speed of the disk controller on the drive array.

VTL Defined

• Virtual Tape Library

• Can virtually create multiple libraries and tape drives that write data to disk in format that the backup software believes is tape.


NDMP Defined

• Network Data Management Protocol

• Open protocol used to control data backup of a NAS device via fiber channel verses IP


SSO Defined

• Shared Storage Option

• Allows a single tape drive to be assigned to multiple media servers.

• Allows multiple backup servers to write to shared libraries and tape drives without conflict.



Schaumburg

ElmhurstMount Prospect

Oak Brook

100 Mb

Proliant DL 360 G2

Proliant DL 360 G2

Proliant DL 360 G2


NetBackup 5.0 Media

NetBackup 5.0 Media

NetBackup 5.0 Media

NetBackup 5.0 Media

All NetBackup servers are Compaq DL360's w/ (2) 1.4 Ghz Pentium III Processors and 2 Gb RAM

100 Mb


LI NK

T X

RX

G E 1LI NK

T X

RX

G E 2F AULT

S TA TUS

P OW E R

A CT

LO G

A CT

LO G

A CT

LO G

A CT

LO G

A CT

LO G

A CT

LO G

A CT

LO G

A CT

LO G


A CT S PE ED A CT S PE EDF C 1 F C 2 F C 3 F C 4 F C 5 F C 6 F C 7 F C 8



LI NK

T X

RX

G E 1LI NK

T X

RX

G E 2F AULT

S TA TUS

P OW E R

A CT

LO G

A CT

LO G

A CT

LO G

A CT

LO G

A CT

LO G

A CT

LO G

A CT

LO G

A CT

LO G


A CT S PE ED A CT S PE EDF C 1 F C 2 F C 3 F C 4 F C 5 F C 6 F C 7 F C 8


Cisco 9216 2Gb Fiber Switchs (x2)

EMC NS600G (SAN/NAS)

REO 9000

Direct attachedFiber Channel

REO 9000

LARiiONC

SAN Attached

1000 Mb (1Gb)

NEO 8000w/ 2 Fiber LTO2 Drives

Proliant DL 360 G2

Proliant DL 360 G2

Clients

Clients

Clients

Agenda• Old Environment - Infrastructure• Old Environment – Challenges• Existing Environment

• Advantages of Existing Environment• Put the Puzzle Together• The Future of our Backups• Backup Best Practices

Advantages of Existing Environment

• Central point to manage.

• Daily admin tasks take minutes – just long enough to verify that all completed successfully.

– No more rotating tapes, except off site.

• Disk based restores take less than 2 minutes.

– Takes longer to initiate the restore job than the actual operation takes to complete.

Advantages of Existing Environment

• All backup schedules are completed in windows specified.

• Confidence and success rate in restores has dramatically increased.

Agenda• Old Environment - Infrastructure• Old Environment – Challenges• Existing Environment• Advantages of Existing Environment

• Put the Puzzle Together• The Future of our Backups• Backup Best Practices

Put the Puzzle Together

• Getting vendors to work together– EMC Celerra – NAS Device

– VERITAS (Symantec) Netbackup

– Overland REO (Disk) and NEO (Library)

Agenda• Old Environment - Infrastructure• Old Environment – Challenges• Existing Environment• Advantages of Existing Environment• Put the Puzzle Together

• The Future of our Backups• Backup Best Practices

The Future of our Backups• Move from a 5 server infrastructure to 3 due to

higher processing capabilities of servers.

• Upgrade network connections for Netbackup servers to Gigabit!

• Expansion chassis for disk library due to increased data.

Agenda• Old Environment - Infrastructure• Old Environment – Challenges• Existing Environment• Advantages of Existing Environment• Put the Puzzle Together• The Future of our Backups

• Backup Best Practices

Backup Best Practices• Backup client settings should be standardized for

network settings, an example would be to hard set to 100/Full.

• Still need tape!

• Don’t use virtual stand alone tape drives for NDMP with Netbackup.

Backup Best Practice• Set up of NDMP attributes through Netbackup is case

sensitive.

• Must have license key for NDMP option of Netbackup.

• Disk based backup units should be configured as RAID 3 for increased data write performance.

– RAID-3 dramatically increase the write performance on the disks verses RAID-5

Questions?

Virtualization Overview

• What is Virtualization

• Key Challenges

• Typical Consolidation Project Goals

• Process Improvements

• Consolidation Approach

• Benefits Realized from Virtualization

Agenda

• What is Virtualization• Key Challenges





Agenda

What is Virtualization?

• A Technology that allows a single machine to run multiple operating systems at once.

Virtualized MemoryEach application sees its own logical memory,

independent of the physical memory

Virtualized NetworksEach application sees its own logical network,

independent of the physical network

Virtualized ServersEach operating system instance sees its

own logical server, independent of the physical servers

Virtualized StorageEach application sees its own logical volume,

independent of the physical disks

Defining Virtualization

Virtualization:Technology that enables logical representations of

physical resources


• Key Challenges• Typical Consolidation Project Goals




Agenda

• Current Model of 1 Application per 1 Server has resulted in an

overabundance of servers and with limited power and rack space

• Simplifying and Consolidating the IT Infrastructure

• Optimizing Server Performance and Loading

– According to Gartner 85% of x-86 servers are only utilizing 15% or less of its computing resources

– Average server builds takes about 6 to 8 hours

• Minimizing Maintenance Tasks and Reallocating Resources to Strategic Business Initiatives

– On Average, of the time an IT employee works on servers, 72% of the time is performing server maintenance & Support Tasks (BIOS, Firmware updates, etc…); 28% Assigned to Support Strategic Initiatives.

Key Challenges

Moving from Maintenance to Innovation

Future IT Application

maintenance 15%

Applicationinnovation

45%

Infrastructureinnovation

10%

Infrastructuremaintenance

30%

Current IT

Applicationmaintenance

30%

Applicationinnovation

23%

Infrastructureinnovation

5%

Infrastructuremaintenance

42%

Source: Large Computer Mfg IT department


• Key Challenges

• Typical Consolidation Project Goals• Process Improvements



Agenda

Typical Consolidation Project Goals

• A more flexible and scalable architecture

• An architecture that is easier and less expensive to support

• High availability at lower cost

• Improved office space and server room utilization

Typical Consolidation Project Goals

• Reduced total cost of ownership

• Disaster recovery at an affordable cost

• Improve test & development environments

• Improve server maintenance processes


• Key Challenges


• Process Improvements• Consolidation Approach


Agenda

Process Improvements

• Improve asset management system / capacity planning process i.e.; buy computing resources when they are needed, not when application needs to run on a under utilized stand alone server

• Promote applications and code changes quickly and efficiently across the IT infrastructure

Process Improvements

• Implement standards:

– Virtualization

– Hardware

– Storage (SAN\iSCSI)

– Disaster recovery

• Implement lights-on org structure – maintenance can be done during the day


• Key Challenges



• Consolidation Approach• Benefits Realized from Virtualization

Agenda

Consolidation Approach

• Consolidate in tandem with “technology refresh” cycle and/or warranty expirations

• Executive buy-in for the consolidation project is key

• Gain buy in from Application Development team

• Map storage to NAS/SAN – “Virtual Networking”

Pre-Virtual Environment

SD

ESC

PROLIANT 8000

pSeries

SD

ESC

PROLIANT

ESC

CL350

Windows Servers

pSeries

pSeries

NAS SAN

pSeries

pSeries

Server1

Server2

Server3

Server4

. . . . .

Server15

Server16

Server17

Server18

Server19

. . . . .

Server25

•Can’t utilize idle storage resources •Can’t utilize idle server resources •High costs for operations, training, support, hardware, etc,,, •High costs for data center environment/facilities

•Standard hardware configuration •Lower hardware acquisition and maintenance costs •Consolidation of idle server and storage resources •Tiered storage solutions•Increased operational efficiency •Cost effective and consistent environments •Reduced costs in technical support and training•Ability to rapidly scale •Lower facility costs

Post - Virtual Environment


Consolidation Approach• What Chicago is trying to accomplish

– We have 24 XP workstations that require 24x7 uptime– 12 application servers requiring upgrades and/or additions

• 3 Print Servers

• 2 Monitoring Servers

• 2 NT Domain Controllers (Chicago still needs old Domain)

• 1 File Server

• 1 Sharepoint Server

• 2 Cava Servers (Used for NAS Virus Scanning)

• 1 Video conferencing server (PolyComm)


Consolidate 36 systems into 4

servers!


• Key Challenges





Agenda

Benefits Realized from Virtualization

• Virtualized network connectivity• Virtualized storage• Provisioning speed• Hardware Technology refresh speed

Benefits Realized from VirtualizationVirtualized network connectivity

Virtualized Storage

Previous State Consolidated State

ESX Frame10-50 VMinstances

VM1VM2 .VM20

NIC

NIC

Integrated MgmtRSA \ ILO

ANetworkSwitch

BNetworkSwitch

HB

A

HB

A

VMDK1 – 10GB

VMDK2 – 10GB

BNetworkSwitch

ANetworkSwitch

DataSet_1

DataSet_2

SAN

NAS

TypicalServer

Configuration

HDD36 GB

HDD36 GB

x14

72 G

B

72 G

B

72 G

B

72 G

B

72 G

B

Inefficient use of idle resourcesEX: ServerA has 500 GB free spaceServerB has 0 GB free space, can’tleverage ServerA’s resources

TOTAL1000 Physical Servers72 TB (OS)200 TB (Data)

TOTAL1000 VM Instances10 TB (OS)130 TB (Data)


Provisioning Speed & Hardware Technology Refresh

• Previous procedure (before virtualization) = Approximately 6 to 8 hours to build one server

– Build and configure hardware– Load Operating System– Load and configure tools (Backup, Resource Kit, Monitoring, etc,,,)– Assign 2 IP addresses – Pull 3 network connections copper or fiber– Turn over to application team to load and configure software

• Consolidated procedure (after virtualization) = 30 minutes to build one virtual machine (server)

– Copy\clone standard virtual server file – OS and tools are pre-loaded and configured– Network connectivity only needed for ESX Server physical frame.– Assign 1 IP address to virtual machine instance– Turn over to application team to load and configure software


Questions?

Chicago Market Data Backup & Virtualization Overview.

Documents

Transcript of Chicago Market Data Backup & Virtualization Overview.