Lesson Learns from Japan cloud trend

Kimihiko Kitase @kkitase

北瀬 公彦 KIMIHIKO KITASE OSS / Cloud solution manager at Citrix Systems Japan Board member at Japan CloudStack User Group Contributor, Apache CloudStack community

twitter: @kkitase mail: kkitase@gmail.com web: http://v12n.jp http://cloudstack.jp Had lots of speech at the cloud, virtualization and network event as cloud evangelist. Wrote lots of magazines, book, articles related cloud, virtualization and network.

“Japanese” sometimes “English” ….

Contributed by Sonny Chen

and Kimihiko Kitase

Rocket Cloudy Surfer Cloudy All Star Cloudy Pixel Cloudy

April 25, 2012

Call for CloudStack mascot proposals

I drew… but….

I know I have no design talent…

June 3rd, 2012

But I imaged from

“dragon ball”, “Journey to the West” and “KungFu Panda” - Orchestrate any clouds and lead members to cloud computing world - Easy to corroboration with Panda (Xen mascot) and other products like Hadoop

I re-designed and posted proposal I know I have no design talent…

Finally I know I have no design talent…

So asked Senior Product Designer, Sonny Chen to design COOL monkey.

June 5th, 2012

July 3rd, 2012

July 14th, 2012

Service Provider Academic Enterprise

Gaming

Company

IT Subsidiary

Company

From the 2013 May number of *Nikkei Computer About 40% of major AWS compatible clouds uses CloudStack

““Our cloud infra is based on CloudStack” is sales talk.”

by one service provider’s evangelist

*Nikkei Computer: One of most famous computer magazine in Japan

• USR - Building AWS-Compatible Public Cloud Service • Slideshare: http://www.slideshare.net/shinichirokashiwagi/building-aws-compatible-cloud

• Thursday 21st 3:00 – 3:30 pm • Shinichiro Kashiwagi • Abstract

• As AWS is getting more popular in the public cloud market there are more customers who expect AWS-compatible interfaces and product specifications from other cloud service providers. In this session Shinichiro shares the experience of building Cloudn, an NTT Communications' AWS-compatible public cloud service using CloudStack, which has AWS EC2 API layer but there are a lot more to prepare for offering AWS-compatible service portfolio to customers. Based on the multi-region and multi-zone CloudStack infrastructure we are offering Dynamic DNS hosting, Load Balancer, Autoscaling, Relational

Database, Object Storage, Monitoring and Provisioning services, with all AWS-compatible API interface.

• Bio • Shinichiro Kashiwagi is a Software Architect of NTT Communications Enterprise Cloud Service. He has

acted as technical lead on various virtualization and cloud service development projects in NTT

on-premise Public Cloud SCSK Datacenter

netXCloud (public cloud)

Based on CloudStack

Cloud System

Enabler (private cloud)

Based on CloudStack

on-premise

(private cloud)

Dedicated Network

Multi-cloud

management

Software

Cloud Management System

CMP: CloudStack Monitoring: ZABBIX

LB: Stingray

XenServer

Self Service Portal

Citrix CloudPortal Business Manager

Internet Admin UI

End User UI

Server Pool

VMware VMware

cluster

VMware XenServer

cluster

VM VM VM VM

Storage Pool

Server Template

Firewall

LB

Firewall

LB

L3 Switch

Firewall

L3 Switch

Firewall

Stingray (L7 LB)

Vyatta (FW, VPN)

Zabbix

Cent OS

RHEL

Cloud Storage

Primary Secondary

L2 1G

L2SW 10G

L2SW 1Gl

L2 1G

L2SW 10G

L2SW 1Gl

Pod 1 … n

VA Storage (Distributed object Storage)

Zone 1 … n

Management Network

Primary Storage

Secondary Storage App

OS

App

OS

App

OS

App

OS

Storage Network

Public Network F/W

vCenter

Internet

Carrier cpmpany (Sendai zone)

Management Network

Primary Storage

Secondary Storage App

OS

App

OS

App

OS

App

OS

Storage Network

Public Network F/W

vCenter

Internet

Carrier company(Hokkaido zone)

Management Network

Primary Storage

Secondary Storage App

OS

App

OS

App

OS

App

OS

Storage Network

Public Network F/W

vCenter

Internet

DC/Carrier company(Shizuoka zone)

Management Network

Primary Storage

Secondary Storage App

OS

App

OS

App

OS

App

OS

Storage Network

Public Network F/W

vCenter

Internet

DC Company(Osaka zone)

Customer’s Administrator

Cloud Controller

CMS (CloudPlatform4.2)

Web Portal App

Charge Calculate System

Internet

DC Company(Okayama zone)

Management Network

Primary Storage

Secondary Storage App

OS

App

OS

App

OS

App

OS

Storage Network

Public Network F/W

vCenter

Internet

Data Center

Alliance Network

Sapporo

Sendai

Shizuoka

Osaka

Okayama

Data Center

Management Network

Primary Storage

Secondary Storage App

OS

App

OS

App

OS

App

OS

Storage Network

Public Network

Internet

JMT Cloud (Shizuoka zone)

Headquarters Branch Office Branch Office

Direct connect

(Dedicated line)

S-2-S VPN S-2-S VPN

App

OS

App

OS

Cloud Controller

CMS(CloudPlatform4.2)

Web Portal App Charge calcurate System

Internet

IPSec-VPN

Customer’s hosting servers in the data center

VPC Virtual Router

LAN

Private Gateway

App

OS

App

OS

Customer’s Virtual Private Cloud on JMT-Cloud Customer’s

Administraotr

Data Center

Alliance Network

300km+

300km+

Tokyo

Osaka Low latency Layer-2

inter DC Network

Toyama

300km+

• Easy-to-use UI – Application Developer (not Infra Engineer)

wants to control infrastructure

• Controlling new CS feature – Some new features are unstable – Original control panel can hide or handle it

• Adding original features – Monitoring (Zabbix integration) – Billing (“resource pack” model)

Monitoring ControlPanel

(INTEC Original)

CloudStack vCenter

ESXi

Primary

Storage

Secondary

Storage

Internet Internet

Create Servers &

VRs

CloudStack

API call

Register Server

(Zabbix API)

Send Performance Data

(Zabbix sender)

Virtual

Servers

Customer Environment

(Advanced Network) Virtual

Router

Get Performance Data

(Zabbix API)

Create

Request

Get Monitor Server Location

UserData Configuration

(Monitor Server Location)

Performance

Data

Request

Show Performance Data

Standby Main storage

Backup storage

Backup storage

2 types Premium dedicated

FTTH Remote Access

Ethernet

Intranet

Backup (Option)

Included Network cost

Internet

Customized Self Service Portal

Value Shared

Active

Backu

p

Main sites Japan East and West

DR site

10G

CloudPlatform 3.0.5

Different location VMware / KVM

HA

• SLA99.99% • Backup to DR site

(default) • Intranet can be used w/o

additional cost • Dedicated or/and Shared

hypervisor can be selected

• Company information • Fully funded by Yahoo Japan

• First Cloud Provider in Japan based

on CloudStack (2011/09)

• First Cloud Provider in World Wide

based on CloudStack on VMware

• Environment • CloudStack: 2.2.15 (Public cloud)

3.0.x (Private cloud)

• Advanced mode

• 2 zones

• 300 km between zones (Tokyo

and Fukushima)

• 2 secondary storages (real-time

replication)

• 10G network

• VR improvement • Kernel Tuning for improving VR

performance (e.g. big subnet)

• Version up from Debian Backport

• Contributions • Redundant Virtual Router

• VMware snapshot improvement

• Multi IP per NIC (function logic)

Fukushima-Zone

SLA 99.999% 100K IOPS

VMware HA All 10 NIC

Multi-cloud management Software / Service

Tokyo-Zone

SLA 99.999% 100K IOPS

VMware HA All 10G NIC

100miles

GSLB

Dedicated Services

Physical Servers Dedicated

LB / FW / IPS On-Premise

Object Storage (Basho Riak)

GSLB Internet

Intranet “IDC Frontier PrivateConnect”

CloudStack management server farm

Cloud Management System

CloudStack Management

Server

vCenter Server

Internet

VMware cluster

VM VM

L2SW

Primary Secondary

VR

VM VM VM VM

Admin UI

End User UI

Dedicated CloudStack for Customers

IDC Frontier Public Cloud

L2SW

Secondary

VR VR VR VR VR

End User UI

Admin UI

Detail (English): http://www.slideshare.net/masaharumunetomo/20120418-hokkaidouniversityacademiccloudenglishpublic

CPU: 4 /node

Core: 40 / node

Hadoop package for data analysis

• Run simulation • Find drug medicine by using

Structure Based Drug Design (SBDD) • Analyze squid data gathered from

fish boat and provide fishing point • Provide evolutionary computing

framework by using CloudFoundry on CloudStack

End User UI

Admin UI

*Shibboleth: http://en.wikipedia.org/wiki/Shibboleth_(Internet2)

HPC Cloud OS • Integration of PCI passthrough into

the Apache CloudStack • https://reviews.apache.org/r/12098/

Detail (English): http://www.slideshare.net/oraccha/hpc-cloud-clouds-on-supercomputers-for-hpc

Iris • Inter-cloud resource

management system for enabling elastic data centers

• Using nested KVM • Network:

• OpenFlow (OVS) • GRE (DC-to-DC) • Floodlight base controller

In Greek mythology, Iris is

the personification of the

rainbow

Detail (Japanese): http://www.slideshare.net/oraccha/ss-27724133

0

100

200

300

400

500

600

700

800

900791 users

as of Nov 21

Osaka 2.7M population

Takoyaki (“octopus dumpling”) Fukuoka

1.5M population Tonkotsu (“pork bone”) Ramen (noodle)

Nagoya 2.3M population

Chicken wing

Tokyo 13M population

everything

Sapporo 2M population

Miso Ramen (noodle)

1st 2010/12/06 (Tokyo) 2nd 2011/3/27 (Tokyo) 3rd 2011/5/27 (Tokyo) 4th 2011/7/25 (Tokyo)

Temp 2011/7/29 (Osaka) 5th 2011/11/30 (Tokyo) 6th 2012/2/23 (Tokyo) 7th 2012/4/18 (Tokyo) 8th 2012/8/2 (Osaka) 9th 2012/9/11 (Tokyo)

10th 2012/11/15 (Tokyo)

Temp 2012/12/7 (Fukuoka) 11th 2013/3/6 (Osaka)

Book Reading 2013/4/16 (Tokyo) Book Reading 2013/5/14 (Tokyo)

12th 2013/3/22 (Tokyo) 13th 2013/8/2 (Osaka) 14th 2013/9/12 (Tokyo)

15th 2013/9/13 (Sapporo) 16th 2013/TBD (Nagoya)

17th 2013/TBD(Tokyo)

Japan CloudStack User Meetup Over 2,000 audiences since 2010/12/06

2012/9/8 (Tokyo) 2012/12/16 (Tokyo) 2013/2/23 (Tokyo) 2013/5/25 (Osaka)

2013/6/22 (Nagoya) 2013/8/3 (Kyoto)

2013/9/14 (Hokkaido) 2013/10/19 (Tokyo)

2013/11/16 (Fukuoka) 2013/12/13 (Tokyo)

Open Source Conference Joined 10 times since 2012/9/8

JCSUG organized / joined 17 something events

in only 2013!

Published on 2013/1/30

Writer: Japan CloudStack User Group

Twitter: @cloudstackja

Published on 2013/10

Writer: Midori Oge, NTT Communications

Vice Chairman of JCSUG Twitter: @star76popin

Date: 2012/12/1 – 2012/12/31 Total attendances: 28 Overview: Everyday until Christmas day (12/25), someone from Japan CloudStack User Group writes blogs and publish 25 blogs.

12/17 Log analysis 12/18 CloudStack and CloudFoundary 12/19 Cloud.com history 12/20 CloudStack for general person 12/21 CloudStack and MidoNet 12/22 Build cloud in the lab 12/23 devcloud #2 12/24 Use CloudStack hardly 12/25 Develop CloudStack 12/26 CloudStack Security Group 12/27 Python one liner 12/28 devcloud #3 12/29 devcloud in japanese environment 1/1 CloudStack and OpenStack swift

12/1 How to install Apache CloudStack 4.0 12/2 How to use cloudmonkey 12/3 CloudStack and Fog 12/4 build a private cloud 12/5 CCC12 report #1 12/6 devcloud 12/7 how to use web console in NAT env. 12/8 CloudStack 4.0 VPC 12/9 CloudStack and NetScaler 12/10 CCC12 report #2 12/11 CloudStack API 12/12 Virtual Router 12/13 CloudStack User Group 12/14 What is CloudStack 12/15 CloudStack and vSphere 12/16 CloudStack Global Settings

http://atnd.org/events/34309

Date: 2013/12/1 – 2013/12/31 Overview: Everyday until Christmas day (12/25), someone from Japan CloudStack User Group writes blogs and publish 25 blogs.

12/17 @shiroica TBD 12/18 12/19 12/20 12/21 @s_adachi 12/22 @penguin2716 Build home cloud 12/23 @smzksts TBD 12/24 12/25 @star76popin TBD 12/26 12/27 12/28 @abeautifulwave TBD 12/29 @zero_root TBD 12/30 @kimotuki TBD 12/31

12/1 @kkitase CCC13EU report 12/2 @u1 Use fluent-plugin-cloudstack 12/3 12/4 12/5 12/6 12/7 12/8 @yukutomi 12/9 12/10 @s_kaiga Deploy wordpress in 30 min 12/11 12/12 @MayumiK0 TBD 12/13 12/14 12/15 @giraffeforestg TBD 12/16 @hsato Use Riak CS for Secondary Storage

http://atnd.org/events/45595

Date: 2014/3/6 Attendances: 500 Sponsors: Gold sponsor: 14 Silver sponsor: 6

LPI Japan

OSS-Cloud CloudStack

Do you know LPI? LPI (Linux Professional Institute) was formally incorporated as a non-profit organization in New Brunswick, Canada on October 25, 1999. LPI provides Linux certification exam.

http://cloudstack.jp/

http://cloudstack.jp/community

users@cloudstack.jp

@cloudstackja

http://www.ustream.tv/channel/cloudstackja

https://www.facebook.com/cloudstackjapan

http://www.youtube.com/user/cloudstackja

If you have any question,

please tweet to @kkitase