Transcript of Sql Server Data Services
- 1. Microsoft
- 2. ()
- , , IBM/Lotus Microsoft . , .
- WebEx ( Cisco 2007 .), PlaceWare ( 2003 . MS Office Live
Meeting ), WebDialogs (c 2007 IBM Lotus Sametime Unyte) . , - ,
?
- 3. ()
- 4. ()
-
-
- public-facing . , Gmail ( Google Enterprise)
- 5.
- 6. SaaS
- 7. DaaS
- 8. DaaS
- Multitenancy hosted model
-
- SOAP, REST, XML, ODBC, JDBC, SQL
- Dedicated database hosted model
- 9.
-
- Simple Storage Service (S3) Elastic Compute Cloud (EC2)
-
- Force.com Web services API Salesforce Object Query Language
(SOQL)
-
- Postgres Plus Advanced Server Cloud Edition
-
- - Amazons Elastic Compute Cloud (EC2) Simple Storage Services
(S3)
- 10.
-
- Oracle Application Express (APEX)
-
- Oracle On-Demand - hosted database service PeopleSoft Oracle
Applications
-
- Web -, Google Earth, Google Finance, ...
-
- Row Key, Column Key, Timestamp . .
-
- : ( ) ; , , - , html . 3 .
- 11. Microsoft
- Microsoft SQL Server Data Services
-
- http://visitmix.com/blogs/2008Sessions/BT05/
-
- : http://www.microsoft.com/sql/dataservices/default.mspx
- 12. Microsoft
Application Service Platform Data Service Platform Integrated Store
CloudDB Distributed In-Memory Cache Velocity Queues Data Delivery
Identity User Management Reporting Service RS Business Intelligence
BI Storage Service Stratus Data Archiving Backup Data Warehouse
Manageability (Autopilot) External CloudDB DSP Unified Programming
Model Workflow Distributed Job Framework Distributed Query Resource
Allocation and Governance Virtualization Synch Services (Harmonica)
Data Fidelity And Cleansing Data Center Services (GFS) Billing
Networking Facilities Support Throttling and Metering
- 13. SQL Server Data Services :
-
-
- Dynamically add / remove partition ranges
-
-
- Load balance partition ranges
-
-
-
- Exchange Hosted Archive (EHS-A) 400
-
-
-
- SharePoint , Data Protection Manager , BizTalk , ...
Mgmt, Provisioning (AP) CloudDB Sitka EHS-A Unstructured BLOB
Simple Structured Structured, Rich Query Database Spectrum Building
Block Svc Finished Svc
- 14. Low Friction Database Endpoint Rich Query Archive Generic
Data Hub Application Cloud DB Sitka Application Cloud DB Archive
App. Email / Collab / LOB App Microsoft Written Cloud DB Sitka
Application Integration Synch App
- 15.
- Goal: A storage platform built for extreme scale and low
cost
- Commodity hardware to lower CapEx
- Lights out operations and self healing to lower OpEx
-
- Apps are partition aware to exploit data parallelism for high
availability, scaling and throughput
-
- Partitions are replicated to achieve reliability
-
- System is self healing - partition data fails over,
load-balances, and scales-up
- Trade off single system image for scale, throughput, low
cost
-
- Fan out operations for large scale, cross partition query
workloads
-
- Optimize code paths for high throughput
- Easy to deploy and manage
-
- No DBA required to manage cluster
-
- Job framework for deploying and running scheduled tasks
Provisioning, Deployment, Management 1-100 101-200 201-300 301-400
401-500 Client Fetch Partition Map Cluster Manager Request
(Key:=323) Partition Lookup
- 16. CloudDB Table Group Customers Row Group Orders Partition
Partitioning Key Column (OrderId)
-
- Has a partitioning key : controls partitioning across
servers
-
- Has a clustering key : controls ordering of rows within a
server
- Table group : a set of tables with the same partitioning
key
- Row group : set of rows in table group with same partitioning
key value
-
- Always on exactly one server
-
- ., Customer->Orders->LineItems Customer ID
- Each table group distributed across nodes
-
- Each storage node assigned ranges partitions of key values
-
- Each partition is replicated for durability
Id Name 34 John 57 92 Id Oid S 34 1 34 2 92 1
- 17. CloudDB Mgmt. Services Data Node SQL Server Fabric Data
Node Components Partition Manager Master Node Mgmt. Services Data
Node SQL Server Fabric Mgmt. Services Data Node SQL Server Fabric
Mgmt. Services Data Node SQL Server Fabric Deployment Health
Monitoring AutoPilot Service Management Self-Healing Master Cluster
Data Cluster Service Boundary Mid-Tier Node Integrated Client
Library Application Mid-Tier Fabric Replication Fetch Partition Map
SQL Client Mgmt. Services Data Node SQL Server Fabric Distributed
Job Framework Distributed Data Services Fabric Distributed Query
Reporting Services Caching GMV Data Node Components Partition
Manager Master Node
- 18.
- Distributed Job Framework
- 19. CloudDB Client Library (ADO.Net) SQL Process Fabric Process
SQL Process Fabric Process SQL Process Fabric Process SQL Process
Fabric Process CloudDB Master Node SQL Process Fabric Process
CloudDB Master Node SQL Process Fabric Process Distributed Fabric
Physical Disks CloudDB Data Cluster CloudDB Master Cluster Manager
AP WD AP WD AP WD AP WD AP WD AP WD CloudDB Data Node CloudDB Data
Node CloudDB Data Node CloudDB Data Node SQL Replication Fabric
Messages SQLClient
- 20. SQL Server P S S S Replication Agent Local Partition Map
Data Node 100 Data Node 101 P S S S Data Node 102 P S S Data Node
103 P S S S Data Node 104 P S S S Data Node 105 P S S S Master Node
(Primary Master) Primary Secondary Secondary Fabric Ring Topology
Failure Detector Name Resolution Reconfiguration Agent Replica
State Monitor Fabric Hosting Fabric Fabric Hosting Leader Elector
Partition Manager Global Replica State Monitor Placement Advisor
Load Balancer SQL Server Global Partition Map Fabric
- 21. Data Node Device Manager Provisioning Deployment AutoPilot
Service Manager Watchdogs Management Services Deployment Services
Health Monitoring Perf Collection Backup Self Healing Perf
Collection Cluster Perf DB (CloudDB TableGroup) Reporting Off-site
Backup Trace Collection Trace DB (CloudDB TableGroup) CloudDB
Deployment Self Healing Application Deployment AutoPilot
- 22.
- 23.
- 24.
-
- DNS- mydomain.data.beta.mssds.com , mydomain authority ,
data.beta.mssds.com
-
- XSD- string , base64Binary , boolean , decimal , dateTime
-
- , metadata (Id, Version, Kind) flexible
- 25. Property Type Value Metadata ID EntityId VWGOLF-01 Kind
EntityKind Car FlexProps Description String Reliable, one owner,
Price Numeric 12000.00 ListingDate Datetime 01-01-2008 LocationZip
String 98052 Property Type Value Metadata ID EntityId
MINICOOPER-264 Kind EntityKind FunCar FlexProps Description String
Reliable, one owner, Price Numeric 12000.00 ListingDate String 1 st
January, 2008 LocationZip String 98052 EngineSize Numeric 1600
Additional property Different instance types Different Kinds
- 26.
- 5fdc7c86-b3de-4f6f-a424-3e9c4d9215ad_MySampleBook
- 27.
- Entity e1 = new Entity();
- // Set required metadata properties
- e1.Id = Guid.NewGuid().ToString() + "_MySampleBook";
- e1.Kind = "UsedBookKind";
- e1.Properties = new System.Collections.Generic.List();
- Property p = new Property();
- p.Value = "My First Book";
- Property p1 = new Property();
- p1.Value = "1-57880-066-3";
- Property p2 = new Property();
- Entity e1 = new Entity();
- // Set required metadata properties
- e1.Id = Guid.NewGuid().ToString() + "_MySampleBook";
- e1.Kind = "UsedBookKind";
- e1.Properties = new Dictionary();
- e1.Properties["Title"] = "My first Book";
- e1.Properties["ISBN"] = "1-57880-066-36";
- e1.Properties["Author"] = "Mr. Author";
- 28. SSDS CloudDB Data Cluster Fabric Replication SQL Client
TECHNOLOGY STACK DATA MODEL Sitka midtier Storage Tier SOAP or REST
Sitka Biz Logic Layer Mgmt. Services SQL Server Fabric Data Node
Data Node Mgmt. Services Data Node SQL Server Fabric Mgmt. Services
Data Node SQL Server Fabric Mgmt. Services Data Node SQL Server
Fabric Mgmt. Services Data Node SQL Server Fabric Mgmt. Services
Data Node SQL Server Fabric Client Application [CloudDB ADO.Net
client] REST SOAP Sitka Runtime
- 29. API
-
- from e in container where e.Kind == Expo:FunCar && e[
Zip ] == 98053 && e[ Model ] == Mini Cooper select e
-
- e[ Tag ] == CUSTOMER , Tag CUSTOMER
- 30. ...
- SQL Server Data Services , Web CloudDB
- 31.
-
- http://www.microsoft.com/sql/dataservices/default.mspx
-
- http://msdn.microsoft.com/en-us/library/cc512417.aspx
-
- http://msdn.microsoft.com/en-us/library/cc678662.aspx
-
- http://blogs.msdn.com/ssds/
-
- http://www.microsoftpdc.com/