Sql Server Data Services

31
Алексей Шуленин Алексей Шуленин Эксперт по технологиям обработки и Эксперт по технологиям обработки и анализа информации анализа информации Департамент стратегических технологий Департамент стратегических технологий Российское представительство Российское представительство Microsoft Microsoft

description

 

Transcript of Sql Server Data Services

  • 1. Microsoft
  • 2. ()
    • (-, -) 8-10
    • , ..,
    • , , IBM/Lotus Microsoft . , .
    • WebEx ( Cisco 2007 .), PlaceWare ( 2003 . MS Office Live Meeting ), WebDialogs (c 2007 IBM Lotus Sametime Unyte) . , - , ?
  • 3. ()
        • ,
        • , , ,
        • ,
      • IT
  • 4. ()
        • public-facing . , Gmail ( Google Enterprise)
      • ( on-premise)
        • ,
        • ,
  • 5.
  • 6. SaaS
      • ,
    • ,
      • ,
      • ,
      • ,
      • , ,
      • : , , , ... IT
  • 7. DaaS
    • , , SaaS . ?
      • , , , ...
  • 8. DaaS
    • Multitenancy hosted model
      • ,
      • SOAP, REST, XML, ODBC, JDBC, SQL
      • , DRI, , ,
    • Dedicated database hosted model
      • : , , ...
      • , .
      • DBA , , ,
    • Database container model
      • ,
      • , , ,
      • ,
      • - (REST, SOAP)
  • 9.
    • Amazon SimpleDB
      • - ,
      • Simple Storage Service (S3) Elastic Compute Cloud (EC2)
      • , ()
      • = ; = , = , =
      • ,
      • API = REST, SOAP
        • SQL
      • DBA ,
      • Web -
    • Force.com
      • PaaS (Platform), DaaS
      • DaaS
      • Force.com Web services API Salesforce Object Query Language (SOQL)
    • EnterpriseDB
      • Postgres Plus Advanced Server Cloud Edition
      • - Amazons Elastic Compute Cloud (EC2) Simple Storage Services (S3)
      • Dedicated Hosted Model
  • 10.
    • Oracle
      • Oracle Application Express (APEX)
      • Oracle On-Demand - hosted database service PeopleSoft Oracle Applications
        • , Oracle
    • Sun-MySQL
      • MySQL DaaS EC2
      • Sun $1 -
      • Project Caroline - PaaS
    • Google BigTable
      • 2
      • Web -, Google Earth, Google Finance, ...
      • Row Key, Column Key, Timestamp . .
      • : ( ) ; , , - , html . 3 .
  • 11. Microsoft
    • Microsoft SQL Server Data Services
      • MIX08 5 2008 .
      • http://visitmix.com/blogs/2008Sessions/BT05/
      • - ( )
      • : http://www.microsoft.com/sql/dataservices/default.mspx
  • 12. Microsoft
    • Distributed Fabric
    Application Service Platform Data Service Platform Integrated Store CloudDB Distributed In-Memory Cache Velocity Queues Data Delivery Identity User Management Reporting Service RS Business Intelligence BI Storage Service Stratus Data Archiving Backup Data Warehouse Manageability (Autopilot) External CloudDB DSP Unified Programming Model Workflow Distributed Job Framework Distributed Query Resource Allocation and Governance Virtualization Synch Services (Harmonica) Data Fidelity And Cleansing Data Center Services (GFS) Billing Networking Facilities Support Throttling and Metering
  • 13. SQL Server Data Services :
    • Zurich , on-premise
      • CloudDB SQL Server
        • Dynamically add / remove partition ranges
        • Load balance partition ranges
          • Windows Live
          • Sitka , Stratus
          • Exchange Hosted Archive (EHS-A) 400
          • SharePoint , Data Protection Manager , BizTalk , ...
        • ?
    • Data Platform Services
      • , ,
    Mgmt, Provisioning (AP) CloudDB Sitka EHS-A Unstructured BLOB Simple Structured Structured, Rich Query Database Spectrum Building Block Svc Finished Svc
  • 14. Low Friction Database Endpoint Rich Query Archive Generic Data Hub Application Cloud DB Sitka Application Cloud DB Archive App. Email / Collab / LOB App Microsoft Written Cloud DB Sitka Application Integration Synch App
  • 15.
    • Goal: A storage platform built for extreme scale and low cost
    • Commodity hardware to lower CapEx
    • Lights out operations and self healing to lower OpEx
    • Optimize I/O throughput
    • Achieved via:
    • Partition data
      • Apps are partition aware to exploit data parallelism for high availability, scaling and throughput
      • Partitions are replicated to achieve reliability
      • System is self healing - partition data fails over, load-balances, and scales-up
    • Trade off single system image for scale, throughput, low cost
      • Fan out operations for large scale, cross partition query workloads
      • Optimize code paths for high throughput
    • Easy to deploy and manage
      • No DBA required to manage cluster
      • Job framework for deploying and running scheduled tasks
    Provisioning, Deployment, Management 1-100 101-200 201-300 301-400 401-500 Client Fetch Partition Map Cluster Manager Request (Key:=323) Partition Lookup
  • 16. CloudDB Table Group Customers Row Group Orders Partition Partitioning Key Column (OrderId)
    • Table : logical relation
      • Has a partitioning key : controls partitioning across servers
      • Has a clustering key : controls ordering of rows within a server
    • Table group : a set of tables with the same partitioning key
    • Row group : set of rows in table group with same partitioning key value
      • Always on exactly one server
      • But may not be clustered
      • ., Customer->Orders->LineItems Customer ID
    • Each table group distributed across nodes
      • Each storage node assigned ranges partitions of key values
      • Each partition is replicated for durability
    Id Name 34 John 57 92 Id Oid S 34 1 34 2 92 1
  • 17. CloudDB Mgmt. Services Data Node SQL Server Fabric Data Node Components Partition Manager Master Node Mgmt. Services Data Node SQL Server Fabric Mgmt. Services Data Node SQL Server Fabric Mgmt. Services Data Node SQL Server Fabric Deployment Health Monitoring AutoPilot Service Management Self-Healing Master Cluster Data Cluster Service Boundary Mid-Tier Node Integrated Client Library Application Mid-Tier Fabric Replication Fetch Partition Map SQL Client Mgmt. Services Data Node SQL Server Fabric Distributed Job Framework Distributed Data Services Fabric Distributed Query Reporting Services Caching GMV Data Node Components Partition Manager Master Node
  • 18.
    • Master Cluster Manager
      • ( )
      • ()
    • Distributed fabric
      • ADO.Net
      • Webstore 5.5 Blue
    • Autopilot
      • , ,
    • Distributed Job Framework
      • ( )
  • 19. CloudDB Client Library (ADO.Net) SQL Process Fabric Process SQL Process Fabric Process SQL Process Fabric Process SQL Process Fabric Process CloudDB Master Node SQL Process Fabric Process CloudDB Master Node SQL Process Fabric Process Distributed Fabric Physical Disks CloudDB Data Cluster CloudDB Master Cluster Manager AP WD AP WD AP WD AP WD AP WD AP WD CloudDB Data Node CloudDB Data Node CloudDB Data Node CloudDB Data Node SQL Replication Fabric Messages SQLClient
  • 20. SQL Server P S S S Replication Agent Local Partition Map Data Node 100 Data Node 101 P S S S Data Node 102 P S S Data Node 103 P S S S Data Node 104 P S S S Data Node 105 P S S S Master Node (Primary Master) Primary Secondary Secondary Fabric Ring Topology Failure Detector Name Resolution Reconfiguration Agent Replica State Monitor Fabric Hosting Fabric Fabric Hosting Leader Elector Partition Manager Global Replica State Monitor Placement Advisor Load Balancer SQL Server Global Partition Map Fabric
  • 21. Data Node Device Manager Provisioning Deployment AutoPilot Service Manager Watchdogs Management Services Deployment Services Health Monitoring Perf Collection Backup Self Healing Perf Collection Cluster Perf DB (CloudDB TableGroup) Reporting Off-site Backup Trace Collection Trace DB (CloudDB TableGroup) CloudDB Deployment Self Healing Application Deployment AutoPilot
  • 22.
    • :
      • ()
    • SLA KPIs
  • 23.
  • 24.
    • A uthority
      • DNS- mydomain.data.beta.mssds.com , mydomain authority , data.beta.mssds.com
    • C ontainer
      • , ,
      • CRUD
    • E ntity
      • name/value
      • XSD- string , base64Binary , boolean , decimal , dateTime
      • , metadata (Id, Version, Kind) flexible
      • Blob -, .- Content
  • 25. Property Type Value Metadata ID EntityId VWGOLF-01 Kind EntityKind Car FlexProps Description String Reliable, one owner, Price Numeric 12000.00 ListingDate Datetime 01-01-2008 LocationZip String 98052 Property Type Value Metadata ID EntityId MINICOOPER-264 Kind EntityKind FunCar FlexProps Description String Reliable, one owner, Price Numeric 12000.00 ListingDate String 1 st January, 2008 LocationZip String 98052 EngineSize Numeric 1600 Additional property Different instance types Different Kinds
  • 26.
    • 5fdc7c86-b3de-4f6f-a424-3e9c4d9215ad_MySampleBook
    • 1
    • My Book
    • 1-57880-066-36
    • Mr. Author
    • Mr. Publisher
    • false
    • 250
    • 2004-01-27T00:00:00
    • AQID
  • 27.
    • Entity e1 = new Entity();
    • // Set required metadata properties
    • e1.Id = Guid.NewGuid().ToString() + "_MySampleBook";
    • e1.Kind = "UsedBookKind";
    • e1.Properties = new System.Collections.Generic.List();
    • Property p = new Property();
    • p.Name = "Title";
    • p.Value = "My First Book";
    • e1.Properties.Add(p);
    • Property p1 = new Property();
    • p1.Name = "ISBN";
    • p1.Value = "1-57880-066-3";
    • e1.Properties.Add(p1);
    • Property p2 = new Property();
    • p2.Name = "Author";
    • p2.Value = "Mr. Author";
    • e1.Properties.Add(p2);
    • Entity e1 = new Entity();
    • // Set required metadata properties
    • e1.Id = Guid.NewGuid().ToString() + "_MySampleBook";
    • e1.Kind = "UsedBookKind";
    • e1.Properties = new Dictionary();
    • e1.Properties["Title"] = "My first Book";
    • e1.Properties["ISBN"] = "1-57880-066-36";
    • e1.Properties["Author"] = "Mr. Author";
  • 28. SSDS CloudDB Data Cluster Fabric Replication SQL Client TECHNOLOGY STACK DATA MODEL Sitka midtier Storage Tier SOAP or REST Sitka Biz Logic Layer Mgmt. Services SQL Server Fabric Data Node Data Node Mgmt. Services Data Node SQL Server Fabric Mgmt. Services Data Node SQL Server Fabric Mgmt. Services Data Node SQL Server Fabric Mgmt. Services Data Node SQL Server Fabric Mgmt. Services Data Node SQL Server Fabric Client Application [CloudDB ADO.Net client] REST SOAP Sitka Runtime
  • 29. API
    • REST, SOAP
    • # LINQ
      • from e in container where e.Kind == Expo:FunCar && e[ Zip ] == 98053 && e[ Model ] == Mini Cooper select e
      • e[ Zip ]
      • e[ Tag ] == CUSTOMER , Tag CUSTOMER
  • 30. ...
    • CloudDB , SQL Server
      • () ( )
      • . .
    • SQL Server Data Services , Web CloudDB
      • Business-ready SLA : ,
      • Application Agility
        • Web 2.0 API
  • 31.
      • http://www.microsoft.com/sql/dataservices/default.mspx
      • -
      • http://msdn.microsoft.com/en-us/library/cc512417.aspx
    • SDK
      • http://msdn.microsoft.com/en-us/library/cc678662.aspx
      • http://blogs.msdn.com/ssds/
    • PDC 2008
      • http://www.microsoftpdc.com/
      • 27-30 , -