Python으로IoT(Internet of Things), Cognitive, Machine Learning 3종 셋트 활용하기

김영욱 EvangelistMicrosoft / DX / 부장youngwook@outlook.com

War of IT

https://github.com/KoreaEva/Python.git

Microsoft  LOVE  ♥

Microsoft ♥ Open Source

PTVS(Python  Tools  for  Visual  Studio)

NTVS(Node.js  Tools  for  Visual  Studio)RTVS(R  Tools  for  Visual  Studio)

PHP  Tools  for  Visual  StudioVisual  C++  for  Linux

Microsoft is Open Source

Microsoft ♥ Python

Sensors on

Linux (Rasberian)

SQL Database Machine Learning

Power BIStream AnalyticsIoT Hubs

Blob / Table

Cognitive Services

Microsoft Cognitive Services

IoT Service

Machine Learning

Visual Studio Code

http://visualstudio.com

Cognitive Servicehttp://www.Microsoft.com/cognitive

Microsoft Cognitive Services Give your apps a human side

VisionFrom faces to feelings, allow your apps to understand images and video

SpeechHear and speak to your users by filtering noise, identifying speakers, and understanding intent

LanguageProcess text and learn how to recognize what users want

KnowledgeTap into rich knowledge amassed from the web, academia, or your own data

SearchAccess billions of web pages, images, videos, and news with the power of Bing APIs

Cognitive Services

Apps Powered by MS Cognitive Services

ProjectMurphy.netCaptionBot.ai

I think it’s a person sitting in front of a computer and he seems ☺. I am 99% sure that’s Bill Gates

Celebslike.me

Roll your own with REST APIs Simple to add: just a few lines of code required

Make the same API code call on iOS, Android, and Windows Integrate into the language and platform of your choice

Built by experts in their field from Microsoft Research, Bing, and Azure Machine Learning Quality documentation, sample code, and community support

Easy Flexible Tested

GET A KEY

BUILD

Why Microsoft Cognitive Services ?

Cognitive Services

Emotion Speaker Recognition

Speech

Custom RecognitionComputer Vision

Face

Video

microsoft.com/cognitive

SearchSpeech Language KnowledgeVision

Linguistic Analysis

Language Understanding

Bing Spell Check

Entity Linking

Knowledge Exploration

Academic Knowledge

Bing Image Search

Bing Video Search

Bing Web Search

WebLM

Text Analytics Recommendations

Bing Autosuggest

Bing News SearchTranslator

Cognitive Services

Emotion Speaker Recognition

Speech

Custom RecognitionComputer Vision

Face

Video

SearchSpeech Language KnowledgeVision

Linguistic Analysis

Language Understanding

Bing Spell Check

Entity Linking

Knowledge Exploration

Academic Knowledge

Bing Image Search

Bing Video Search

Bing Web Search

WebLM

Text Analytics Recommendations

Bing Autosuggest

Bing News SearchTranslator

microsoft.com/cognitive

{Subscription Key}

JSON• http://www.json.org/json-ko.html

Vision APIComputer VisionEmotionFace

Demo

LanguageBing Spell checkLanguage UnderstandingLinguistic AnalysisText Analytics WebLM

Demo

BingBing Web SearchBing Image SearchBing Video SearchBing News SearchBing Autosuggest

Bing beyond search in bing.comSmarter, more

engaging experiences

Trusted by industry-leading experiences

Introducing Bing Search API v5

Web Search

Image Search

Video Search

News Search

Autosuggest

Spell Check

Search API v5

REST

Enhanced Search and Filtering Capabilities

Ongoing Improvements and Support

Web- Scale

High Performance

Secure (HTTPs)

Web Search APIWeb Search API

*screenshots show actual search results on bing.com

https://bingapis.azure-api.net/v5/search?q=nasa

Get relevant web and answer results and metadata with one API call

{ “_type”: “SearchResponse”, “queryContent”: {…}, “webPages”: {…}, “news”: {…}, “images”: {…}, “videos”: {…}, “relatedSearches”: {…}, “rankingResponse”: {…} }

{ “answerType”:”WebPages”, “resultIndex”:0,… }, { “answerType”:”News”, “resultIndex”:1,… }

Ranking Response

Search Response

Web Results

Deep Links

(1st Algo)

News Results

Image Results

Video Results

Related Searches

Vertical Search APIshttps://bingapis.azure-api.net/v5/images/search?q=shuttle+launch

• Enhanced metadata and filters (size, license, style, freshness, color) • Image insights (entity recognition, visually similar)

Image Search API

source: nasa.gov

https://bingapis.azure-api.net/v5/videos/search?q=viral+videos

• Enhanced metadata and filters (price, resolution, length, freshness)

• Motion thumbnails (video preview)

https://bingapis.azure-api.net/v5/news/search?q=cuba

• News by category/market, and trending news • Rich article metadata (featured entities)

source: youtube.com

Video Search API

*screenshots show actual search results in bing.com

Get more results, features and metadata tailored to each search vertical

News Search API

source: cnn.com

Demo

• Sign up and get started today for free at

www.microsoft.com/cognitive

Developer Call to Action

Internet of Thingshttp://www.microsoft.com/iot

Sensors on

Linux (Rasberian)

SQL Database Machine Learning

Power BIStream AnalyticsIoT Hubs

Blob / Table

Cognitive Services

Microsoft Cognitive Services

IoT Service

Machine Learning

• 지원되는 프로토콜은 HTTP1.1, MQTT, AMQP 1.0 (16년 4월 OPC 공식지원 발표)• LWM2M, CoAP 등의 지원은 계획 중이나 시기 미정

IoT Hub

Stream Analysis

Sensors on

Linux (Rasberian)

SQL Database Machine Learning

Power BIStream AnalyticsIoT Hubs

Blob / Table

Cognitive Services

Microsoft Cognitive Services

IoT Service

Machine Learning

Machine Learninghttp://www.microsoft.com/iot

Microsoft & Machine Learning15 years of realizing innovation

SQL Server enables

data mining

Computers work on

users behalf, filtering junk

email

Microsoft Kinect can

watch users gestures

Microsoft launches

Azure Machine Learning

Microsoft search engine

built with machine learning

Bing Maps ships with ML

traffic-prediction service

Successful, real-time, speech-to-

speech translation

John Platt, Distinguished scientist at Microsoft Research

1999 201220082004 201420102005

Machine learning is pervasive throughout Microsoft products.“ ”

One solution for Machine Learning - from data to results

Azure Portal

Azure Ops Team

ML Studio

Data Scientist

HDInsight

Azure Storage

Desktop Data

Azure Portal & ML API service

Azure Ops Team

PowerBI/Dashboards

Mobile AppsWeb Apps

ML API service Developer

Machine Learning

Data I/O

Taking Data & preparing for AnalysisDimensionality reduction. E.g. Kinect measures 1000 points, 6 are relevantFitting Model selection; calibration; assessment

R – free scripts/graphics, many packages based on Vector Data.

Metrics to allow us to describe the data. E.g. Mean, Correlation…

Tools used for Text Input. E.g. ‘What is the theme of this essay?’