20161221 FindSpark(市ヶ谷GeekNightでのLT)

7

Click here to load reader

Transcript of 20161221 FindSpark(市ヶ谷GeekNightでのLT)

Page 1: 20161221 FindSpark(市ヶ谷GeekNightでのLT)

FindSparkPython Spark

Page 2: 20161221 FindSpark(市ヶ谷GeekNightでのLT)
Page 3: 20161221 FindSpark(市ヶ谷GeekNightでのLT)

2017

Page 4: 20161221 FindSpark(市ヶ谷GeekNightでのLT)

Python Spark

IPython Jupyter …

Page 5: 20161221 FindSpark(市ヶ谷GeekNightでのLT)

findSparkhttps://github.com/minrk/

findspark

Page 6: 20161221 FindSpark(市ヶ谷GeekNightでのLT)

pip install findsparkSPARK_HOME

import findsparkfindspark.init()

from pyspark.sql import SparkSession

spark = SparkSession.builder..appName('myApp')..getOrCreate()

Page 7: 20161221 FindSpark(市ヶ谷GeekNightでのLT)