Upgrade to Pro — share decks privately, control downloads, hide ads and more …

adhoc analysis apache spark

moyomot
June 23, 2015
1.1k

adhoc analysis apache spark

moyomot

June 23, 2015
Tweet

Transcript

  1. 4QBSLͷ͕͜͜͏Ε͍͠ w 4ͱͷ਌࿨ੑ͕ߴ͍ w +40/෦෼ͷऔΓग़͕͠༰қ w 4QBSL42-ɺ%BUB'SBNF͕࢖͑Δ ※ίʔυΠϝʔδ val textFile

    = sc.textFile(“s3n://bucket-name/path/*/*.gz”) val json = textFile.map(…) val table = sqlContext.jsonRDD(json) … val data = sqlContext.sql(“SELECT … “)