事業成長をBoostさせるデータ基盤 #devsumi #devboost / 20181215

ࣄۀ੒௕ΛBoostͤ͞Δ 
σʔλج൫
2018-12-15 
Developers Boost ʙU30ΤϯδχΞͷొཽ໳ʙ 
presented by @yuzutas0
 
https://www.pexels.com/photo/ﬂight-sky-earth-space-2166/

View Slide

ຊ೔ͷࢿྉ͸WEBʹެ։͠·͢ 
#devsumi #devboost 

ࡱӨɾه࿥ͷඞཁ͸͋Γ·ͤΜ 
ͭ͘Ζ͍Ͱௌ͍͍͚ͯͨͩΕ͹ͱࢥ͍·͢

View Slide

εϥΠυ 100+ / 20min
 
ϒʔετ͔͚ͯ࿩͠·͢ʂ

View Slide

ɹSho Yokoyamaɹ@yuzutas0
ɹɹ
 
 

ϦΫϧʔτςΫϊϩδʔζ  
ITΤϯδχΞϦϯάຊ෦ ϓϩμΫτΤϯδχΞϦϯά෦
ϕϯνϟʔΩϟϐλϧ͔Β౤ࢿΛड͚︎︎ͯͷىۀɾձࣾܦӦɺ  
ϦΫϧʔτάϧʔϓձࣾ︎͓͚Δෳ਺︎৽نࣄۀ︎্ཱͪ͛Λܦ︎ͯݱ৬ɻ
ओ︎ʹٸ੒௕ϓϩμΫτΛର৅︎ʹɺγεςϜΞʔΩςΫνϟ︎࠶ߏங΍ 
ΤϯδχΞνʔϜͷ︎্ཱͪ͛ɾཱ︎௚͠ʹ︎ैࣄɻ
࠷ۙ︎͸ʮݱ৔︎Ͱ࢖ΘΕΔσʔλج൫ʯΛ࣠ʹ︎ɺ 
૊৫શମ︎ʹ͓͚Δσʔλ׆༻Λਪਐ͠︎͍ͯ·͢ɻ

View Slide

ຊ೔ͷ಺༰ͱॏෳ͢Δͱ͜Ζ͕ଟʑ͋Γ·͢
ɹաڈͷʮσʔλج൫ʯࢿྉ

http://www.atmarkit.co.jp/ait/articles/1804/23/news011.html
https://speakerdeck.com/yuzutas0

View Slide

l
z
ฏۉ೥ऩͷߴ͍৬छ͸…… 
ʮData Warehouse ArchitectʯͰ 
15ສ4800υϧʢ1702ສ8000ԁʣ
ITۀքͰฏۉ೥ऩͷߴ͍৬छ͸ιϑτ΢ΣΞΤϯδχΞ
ϦϯάϚωʔδϟɺσʔλ΢ΣΞϋ΢εΞʔΩςΫτɺ
ιϑτ΢ΣΞ։ൃϚωʔδϟͳͲɻถGlassdoor 
https://www.publickey1.jp/blog/18/itglassdoor.html

ɹσʔλج൫ਓࡐ΁ͷ஫໨ʢधཁʣ

View Slide

ɹσʔλج൫ਓࡐ΁ͷ஫໨ʢڙڅʣ
IUUQCIBUFOBOFKQFOUSZZV[VUBTIBUFOBCMPHDPNFOUSZ

View Slide

ϓϩμΫτ։ൃ ʹ͓͚Δ 
ʮ࢖ΘΕΔσʔλج൫ʯ ͷ ߏஙࣄྫ ͷ঺հ

ɹຊ೔ͷΰʔϧ

View Slide

σʔλج൫ͷߏங΍ӡ༻Λ 
୲౰͢ΔςοΫϦʔυ 
։ൃݱ৔ʹσʔλจԽΛਁಁ͍ͤͨ͞ 
ιϑτ΢ΣΞΤϯδχΞ

ɹ૝ఆ͢Δର৅

View Slide

ɹɹɹ
ɹج൫γεςϜʹดͨ͡࿩
ɹɹɹ
"ɹج൫Λ௨ͯ͠จԽΛม͑Δ࿩

ɹΤϯδχΞϦϯάͷձͰ͕͢

View Slide

l
z
 
ιϑτ΢ΣΞ։ൃ্ͷ໰୊ͷଟ͘͸ɺ 
ٕज़తͱ͍͏ΑΓࣾձֶతͳ΋ͷͰ͋Δ
 
τϜɾσϚϧίɺςΟϞγʔɾϨελʔʰϐʔϓϧ΢ΣΞʱ 
https://shop.nikkeibp.co.jp/front/commodity/0000/P85240/

ɹσʔλΛѻ͏ͱ͖ͷน

View Slide

l
z
ΤϯδχΞϦϯάͰॏཁͳͷ͸ 
ʮͲ͏ͨ͠Βޮ཰Α͘ෆ࣮֬ੑΛݮΒ͍͚ͯ͠Δͷ͔ʯ 
ͱ͍͏ߟ͑ํͳͷͰ͢
 
޿໦ େ஍ʰΤϯδχΞϦϯά૊৫࿦΁ͷট଴ʱ 
https://gihyo.jp/book/2018/978-4-7741-9605-3

ɹจԽΛΤϯδχΞϦϯά͢Δ

View Slide

1. ϓϩμΫτ / νʔϜ
 
2. σʔλج൫ͷߏங
ɹɹϢʔεέʔεɹߏஙͷഎܠɹઃܭϙϦγʔɹσʔλϑϩʔɹ։ൃϓϩηε
 
3. σʔλจԽΛ૊৫ʹ૷ண͢Δ

ɹΞδΣϯμ

View Slide

ࠗ׆ɾ࿀׆
ɹϓϩμΫτ

View Slide

ֹ݄՝ۚϞσϧɹ˞࿀݁ͼঁੑϢʔβʔ͸ຊਓ֬ೝྉͷΈ
ɹར༻ͷྲྀΕ
45&1 45&1 45&1
ؾʹͳͬͨΒʮ͍͍Ͷʂʯ ૬ޓ͍͍ͶʂͰϚονϯά ϝοηʔδͰ΍ΓͱΓ։࢝

View Slide

΄͔:ελοϑ༻︎ۀ຿؅ཧπʔϧ︎︎︎αϒγεςϜ
ɹɹɹɹɹɹɹɹɹɹɹɹΦϯϓϨ

ɹγεςϜུ֓

View Slide

※ถࠃͰ͸݁ࠗͨ͠Χοϓϧͷ1/3͕ΦϯϥΠϯͰͷग़ձ͍

ɹσʔςΟϯάࢢ৔ͷ֦େ

View Slide

ɹࣄۀ੒௕ → εςʔΫϗϧμʔͷଟ༷Խ
σβΠϯ
ηΩϡϦςΟ
๏຿
Πϯϑϥ
SRE
ΞϓϦج൫
ू٬
ΧελϚʔ 
αϙʔτ
σʔλ 
αΠΤϯε
ػցֶश 
ΤϯδχΞ
։ൃӡ༻ 
νʔϜA
։ൃӡ༻ 
νʔϜB
։ൃӡ༻ 
νʔϜC
PO PO PO
σΟϨΫγϣϯ
޿ใ

View Slide

 
 

ɹΞδΣϯμ

View Slide

ɹσʔλج൫ = ֤෦ॺʹσʔλΛఏڙ
σʔλج൫

View Slide

 
 

ɹΞδΣϯμ

View Slide

ɹͲͷΑ͏ʹ׆༻͍ͯ͠Δ͔
σʔλج൫

View Slide

Ϗδωεࢦඪʢച্΍Daily Active UserʣͷਪҠ 
 
ຖேͷSlack௨஌ɹɹɹɹSpreadsheetɹɹɹɹμογϡϘʔυ

ɹɹɹKPIϞχλϦϯά
1

View Slide

ओཁಋઢʢձһొ࿥͔Β੒ࠗୀձ·Ͱʣʹ͓͚Δར༻ɾ཭୤
ߦಈϑΝϯωϧɹɹɹɹɹɹδϟʔχʔϚοϓ

ɹɹɹϢʔβʔߦಈͷՄࢹԽ
2

View Slide

ɹɹABςετ݁Ռɹɹɹɹ৽ػೳͷར༻౓߹͍

ɹɹɹࢪࡦͷޮՌݟཱͯɾܭଌ
3

View Slide

ɹɹɹػցֶशʹΑΔϨίϝϯυ
4
http://image.itmedia.co.jp/l/im/ait/articles/1804/23/l_news011_04.jpg

View Slide

ա৒ΞΫηεͳͲͷҟৗύλʔϯΛಛఆ

ɹɹɹ໎࿭ߦҝͷࣗಈݕ஌
5

View Slide

ɹɹɹ໰͍߹Θͤͷ܏޲෼ੳ
6

View Slide

ɹɹɹ޿ࠂ഑৴ͷ࠷దԽ
7

View Slide

෼ੳ݁ՌΛϝσΟΞʹ৘ใఏڙ͢Δ͜ͱͰࢢ৔׆ੑԽʹߩݙ

ɹɹɹχϡʔεϨλʔ
8
IUUQXXXSFDSVJUNQDPKQOFXTSFMFBTF@IUNM

View Slide

σόΠεγΣΞ΍Ϋϥογϡ཰ɺϨεϙϯελΠϜ

ɹɹɹγεςϜϞχλϦϯά
9
IUUQZV[VUBTIBUFOBCMPHDPNFOUSZ

View Slide

ɹɹɹো֐ൃੜ࣌ͷӨڹௐࠪ
10

View Slide

εΫϥϜνʔϜͷϕϩγςΟ ΍ νέοτফԽͷϝτϦΫε

ɹɹɹνʔϜͷΩϟύγςΟ
11

View Slide

͋ΒΏΔ෼໺ɾࢪࡦͰσʔλʹ΋ͱ͍ͮͨ 
ҙࢥܾఆʢBIʣ΍ࣗಈ൑ఆʢMLʣ͕ॏཁʹ

ɹϢʔεέʔε͸ଟذʹ౉Δ

View Slide

 
 

ɹΞδΣϯμ

View Slide

ɹͳͥج൫͕ඞཁʹͳ͔ͬͨ
σʔλج൫

View Slide

DBͷσʔλΛ࢖͍͍ͨͷͰ 
೔࣍ͰS3ʹCSVΛग़ྗ͍ͯͩ͘͠͞ 

ɹ࠷ॳ͸খ͞ͳσʔλૄ௨ґཔ
෦ॺA

View Slide

ɹ૊৫͕εέʔϧ → ֤෦ॺ͔Βґཔ
෦ॺB
෦ॺC
෦ॺD

View Slide

ͬͪ͜Ͱαʔόͱૄ௨πʔϧΛ༻ҙ͠·͢ 
ϨϏϡʔˍຊ൪؀ڥʹஔ͍ͯ΋Β͑·͔͢

ɹରԠʹֻ͕͔࣌ؒΔͱ……
ੜσʔλΛ౉ͯ͠΋Β͑Ε͹ 
ͬͪ͜Ͱ࢖͑ΔΑ͏ʹՃ޻͢ΔͷͰ
෦ॺE

View Slide

ɹ֤෦ॺ͝ͱʹσʔλૄ௨ɾՃ޻
෦ॺA 
நग़σʔλ
෦ॺB 
நग़σʔλ
෦ॺA 
Ճ޻ϩδοΫ
෦ॺB 
Ճ޻ϩδοΫ

View Slide

ɹମ੍ͷ··ʹγεςϜෳࡶԽ - ίϯ΢ΣΠͷ๏ଇ
ݩσʔλ
֤෦ॺ޲͚ʹσʔλࢀরγεςϜΛܧ͗଍͠

View Slide

ɾফඅ੫ΛؚΉͷ͔
ɾׂҾ෼͸Ͳ͜Ͱࠩ͠Ҿ͘ͷ͔
ɾ೥ؒܖ໿ϓϥϯ͸݄࣍Ͱ҈෼͢Δͷ͔
ɾ҈෼͢Δ৔߹͸్தղ໿ΛͲ͜ʹܭ্͢Δͷ͔
ɾฦۚ͸ޙͰҰׅͰࠩ͠Ҿ͘ͷ͔ɺߪೖ࣌ʹ͔͞ͷ΅ͬͯࠩ͠Ҿ͘ͷ͔
ɾϞόΠϧΞϓϦͷ՝ۚ͸Apple΍Google΁ͷܾࡁख਺ྉΛؚΉͷ͔
ɾ༻్͸ࡒ຿ձܭ͔؅ཧձܭ͔

ɹ෦ॺ͝ͱʹʮച্ʯ͕ζϨΔ໰୊

View Slide

ʢҰ͕࣌ສࣄ͜ͷௐࢠͳͷͰʣ
 
͋ΔνʔϜ͸ࣗ෼ͨͪͷࢪࡦͰKPI͕େ෯ʹ্͕ͬͨͱओுͯ͠΋
ผͷνʔϜ͔Β͸Կͷࢀߟʹ΋ͳΒͳ͍਺ࣈʹݟ͑Δ
Ͳͷσʔλ͕ਖ਼͍͠ͷ͔୭΋෼͔Βͳ͍ͨΊ
ԣஅͰͷҙࢥܾఆ΍ௐ੔͕ࠔ೉ʹͳΔ

ɹσʔλͷ৴པੑ

View Slide

 
http://jp.techcrunch.com/2017/06/25/20170623ﬁve-building-blocks-of-a-data-driven-culture/

ɹମ੍֦େ → σʔλج൫ͷඞཁੑ
ࣄ࣮ͷ୯Ұ৘ใݯΛ͍࣋ͬͯΔ৔߹ʹ͸ɺΞφϦετ΍ 
ଞͷҙࢥܾఆऀͱ͍ͬͨΤϯυϢʔβʔͨͪʹɺ༏ΕͨՁ஋Λ 
ఏڙ͢Δ͜ͱ͕Ͱ͖Δɻ൴Β͸૊৫಺ͰσʔλΛ୳͕࣌ؒ͢ 
গͳͯ͘ࡁΉΑ͏ʹͳΓɺσʔλͷར༻ʹΑΓଟ͘ͷ࣌ؒΛ 
ׂ͘͜ͱ͕Ͱ͖ΔΑ͏ʹͳΔ͔Βͩɻ

View Slide

 
 

ɹΞδΣϯμ

View Slide

ɹͲͷΑ͏ͳγεςϜΛߏங͔ͨ͠
σʔλج൫

View Slide

1. ModelͱViewΛ෼͚Δ΂͠ 
2. ͳΔ΂͘ϥΫͯ͠࡞Δ΂͠

ɹઃܭϙϦγʔ

View Slide

ɹModelͱViewΛ෼͚Δ΂͠
ɹɹɹɹɹɹɹɹɹɹɹɹɹDWH
੹຿ʹԠͨ͡γεςϜͷ෼཭ɾ݁߹ 
Model (஝ੵ/Ճ޻) ͱView (ࢀর)

View Slide

ɹ஫ҙɿ෦ॺ͝ͱʹ࠷దͳView͸ҟͳΔ
Excel
ؾܰʹ਺ࣈΛม͑ͯ 
γϛϡϨʔγϣϯ
Ϗδωε෦໳
Tableau
ߴՁ֨ɾߴػೳ 
෼ੳཁٻʹରԠ
Re:dash
SQL͕ॻ͚Δͻͱ 
͓खܰར༻
σΟϨΫλʔ
Jupyter 
GitͰίʔυ؅ཧ 
ϓϩάϥϜͷԸܙ
ΤϯδχΞ
෼ੳ෦໳

View Slide

ɹͳΔ΂͘ϥΫͯ͠࡞Δ΂͠
σʔλૢ࡞ͳΒPython
ΤίγεςϜʹ৐Δ
σʔλอଘͳΒBigQuery 
GoogleʹཔΔ
ΞϓϦ૚ Πϯϑϥ

View Slide

 
 

ɹΞδΣϯμ

View Slide

ɹσʔλϑϩʔͷߏங
ऩू Ճ޻ ׆༻
஝ੵ
ύΠϓϥΠϯ؅ཧ
Model View

View Slide

ऩू Ճ޻ ׆༻
஝ੵ
Model View
ऩू
ύΠϓϥΠϯ؅ཧ

View Slide

ɹσʔλऩू
ݸਓ৘ใ 
ϚεΫࡁΈView
Recruit Ads
Console
Recruit Crash 
Report
όον
ετϦʔϛϯά
WebAPI
εΫϨΠϐϯά
requests +
beautiful soup

View Slide

Python (requests + beautiful soup) on Jupiter ʹΑΔ 
WebAPIίʔϧɾը໘εΫϨΠϐϯά

ɹখ͘͞ࢼ͠ͳ͕ΒγεςϜΛҭͯΔ
·ͣ͸ϩʔΧϧ؀ڥͰࡁ·ͤΔ ܁Γฦ͠࢖͏ͳΒεΫϦϓτԽ
IUUQTXXXTIBSFJDPOOFUEPDVNFOUpMFQZ

View Slide

ऩू Ճ޻ ׆༻
஝ੵ
Model View
஝ੵ
ύΠϓϥΠϯ؅ཧ

View Slide

3૚ߏ଄ 
ࢀߟʰ10೥ઓ͑Δσʔλ෼ੳೖ໳ - SQLΛ෢ثʹσʔλ׆༻࣌୅Λੜ͖ൈ͘ʱ

ɹσʔλ஝ੵ
ɹɹɹɹɹɹBigQuery - Google Cloud Platform
Source 
ݩσʔλͷίϐʔ
Warehouse 
ओཁࢦඪɾසग़σʔλ 
தؒςʔϒϧ
App 
֤πʔϧ͔Β௚઀ࢀর 
ඇٕज़ऀ޲͚IF
஝ੵ

View Slide

ྫɿ enmusubi__source__db
ΞϯμʔείΞ2ͭͰཁૉΛ۠੾Δ 
BEMʢCSSͷઃܭख๏ʣϥΠΫͳنଇ

ɹσʔληοτͷ໋໊نଇ
ϓϩμΫτ໊ source
warehouse
app
ϝΠϯDB
αʔόϩά
ΞΫηεղੳπʔϧ

View Slide

૚ߏ଄ʹ͓͚ΔͭͷྲྀΕ

"QQ
ར༻ऀ޲͚*'
㲈σʔλϚʔτ
8BSFIPVTF
υϝΠϯ஌ࣝΛද͢σʔλ
㲈σʔλ΢ΣΞϋ΢ε
4PVSDF
ݩσʔλͷίϐʔ
㲈σʔλϨΠΫ
σʔλύΠϓϥΠϯʹ͓͍ͯػց͕ॲཧ͢ΔྲྀΕ
ࣄۀ΍γεςϜͷ 
શσʔλΛίϐʔ͢Δ
μογϡϘʔυ΍ 
ϨϙʔτͱରʹͳΔ
։ൃϓϩηεʹ͓͍ͯਓ͕ؒઃܭ͢ΔྲྀΕ
ूܭɾ෼ੳύλʔϯΛ੔ཧ 
㲈8*5)۟ͷසग़σʔλ
ᶃ ᶄ ᶅ
ᶃ ᶃ
ᶄ

View Slide

ऩू Ճ޻ ׆༻
஝ੵ
Model View
Ճ޻
ύΠϓϥΠϯ؅ཧ

View Slide

3૚ߏ଄ 
ࢀߟʰ10೥ઓ͑Δσʔλ෼ੳೖ໳ - SQLΛ෢ثʹσʔλ׆༻࣌୅Λੜ͖ൈ͘ʱ

ɹσʔλՃ޻
ɹɹɹɹɹɹBigQuery - Google Cloud Platform
Source 
ݩσʔλͷίϐʔ
Warehouse 
ओཁࢦඪɾසग़σʔλ 
தؒςʔϒϧ
App 
֤πʔϧ͔Β௚઀ࢀর 
ඇٕज़ऀ޲͚IF
Ճ޻ Ճ޻

View Slide

IUUQTHSPXUIIBDLKPVSOBMDPNLQJUSFFGPSBQQ
ɹओཁࢦඪΛதؒςʔϒϧͰ؅ཧ

View Slide

8*5)۟ͷͭͭΛΦϒδΣΫτͷΑ͏ʹѻ͏ 
ωετͤͣ͞ʹ8*5)͚۟ͩͰෳࡶͳूܭϩδοΫΛ૊Έཱ͍ͯͯ͘
42-πϦʔʹΑΔूܭϩδοΫ

JOTQJSFECZlσʔλϒϨϯσΟϯάˍ༧ଌ෼ੳπʔϧzʰ"MUFSZYʱ

View Slide

ऩू Ճ޻ ׆༻
஝ੵ
Model View
׆༻
ύΠϓϥΠϯ؅ཧ

View Slide

ɹσʔλ׆༻ - Pushܕ
IUUQGSFFJMMVTUSBUJPOTHBUBHOFUIUNM
ػցֶशࢪࡦ

View Slide

ΞυϗοΫ
ࣗಈԽ

ɹσʔλ׆༻ - Pullܕ

View Slide

ऩू Ճ޻ ׆༻
஝ੵ
Model View
ύΠϓϥΠϯ؅ཧ

View Slide

؅ཧπʔϧʹظ଴͢Δཁ݅ʢཧ૝ʣ
 
 

ɹσʔλύΠϓϥΠϯͷ؅ཧ
1. ίʔυͰόʔδϣϯ؅ཧ 
2. εέδϡʔϧࣗಈىಈ 
3. ηοτΞοϓ΍ϝϯςφϯεͷָ͞(DB಺แͳͲ) 
4. GUI/CUI྆ํͰϩάɾύϑΥʔϚϯεͷ؅ཧ 
5. GUI/CUI྆ํͰม਺ࢦఆͷ࠶࣮ߦ
6. ࣗಈϦτϥΠॲཧɾεΩοϓػೳ 
7. εΫϦϓτͷฒྻ࣮ߦ 
8. αʔόͷΦʔτεέʔϧ 
9. ༗޲ඇ८ճάϥϑͷࣗಈ࡞੒ 
10. Python3.6~ରԠʢςΩετॲཧ͕֨ஈʹָʣ

View Slide

࠷ॳ͸Jenkinsͷ͓खܰߏங͔Β͸͡Ίͨ
 
ɹɹɹɹɹɹ● 2ܥ + BlueOcean + Pipeline of jenkinsﬁles 
ɹɹɹɹɹɹ● ϦτϥΠػߏɾॲཧ࠷దԽ͸ଞʹྼΔ 
ɹɹɹɹɹɹ● jenkinsδϣϒ͔ΒγΣϧܦ༝Ͱ֤छॲཧΛίʔϧ

ɹখ࢝͘͞ΊΔ ※ݱࡏ͸Cloud ComposerʹҠ؅ࡁΈ

View Slide

ɹσʔλϑϩʔͷߏஙʢ׬ʣ
ऩू Ճ޻ ׆༻
஝ੵ
Model View
ύΠϓϥΠϯ؅ཧ

View Slide

 
 

ɹΞδΣϯμ

View Slide

ɹͲͷΑ͏ͳϓϩηεΛ࠾༻͔ͨ͠
σʔλج൫

View Slide

ʮσʔλ׆༻ͷج൫ʯܭը͸
ࣦഊ͔Β࢝·ͬͨ

View Slide

μογϡϘʔυΛ 
෦԰ͷϞχλʔʹө͢
ɹ࠷ॳͷҰา

View Slide

1. ຖ೔ͷKPIΛ͢Β͢Βݴ͑ΔΑ͏ʹͳΔ͔΋ 
 
ɹ2. ҟৗ஋ʹؾ͍ͮͯਝ଎ʹಈ͚ΔΑ͏ʹͳΔ͔΋
ɹߴ·Δظ଴

View Slide

1िؒͰ୭΋ݟͳ͘ͳͬͨ
ɹݱ࣮͸ඇ৘Ͱ͋Δ

View Slide

View Slide

ɹɹɹ׬ᘳͳاըॻʁ
ɹɹɹѹ౗తͳ༧ࢉʁ
ɹɹɹ1೥ؒͷ։ൃϓϩδΣΫτʁ

ɹʮ࠷ڧͷσʔλج൫ʯΛࢧ͑Δϓϩηεʁ

View Slide

ɹɹɹ׬ᘳͳاըॻʁ
ɹɹɹѹ౗తͳ༧ࢉʁ
ɹɹɹ1೥ؒͷ։ൃϓϩδΣΫτʁ

ɹʮ࠷ڧͷσʔλج൫ʯΛࢧ͑Δϓϩηεʁ
❌

View Slide

ɹɹ● ࢥ͍ͬͯͨͷͱҧͬͨ
ɹɹ● ྑͦ͞͏͚ͩͲ݁ہ࢖Θͳ͔ͬͨ

ɹ1೥ޙʹ଴ͭ΋ͷ

View Slide

ɹʮԶͷߟ͑ͨ࠷ڧͷσʔλج൫ʯ͸࢖ΘΕͳ͍
IUUQXXXQSPKFDUDBSUPPODPN

View Slide

→ ͜ΕͳΒ࣮֬ʹ࢖ͬͯ΋Β͑Δ

ɹগͣͭ͠γεςϜΛஔ͖׵͑ͨ
 
࣮͸͏ͪͷ෦ॺͰຖேSlackʹάϥϑΛ 
खಈͰྲྀ͍ͯ͠ΔΜ͚ͩͲʂ
 
͜ͷػʹࣗಈԽ͠·͔͢ʂ

View Slide

ɹɹɹQ.ɹ࠷ॳʹཁ݅Λશ෦ચ͍ग़ͤ͹OKʁ 
 
ɹɹɹA.ɹNGʂʮ΍Γ͍ͨ͜ͱʯ͸มΘΔʂ 
ɹɹɹɹɹɹɹ ● ଞࣾϒϩάΛݟͯʮ͏ͪ΋΍Γ͍ͨʂʯ 
ɹɹɹɹɹɹɹ ● ৽͍͠BIπʔϧͷఏҊʹʮ͜Ε͍͍ʂʯ 
ɹɹɹɹɹɹɹ ● ࣮ࡍʹը໘Λ࡞ͬͨΒʮͳΜ͔ҧ͏ʂʯ
 
ɹɹ ɹɹ → มԽʹॊೈʹରԠ͢Δʂ

ɹΠςϨʔγϣϯΛճ͢͜ͱ͕େࣄ

View Slide

TodoΛνέοτ؅ཧ → ॊೈʹ༏ઌॱҐΛೖΕସ͑Δ

ɹνέοτۦಈ։ൃ

View Slide

ɹλεΫͷ༏ઌॱҐ
1 σʔλ͕·͕͍ͪͬͯΔ 
ٙ࿭ͷௐࠪ
ɹ1ͭؒҧ͍ͬͯΔͱશ෦৴༻Ͱ͖ͳ͘ͳΔͷͰ࠷༏ઌରԠɻ 
ɹ͙͢ௐࠪ͢Ε͹ؔ܎ऀͷ৴༻࢒ߴΛ૿΍ͤΔɻ
2 Modelվम
ɹσʔλ߲໨௥ՃͳͲɻ 
ɹଟগݟʹͯ͘͘΋࢖͑Δঢ়ଶʹ͢Δ͜ͱ͕༏ઌɻ 
ɹ࠷ѱͷ৔߹Ͱ΋Ͳ͏ʹ͔࢖͏ଆͰ޻෉Ͱ͖ΔͷͰɻ
3 Viewվम
ɹάϥϑͷݟӫ͑ͳͲɻ 
ɹҰ൪ʮมԽ͍ͯ͠ΔʯΠϯύΫτ → ؔ܎ߏஙʹ͸د༩ɻ 
ɹ࢖͍खʹͱͬͯ͸ॏཁͳͷͰՄೳͳൣғͰαϙʔτɻ
4 γεςϜͷอकੑͱ 
ύϑΥʔϚϯε
ɹϘτϧωοΫʹͳͬͨΒରॲ͢Δɻ 
ɹ࠷ॳ͔ΒڽΔͱʮૣ͗͢Δ࠷దԽʯʹؕΓ͕ͪɻ 
ɹ࡞ۀνέοτʹ͢Δ·Ͱ΋ͳ͍ͭ͘Ͱʹ௚͢श׳Λ͚ͭΔɻ

View Slide

ɹࣗಈςετʹΑΔI/Oͷ୲อ
● Excel಺༰Λظ଴஋ʹ൓ө → GreenʹͳΕ͹࠶ݱ׬ྃ - ·͞ʹ “TDD” 
● SQLνϡʔχϯά΍ϦϑΝΫλ࣌ʹσάϨΛଈ࣌ݕ஌Ͱ͖ΔͷͰ૬ੑྑ͍

View Slide

ɹॏް௕େͳExcelΛ࠶ݱ͢Δˠ·ͣղಡ
ϚΠϯυϚοϓʹΑΔ੔ཧ 
εϥΠυʹೖΔΑ͏ʹʢೖΓ͖ͬͯͳ͍͚ͲʣॖΊͨΒը૾͕௵Εͯ͠΋͏ͨ……

View Slide

ɹɹ1. Jupyter Notebook Ͱௐࠪ಺༰ͱ 
ɹɹɹσʔλΛ࠶ݱՄೳͳܗͰอଘ͢Δ
 
 
ɹɹ2. Github Preview Λͦͷ·· 
ɹɹɹઆ໌ࢿྉͱͯ͠ར༻͢Δ

ɹطଘͷܭࢉϛε΍σʔλෆ੔߹Λൃݟ

View Slide

ɹχʔζ։୓ͷ޷॥؀
֤෦ॺͷϢʔεέʔεΛ 
ώΞϦϯά͠΍͘͢ͳΔ
ʮσʔλͷ͜ͱ͸͍ͭ͜ʹฉ͚ʯ 
ʹ ࣭໰΍૬ஊ͕དྷΔΑ͏ʹͳΔ
طଘσʔλͷϛε΍໰୊ɺ 
͞ΒͳΔհࡏ༨஍ʹؾ෇͚Δ
খ͞ͳ࣮੷ 
طଘσʔλͷܭࢉϛε΍ෆ੔߹Λൃݟ 
→ ใࠂͯ͠௚͢

View Slide

ͱʹ͔͘਺ࣈ͕߹Θͳ͍

ɹ޷॥؀Λࢧ͑Δ೜଱
γεςϜ࿈ܞͷ్தͰ࢛ࣺޒೖ͕ੵΈॏͳΔ
Excel͕طʹ 4 x 1990 = 7959 ͱͳ͍ͬͯΔ
࣮ߦλΠϛϯάͰूܭ݁Ռ͕มΘΔ 
→ طଘͷ਺஋͸୭΋࠶ݱͰ͖ͳ͍

View Slide

࣮ࡍʹඅ΍ͨ࣌ؒ͠ͷ80% ʹ ͻͨ͢Β஍ಓͳ࡞ۀ
 
·͊ɺେมͰͨ͠ɻ

ɹ׼ͱྦͷτϥϒϧγϡʔςΟϯά

View Slide

ɹ֤෦ॺ΁ͷσʔλఏڙΛ࣮ݱ
σʔλج൫

View Slide

 
 

ɹΞδΣϯμ

View Slide

ɹΤϯδχΞ͸Measure͔Β࢝ΊͯΈΔ
Build
Measure
Learn
Ͱ͖͍ͯΔ
΍ͬͯΈΔ

View Slide

ɹɹͲΜͳϢʔβʔ͕৽ػೳΛ࢖ͬͨͷ͔ 
ɹɹϓϩμΫτʹͲΜͳظ଴Λ΋͍ͬͯΔͷ͔
ɹɹϏδωεKPI͸Ͳͷఔ౓޲্ͨ͠ͷ͔ 
ɹɹ෭࡞༻͸͔͋ͬͨʢ͋ΔػೳΛԡ͠ग़͢ → ผͷػೳ͕࢖ΘΕͳ͘ͳΔՄೳੑʣ

ɹ࣮ࢪͨ͠ࢪࡦͷ݁ՌΛ෼ੳ
IUUQHBUBHOFUGSFFJMMVTUSBJUJPO

View Slide

ɹ͜Μͳײ͡Ͱ΍Γ·ͨ͠
1. ϗϫΠτϘʔυʹ෼ੳཁ݅ 
ɹɹΧελϚʔߦಈભҠΛϕʔεͱͨ͠ࢦඪπϦʔ 
ɹɹϩάΠϯ཰͕޲্ → ΞΫγϣϯ͕… → ച্׵ࢉ
 
ɹɹɹɹ2. JupyterͰ෼ੳ 
ɹɹɹɹɹίʔυ͸શͯίϛοτཤྺͰ؅ཧ 
 
ɹɹɹɹɹɹɹɹ3. ෼ੳ݁ՌΛؔ܎ऀʹڞ༗ 
ɹɹɹɹɹɹɹɹɹGithubͷϓϨϏϡʔը໘Λ׆༻

View Slide

1. ํ޲ੑΛҙࣝ͢Δʢϝοηʔδϯάʣ
2. ମݧͯ͠ΈΔʢτϥΠΞϧʣ
3. ࢓૊ΈԽ͢Δʢϓϩηε૷ணʣ
4. ੒ޭܦݧΛڞ༗͢Δ

ɹจԽΛਁಁͤ͞ΔྲྀΕ

View Slide

͋ͷख͜ͷखͰʮσʔλ෼ੳ΍Ζ͏ʯͷۭؾΛৢ੒
ɹ ● σʔλ෼ੳϋοΧιϯͷ։࠵
ɹ ● ே׆ x ࣗ༝ݚڀʢϏοτίΠϯͷ஋্͕ΓཁҼΛ౷ܭղੳ͢Δۚͷ๢ऀ͕େྔൃੜʣ
ɹ ● JupyterHubΛ֦ுͨ͠PythonֶशαΠτ΍ 
ɹɹ֎ʹஔ͚ͳ͍σʔλ޲͚ͷnbviewerΛࣾ಺ఏڙ

ɹϝοηʔδϯά

View Slide

1ͭͷϞχλʔΛғΜͰશһͰ࡞ۀ͢Δ
ɹɹ ● पғ͕ௐ΂ͨΓΞυόΠε͠ͳ͕ΒਐΊΔ 
ɹɹɹ → ϋϚΒͳ͍ / ࠳ંΛ๷͙ɺTips΍ίπΛڞ༗͋͠͏ 
ɹɹ ● օ͕΍ΔͳΒࣗ෼΋΍Δ͔ʂͷޙԡ͠ 
ɹɹɹ → ʮ΍ͬͯΈͨΒࢥͬͨҎ্ʹྑ͔ͬͨʯͷମݧ

ɹମݧɿϞϒ ϓϩάϥϛϯά σʔλ෼ੳ

View Slide

 
σʔλ࢓༷ʹৄ͍͠ʢগͳ͘ͱ΋ௐࠪ͢ΔεΩϧ͸΋͍ͬͯΔʣΤϯδχΞ͕ 
୲౰ྖҬΛ޿͛Δ͜ͱͰલޙ޻ఔͷϦʔυλΠϜΛ୹ॖ 

ɹϓϩηε૷ணɿ։ൃ޻ఔʹ૊ΈࠐΉ
੡଄
ઃܭ ࢼݧ ϦϦʔε
ޮՌ 
ଌఆ
ཁ݅ 
ఆٛ
ཁٻ 
੔ཧ
੡଄
ઃܭ ࢼݧ ϦϦʔε
ޮՌ 
ଌఆ
ཁ݅ 
ఆٛ
ཁٻ 
੔ཧ
طʹ΍͍ͬͯΔ
෼ੳཁٻ ϩάཁ݅ ܭଌ
ΞΠσΞ

View Slide

ΤϯδχΞ ʹ ͦͷ৔Ͱσʔλ࢓༷Λௐ΂Δ͜ͱ͕Ͱ͖Δ
 
σʔλαΠΤϯε෦໳͕࢓༷ώΞϦϯάΛॏͶͯ 
1ि͔͚͍ؒͯͨ෼ੳ͕1࣌ؒͰ׬ྃʢϑϩʔޮ཰Խʣ

ɹ੒ޭମݧɿΞδϦςΟͷ޲্
ϝΠϯϞχλʔ͸ 
Jupyter Notebook
αΠυϞχλʔ͸ 
ϓϩμΫτͷιʔείʔυ
ʴ

View Slide

νʔϜ͝ͱͷຽओԽঢ়گ
֤νʔϜ͕σʔλ׆༻Ͱ͖͍ͯΔ͔ϞχλϦϯάˠϒϩοΧʔͷݕ஌ɾ෼ੳˠվળΞΫγϣϯ

νʔϜ" νʔϜ# νʔϜ$ νʔϜ% νʔϜ& νʔϜ' νʔϜ( νʔϜ) νʔϜ* νʔϜ+ νʔϜ,
ੜϩά 
ಠࣗར༻
σʔλ5ࢧԉ 
ۀ຿ґཔ
σʔλ5ࢧԉ 
σʔλग़ྗ
ࣗओత 
σʔλग़ྗ
୲౰ऀґଘ ୲౰ऀґଘ ୲౰ऀґଘ
ࣗओత 
σʔλੜ੒
ଞνʔϜґཔ
ج൫ߩݙʂ ୲౰ऀґଘ ୲౰ऀґଘ
ہॴԽͷน
ࣗ૸ͷน
վળͷน

View Slide

 
 

ɹΞδΣϯμ

View Slide

ɾݱ৔ͷ1ਓ1ਓ͕ओ໾ͱͳΓɺσʔλΛ׆༻ ͯ͠ ϓϩμΫτ΍ۀ຿ Λຏ͖ࠐΉ
ɾ͜ͷੵΈॏͶʹΑͬͯࣄۀ͕੒௕͠ɺސ٬ʹՁ஋Λಧ͚Δ͜ͱʹͳΔ
ɹࣄۀͷ੒௕ʢBoostʣΛࢧ͑Δ
4&$*Ϟσϧ
ސ٬Ձ஋ উͪےɾUVP
ΤϯδχΞ ू٬
σβΠϯ ηΩϡϦςΟ
๏຿
ΧελϚʔαϙʔτ ޿ใ
ࢧԉऀɾ։୓ऀͱͯ͠ͷ 
σʔλαΠΤϯςΟετ
σʔλ

View Slide

গ͠Ͱ΋ଟ͘ͷ ։ൃݱ৔ ͕ 
ੈͷதʹ ྑ͍ϓϩμΫτ Λఏڙ͢Δ 
ώϯτ ʹͳΕͨΒͱࢥ͍ͬͯ·͢

ɹ఻͍͑ͨ͜ͱ

View Slide

“σʔλج൫” ʹڵຯͷ͋Δ
U30ͳιϑτ΢ΣΞΤϯδχΞͷօ༷
ͥͻҰॹʹಇ͖·ͤΜ͔ʂʁ

ɹʲએ఻ʳJoin Us !!!

View Slide

͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠
presented by @yuzutas0 
https://www.pexels.com/photo/ﬂight-sky-earth-space-2166/

View Slide

事業成長をBoostさせるデータ基盤 #devsumi #devboost / 20181215

事業成長をBoostさせるデータ基盤 #devsumi #devboost / 20181215

yuzutas0
PRO

More Decks by yuzutas0

Other Decks in Technology

Featured

Transcript

事業成長をBoostさせるデータ基盤 #devsumi #devboost / 20181215

事業成長をBoostさせるデータ基盤 #devsumi #devboost / 20181215

yuzutas0 PRO

More Decks by yuzutas0

Other Decks in Technology

Featured

Transcript

yuzutas0
PRO