Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

MLCT #5 Pipeline Jungles とたたかう話

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for soonraah soonraah
July 13, 2018
Technology
2k
0

MLCT #5 Pipeline Jungles とたたかう話

Avatar for soonraah

soonraah

July 13, 2018

More Decks by soonraah

See All by soonraah
Amazon EMR でのバッチ処理 Spark アプリケーション運用で 気をつけたいこと
Avatar for soonraah soonraah
1
650
Apache Spark による推薦システム案件例
Avatar for soonraah soonraah
11
8.1k
Spark MLlib でやってみる協調フィルタリング
Avatar for soonraah soonraah
8
7.8k

Other Decks in Technology

See All in Technology
AIカンパニーへの転換を支えた、エンジニアの仕事の再定義
Avatar for KNOWLEDGE WORK / 株式会社ナレッジワーク kworkdev
PRO
2
1.2k
Temporal 最高!でも改めて「日付」について調べたら人類の負債すぎる件
Avatar for Riya Amemiya riyaamemiya
0
150
AIがコードを書く時代に、エンジニアは何で自分の価値を証明するのか / In an era where AI writes code how do engineers prove their value
Avatar for CARTA Engineering carta_engineering
3
1.1k
Optunaの最新リリースv5.0について
Avatar for Preferred Networks pfn
PRO
0
120
1つのリクエストを追って理解する - llm-dのP/D分離
Avatar for akhino akhino
1
160
V8のArray.prototype.flatを最大約20倍速くするまでと、巨大OSSへの大規模コミットの道のり
Avatar for Riya Amemiya riyaamemiya
0
290
10年後、Engineering 行為を剥奪されるとして、わたしたちは、どう、何を創ればいいだろうか。 / If Engineering Is Taken Away in 10 Years, How and What Should We Create?
Avatar for 株式会社ビットキー / Bitkey Inc. bitkey
PRO
1
190
⾮構造化データを価値に変える AI エージェント基盤とその組織
Avatar for 株式会社IVRy（社員登壇資料） ivry_presentationmaterials
0
190
実体験から学ぶ分析エージェントの開発と運⽤
Avatar for Recruit recruitengineers
PRO
8
2.4k
go-sqletch
Avatar for moznion moznion
0
140
Rust で関数型ドメインモデリング
Avatar for ONDA, Takashi takonda
0
140
OptunaHub: ブラックボックス最適化のためのプラットフォーム
Avatar for Preferred Networks pfn
PRO
0
140

Featured

See All Featured
Breaking role norms: Why Content Design is so much more than writing copy - Taylor Woolridge
Avatar for UX Y'all uxyall
1
450
Exploring the relationship between traditional SERPs and Gen AI search
Avatar for Ray Grieselhuber raygrieselhuber
PRO
4
4.4k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
230
23k
HU Berlin: Industrial-Strength Natural Language Processing with spaCy and Prodigy
Avatar for Ines Montani inesmontani
PRO
0
750
How to Ace a Technical Interview
Avatar for Jacob Kaplan-Moss jacobian
280
24k
It's Worth the Effort
Avatar for 3n 3n
188
29k
Chasing Engaging Ingredients in Design
Avatar for Sebastian Deterding codingconduct
0
360
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
6.3k
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
77
5.6k
Java REST API Framework Comparison - PWX 2021
Avatar for Matt Raible mraible
34
9.8k
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
540
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
35k

Transcript

  1. 1JQFMJOF+VOHMFTͱ ͔ͨͨ͏࿩ .BDIJOF-FBSOJOH$BTVBM5BML  'SJ !TPPOSBBI

  2. "(&/%" • ຊ೔ͷ͓࿩ • 1JQFMJOF+VOHMFTͱ͸ • ฐࣾͷػցֶश • ฐࣾͷ 1JQFMJOF+VOHMFT

    • վળ • ·ͱΊ 2

  3. ຊ೔ͷ͓࿩ • ৽͍͠ϑϨʔϜϫʔΫͷ࿩͸͠·ͤΜ • ΞϧΰϦζϜͷ࿩΋͠·ͤΜ • ػցֶशʹ·ͭΘΔٕज़తෛ࠴ͱͷ޲͖߹͍ํͷ Ұྫͱͯ͠ฐࣾͷ 1JQFMJOF+VOHMFTͱͦͷରࡦ ʹ͍ͭͯ͝঺հ͠·͢

    3

  4. 1JQFMJOF+VOHMFTͱ͸ • ػցֶशγεςϜͷΞϯνύλʔϯͷͭ • ػցֶशͷͨΊͷσʔλநग़ॲཧ͕ෳࡶʹͳͬͯ͠·͏͜ͱ • ଟछͷಛ௃ྔɺσʔλιʔε • +0*/͍ͬͺ͍ •

    தؒϑΝΠϧͷग़ྗ • FUD • ਫ਼౓ΛٻΊ͍ͯ͘աఔͰͩΜͩΜෳࡶʹਐԽ͍ͯ͘͠ • ࢀߟ • .BDIJOF-FBSOJOH5IF)JHI*OUFSFTU$SFEJU$BSEPG5FDIOJDBM%FCU • )JEEFO5FDIOJDBM%FCUJO.BDIJOF-FBSOJOH4ZTUFNT 4

  5. ฐࣾͷػցֶश • Πϯλʔωοτ޿ࠂ • ΑΓΫϦοΫ͞Ε΍͍͢৚݅ͷ޿ࠂ࿮ʹߴ͘ೖࡳ͍ͨ͠ • $53 $MJDL5ISPVHI3BUJP ༧ଌ •

    ֶशσʔλ • αϯϓϧ޿ࠂ͕දࣔ͞Εͨͱ͍͏Πϕϯτ • ಛ௃ྔදࣔ͞Εͨ޿ࠂʹͻ΋ͮ͘ಛ௃ • ϥϕϧDMJDL͞Εͨ PS͞Εͳ͔ͬͨ • ৄ͘͠͸ͪ͜Β΋ • ωοτ޿ࠂ഑৴αʔϏεʹ͓͚Δ.-γεςϜͷ࣮૷ͱӡ༻ • ωοτ޿ࠂ࣮຿ͰػցֶशΛ׆༻͢Δ্Ͱͷۤ࿑࿩ 5

  6. ฐࣾͷػցֶश DPOU`E • ֶशσʔλͷݩͱͳΔϩά͸ΦϯϓϨ )JWFʹอଘ • ಛఆͷαʔό্Ͱඇ෼ࢄʗόονֶश 6 ֶश༻αʔό σʔλநग़

    )%'4

  7. ฐࣾͷ 1JQFMJOF+VOHMFT • )JWF2-ʹΑΔֶशσʔλநग़ • ෳ਺ͷ +0*/ΛؚΉෳࡶͳ௕͍ΫΤϦ • ͩΜͩΜͱਐԽ͍ͯ͠Δ •

    ࣅͨΑ͏ͳɺ͔͠͠গ͠ҟͳͬͨϞσϧ͝ͱͷ ෳ਺ͷΫΤϦ • ςετ͕ͳ͍ • தؒσʔλΛग़ྗ͢Δଟஈͷॲཧ 7

  8. ฐࣾͷ 1JQFMJOF+VOHMFT DPOU`E • Կ͕ى͔ͬͨ͜ • ! நग़৚݅ͷޡΓͷൃݟͷ஗Ε • !

    ϦϑΝΫλϦϯάͰ͖ͳ͍ • ! ϨϏϡʔ͕͖͍ͭ 8

  9. վળ 1IBTF4QBSLBQQԽ • )JWF2-ʹΑΔநग़͔Β "QBDIF4QBSL΁ • ͜ͷ࣌఺Ͱ͸Ϟσϧ͝ͱͷ OBJWFͳ࣮૷ • !

    QSPT • ୯ମςετ͕هड़Մೳʹ • ଎͘ͳΓதؒϑΝΠϧΛग़ྗ͢Δଟஈॲཧ͕ෆཁʹ • " DPOT • )JWF2-ΑΓ΋։ൃͷෑډ͕ߴ͍ 4DBMB4QBSL 9

  10. վળ 1IBTF$POGJHVSBUJPOԽ • Ϟσϧ͝ͱʹඞཁͳઃఆΛ :".-ܗࣜͷίϯϑΟά ϑΝΠϧʹهࡌ͠ɺͦΕΛಡΜͩ 4QBSLBQQ͕நग़ • OBJWFͳ࣮૷Λͨͨ͠Ίʹڞ௨ԽͰ͖Δͱ͜Ζ͕ݟ͑ͨ •

    ίϯϑΟάʹ͸ಛ௃ɺσʔλظؒɺϑΟϧλॲཧͳͲΛࢦఆ • ! QSPT • جຊతʹ 4DBMB4QBSLͷ։ൃ͕ෆཁʹ • " DPOT • ͜Ε·Ͱͱେ͖͘ҟͳΔΑ͏ͳநग़ॲཧͷ։ൃίετ • ʢͰ΋ͦ͏ͦ͏ͳ͍ΑͶʣ 10

  11. վળͷ·ͱΊ 11 1IBTF 5FTUBCJMJUZ &GGJDJFODZ .BJOUBJOBCJMJUZ 1IBTF վળલ ! !

    " 1IBTF 4QBSLBQQԽ " " ! 1IBTF $POGJHVSBUJPOԽ " " " كʹ!

  12. ػցֶशͷෛ࠴Λ΍͚ͬͭΔͷʹ ຊ౰ʹඞཁͳ͜ͱ 1BZJOHEPXO.-SFMBUFEUFDIOJDBMEFCUSFRVJSFT BTQFDJGJDDPNNJUNFOU XIJDIDBOPGUFOPOMZCF BDIJFWFECZBTIJGUJOUFBNDVMUVSF3FDPHOJ[JOH  QSJPSJUJ[JOH BOESFXBSEJOHUIJTFGGPSUJTJNQPSUBOU GPSUIFMPOHUFSNIFBMUIPGTVDDFTTGVM.-UFBNT

    )JEEFO5FDIOJDBM%FCUJO.BDIJOF-FBSOJOH4ZTUFNT ΑΓ 12

  13. ͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠ 13