Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
日系大手と日系スタートアップと外資系で働いてみた
Search
yush1ga
March 06, 2024
2
770
日系大手と日系スタートアップと外資系で働いてみた
LT資料
https://findy.connpass.com/event/310652/
yush1ga
March 06, 2024
Tweet
Share
More Decks by yush1ga
See All by yush1ga
ロジスティック回帰で お金もらえるし職務経歴書は倍になる
yush1ga
1
3.2k
Featured
See All Featured
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
Embracing the Ebb and Flow
colly
87
4.8k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
46
7.6k
How GitHub (no longer) Works
holman
315
140k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
34
6k
The Invisible Side of Design
smashingmag
301
51k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
131
19k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
53
2.9k
VelocityConf: Rendering Performance Case Studies
addyosmani
332
24k
The Language of Interfaces
destraynor
160
25k
The World Runs on Bad Software
bkeepers
PRO
70
11k
How to Think Like a Performance Engineer
csswizardry
25
1.8k
Transcript
ܥେखͱܥελʔτΞοϓͱ֎ࢿܥ Ͱಇ͍ͯΈͨ Yuki Shiga (@yush1ga)
• ݱ৬ ◦ Solutions Architect@Databricks • ͖ͳͷ ◦ ϥʔϝϯ ◦
ອը ◦ σʔλؔ࿈ٕज़ • ͦͷଞ ◦ ࣗʹ Spark Ϋϥελ͋Γ·͢ ࣗݾհ
• DATA + AI Company ◦ Spark, MLFlow, Delta Lake
ͷ ։ൃऀʹΑΓઃཱ • Databricks Data Intelligence Platform ◦ ETL ◦ σʔλΣΞϋε ◦ BI ◦ σʔλΧλϩά ◦ ػցֶशج൫ Databricks δϟύϯެࣜ X ΞΧϯτ @DatabricksJP
2014 2016 2018 2020 2022 2024 υΠπཹֶ υΠπਓೳη ϯλʔʹཹֶ έόϒΛͨ͘͞Μ
৯Δ ΩϟϦΞ म࢜՝ఔ ඇৗʹൣతͳ ֶੜͱͯ͠ৼΔ͏ ֶձ in US ࣭ٙԠͰਏࢎΛ ঐΊΔ ܥେखWeb εΫϥϜͰ ϛυϧΣΞ։ൃ ग़ு in US ΞϝϦΧͱڞಉ։ൃ ΧϯϑΝϨϯεࢀՃ R&Dʹҟಈ σʔλͷྖҬʹ͖ͬͯͨ NLPɾը૾ೝࣝʹऔΓΉ ग़ு in US ֶձࢀՃ (ௌߨ) ܥελʔτΞοϓ MLɾσʔλνʔϜͷ্ཱͪ͛ ֎ࢿܥ ιϦϡʔγϣϯ ΞʔΩςΫτʹ ΩϟϦΞνΣϯδ
ܥେखWebاۀ ब৬ͷ͖͔͚ͬ ◦ Ұ൪࠷ॳʹఆΛ͘Εͨ (M1ͷ1݄͘Β͍) ◦ ͬͨ͜ͱ͋ΔαʔϏεͳͷͰΠϝʔδ͔ͬͨ͢͠ ◦ ߴ͍ٕज़ਫ४ ◦
ΩϥΩϥձੜ׆ ◦ εϩʔͳঢڅϖʔε ◦ ֤ͷϓϩ͕ࡏ੶ ◦ ͜Ε·Ͱ௨Γͷੜ׆ ◦ ϝϦϋϦ͋ΔධՁ ೖࣾલͷҹ ೖࣾޙͷ࣮ࡍ
ܥελʔτΞοϓ స৬ͷ͖͔͚ͬ • ෭ۀΛ͍ͯͯ͠༠ΘΕͨ • ࡞ͬͨͷ͕ੈʹग़ͦ͏ • େ͖͍ࡋྔ • εϐʔυײ
• ࣌ؒ࿑ಇ • σʔλج൫ɺػցֶशϞσϦϯάɺAPI։ൃɺEMɺ࠾༻ • ϦϦʔεʹࢸΔPJଟ • ҙ֎ͱఆ࣌ ೖࣾલͷҹ ೖࣾޙͷ࣮ࡍ
֎ࢿܥ స৬ͷ͖͔͚ͬ • ֎ࢿܥاۀͱSAͱ͍͏৬छʹڵຯ͕͋ͬͨ • σʔλܥͷΩϟϦΞΛ׆͔ͤͦ͏ • ߴ͍ٕज़ਫ४ • άϩʔόϧɾίϛϡχέʔγϣϯ
• Ռओٛ • ֤ͷϓϩ͕ࡏ੶ (ཁӳޠ) • ճආෆೳͷӳޠίϛϡχέʔγϣϯ࣌ʑ • ඪߴΊ ೖࣾલͷҹ ೖࣾޙͷ࣮ࡍ
։ൃऀ͔ΒιϦϡʔγϣϯΞʔΩςΫτ ֎ࢿܥͷϙδγϣϯٕज़ࢧԉͷϩʔϧ͕ଟ͍ (ཁग़య) ͜Ε·Ͱͷܦݧ ݱ৬ʹ׆͔ͤΔ • ։ൃऀدΓ ◦ ػցֶशΤϯδχΞ ◦
σʔλαΠΤϯςΟετ ◦ όοΫΤϯυΤϯδχΞ ◦ EM • ٕज़ཧղ ◦ ٕज़͜Ε·Ͱͱڞ௨ • ސ٬ཧղ ◦ ͓٬༷ͷؾ͕࣋ͪΘ͔Δ • ࣮ྗ ◦ ίʔυΛॻ͘ػձ͋Δ
͜͜·Ͱ n=1 • ܥେखاۀಉ࢜ͰจԽҟͳΔ • ελʔτΞοϓಉ࢜ͰจԽҟͳΔ • ֎ࢿܥಉ࢜ͰจԽҟͳΔ اۀͷΧςΰϦͰஅͤͣ ΩϟϦΞΛۛຯ͢Δͷ͕͓͢͢Ί
͓ΘΓ