Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
pytorchで機械学習しない
Search
Hata Ryosuke
October 21, 2019
Technology
3
870
pytorchで機械学習しない
pytorchでマクローリン展開とニュートン法を試してみました。
Hata Ryosuke
October 21, 2019
Tweet
Share
More Decks by Hata Ryosuke
See All by Hata Ryosuke
Monocular 3D Object Detection Survey
ryosukehata
3
380
量子情報勉強会,量子ゲートについて
ryosukehata
0
190
Other Decks in Technology
See All in Technology
Discord とビルダー&チャットボットの使い方 / How to use Discord and Builder & Chatbots
ks91
PRO
0
130
NgRx Signal Store
rainerhahnekamp
0
120
Aurora MySQL v3(MySQL8.0互換)の オンラインDDLの罠挙動を全バージョンで検証した
yutakikai
1
150
コンテナセキュリティの基本と脅威への対策
kyohmizu
3
700
アプリがつくるNOT A HOTELブランド
hokuts
1
450
Reducing Cross-Zone Egress at Spotify with Custom gRPC Load Balancing Recap
koh_naga
0
120
WebアプリケーションにおけるPDOの使い方入門 / phpcon odawara 2024
meihei3
2
430
Data and AI Governance: Existing Challenges and Emerging Trends
scotthsieh825
0
160
LLM とプロンプトエンジニアリング/チューターをビルドする / LLM and Prompt Engineering and Building Tutors
ks91
PRO
0
220
Vertex AI を中心に 生成AIのアップデートを共有します
kaz1437
0
140
Databricks:『生成AI World Cup』のご案内
databricksjapan
2
150
オーナーシップを持つ領域を明確にする
konifar
11
2.6k
Featured
See All Featured
VelocityConf: Rendering Performance Case Studies
addyosmani
320
23k
Art, The Web, and Tiny UX
lynnandtonic
288
19k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
9
8.3k
How To Stay Up To Date on Web Technology
chriscoyier
782
250k
Adopting Sorbet at Scale
ufuk
67
8.6k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
13
1.5k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
186
16k
Typedesign – Prime Four
hannesfritz
36
2.1k
Fantastic passwords and where to find them - at NoRuKo
philnash
36
2.5k
A Tale of Four Properties
chriscoyier
150
22k
Scaling GitHub
holman
457
140k
The World Runs on Bad Software
bkeepers
PRO
61
6.7k
Transcript
pytorchͰػցֶश͠ͳ͍ ػցֶश/Kaggle͘͘ձ#10ˏ େࡕ(10/21 19:00ʙ) ാɹྒྷհ
͜͡͠ΐ͏͔͍ twitter (@hattan0523) ϝʔΧʔۈ ීஈ$"%ϙνϙνͯ͠ɼ ͦΕͬΆ͍ਤΛग़͢ਓ ɹɹʢ෩ͷͱ͖ʹΨϥεʹςʔϓషΔ͖ͱ͔ܭࢉ͢ΔɻͲΜͳਤͰ࡞Ε·͢ʣ ػցֶशओۀͰ͋Γ·ͤΜ େֶ࣌ʹྔࢠޫֶͷݚڀʹूத͠ɼ
ໟΛࣦ͍ത࢜Λऔಘɻ http://www.breault.com/software/asap-nextgen https://www.muratasoftware.com/products/ examples/watgal004/
ಈػ pytorchͱ͔ਂֶशͷϥΠϒϥϦɼ ίϯϖʹ͍ͬͺ͍ΘΕͯΔ͠ ը૾ͱ͔NLPͷਂֶशΛΔͱ͖ ͱΓ͋͑ͣͬͱ͖Ό͑͑Ζɻ https://twitter.com/nino_pira/status/1181913845507354626
ಈػ pytorchԿΛͬͯΔͷʁ ͡Ͳ͏ͼͿΜʁ ͠Μͦ͏͕͘͠ΎʔͷϥΠϒϥϦͰʁ ͦ͏ͩʂ ඍΛ͠Α͏ʂ
ࠓճɿࣗಈඍΛͬͯܭࢉ ϚΫϩʔϦϯల։ sinؔΛ10࣍·Ͱ sinؔΛ20࣍·Ͱ χϡʔτϯ๏ɹɹɹɹɹɹɹɹͷղΛग़͢
ࣗಈඍ is Կʁ https://github.com/pytorch/pytorch/blob/edb88b5f3af03718b443d015f195faa1832ce95b/caffe2/operators/sin_op.cu ɾඍ ࣮ࡍʹಋؔͷఆٛʹैͬͯతʹܭࢉ͢Δɻ ޡ͕ࠩͰ͖Δɻ ɾࣗಈඍ ܭࢉ͢ΔؔͷಋؔΛ༧Ίఆ͓ٛͯ͘͠ɻ ؔʹೖ͢Δ͚ͩͳͷͰޡࠩ΄΅ͳ͍ɻ
pytorchͷsinͷಋؔͷఆٛ ֻ͚ͷͱ͜ΖΛݟΔͱɼ ಋؔ(cos)͕ఆٛ͞Ε͍ͯΔ ͜ͱ͕Θ͔Δɻ ࢀߟɿࣗಈඍΛ࣮ͯ͠ཧղ͢Δ https://qiita.com/lotz/items/39c52f08cc9b5d8439ca https://qiita.com/lotz/items/f1d4ab1d83dc13a5d81a
ͬͯΈΔ ී௨ʹΈͳ͞Μ͕࣮ߦ͍ͯ͠Δ͜ͱɻ requires_grad=Trueͱ͢Δ͜ͱͰɼඍ͢ΔΑʔͬͯએݴ͢Δɻ backward()ͰܭࢉάϥϑʹԊͬͯࣗಈඍ͕ݺͼग़͞Εɼ x.gradͰඍ͕ಘΒΕ·͢ɻ ࢀߟɿPyTorchͰߴ֊ภඍ (https://qiita.com/tmasada/items/ 9dee38e5bc1482217493)
ೋ֊ඍ ‘torch.autograd.grad(f, x, create_graph=True)’Ͱɼfʹ͍ͭͯxͰඍ ͢ΔΑʔͱએݴ͢Δɻ ܭࢉάϥϑΛ࡞Βͳ͍ͱඍͯ͘͠Εͳ͍ɻ ࡉ͔͍͜ͱ্ͷQiitaͷهࣄͰɻ ࢀߟɿPyTorchͰߴ֊ภඍ (https://qiita.com/tmasada/items/ 9dee38e5bc1482217493)
ԿճͰඍͰ͖·͢ʂ ࢀߟɿPyTorchͰߴ֊ภඍ (https://qiita.com/tmasada/items/ 9dee38e5bc1482217493) ඍ͕Ͱ͖ΔʂͰ͖Δͧʂʂ
ϚΫϩʔϦϯల։ Β͔ͳؔΛ্ͷΑ͏ͳܗʹల։ͯ͠ɼ ۙࣅతͳؔͱͯ͠ද͢͜ͱ͕Ͱ͖Δɻ ֶಘҙ͡Όͳ͍ͷͰɼ ݫີͳఆٛΑ͘Θ͔͍ͬͯ·ͤΜɻ ͜ΕΛpytorchͰ࣮ͯ͠ΈΑ͏ʂ (kaggleͷnotebookࢀর)
sinؔͰಘΒΕͨάϥϑ ͬͨ͜ͱ 1.ҙͷ࣍·ͰܭࢉάϥϑΛ࡞ͯ͠ɼඍΛܭࢉ͢Δ 2.֤ԣ࣠ͷʹରͯ͠ܭࢉͨ͠ඍͰॎ࣠ͷΛग़͢ɻ େมͳͷͰ1,2ΛߦྻͰܭࢉ͢Δ sinؔΛ10࣍·Ͱ sinؔΛ20࣍·Ͱ https://www.kaggle.com/hattan0523/pytorch-maclaurin-series? scriptVersionId=22206309
χϡʔτϯ๏ ඍΛͬͯํఔࣜΛղ͘ํ๏ ʹ͍ͭͯࣗಈඍΛͬͯղ͍ͯΈΔɻ ղ x=ln2≒0.69314718056 C++ - ඇઢܗํఔࣜͷղ๏ʢχϡʔ τϯ๏ʣʂ https://www.mk-mode.com/blog/
2012/11/21/21002047/# ΑΓҾ༻
σϞ̎ɿ݁Ռ ࣮ίʔυ: https://www.kaggle.com/hattan0523/newton-raphson-method-by- pytorch ղ x=ln2≒0.69314718056 ॳظͱؔΛ༩͑ΕɼҙͷճܭࢉΛߦͬͯ͘ΕΔɻ ֓ͶऩଋͰ͖ͨʂ
·ͱΊ ɾpytorchࣗಈඍͷϥΠϒϥϦ Ͱ͌ʔΒʔʹΜ͙Ͱͳͦ͞͏ɻ ɾܭࢉάϥϑΛ໌ࣔతʹ࡞ͬͯ͋͛Δ͜ͱͰ ɹඍՄೳͳؔΛ͍ͬͯΖΜͳ༡ͼ͕Ͱ͖ͦ͏ɻ ɾྫͱͯ͠ɼ sinؔͷϚΫϩʔϦϯల։ χϡʔτϯ๏ΛͬͨํఔࣜͷղΛಋग़ͨ͠ɻ ɾඍָ͍͠ΊΔͬ