Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Vertex AI 試してみた / tried-vertex-ai
kasacchiful
April 24, 2022
Programming
0
92
Vertex AI 試してみた / tried-vertex-ai
2022/04/24 (日) Python機械学習勉強会 in 新潟で発表した資料です。
kasacchiful
April 24, 2022
Tweet
Share
More Decks by kasacchiful
See All by kasacchiful
サーバーレスパターンを見てみよう / 20220212peacock-engineer-group-lt
kasacchiful
0
58
AWSで作る、サーバーレスデータ分析基盤構築 / jawsug-niigata-11
kasacchiful
1
98
サーバーレスの分析基盤 / 20211117peacock-engineer-group-lt
kasacchiful
0
49
S3にあるデータをAthenaのクエリで取得してLambda (Pandas) で加工してみた / akiba-aws-online7
kasacchiful
0
400
サーバーレスでデータ連携する際にハマったところ / ninno-techfest-20211022-lt
kasacchiful
0
160
画像生成で遊ぶ / osc2021niigata
kasacchiful
0
260
サーバーレスの分析基盤 / ninno-techfest-20210917-lt
kasacchiful
0
95
製造業のDX化に使える!AWSの各種サービス紹介と活用方法 / 20210915-niigata-dx-seminar
kasacchiful
0
400
AWS認定Machine Learning - Specialty受けてきた / aws-certifed-machine-learning-specialty
kasacchiful
0
150
Other Decks in Programming
See All in Programming
From Java through Scala to Clojure
lagenorhynque
0
220
JSのウェブフレームワークで高速なルーターを実装する方法
usualoma
1
1.8k
Licences open source : entre guerre de clochers et radicalité
pylapp
2
500
engineer
spacemarket
0
1.3k
Vite でお手軽 Vue.js の環境構築
azuki
2
180
Improving Developer Experience Through Tools and Techniques 2022
krzysztofzablocki
0
530
Amazon Aurora の v1 が EOL になるので 10 クラスタアップグレードして出てきたノウハウ
dekokun
0
860
Running Laravel/PHP on AWS (AWS Builders Day Taiwan 2022)
dwchiang
0
140
"What's new in Swift"の要約 / swift_5_7_summary
uhooi
1
320
短納期でローンチした新サービスをJavaで開発した話/launched new service using Java
eichisanden
6
1.9k
Angular-basierte Micro Frontends mit Module Federation @API Summit
manfredsteyer
PRO
0
110
Springin‘でみんなもクリエイターに!
ueponx
0
210
Featured
See All Featured
How GitHub (no longer) Works
holman
296
140k
Mobile First: as difficult as doing things right
swwweet
213
7.5k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
349
27k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
29
4.3k
The Illustrated Children's Guide to Kubernetes
chrisshort
15
36k
The Mythical Team-Month
searls
209
39k
Designing Experiences People Love
moore
130
22k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
19
1.4k
A better future with KSS
kneath
225
15k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
7
1.1k
What's in a price? How to price your products and services
michaelherold
229
9.4k
Producing Creativity
orderedlist
PRO
334
37k
Transcript
Vertex AI ࢼͯ͠Έͨ Python ػցֶशษڧձ in ৽ׁ 2022-04-24 @kasacchiful
Classmethod, Inc. Solutions Architect / Software Develper Favorite: Community: •
JAWS-UG Niigata • Python ML in Niigata • JaSST Niigata • ASTER • SWANII • etc. Hiroshi Kasahara @kasacchiful @kasacchiful 2
MLOpsͱԿ͔ʁ
MLOps • ػցֶशϓϩδΣΫτΛԁʹਐΊΔͨΊͷऔΓΈɾମ੍ɾࢥ • ػցֶशνʔϜ / ։ൃνʔϜ / ӡ༻νʔϜ ͕͓ޓ͍ʹڠௐ͠߹͏͜ͱ
ͰɺػցֶशϞσϧͷ࣮͔Βӡ༻·ͰͷϥΠϑαΠΫϧΛԁʹਐ ΊɺܧଓతʹՁΛఏڙ͢Δ͜ͱΛతʹͯ͠Δ • DevOpsͷػցֶशϓϩδΣΫτ൛ • ʮ։ൃαΠΫϧͷॖʯʮ։ൃࣗମͷਝԽʯʮ৴པੑߴ͍ϦϦʔεʯ ΛMLϓϩδΣΫτʹ
MLγεςϜͷཁૉ IUUQTDMPVEHPPHMFDPNBSDIJUFDUVSFNMPQTDPOUJOVPVTEFMJWFSZBOEBVUPNBUJPOQJQFMJOFTJONBDIJOFMFBSOJOH
MLOps Life Cycle IUUQTOFBMBOBMZUJDTDPNFYQFSUJTFNMPQT
Continuous Delivery for Machine Learning end- to-end Process IUUQTNBSUJOGPXMFSDPNBSUJDMFTDENMIUNM
MLOpsΠϯϑϥج൫ʹඞཁͳ͜ͱ • σʔλιʔεͱɺ͔ͦ͜Βੜ͞ΕΔσʔληοτͷཧ • ֶशࡁϞσϧͷཧ • CI / CDؚΜͩMLσϦόϦύΠϓϥΠϯ •
Ұ࿈ͷδϣϒΛ؆୯ʹճͨ͢Ίͷίϯςφ
Ұ͔Βߏங͢ΔͷେมͳͷͰ ΫϥυαʔϏε͍͍ͨ
MLOpsؔ࿈αʔϏε • AWS • Amazon SageMaker • Google Cloud •
Vertex AI • Azure • Azure Machine Learning
IUUQTQBHFTBXTDMPVEDPNST5;.JNBHFT@"84Ͱߏங͢Δ.-0QTج൫@൛@@"*.-5PLZPQEG
IUUQTDMPVEHPPHMFDPNCMPHKBUPQJDTEFWFMPQFSTQSBDUJUJPOFSTOFXNMMFBSOJOHQBUIWFSUFYBJ
ࠓճVertex AIΛࢼͯ͠Έͨ
Vertex AIࢼͯ͠Έͨ • ϞσϧͷτϨʔχϯάɺσϓϩΠɺςετΛҰ௨Γࢼ͢ • AutoMLͷΫΠοΫελʔτΛϕʔεʹ࣮ࢪ • https://cloud.google.com/automl-tables/docs/quickstart?hl=ja • දܗࣜσʔλͷྨ
σʔληοτ
σʔληοτ
σʔληοτ
τϨʔχϯά
τϨʔχϯά
τϨʔχϯά
τϨʔχϯά
σϓϩΠ
σϓϩΠ
σϓϩΠ
σϓϩΠ
ςετ
curlͰࢼ͢ curl -X POST \ -H "Authorization: Bearer $(gcloud auth
print-access-token)" \ -H "Content-Type: application/json" \ https://asia-northeast1-aiplatform.googleapis.com/v1/projects/${PROJECT_ID}/locations/asia-northeast1/endpoints/${ENDPOINT_ID}:predict \ -d “@${INPUT_DATA_FILE} " { "predictions": [ { "classes": [ "1" , "2 " ] , "scores": [ 0.98835468292236328 , 0.0116453049704432 5 ] } ] , "deployedModelId": "8383556259466444800" , "model": "projects/1066851579090/locations/asia-northeast1/models/6083061274810253312" , "modelDisplayName": "sample_tabular_dataset_model " }
ύΠϓϥΠϯ • kube fl ow pipelines ͘͠ Tensor fl ow
Extended ͰύΠϓϥ ΠϯΛهࡌͯ͠ɺVertex AIʹొ IUUQTDMPVEHPPHMFDPNCMPHKBQSPEVDUTBJNBDIJOFMFBSOJOHTFSWFSMFTTNBDIJOFMFBSOJOHQJQFMJOFTPOHPPHMFDMPVE
MLOpsΠϯϑϥج൫ʹඞཁͳ͜ͱ • σʔλιʔεͱɺ͔ͦ͜Βੜ͞ΕΔσʔληοτͷཧ • Vertex AIͰ֤छσʔληοτΛཧͰ͖Δ • ֶशࡁϞσϧͷཧ • Ϟσϧͷόʔδϣϯͷཧ͕Մೳ
• CI / CDؚΜͩMLσϦόϦύΠϓϥΠϯ • kebe fl ow pipelines͘͠Tensor fl ow ExtendedͰߏஙՄೳ • Ұ࿈ͷδϣϒΛ؆୯ʹճͨ͢Ίͷίϯςφ • طଘͷίϯςφར༻ͷ΄͔ɺΧελϜίϯςφ༻Մೳ
SageMaker / Vertex AI ͷػೳ σʔληοτ ͷ࡞ ਓྗʹΑΔΞ ϊςʔγϣϯ ࢧԉ
ಛྔϦϙδ τϦ ύΠϓϥΠϯ ϞσϧͷධՁ σϓϩΠ ϞχλϦϯά 4BHF.BLFS 4BHF.BLFS %BUB 8SBOHMFS 4BHF.BLFS (SPVOE5SVU I 4BHF.BLFS 'FBUVSF 4UPSF 4BHF.BLFS 1JQFMJOF 4BHF.BLFS %FCVHHFS 4BHF.BLFS $MBSJGZ όονਪ˓ ϦΞϧλΠϜ ਪ˓ 4BHF.BLFS .PEFM .POJUFS 7FSUFY"* σʔληοτ ϥϕϧλε Ϋ 7FSUFY"* 'FBUVSF 4UPSF 7FSUFY"* 1JQFMJOF ϞσϧͷධՁ όονਪ˓ ϦΞϧλΠϜ ਪ˓ 7FSUFY"* .POJUPSJOH
ॴײ • ݁ߏGUI্Ͱૢ࡞Ͱ͖Δ͠ɺΘ͔Γ͍͢ • ಛʹAutoML • Vertex AIͷPython SDK͕༻ҙ͞ΕͯΔͷͰɺίʔυͰཧͰ͖Δ •
SageMakerPython SDK͕͋Δ • ଞͷGoogle CloudαʔϏεͱͷ࿈ܞํ๏͕Α͘Θ͔Βͳ͍ (ଟͰ͖Δ ΜͩΖ͏͚Ͳ)
·ͱΊ • MLγεςϜߏஙͷࡍɺMLίʔυҎ֎ͷཁૉଟ͘ɺ࣌ؒखؒ ͔͔Δɻ • ΫϥυαʔϏεͷMLOpsؔ࿈ͷαʔϏεΛ͏·͘͏͜ͱͰɺ࿑ ྗΛগͳͯ͘͠MLγεςϜΛߏஙɾӡ༻͢Δ͜ͱ͕Մೳ
͓͠·͍