Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Vertex AI 試してみた / tried-vertex-ai
Search
kasacchiful
April 24, 2022
Programming
0
430
Vertex AI 試してみた / tried-vertex-ai
2022/04/24 (日) Python機械学習勉強会 in 新潟で発表した資料です。
kasacchiful
April 24, 2022
Tweet
Share
More Decks by kasacchiful
See All by kasacchiful
dbt coreとFargateでデータ変換 / 20240928-jawsug-toyama-hokuriku-shinkansen
kasacchiful
1
60
What we keep in mind when migrating from Serverless Framework to AWS CDK and AWS SAM
kasacchiful
1
280
AWSでIcebergを使ってデータウェアハウスを構築してみる / 20240810-jawsug-akita
kasacchiful
0
33
サーバーレスパターンを元にAWS CDKでデータ基盤を構築する / 20240731_classmethod_odyssey_online_build_a_data_infrastructures_using_aws_cdk_based_on_serverless_patterns
kasacchiful
0
430
AWS IoT 1-clickがサービス終了するので、SORACOMに移行した話 / 20240518-jawsug-niigata-iotlt-niigata
kasacchiful
0
230
AWS Application Composerで始める、 サーバーレスなデータ基盤構築 / 20240406-jawsug-hokuriku-shinkansen
kasacchiful
1
540
AWSの各種サービス紹介と活用方法 − AI・ML活用デモを交えて − / 20231208aws-aiml-seminar
kasacchiful
0
510
Amazon Rekognition デモ / 20231208-aws_seminar-01-rekognition-demo
kasacchiful
0
530
Amazon Lookout for Vision デモ / 20231208-aws_seminar-02-lookout-vision-demo
kasacchiful
0
510
Other Decks in Programming
See All in Programming
PHPで作るWebSocketサーバー ~リアクティブなアプリケーションを知るために~ / WebSocket Server in PHP - To know reactive applications
seike460
PRO
2
650
歴史と現在から考えるスケーラブルなソフトウェア開発のプラクティス
i10416
0
140
DevFest - Serverless 101 with Google Cloud Functions
tunmise
0
130
CloudflareStack でRAGに入門
asahiiwm
0
100
バグを見つけた?それAppleに直してもらおう!
uetyo
0
180
Fibonacci Function Gallery - Part 1
philipschwarz
PRO
0
230
Zoneless Testing
rainerhahnekamp
0
120
range over funcの使い道と非同期N+1リゾルバーの夢 / about a range over func
mackee
0
110
PSR-15 はあなたのための ものではない? - phpcon2024
myamagishi
0
180
AppRouterを用いた大規模サービス開発におけるディレクトリ構成の変遷と問題点
eiganken
1
160
Semantic Kernelのネイティブプラグインで知識拡張をしてみる
tomokusaba
0
180
週次リリースを実現するための グローバルアプリ開発
tera_ny
1
110
Featured
See All Featured
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
48
2.2k
The Pragmatic Product Professional
lauravandoore
32
6.3k
Java REST API Framework Comparison - PWX 2021
mraible
28
8.3k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
33
2k
4 Signs Your Business is Dying
shpigford
182
21k
Being A Developer After 40
akosma
87
590k
A Tale of Four Properties
chriscoyier
157
23k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
45
2.2k
Navigating Team Friction
lara
183
15k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
280
13k
A Modern Web Designer's Workflow
chriscoyier
693
190k
The Art of Programming - Codeland 2020
erikaheidi
53
13k
Transcript
Vertex AI ࢼͯ͠Έͨ Python ػցֶशษڧձ in ৽ׁ 2022-04-24 @kasacchiful
Classmethod, Inc. Solutions Architect / Software Develper Favorite: Community: •
JAWS-UG Niigata • Python ML in Niigata • JaSST Niigata • ASTER • SWANII • etc. Hiroshi Kasahara @kasacchiful @kasacchiful 2
MLOpsͱԿ͔ʁ
MLOps • ػցֶशϓϩδΣΫτΛԁʹਐΊΔͨΊͷऔΓΈɾମ੍ɾࢥ • ػցֶशνʔϜ / ։ൃνʔϜ / ӡ༻νʔϜ ͕͓ޓ͍ʹڠௐ͠߹͏͜ͱ
ͰɺػցֶशϞσϧͷ࣮͔Βӡ༻·ͰͷϥΠϑαΠΫϧΛԁʹਐ ΊɺܧଓతʹՁΛఏڙ͢Δ͜ͱΛతʹͯ͠Δ • DevOpsͷػցֶशϓϩδΣΫτ൛ • ʮ։ൃαΠΫϧͷॖʯʮ։ൃࣗମͷਝԽʯʮ৴པੑߴ͍ϦϦʔεʯ ΛMLϓϩδΣΫτʹ
MLγεςϜͷཁૉ IUUQTDMPVEHPPHMFDPNBSDIJUFDUVSFNMPQTDPOUJOVPVTEFMJWFSZBOEBVUPNBUJPOQJQFMJOFTJONBDIJOFMFBSOJOH
MLOps Life Cycle IUUQTOFBMBOBMZUJDTDPNFYQFSUJTFNMPQT
Continuous Delivery for Machine Learning end- to-end Process IUUQTNBSUJOGPXMFSDPNBSUJDMFTDENMIUNM
MLOpsΠϯϑϥج൫ʹඞཁͳ͜ͱ • σʔλιʔεͱɺ͔ͦ͜Βੜ͞ΕΔσʔληοτͷཧ • ֶशࡁϞσϧͷཧ • CI / CDؚΜͩMLσϦόϦύΠϓϥΠϯ •
Ұ࿈ͷδϣϒΛ؆୯ʹճͨ͢Ίͷίϯςφ
Ұ͔Βߏங͢ΔͷେมͳͷͰ ΫϥυαʔϏε͍͍ͨ
MLOpsؔ࿈αʔϏε • AWS • Amazon SageMaker • Google Cloud •
Vertex AI • Azure • Azure Machine Learning
IUUQTQBHFTBXTDMPVEDPNST5;.JNBHFT@"84Ͱߏங͢Δ.-0QTج൫@൛@@"*.-5PLZPQEG
IUUQTDMPVEHPPHMFDPNCMPHKBUPQJDTEFWFMPQFSTQSBDUJUJPOFSTOFXNMMFBSOJOHQBUIWFSUFYBJ
ࠓճVertex AIΛࢼͯ͠Έͨ
Vertex AIࢼͯ͠Έͨ • ϞσϧͷτϨʔχϯάɺσϓϩΠɺςετΛҰ௨Γࢼ͢ • AutoMLͷΫΠοΫελʔτΛϕʔεʹ࣮ࢪ • https://cloud.google.com/automl-tables/docs/quickstart?hl=ja • දܗࣜσʔλͷྨ
σʔληοτ
σʔληοτ
σʔληοτ
τϨʔχϯά
τϨʔχϯά
τϨʔχϯά
τϨʔχϯά
σϓϩΠ
σϓϩΠ
σϓϩΠ
σϓϩΠ
ςετ
curlͰࢼ͢ curl -X POST \ -H "Authorization: Bearer $(gcloud auth
print-access-token)" \ -H "Content-Type: application/json" \ https://asia-northeast1-aiplatform.googleapis.com/v1/projects/${PROJECT_ID}/locations/asia-northeast1/endpoints/${ENDPOINT_ID}:predict \ -d “@${INPUT_DATA_FILE} " { "predictions": [ { "classes": [ "1" , "2 " ] , "scores": [ 0.98835468292236328 , 0.0116453049704432 5 ] } ] , "deployedModelId": "8383556259466444800" , "model": "projects/1066851579090/locations/asia-northeast1/models/6083061274810253312" , "modelDisplayName": "sample_tabular_dataset_model " }
ύΠϓϥΠϯ • kube fl ow pipelines ͘͠ Tensor fl ow
Extended ͰύΠϓϥ ΠϯΛهࡌͯ͠ɺVertex AIʹొ IUUQTDMPVEHPPHMFDPNCMPHKBQSPEVDUTBJNBDIJOFMFBSOJOHTFSWFSMFTTNBDIJOFMFBSOJOHQJQFMJOFTPOHPPHMFDMPVE
MLOpsΠϯϑϥج൫ʹඞཁͳ͜ͱ • σʔλιʔεͱɺ͔ͦ͜Βੜ͞ΕΔσʔληοτͷཧ • Vertex AIͰ֤छσʔληοτΛཧͰ͖Δ • ֶशࡁϞσϧͷཧ • Ϟσϧͷόʔδϣϯͷཧ͕Մೳ
• CI / CDؚΜͩMLσϦόϦύΠϓϥΠϯ • kebe fl ow pipelines͘͠Tensor fl ow ExtendedͰߏஙՄೳ • Ұ࿈ͷδϣϒΛ؆୯ʹճͨ͢Ίͷίϯςφ • طଘͷίϯςφར༻ͷ΄͔ɺΧελϜίϯςφ༻Մೳ
SageMaker / Vertex AI ͷػೳ σʔληοτ ͷ࡞ ਓྗʹΑΔΞ ϊςʔγϣϯ ࢧԉ
ಛྔϦϙδ τϦ ύΠϓϥΠϯ ϞσϧͷධՁ σϓϩΠ ϞχλϦϯά 4BHF.BLFS 4BHF.BLFS %BUB 8SBOHMFS 4BHF.BLFS (SPVOE5SVU I 4BHF.BLFS 'FBUVSF 4UPSF 4BHF.BLFS 1JQFMJOF 4BHF.BLFS %FCVHHFS 4BHF.BLFS $MBSJGZ όονਪ˓ ϦΞϧλΠϜ ਪ˓ 4BHF.BLFS .PEFM .POJUFS 7FSUFY"* σʔληοτ ϥϕϧλε Ϋ 7FSUFY"* 'FBUVSF 4UPSF 7FSUFY"* 1JQFMJOF ϞσϧͷධՁ όονਪ˓ ϦΞϧλΠϜ ਪ˓ 7FSUFY"* .POJUPSJOH
ॴײ • ݁ߏGUI্Ͱૢ࡞Ͱ͖Δ͠ɺΘ͔Γ͍͢ • ಛʹAutoML • Vertex AIͷPython SDK͕༻ҙ͞ΕͯΔͷͰɺίʔυͰཧͰ͖Δ •
SageMakerPython SDK͕͋Δ • ଞͷGoogle CloudαʔϏεͱͷ࿈ܞํ๏͕Α͘Θ͔Βͳ͍ (ଟͰ͖Δ ΜͩΖ͏͚Ͳ)
·ͱΊ • MLγεςϜߏஙͷࡍɺMLίʔυҎ֎ͷཁૉଟ͘ɺ࣌ؒखؒ ͔͔Δɻ • ΫϥυαʔϏεͷMLOpsؔ࿈ͷαʔϏεΛ͏·͘͏͜ͱͰɺ࿑ ྗΛগͳͯ͘͠MLγεςϜΛߏஙɾӡ༻͢Δ͜ͱ͕Մೳ
͓͠·͍