Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Core ML First Impressions
Search
Sponsored
·
Ship Features Fearlessly
Turn features on and off without deploys. Used by thousands of Ruby developers.
→
Chiharu Nameki
June 19, 2017
Technology
900
1
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Core ML First Impressions
CA.swift #3 WWDC17報告会
Chiharu Nameki
June 19, 2017
Transcript
23 slides
Core ML First Impressions CA.swift #3 WWDC17 ใࠂձ 2017/6/19 ߦ
ઍय़
ࣗݾհ • ߦ ઍय़ʢͳΊ͖ ͪΔʣ • AmebaΞϓϦ iOSΤϯδχΞ • 20153݄த్ೖࣾ
macOS͚ΞϓϦϛυϧΣΞΛ࡞ͬͯ·ͨ͠ • WWDCͷࢀՃ2015Ҏདྷ̎ ←!?
Core ML Framework
WWDC17 Keynote
• ΫϥΠΞϯταΠυͰػցֶशͷ݁ՌͷϞσϧΛར༻͢ΔͨΊͷI/F ͜Ε·ͰެࣜͷࣸਅΞϓϦͳͲͰར༻͞Ε͍ͯͨػೳ͕3rd Partyʹղ์͞Εͨɻ • ϋʔυΣΞʹΑΔߴͳॲཧɻCPU, GPUΛࣗಈతʹબɻ • ্Ͱ࣮ߦ͢ΔͨΊҎԼͷϝϦοτ͕͋Δɻ
Underlying Function Introducing Core ML
Accelerate & BNNS Metal Performance Shaders CPU GPU Core ML
Vision Natural Language Processing APP NEW NEW Architecture
Accelerate & BNNS Metal Performance Shaders CPU GPU Core ML
Vision NLP NSLinguisticTagger APP iOS 4.0+, macOS 10.3+, tv0S 9.0+, watchOS 4.0+ iOS 11.0+, macOS 10.3+, tv0S 11.0+, watchOS 4.0+ iOS 9.0+, macOS 10.13+, tv0S 9.0+ iOS 11.0+, macOS 10.13+, tv0S 11.0+ iOS 5.0+, macOS 10.7+, tv0S 9.0+, watchOS 2.0+ OS version & Hardware limitations Metal supported A7ʢ= iPhone 5sʣand later NEW NEW
Platforms State of the Union ։ൃϑϩʔ
Core ML in Depth ։ൃϑϩʔ
https://developer.apple.com/documentation/ coreml/converting_trained_models_to_core_ml Converting Trained Models to Core ML ΑΓ •
CaffeͳͲͰੜͨ͠Ϟσϧ Λ .mlmodel ϑΝΠϧʹมͯ͠ར༻ • มπʔϧ coremltool ʢOpen Sourceʣ • coremltoolΛࢀߟʹมπʔϧͷ࡞ Մೳ αϙʔτπʔϧ & Ϟσϧ
API Core ML Framework MLModel MLFeatureProvider MLFeatureProvider INPUT OUTPUT func
prediction(from input: MLFeatureProvider) throws -> MLFeatureProvider
API Core ML Framework MLFeatureProvider featureNames featureValue(for: String) MLFeatureValue type
int64Value doubleValue stringValue dictionaryValue: [AnyHashable: NSNumber] imageBufferValue: CVPixelBuffer? multiArrayValue: MLMultiArray? ಛྔͷϥούʔ ಛྔʹΞΫηε͢ΔͨΊͷI/F ͷଟ࣍ݩྻ
.mlmodel͔Βࣗಈੜ͞ΕΔίʔυ MLModel MLFeatureProvider MLFeatureProvider ModelInput ModelOutput func prediction(input: ModelInput) throws
-> ModelOutput Model ※ Model࣮ࡍʹϞσϧ໊ʹͳΔ
Vision Framework
Vision Framework • Core ML frameworkͷ্ʹΓཱͭɺComputer Visionͷ ྖҬʹಛԽͨ͠API • ඇৗʹଟ͘ͷೖྗϑΥʔϚοτΛαϙʔτ
• CVPixelBuffer, CGImage, CIImage, NSURL, NSData • CVPixelBufferʹมͯ͠Core MLʹͯ͘͠ΕΔ • ը૾ͷΦϦΤϯςʔγϣϯղੳʹదͨ͠αΠζͷεέʔ Ϧϯάαϙʔτ iOS 11.0+, macOS 10.13+, tv0S 11.0+
Vision Framework • إݕग़ • إύʔπݕग़ • ը૾߹ʢύϊϥϚͳͲʣ • ۣܗݕग़
• όʔίʔυݕग़ • ςΩετݕग़ • τϥοΩϯά • ਫฏݕग़ • MLModelΛར༻ͨ͠ղੳ
Vision Framework Deep LearningΛར༻͍ͯ͠ΔͷͰ ԣإɾإͷҰ෦͕ӅΕ͍ͯΔɾࢠɺαϯάϥεண༻࣌ͳͲOK
API Vision Framework VNRequest VNRequestHandler VNObservation completionHandler handler.perform([request]) ೖྗը૾ &
ϦΫΤετͷॲཧ ϦΫΤετ ݁Ռ VNDetectFaceRectanglesRequest VNDetectFaceLandmarksRequest VNDetectRectanglesRequest VNCoreMLRequest VNDetectBarcodesRequest VNTrackingRequest VNDetectHorizonRequest … VNImageRequestHandler VNSequenceRequestHandler VNFaceObservation VNTextObservation VNHorizonObservation VNRectangleObservation VNBarcodeObservation VNTrackObjectRequest VNClassificationObservation
Demo
Core ML First Impressions • ϞσϧͷऔΓࠐΈඇৗʹ؆୯ • ϓϩμΫτʹऔΓࠐΉͷਫ਼ݹ͍σόΠεͰͷ Λݟͳ͕Β •
ೖྗͷิॿͳͲʹྑͦ͞͏ • Ϟσϧͷ՝Λղܾ͢Δඞཁ͕͋Δ • ༰ྔΛখ͘͞ • ਫ਼্
ࢀߟηογϣϯ • WWDC17 Keynote • Platforms State of the Union
• Introducing Core ML • Core ML in Depth • Vision Framework: Building on Core ML • Natural Language Processing and your Apps
Thank you. Apple Park June 4th 2017. Still Constructing …
More Decks by Chiharu Nameki
See All by Chiharu Nameki
続・空間オーディオを活用しよう!
ridwy
0
84
iPhoneでの空間メディア視聴体験の探求
ridwy
1
140
空間再現力の鍵、APMPを読み解く
ridwy
1
580
空間ビデオフォーマット、MV-HEVCが写し撮る世界
ridwy
4
3k
空間オーディオを活用しよう!
ridwy
1
800
AVPlayerのHLS再生時のエラーをハンドリングする
ridwy
0
1k
AirPlayの裏舞台
ridwy
0
3.2k
AVPlayerできちんとコンテンツ保護
ridwy
0
2.2k
検証 SharePlay media playback
ridwy
1
2.2k
Other Decks in Technology
See All in Technology
Terraform 0 to 100:100個以上のリポジトリを常に最新にし続けるための自動化
sue445
3
1.4k
Del vibe coding a un Desarrollo (agéntico) fiable
jcabot
0
220
攻撃と守りは何が変わり、何が変わらないのか~最近の不正アクセスから考える、リスク評価と標準の使いどころ
oidfj
2
320
お風呂場をサーバルームにしよう
yusuke427
0
400
業務の傍らで進める改善ループエンジニアリング
bengo4com
1
240
フロントエンドのテストカバレッジは 100%強制がいい
bengo4com
5
1.7k
AI-DLCでソフトウェア開発の速さは 上がったのか?
rfdnxbro
0
140
実測データからサービスの成長余力を測る。負荷シナリオ・テストデータ・限界値の設計
kazatohiei
0
170
Welcome JXL!
dynamis
0
120
Amazon Bedrock AgentCore の基礎とセキュリティ・ガバナンス
ren8k
0
270
おうち環境でも「なるべく止めたくない!」 ― おうち環境の機器冗長化の理想と現実
yuutosi
1
700
Amazon EFS のマルウェアスキャンをClamAV で自前実装したら苦労した話
mtmtfactory01
0
110
Featured
See All Featured
Information Architects: The Missing Link in Design Systems
soysaucechin
1
1.3k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
360
31k
AI: The stuff that nobody shows you
jnunemaker
PRO
12
1.3k
Ethics towards AI in product and experience design
skipperchong
2
470
Game over? The fight for quality and originality in the time of robots
wayneb77
1
340
The Director’s Chair: Orchestrating AI for Truly Effective Learning
tmiket
1
360
Scaling GitHub
holman
464
140k
Designing Powerful Visuals for Engaging Learning
tmiket
1
660
Tell your own story through comics
letsgokoyo
1
1.1k
Measuring Dark Social's Impact On Conversion and Attribution
stephenakadiri
2
340
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
46
3.1k
Public Speaking Without Barfing On Your Shoes - THAT 2023
reverentgeek
1
670