At Cloud Next organized by GDG Seattle. This talk presents resources on how to make Android apps with Google ML via Google Play Services, pre-trained ML models and TensorFlow.
subset of Artificial Intelligence • Study of algorithms • Learn from examples and experience (instead of hard-coded programming rules) Source: ML Recipes #1 by Google Developers - https://www.youtube.com/watch?v=cKxRvEZd3Mw Use model to predict Train a model Collect training data 4
pre-trained ML APIs ◦ Android apps with ML APIs ◦ Android apps with TensorFlow • How to make apps with intelligence • Understand the importance of ML for app developers 5
Complexity Pre-trained ML Services (via REST APIs) Vision Speech Language Text… Train or build your ML models Google Cloud ML Platform Google Play Services Mobile Vision API 6
of the Google Play services • Very easy to get started • Can detect: ◦ Face (FaceDetector) | codelab ◦ Barcode (BarcodeDetector) | codelab ◦ Text (TextRecognizer) | codelab Detailed documentation on Mobile Vision API - https://developers.google.com/vision/ 8
• Detect one or multiple faces • Facial detection not recognition • Detection from image or live video • Face can be detected from different angles • Detects activities: ◦ winking, blinking and smiling • Detect landmarks on face 9
Create a face detector for facial landmarks (e.g., eyes) 3. For each face, draw the eyes FaceDetector detector = new FaceDetector.Builder() .setLandmarkType(FaceDetector.ALL_LANDMARKS) .build(); SparseArray<Face> faces = detector.detect(image); for (int i = 0; i < faces.size(); ++i) { Face face = faces.valueAt(i); for (Landmark landmark : face.getLandmarks()) { // Draw eyes 2. Detect faces in the image 10 Googly Eyes Android App
• Detects barcodes in real-time, on device, in any orientation. • Detects multiple barcodes at once • Detects and parses barcodes and Qr codes of various formats 11
• Detects text in real-time, on device. • Detects text in Latin based languages (French, German, English, etc.) • Recognizes text in images and video streams 12
iOS • Android sample app with TensorFlow ◦ TF Classify ◦ TF Detect ◦ TF Stylize • Checkout all TensorFlow Dev Summit videos ◦ Pete Warden’s talk Mobile and Embedded TensorFlow • TensorFlow on Android by Yufeng Guo 20
machine learning APIs • Try out TensorFlow tutorials and code labs • Check out the AI experiments • Study machine learning basics • Build an app with intelligence 23
2016 - • Google’s Vision on Machine Learning • Machine Learning for Art • Machine learning is not the future • Breakthroughs in Machine Learning • How to build a smart RasPi Bot with Cloud Vision and Speech API Google AI Experiments • https://aiexperiments.withgoogle.com/ Udacity blog • The What, How, and Why of Artificial Intelligence, Machine Learning, and Self-Driving Cars 25
resources Udacity • Intro to Machine Learning • AI Engineer Nanodegree • ML Engineer Nanodegree • Self-driving Car Engineer Nanodegree • Deep Learning (TensorFlow) Stanford • Andrew Ng’s ML course on Coursera Google Developers • Machine Learning Recipes (short Youtube videos) Reading • Python Machine Learning by Sabastian Raschka 26
margaretmz
8maki
sashimimochi
tamaiyutaro
fumiyasac0921
hirutas
os1ma
phaya72
koedoyoshida
isaoshimizu
oracle4engineer
horiuchie
palkan
yeseniaperezcruz
hatefulcrawdad
maggiecrowley
mthomps
chrisshort
philnash
lara
stephaniewalter
holman
lynnandtonic
tmm1
