Hoi Lam - Adding ML Kit to Android Things And some TensorFlow things

Transcript

1. #WeAreHoi #WeAreHoi Adding ML Kit to Android Things And some TensorFlow things DroidCon Berlin 2018
3. #WeAreHoi
4. #WeAreHoi 5,000+ features 2,000+ emoji
5. #WeAreHoi On-Device Machine Intelligence
6. #WeAreHoi Google首个 简体中文 on-device TensorFlow Lite模型
7. #WeAreHoi ProjectionNet: Learning Efficient On-Device Deep Networks Using Neural Projections
8. NotificationCompat.Action action = new NotificationCompat.Action.Builder(R.drawable.ic_reply_white_24dp, replyLabel, replyPendingIntent) .addRemoteInput(remoteInput) .setAllowGeneratedReplies(true) // <--- Turn on smart replies .build();
9. #WeAreHoi #WeAreHoi A beginner’s guide to ML Kit
10. #WeAreHoi Beta
11. #WeAreHoi Landmark recognition Image labelling Text recognition Face detection Barcode scanning Smart replies “Coming soon”
12. #WeAreHoi Landmark recognition Image labelling Text recognition Face detection Barcode scanning Smart replies “Coming soon”
13. #WeAreHoi Image Labelling Low latency High accuracy 400+ labels 10,000+ labels Free Free then quota Check the website!
14. #WeAreHoi Android Things Image Classifier
15. #WeAreHoi Android Things Image Classifier
16. #WeAreHoi Live Coding!
17. #WeAreHoi #WeAreHoi A beginner’s guide to TensorFlow
18. #WeAreHoi OR NOT
19. #WeAreHoi MobileNet - labels.txt
20. #WeAreHoi if(confidence.strawberry > threshold) "Strawberry" else "Other"
21. #WeAreHoi OR NOT
22. #WeAreHoi
23. #WeAreHoi Live Demo!
24. #WeAreHoi OR NOT
25. #WeAreHoi 60 photos 3,669 photos
26. #WeAreHoi 60 photos ~30 photos
27. #WeAreHoi OR NOT Not to scale...
28. #WeAreHoi • Control your environment (apples and oranges) • Make your model smaller - Quantization - instead of using Float32 use uint8 ◦ Need fake quantization node ◦ Search for Fixed Point Quantization for more details • Mixing samples ◦ java.lang.IllegalArgumentException: Failed to get input dimensions. 0-th input should have 602112 bytes, but found 150528 bytes. ◦ java.lang.IllegalArgumentException: Cannot convert an TensorFlowLite tensor with type FLOAT32 to a Java object of type [[B (which is compatible with the TensorFlowLite type UINT8)
29. #WeAreHoi User (eXperience) first, Use what’s there, Customise if necessary
30. #WeAreHoi #WeAreHoi Adding ML Kit to Android Things And some TensorFlow things DroidCon Berlin 2018