Gemma's Counting Magic: Bringing Object Detection to Your Android App

In this workshop, we will explore the integration of machine learning into Android applications, focusing on object detection and counting objects using Gemma in combination with TensorFlow Lite. This session is ideal for Android developers looking to integrate powerful AI and machine learning features into their projects, with little or no experience in machine learning required.

Transcript

1. Gemma's Counting Magic: Bringing Object Detection to Your Android App Engineering Manager | Google Developer Expert Hannah Olukoye
2. AGENDA 01 02 03 Introductio n Setup + Demo Questions
3. "“It is hard to show your skill as a sailor when there is no wind.” Good Strategy, Bad Strategy - Richard P. Rumelt
4. Importance of AI in Android Applications 2 1 3 Enhanced Experience Advanced Functionality Automation of Tasks
5. Gemma? • Gemma 2 – Scalable power for all platforms, • CodeGemma – Your coding co-pilot, optimized for AI-assisted development • PaliGemma – Handles both text and images seamlessly across devices. • RecurrentGemma – Master of sequential data tasks, in any size. • ShieldGemma – Fortified for security, perfect for sensitive data handling.
6. TensorFlow Lite is a ML framework optimized to run pre-trained models on mobile devices like Android smartphones. TensorFlow Lite? • Mobile-Optimized • Pre-built Models • Model Conversion • Core components: • Interpreter: Runs models on-device. • Converter: Converts models to TFLite format. • Hardware acceleration
7. Object Detection Food Packaging: • Label Verification • Packaging Inspection
8. Demo?
9. Setup • Open/Create an account on Gemma • Open/Create an account on Kaggle
10. Setup On Android Studio 1. Add TensorFlow Lite Dependencies 2. Add your TensorFlow Lite Model 3. Add your Labels File
11. Resources • https://medium.com/google-developer-experts/part-3-deploy-gemma-on-android-5bac532c54b7 • https://www.kaggle.com/ • https://www.kaggle.com/models/google/paligemma • https://rockyshikoku.medium.com/using-yolov8-object-detection-model-on-android-18e51a519ba8 • https://github.com/google-gemini/gemma-cookbook/tree/main/PaliGemma/PaliGemma-on-Androi d