Using Deep Learning and GCP in Helping Rice Farmers

Transcript

1. Using Deep Learning and GCP in Helping Rice Farmers Marc Anthony Reyes hello@marcreyes.ph / @marcreyesph Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 1
2. About Me Recent Computer Science graduate, Xavier University – Ateneo de Cagayan Kubernetes Guy @ Mynt Likes cats and everything Python Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 2
3. Applications of Machine Learning Business Analytics Computer Vision Finance Manufacturing Medicine And the list goes on… Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 3
4. How About Farming? Little to no government support Lack of interest Youth find it not an interesting field to take on Left behind of technological advancements Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 4
5. AI Projects on Farming Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 5
6. UmaBOT Agricultural drone for monitoring plant health Funded by Jollibee Group Foundation Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 6
7. Realizations Drone parts are expensive Maintenance and repair Expensive for small-scale farmers Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 7
8. Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 8 Introducing PalayLab
9. Partners Department of Agriculture Regional Field Office 10 PhilRice Database and Management Portal Opol Municipal Agricultural Office Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 9
10. Partners TensorFlow Research Cloud for Google Cloud Platform Free TPU Usage Quota Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 10
11. TFRC Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 11 tensorflow.org/tfrc
12. TFRC Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 12 tensorflow.org/tfrc
13. Methodology Data Collection Data Prepocessing Feature Extraction Model Training Model Deployment Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 13
14. Data Collection Image of healthy rice plants Image of rice plant pests and diseases Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 14
15. Data Collection DISEASES Bacterial Blight Rice Blast Sheath Blight Tungro INFESTATIONS Army Worm Golden Apple Snail Green Leafhopper Rice Black Bug Rice Ear Bug Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 15
16. Data Preprocessing Preparation of train-test data Data augmentation Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 16
17. Data Preprocessing Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 17
18. Feature Extraction Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 18
19. Model Training Inception ResNet v2 from scratch Got 89% accuracy in training Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 19
20. Training on GCP Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 20 Convert processed images to .tfrecords file Test Train Upload to Google Cloud Storage Cloud TPU Submit to Prepare training job configuration files
21. Model Deployment Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 21 .tflite model file Mobile optimized Model Host to Firebase ML Kit Return predictions API integration Submit image for prediction Mobile application Automatic model updates Automatic model fallback Save model to phone
22. Phone to GCP Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 22 Send image Firebase Cloud Storage API integration Google Cloud Storage Cloud TPU Submit to Prepare training job configuration files
23. PalayLab 1) Diseases Activity 2) Pests Activity 3) Detection Activity 4) Statistics Activity Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 23
24. Plant Health Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 24
25. NDVI Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 25
26. Plant Health Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 26 Get percentage of segmented lesion area over the healthy one
27. PalayLab 1) Live Camera View 2) Detection Result 3) Information About the Disease/Pest Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 27
28. PalayLab 1) Select Image Activity 2) Select Activity Intent 3) Select Image From Gallery 4) Image Select Preview 5) Detection Result 6) Information About the Disease/Pest Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 28
29. Moving Forward Including other factors such as the soil, moisture, and weather condition as features for the model. Legacy support for phones that have deprecated API levels. Introduce mobile applications to government agencies for training of farmers Map severity of infestation/infection in a field Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 29
30. Recognition Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 30 Top 6, 2019 BPI-DOST Science Awards
31. Thank you very much! Let’s build more ML solutions for farming. Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 31 Marc Anthony Reyes hello@marcreyes.ph / @marcreyesph