Using Deep Learning and GCP in Helping Rice Farmers Marc Anthony Reyes [email protected] / @marcreyesph Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 1 

About Me Recent Computer Science graduate, Xavier University – Ateneo de Cagayan Kubernetes Guy @ Mynt Likes cats and everything Python Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 2 

Applications of Machine Learning Business Analytics Computer Vision Finance Manufacturing Medicine And the list goes on… Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 3 

How About Farming? Little to no government support Lack of interest Youth find it not an interesting field to take on Left behind of technological advancements Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 4 

AI Projects on Farming Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 5 

UmaBOT Agricultural drone for monitoring plant health Funded by Jollibee Group Foundation Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 6 

Realizations Drone parts are expensive Maintenance and repair Expensive for small-scale farmers Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 7 

Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 8 Introducing PalayLab 

Partners Department of Agriculture Regional Field Office 10 PhilRice Database and Management Portal Opol Municipal Agricultural Office Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 9 

Partners TensorFlow Research Cloud for Google Cloud Platform Free TPU Usage Quota Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 10 

TFRC Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 11 tensorflow.org/tfrc 

TFRC Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 12 tensorflow.org/tfrc 

Methodology Data Collection Data Prepocessing Feature Extraction Model Training Model Deployment Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 13 

Data Collection Image of healthy rice plants Image of rice plant pests and diseases Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 14 

Data Collection DISEASES Bacterial Blight Rice Blast Sheath Blight Tungro INFESTATIONS Army Worm Golden Apple Snail Green Leafhopper Rice Black Bug Rice Ear Bug Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 15 

Data Preprocessing Preparation of train-test data Data augmentation Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 16 

Data Preprocessing Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 17 

Feature Extraction Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 18 

Model Training Inception ResNet v2 from scratch Got 89% accuracy in training Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 19 

Training on GCP Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 20 Convert processed images to .tfrecords file Test Train Upload to Google Cloud Storage Cloud TPU Submit to Prepare training job configuration files 

Model Deployment Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 21 .tflite model file Mobile optimized Model Host to Firebase ML Kit Return predictions API integration Submit image for prediction Mobile application Automatic model updates Automatic model fallback Save model to phone 

Phone to GCP Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 22 Send image Firebase Cloud Storage API integration Google Cloud Storage Cloud TPU Submit to Prepare training job configuration files 

PalayLab 1) Diseases Activity 2) Pests Activity 3) Detection Activity 4) Statistics Activity Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 23 

Plant Health Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 24 

NDVI Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 25 

Plant Health Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 26 Get percentage of segmented lesion area over the healthy one 

PalayLab 1) Live Camera View 2) Detection Result 3) Information About the Disease/Pest Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 27 

PalayLab 1) Select Image Activity 2) Select Activity Intent 3) Select Image From Gallery 4) Image Select Preview 5) Detection Result 6) Information About the Disease/Pest Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 28 

Moving Forward Including other factors such as the soil, moisture, and weather condition as features for the model. Legacy support for phones that have deprecated API levels. Introduce mobile applications to government agencies for training of farmers Map severity of infestation/infection in a field Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 29 

Recognition Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 30 Top 6, 2019 BPI-DOST Science Awards 

Thank you very much! Let’s build more ML solutions for farming. Thursday, December 12, 2019 Using Deep Learning and GCP in Helping Rice Farmers 31 Marc Anthony Reyes [email protected] / @marcreyesph