Share
Embed
Taking photos is free
Xyggy
February 21, 2019
Transcript
9 slides
-
1 Taking photos is free Farmer wants to know disease
type affecting tomato crop. Photos are from the same plant. Dataset: 80K plant leaf images of different crops https://plantvillage.org/ No image pre-processing performed. No textual data used. Feature vectors generated automatically with deep learning. #1 #2 #3 www.xyggy.com © 2019 -
2 Query with photo #1 Top 5 results: 1 potato_early_blight
2 tomato_early_blight 3 potato_early_blight 4 potato_early_blight 5 tomato_early_blight 2nd result identifies disease www.xyggy.com © 2019 -
3 Query with photo #2 Top 5 results: 1 tomato_early_blight
2 celery_early_blight 3 tomato_early_blight 4 potato_early_blight 5 tomato_early_blight 1st result identifies disease www.xyggy.com © 2019 -
4 Query with photo #3 Top 5 results: 1 soybean_leaf_blight
2 celery_early_blight 3 potato_early_blight 4 tomato_early_blight 5 soybean_leaf_blight 4th result identifies disease www.xyggy.com © 2019 -
5 Real world data is noisy 3 queries with different
photos from the same tomato plant give different predictions. Real world data is noisy. Let’s try with Thingy using multiple photos per query. www.xyggy.com © 2019 -
6 Query with photo #1 and #2 Top 5 results:
1 tomato_early_blight 2 tomato_early_blight 3 celery_early_blight 4 potato_early_blight 5 potato_early_blight top 2 positions identify disease www.xyggy.com © 2019 -
7 Add photo #3 to query top 3 positions identify
disease Top 5 results: 1 tomato_early_blight 2 tomato_early_blight 3 tomato_early_blight 4 potato_early_blight 5 potato_early_blight www.xyggy.com © 2019 -
8 Taking photos is free Taking photos is free. Ditto
audio, video, sensor and other item data. Multiple items per query gives Thingy additional information to work with to improve relevance. Perfect for a noisy world. www.xyggy.com © 2019