Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Taking photos is free

Xyggy
February 21, 2019

Taking photos is free

Xyggy

February 21, 2019
Tweet

More Decks by Xyggy

Other Decks in Technology

Transcript

  1. 1 Taking photos is free Farmer wants to know disease

    type affecting tomato crop. Photos are from the same plant. Dataset: 80K plant leaf images of different crops https://plantvillage.org/ No image pre-processing performed. No textual data used. Feature vectors generated automatically with deep learning. #1 #2 #3 www.xyggy.com © 2019
  2. 2 Query with photo #1 Top 5 results: 1 potato_early_blight

    2 tomato_early_blight 3 potato_early_blight 4 potato_early_blight 5 tomato_early_blight 2nd result identifies disease www.xyggy.com © 2019
  3. 3 Query with photo #2 Top 5 results: 1 tomato_early_blight

    2 celery_early_blight 3 tomato_early_blight 4 potato_early_blight 5 tomato_early_blight 1st result identifies disease www.xyggy.com © 2019
  4. 4 Query with photo #3 Top 5 results: 1 soybean_leaf_blight

    2 celery_early_blight 3 potato_early_blight 4 tomato_early_blight 5 soybean_leaf_blight 4th result identifies disease www.xyggy.com © 2019
  5. 5 Real world data is noisy 3 queries with different

    photos from the same tomato plant give different predictions. Real world data is noisy. Let’s try with Thingy using multiple photos per query. www.xyggy.com © 2019
  6. 6 Query with photo #1 and #2 Top 5 results:

    1 tomato_early_blight 2 tomato_early_blight 3 celery_early_blight 4 potato_early_blight 5 potato_early_blight top 2 positions identify disease www.xyggy.com © 2019
  7. 7 Add photo #3 to query top 3 positions identify

    disease Top 5 results: 1 tomato_early_blight 2 tomato_early_blight 3 tomato_early_blight 4 potato_early_blight 5 potato_early_blight www.xyggy.com © 2019
  8. 8 Taking photos is free Taking photos is free. Ditto

    audio, video, sensor and other item data. Multiple items per query gives Thingy additional information to work with to improve relevance. Perfect for a noisy world. www.xyggy.com © 2019