Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Taking photos is free

Xyggy
February 21, 2019

Taking photos is free

Xyggy

February 21, 2019
Tweet

More Decks by Xyggy

Other Decks in Technology

Transcript

  1. 1
    Taking photos is free
    Farmer wants to know disease type affecting tomato crop.
    Photos are from the same plant.
    Dataset: 80K plant leaf images of different crops https://plantvillage.org/
    No image pre-processing performed. No textual data used.
    Feature vectors generated automatically with deep learning.
    #1 #2 #3
    www.xyggy.com © 2019

    View Slide

  2. 2
    Query with photo #1
    Top 5 results:
    1 potato_early_blight
    2 tomato_early_blight
    3 potato_early_blight
    4 potato_early_blight
    5 tomato_early_blight
    2nd result identifies disease
    www.xyggy.com © 2019

    View Slide

  3. 3
    Query with photo #2
    Top 5 results:
    1 tomato_early_blight
    2 celery_early_blight
    3 tomato_early_blight
    4 potato_early_blight
    5 tomato_early_blight
    1st result identifies disease
    www.xyggy.com © 2019

    View Slide

  4. 4
    Query with photo #3
    Top 5 results:
    1 soybean_leaf_blight
    2 celery_early_blight
    3 potato_early_blight
    4 tomato_early_blight
    5 soybean_leaf_blight
    4th result identifies disease
    www.xyggy.com © 2019

    View Slide

  5. 5
    Real world data is noisy
    3 queries with different photos from the same
    tomato plant give different predictions.
    Real world data is noisy.
    Let’s try with Thingy using multiple photos per
    query.
    www.xyggy.com © 2019

    View Slide

  6. 6
    Query with photo #1 and #2
    Top 5 results:
    1 tomato_early_blight
    2 tomato_early_blight
    3 celery_early_blight
    4 potato_early_blight
    5 potato_early_blight
    top 2 positions identify disease
    www.xyggy.com © 2019

    View Slide

  7. 7
    Add photo #3 to query
    top 3 positions identify disease
    Top 5 results:
    1 tomato_early_blight
    2 tomato_early_blight
    3 tomato_early_blight
    4 potato_early_blight
    5 potato_early_blight
    www.xyggy.com © 2019

    View Slide

  8. 8
    Taking photos is free
    Taking photos is free. Ditto audio, video, sensor
    and other item data.
    Multiple items per query gives Thingy
    additional information to work with to improve
    relevance.
    Perfect for a noisy world.
    www.xyggy.com © 2019

    View Slide

  9. 9
    Thingy
    www.xyggy.com © 2019

    View Slide