Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Chef*mo: 動画が調理器具を制御して調理を支援するシステムの提案 / Chefmo

Tsubasa Yumura
December 23, 2017

Chef*mo: 動画が調理器具を制御して調理を支援するシステムの提案 / Chefmo

2017年12月23日(土)にグランフロント大阪で開催されたEC46の発表資料。論文はこちら → https://goo.gl/6oJHh4

Tsubasa Yumura

December 23, 2017
Tweet

More Decks by Tsubasa Yumura

Other Decks in Research

Transcript

  1. Chef mo
    *
    ౬ଜ ཌྷ†, ݹؘ ༎ࢠ†, দຊ ՚า‡, ஛ᖒ ͻ͞Έ†, ܀ݪ Ұو‡ɹ
    ಈը͕ௐཧث۩Λ੍ޚͯ͠ௐཧΛࢧԉ͢ΔγεςϜͷఏҊ
    † Chefˎmo ϓϩδΣΫτ

    ‡ ௡ాक़େֶ
    ৘ใॲཧֶձ ୈ46ճΤϯλςΠϯϝϯτίϯϐϡʔςΟϯάˏάϥϯϑϩϯτେࡕ

    View full-size slide

  2. Chef mo
    *
    Chefˎmo
    2

    View full-size slide

  3. Chef mo
    *
    ຊൃදͷ֓ཁ
    • ྉཧಈըʹௐཧεΫϦϓτΛຒΊࠐΈɺಈըͷ಺༰ʹ
    ߹Θͤͯௐཧث۩Λ੍ޚͯ͠ௐཧࢧԉΛߦ͏γεςϜ
    ΛఏҊ
    • ίϯηϓτ࣮૷Λߦͬͨ
    • ಈըͱIoTػثͷ࿈ܞϑϨʔϜϫʔΫsrt.jsΛ༻͍ͨ
    • ʮ͔͚ΔʯʮࠞͥΔʯʮ੾Δʯͷ3छྨͷௐཧߦಈΛ
    ࣮૷ͨ͠
    • ٞ࿦ͱ՝୊Λ·ͱΊͨ
    3

    View full-size slide

  4. Chef mo
    *
    ͸͡Ίʹ
    • ྉཧಈը
    • Ωϡʔϐʔ3෼ΫοΩϯάʢ1962೥ʙʣ
    • 1෼ྉཧಈըʢKurashiruͳͲʣ
    4
    [2]kurashiru
    http://www.kurashiru.com/
    ޘָ
    ࢹௌΛָ͠Ή
    ެ։Λָ͠Ή
    ޘָ
    ࣮ӹ
    ྉཧʹؔ͢Δ
    ৘ใΛಘΔ
    ࣮ӹ
    ྉཧಈըΛͳͥ؍Δ͔ʁ

    View full-size slide

  5. Chef mo
    *
    ͸͡Ίʹ
    • ػցʹΑΔௐཧࢧԉٕज़ͱ૊Έ߹ΘͤΔ͜ͱʹΑΓɺ
    ྉཧಈըͷࢹௌΛΑΓΑ͍΋ͷʹঢ՚Ͱ͖ΔͷͰ͸ͳ
    ͍͔ʁ
    5
    [4]Moley [6]Cooky

    View full-size slide

  6. Chef mo
    *
    ͸͡Ίʹ
    6
    ྉཧಈըͷ
    ݩͷ໾ׂ
    ௐཧࢧԉ
    ྟ৔ײ
    ָ͠͞
    Chef mo
    *
    ಈը͕ௐཧث۩Λ੍ޚͯ͠ௐཧΛࢧԉ͢ΔγεςϜ
    ޘָ
    ࢹௌΛָ͠Ή
    ެ։Λָ͠Ή
    ޘָ
    ࣮ӹ
    ྉཧʹؔ͢Δ
    ৘ใΛಘΔ
    ࣮ӹ
    Chefˎmo
    Ͱ֦ு

    View full-size slide

  7. Chef mo
    *
    ؔ࿈ݚڀ | ػցʹΑΔௐཧࢧԉ
    7
    [4]Moley – The world's first robotic kitchen
    http://www.moley.com/

    View full-size slide

  8. Chef mo
    *
    ؔ࿈ݚڀ | ػցʹΑΔௐཧࢧԉ
    8
    [6]Sugiura et al., Cooking with robots: designing a household
    system working in open environments (2010)

    View full-size slide

  9. Chef mo
    *
    ؔ࿈ݚڀ | ϨγϐͱWeb
    9
    [10]٢઒ͱٶԼ, άϥϑΟΧϧσʔλϑϩʔʹΑΔ
    ௐཧϨγϐϓϩάϥϛϯάݴޠͷఏҊ (2010)
    [9] RecipeML
    • Ϩγϐ
    • ྉཧΛͭ͘ΔͨΊʹඞཁͳࡐྉ΍ௐཧํ๏ͳͲͷ৘ใΛॻ͖هͨ͠खॱॻ
    • खॱॻͱ͍͏ಛੑ͔Βߏ଄Խ͞Εͨهड़ʹ͸޲͍͍ͯΔ

    View full-size slide

  10. Chef mo
    *
    ؔ࿈ݚڀ | ϨγϐͱWeb
    10
    [12]౉ᬑΒ, smoon: Webͷ࣮ମԽʹΑΔߦಈࢧԉͱͦͷࢼ࡞ (2011)

    View full-size slide

  11. Chef mo
    *
    ؔ࿈ݚڀ | ಈըʹΑΔεΫϦϓτ࣮ߦ
    11
    [13]܀ݪͱڮຊ, srt.js: ө૾ίϯςϯπ΁ͷ IoT ࢦ޲֦ு
    ϓϩάϥϜຒΊࠐΈϑϨʔϜϫʔΫ (2016)
    • srt.js
    • srtϑΝΠϧ(ࣈນ)ʹJavaScriptΛهड़࣮ͯ͠ߦ͢ΔϑϨʔϜϫʔΫ
    • ࠶ੜͨ͠ಈըͷ೚ҙͷλΠϛϯάʹ߹ΘͤͯίʔυΛ࣮ߦ

    View full-size slide

  12. Chef mo
    *
    Chefˎmo
    • ௐཧεΫϦϓτ
    • ಈըʹ͋ΘͤͨௐཧࢧԉͷखॱΛهࡌ
    • User Generated Contents(UGC)ͱͯ͠ͷੜ੒Λ૝ఆ
    • ΩονϯϚωʔδϟ
    • ֤ՈఉͷΩονϯʹ഑ஔ
    • ௐཧث۩΍σΟεϓϨΠͳͲͷػثશମΛ౷ׅ
    12

    View full-size slide

  13. Chef mo
    *
    Chefˎmo
    • ௐཧࢧԉͷܗଶ
    13

    View full-size slide

  14. Chef mo
    *
    Chefˎmo
    • ௐཧࢧԉͷ౓߹͍
    14
    ChefˎmoͷλʔήοτྖҬ

    View full-size slide

  15. Chef mo
    *
    ίϯηϓτ࣮૷
    • YouTubeͷطଘௐཧಈըΛ࢖༻
    • srt.jsͷϑϨʔϜϫʔΫΛར༻ͯ͠ௐཧεΫϦϓτΛ࣮ߦ
    • Webmo[16]Λར༻ͯ͠ௐཧث۩Λࣗ࡞
    • ʮ͔͚ΔʯʮࠞͥΔʯʮ੾ΔʯΛ࣮૷
    • 3ͭͷϢʔεέʔεΛ࣮ࢪ
    • (a)υϨογϯάΛ͔͚Δ
    • (b)ཛΛ༹͘
    • (c)౾෗Λ੾Δ
    15

    View full-size slide

  16. Chef mo
    *
    ίϯηϓτ࣮૷
    16

    View full-size slide

  17. Chef mo
    *
    ίϯηϓτ࣮૷
    17

    View full-size slide

  18. Chef mo
    *
    ٞ࿦ | Chefˎmoͷ׆༻
    • λϨϯτ΍ΩϟϥΫλʔͷጪґ
    • ༗໊γΣϑͷௐཧಈը
    • ྉཧͷັྗΛߴΊΔߴڃ৯ࡐͷಈըͳͲͷಈը
    • өը΍ΞχϝͱͷίϥϘϨʔγϣϯͷ࣮ݱ
    18
    [18]͚΋ͷϑϨϯζCAFE
    https://twitter.com/japaricafe_hara/status/929896900525830144

    View full-size slide

  19. Chef mo
    *
    ٞ࿦ | ௐཧث۩
    • ຊൃදͰ͸Webmo(αʔϘϞʔλ)Λར༻ͯࣗ͠࡞
    • API੍ޚͰ͖Δௐཧث۩΋ࠓޙීٴ͢ΔͰ͋Ζ͏
    • ͍··Ͱʹͳ͍ௐཧث۩ͷࣗ࡞΋޿·Γͭͭ͋Δ
    • Maker Faire TokyoͰ΋ʮ৯඼ʯΧςΰϦ͕ઃஔ
    19
    [22];Γ͔͚ϓϩολ:LunchBot [24]ຊ֨ͩ͠ϝʔΧʔʮBUSHIʯ [25]ΫϨʔϓϩϘοτʮΫϨϓʯ

    View full-size slide

  20. Chef mo
    *
    ٞ࿦ | ௐཧεΫϦϓτͷ࡞੒
    • ຊൃදͷίϯηϓτ࣮૷Ͱ͸srt.jsʹ࣮ͯߦ͢ΔJavaScriptͰ
    Webmoͷؔ਺Λهड़
    • جຊతͳௐཧߦಈΛϥΠϒϥϦͱͯ͠੔ཧ͠ػثͷࠩҟΛٵऩ
    • Ϩγϐͷղੳ΍ߦಈೝ͔ࣝΒௐཧεΫϦϓτͷࣗಈੜ੒
    20
    [28]Hashimoto et al., Kusk dataset: Toward a direct understanding
    of recipe text and human cooking activity (2014)

    View full-size slide

  21. Chef mo
    *
    ٞ࿦ | ෺ཧੈքͱಈըͷ༥߹
    • ChefˎmoͷޮՌΛߴΊΔͨΊʹ෺ཧੈքͱಈըͷ༥߹͕ॏཁ
    • VR/MR/ARͷ׆༻
    • ಈըͱͷ઀ଓײ
    21
    [29]౉ᬑͱதଜ, WorldConnector: Χϝϥ΁ͷ਎ମੑ෇༩ʹΑΔ
    ө૾ੈք΁ೖΓࠐΉΠϯλϑΣʔε (2014)

    View full-size slide

  22. Chef mo
    *
    ՝୊
    • ௐཧߦಈͷཻ౓
    • ଟ͘ͷௐཧߦಈʹ͸લ४උ͕ඞཁ
    • ྫ͑͹ʮ੾Δʯͷલʹ͸ʮ৯ࡐΛ·ͳ൘ͷ্ʹͷͤΔʯͱ͍
    ͏४උߦಈ͕͋Δ
    • ղܾҊ
    • ௐཧεΫϦϓτৄࡉԽʹΑΔࣗಈԽ
    • ਓ͕ڠௐͰ͖ΔΑ͏ࢧ࣋ɾ༠ಋ
    22

    View full-size slide

  23. Chef mo
    *
    ՝୊
    • ಈըͷ࣌ؒ࣠ͷௐ੔
    • طଘͷௐཧಈը͸ਓ͕ࢹௌ͢ΔͨΊʹͭ͘ΒΕ͍ͯ
    Δ
    • ಈըͰ͸ෆཁͳ෦෼͸লུ͞ΕΔͨΊ࣮ࡍͷௐཧ࣌
    ؒΑΓ୹͍
    • ղܾҊ
    • ௐཧߦಈͷਐḿʹΑΓಈը࠶ੜΛ੍ޚ
    23

    View full-size slide

  24. Chef mo
    *
    ·ͱΊ
    • ಈը͕ௐཧΛࢧԉ͢ΔγεςϜChefˎmoͷίϯηϓτ
    Λఏএ
    • Chefˎmoͷ׆༻ํ๏΍՝୊ɺՄೳੑʹ͍ͭͯٞ࿦Λ·
    ͱΊͨ
    • ௐཧث۩ͷൃల΍ಈըࢹௌελΠϧͷมԽʹΑͬͯ
    Chefˎmoͷ׆༻৔໘͸޿͕Δ
    24

    View full-size slide