Upgrade to Pro — share decks privately, control downloads, hide ads and more …

APIs for VJ-ing

APIs for VJ-ing

fand/amagitakayosi

September 15, 2017
Tweet

More Decks by fand/amagitakayosi

Other Decks in Technology

Transcript

  1. APIs
    for
    VJ-ing
    APIs
    for
    VJ-ing
    amagitaJayosi

    View full-size slide

  2. @amagitakayosi

    View full-size slide

  3. ࠷ۙAtomύοέʔδΛ࡞ͬͯ·͢

    View full-size slide

  4. ࠓ೔͸๻͕࡞ͬͨ
    "UPNύοέʔδΛ

    ঺հσϞͭͭ͠
    ࢖͍ͬͯΔ"1*Λ
    ղઆ͠·͢ʂʂʂʂ

    View full-size slide

  5. glsl
    livecoder

    View full-size slide

  6. HMTMMJWFDPEFS
    w "UPNͰ7+Ͱ͖Δύοέʔδ
    w (-4-ͷ࣮ߦ؀ڥ
    w (-4-Ͱө૾ΛϦΞϧλΠϜʹੜ੒ͨ͠Γ
    w ಈըը૾Λϩʔυͯ͠

    (-4-ͰՃ޻Ͱ͖ΔΑ͏ʹͨ͠Γ

    View full-size slide

  7. (-4-γΣʔμʔͷҰछ
    w %$(ͰӄӨΛܭࢉ͢ΔͨΊͷݴޠ
    w )-4- %JSFDU9
    ͱ͔ɺ.FUBM NBD04
    ͱ͔
    w ߦྻܭࢉʹศརͳϏϧτΠϯؔ਺
    w qPBUEPU WFDB WFDC
    ͱ͔

    View full-size slide

  8. γΣʔμʔΞʔτ
    w (-4-͸(16ύϫʔΛϑϧ׆༻Ͱ͖Δ
    w ʮ(-4-͚ͩͰෳࡶͳάϥϑΟοΫදݱΛ

    ɹඳըͰ͖ΔͷͰ͸ʁʯ
    w Ұ෦ͷਓʑ͕େڵฃ

    View full-size slide

  9. ࢀߟLJOUSPl&MFWBUFEz
    IUUQTXXXZPVUVCFDPNXBUDI WK#W#NJ5SP

    View full-size slide

  10. ී௨ͷ%άϥϑΟοΫε
    w ਺ઍʙ਺ສϙϦΰϯγΣʔμʔ

    View full-size slide

  11. ൘ϙϦ
    w ࡾ֯ܗݸγΣʔμʔ͚ͩͰશͯΛදݱ

    View full-size slide

  12. طଘͷϥΠϒίʔσΟϯά؀ڥ
    w ,PEFMJGFNFUBMͰॻ͚ΔσεΫτοϓΞϓϦ
    w 4IBEFSUPOF&NBDT$MPKVSF
    w ):-0(&/)BTLFMM੡"MU(-4-؀ڥ
    w 4ZOUIDMJQTFδϟό

    View full-size slide

  13. طଘ؀ڥ΁ͷෆຬ
    • ίʔυิ׬͍ͨ͠
    • linter࢖͍͍ͨ
    • ϞδϡʔϧγεςϜ࢖͍͍ͨ
    • GLSLʹ͸جຊincludeͱ͔ͳ͍

    View full-size slide

  14. "UPNύοέʔδͱͯࣗ͠࡞
    w طଘͷύοέʔδΛར༻Ͱ͖Δ
    w MJOUFS BVUPDPNQMFUF FUDʜ
    w &MFDUSPOͳͷͰɺϒϥ΢βͷ༷ʑͳ

    "1*Λར༻Ͱ͖Δ
    w +4੡(-4-όϯυϥʔΛ࢖͑Δ

    View full-size slide

  15. IUUQTXXXqJDLSDPNQIPUPTIFMMPDBUGPPE
    API

    View full-size slide

  16. HMTMMJWFDPEFSͰར༻ͯ͠Δ"1*
    w 8FC"VEJP"1*
    w 8FC.*%*"1*
    w (BNFQBE"1*
    w HFU6TFS.FEJB
    w 04$ 8*1

    View full-size slide

  17. 8FC"VEJP"1*
    w ݴΘͣͱ஌ΕͨԻΛग़͢΍ͭ
    w γϯηͱ͔΋࡞ΕΔ
    w ࢓༷͕ίϩίϩมΘΔ
    w (JU)VCͰٞ࿦͕ݟΕΔ

    View full-size slide

  18. Ի੠ೖྗ͔Βछྨͷ৘ใΛऔಘ
    w Իྔ
    w ೾ܗ
    w εϖΫτϥϜ
    w प೾਺ଳ͝ͱͷԻྔΛղੳͨ͠΋ͷ

    View full-size slide

  19. Ի੠ೖྗ͔Βछྨͷ৘ใΛऔಘ
    w Իྔ
    w ೾ܗ
    w εϖΫτϥϜ
    w प೾਺ଳ͝ͱͷԻྔΛղੳͨ͠΋ͷ
    AnalyserNodeͰ
    ҰؾʹऔಘͰ͖Δ

    View full-size slide

  20. (-4-ʹσʔλΛ౉͢
    w +4͔Β(-4-ʹ౉ͤΔσʔλͷ਺͸্ݶ͕͋Δ
    w େྔͷσʔλΛ౉͢ʹ͸ςΫενϟΛ࢖͏ʂ
    w ೾ܗΛ6JOU"SSBZʹม׵͠ɺ

    5)3&&%BUB5FYUVSFͰ(16ଆʹૹΔ

    View full-size slide

  21. ೾ܗΛUFYUVSFͱͯ͠දݱ

    View full-size slide

  22. εϖΫτϥϜ΋ಉ༷

    View full-size slide

  23. 8FC.*%*"1*
    w .*%*ָثͷԋ૗৘ใͷن֨
    w ϒϥ΢β͔ΒָثΛ໐Βͨ͠Γ
    w .*%*ίϯτϩʔϥʔͰ

    8FCΞϓϦΛૢ࡞ͨ͠Γ

    View full-size slide

  24. .*%*ϝοηʔδͷߏ଄
    w .*%*ίϯ౳Ͱ࢖ΘΕΔϝοηʔδ͸όΠτ
    0xB0 0x00 0x7F
    ϝοηʔδͷछྨ ίϯτϩʔϧ൪߸ ஋

    View full-size slide

  25. UFYUVSFʹม׵
    w YͷUFYUVSFʹϚοϐϯά
    w CZUF໨Y࣠
    w CZUF໨Z࣠
    w CZUF໨஋

    View full-size slide

  26. ྫY#YY'
    256
    128

    View full-size slide

  27. ྫY#YY'
    x=0xB0=172
    y=0
    0x7F
    = 128 (/255)
    = ໌Δ͞൒෼

    View full-size slide

  28. OPUFPOPGG͸ಛผѻ͍͍ͨ͠
    w OPUFPOP⒎͸όΠτ໨͕YY
    w YͷςΫενϟΛ࡞Δ
    x=Իͷߴ͞
    ৭=Իྔ

    View full-size slide

  29. (BNFQBE"1*
    w ήʔϜύουͷ৘ใΛऔಘ͢Δ
    w ϑϨʔϜຖʹϙʔϦϯά͢Δඞཁ͕͋Δ

    View full-size slide

  30. ήʔϜύουͷ઀ଓΛ଴ͬͯ
    rAF಺ͰຖϑϨʔϜ
    Ϙλϯ৘ใΛऔಘ͢Δ

    View full-size slide

  31. HFU6TFS.FEJB
    w ϚΠΫ΍Χϝϥͷө૾ΛऔಘͰ͖Δ
    w WJEFPཁૉͷTSDʹࢦఆͰ͖Δ

    View full-size slide

  32. getUserMediaͷ݁Ռ͔Β
    videoཁૉΛ࡞ͬͯ
    THREE.VideoTextureͰ
    GLSLʹ౉͢

    View full-size slide

  33. 04$ ະରԠ

    w .*%*ΑΓ΋ॊೈͰɺ

    ༷ʑͳϝοηʔδΛఆٛͰ͖Δϓϩτίϧ
    w ָثͱ͔ϥΠϒίʔσΟϯάۀքͰ͸

    σϑΝΫτʹͳΓͭͭ͋Δ
    w ରԠͯ͠΁Μͷʁͱ͍͏ཁ๬͕͋ͬͨ

    View full-size slide

  34. 04$ϝοηʔδͷߏ଄
    w Ϛδ͔Α
    /foo/bar 1 baz [1 2 3]
    OSCΞυϨε
    ೚ҙͷจࣈྻ
    OSCҾ਺

    ೚ҙݸͷҾ਺

    View full-size slide

  35. 04$ʹରԠ͢Δʹ͸
    w NJEJYZ[Έ͍ͨͳΤϯυϙΠϯτͰ

    .*%*ͬΆ͘ରԠ͢Δ͔͠ͳ͍ʜʜʁ
    w 5PVDI04$ʹ͸.*%*ϒϦοδ͕͋Γɺ

    ࣅͨΑ͏ͳ͜ͱΛ΍͍ͬͯΔͬΆ͍

    View full-size slide

  36. ͓·͚TUBDLHMHMTMJGZ
    w CSPXTFSJGZͷ(-4-൛
    w 

    ͱ͔ॻ͘ͱόϯυϧͯ͘͠ΕΔ
    w HMTMJGZ༻ͷϥΠϒϥϦ͕

    OQNͰଟ਺ެ։͞ΕͯΔ

    View full-size slide

  37. ݟ֮͑͋Δ։ൃਞ

    View full-size slide

  38. ͍ΖΜͳϥΠϒϥϦ͕͋Δɻੈքʜʜ

    View full-size slide

  39. ࡢ೔HMTMJGZαϙʔτ͠·ͨ͠

    View full-size slide

  40. (-4-ͨͷ͍͠ʂʂʂ
    w ࠷ۙझຯͰ8FCΞϓϦશવॻ͍ͯͳ͍
    w ΈΜͳ(-4-΍Ζ͏ͥ

    View full-size slide

  41. 1BUDIFTXFMDPNF

    View full-size slide

  42. eNJOY
    VJ-ING!!!
    eNJOY
    VJ-ING!!!

    View full-size slide