動画エフェクトに関する新技術の紹介

Transcript

1. Copyright © ZOZO, Inc. ಈըΤϑΣΫτʹؔ͢Δ
 ৽ٕज़ͷ঺հ גࣜձࣾZOZO ϒϥϯυιϦϡʔγϣϯ։ൃຊ෦ FAANS෦ ϑϩϯτΤϯυϒϩοΫ Ճ౻ ঵ਅ @shoma10170806
2. © ZOZO, Inc. 2 גࣜձࣾZOZO ϒϥϯυιϦϡʔγϣϯ։ൃຊ෦ FAANS෦ ϑϩϯτΤϯυϒϩοΫ Ճ౻ ঵ਅ • X: @shoma10170806 • γϣοϓελοϑͷൢചαϙʔτπʔϧ
 ʮFAANSʯͷiOSΞϓϦΛ։ൃ • ത࢜ޙظ՝ఔʹࡏֶதɹը૾ॲཧͳͲͷݚڀʹैࣄ
3. © ZOZO, Inc. 3 FAANSͷಈըػೳ ϑΝογϣϯಈը
4. © ZOZO, Inc. 4 FAANSͷಈըػೳ ϑΝογϣϯಈը 88%$
   
   ಈըΤϑΣΫτͷ৽ٕज़
5. © ZOZO, Inc. 5 ಈըΤϑΣΫτͷηογϣϯ l&OIBODF
   ZPVS
   BQQ
   XJUI
   NBDIJOF
   MFBSOJOH
   CBTFE
   WJEFP
   F ff FDUTz 7JEFP5PPMCPYGSBNFXPSL ϑϨʔϜϨʔτͷม׵ ϒϥʔʢ΅͔͠ʣͷద༻ ௒ղ૾ʢߴղ૾౓Խʣ
6. © ZOZO, Inc. 6 l&OIBODF
   ZPVS
   BQQ
   XJUI
   NBDIJOF
   MFBSOJOH
   CBTFE
   WJEFP
   F ff FDUTz 7JEFP5PPMCPYGSBNFXPSL ϑϨʔϜϨʔτͷม׵ ϒϥʔʢ΅͔͠ʣͷద༻ ௒ղ૾ʢߴղ૾౓Խʣ ಈըΤϑΣΫτͷηογϣϯ
7. © ZOZO, Inc. 7 ϑϨʔϜϨʔτͷม׵ͱ͸ ඵͰຕ T
8. © ZOZO, Inc. 8 ϑϨʔϜϨʔτͷม׵ͱ͸ ඵͰຕ ඵͰຕ T T ө૾
   ׈Β͔ʹʂ
9. © ZOZO, Inc. 9 ϑϨʔϜϨʔτม׵ྫʢ+ εϩʔʣ ݩಈը
   T
   ຕ εϩʔ εϩʔ
   ʴ
   ม׵
10. © ZOZO, Inc. 10 ϑϨʔϜϨʔτม׵ྫʢ+ εϩʔʣ ݩಈը
    T
    ຕ εϩʔ εϩʔ
    ʴ
    ม׵ εϩʔͷΈ
    T
    ຕ ϑϨʔϜϨʔτม׵
    T
    ຕ
11. © ZOZO, Inc. 11 ࣮૷ͷྲྀΕ ɾ75'SBNF3BUF$POWFSTJPO$PO fi HVSBUJPOͷఆٛ ɾ75'SBNF1SPDFTTPSͷఆٛ ɾόοϑΝͷׂΓ౰ͯ ɾϑϨʔϜϨʔτͷม׵ॲཧ
12. © ZOZO, Inc. 12 ࣮૷ͷྲྀΕ ɾ75'SBNF3BUF$POWFSTJPO$PO fi HVSBUJPOͷఆٛ ɾ75'SBNF1SPDFTTPSͷఆٛ ɾόοϑΝͷׂΓ౰ͯ ɾϑϨʔϜϨʔτͷม׵ॲཧ
13. © ZOZO, Inc. 13 VTFrameRateConversionConfigurationͷఆٛ ᶃ
    75'SBNF3BUF$POWFSTJPO$PO fi HVSBUJPOͱ͸ ϑϨʔϜϨʔτม׵ͷॳظߏ੒ͷఆٛ ᶄ
    ར༻Մೳͳ04 J04
     ɺJ1BE04
    ɺNBD04
    
14. © ZOZO, Inc. 14 VTFrameRateConversionConfigurationͷఆٛ ᶅ
    ϓϩάϥϜ guard let configuration = VTFrameRateConversionConfiguration( ɹɹɹɹframeWidth: width, ɹɹɹɹframeHeight: height, ɹɹɹɹusePrecomputedFlow: false, ɹɹɹɹqualityPrioritization: .normal, ɹɹɹɹrevision: .revision1 ) else {ɹthrow Fault.failedToCreateFRCConfigurationɹ}
15. © ZOZO, Inc. 15 VTFrameRateConversionConfigurationͷఆٛ ᶅ
    ϓϩάϥϜ guard let configuration = VTFrameRateConversionConfiguration( ɹɹɹɹframeWidth: width, ɹɹɹɹframeHeight: height, ɹɹɹɹusePrecomputedFlow: false, ɹɹɹɹqualityPrioritization: .normal, ɹɹɹɹrevision: .revision1 ) else {ɹthrow Fault.failedToCreateFRCConfigurationɹ} ಈըͷ෯ɺߴ͞
16. © ZOZO, Inc. 16 VTFrameRateConversionConfigurationͷఆٛ ᶅ
    ϓϩάϥϜ guard let configuration = VTFrameRateConversionConfiguration( ɹɹɹɹframeWidth: width, ɹɹɹɹframeHeight: height, ɹɹɹɹusePrecomputedFlow: false, ɹɹɹɹqualityPrioritization: .normal, ɹɹɹɹrevision: .revision1 ) else {ɹthrow Fault.failedToCreateFRCConfigurationɹ} ಈըͷ෯ɺߴ͞ ಛ௃ྔͷܭࢉํ๏
17. © ZOZO, Inc. 17 VTFrameRateConversionConfigurationͷఆٛ ᶅ
    ϓϩάϥϜ guard let configuration = VTFrameRateConversionConfiguration( ɹɹɹɹframeWidth: width, ɹɹɹɹframeHeight: height, ɹɹɹɹusePrecomputedFlow: false, ɹɹɹɹqualityPrioritization: .normal, ɹɹɹɹrevision: .revision1 ) else {ɹthrow Fault.failedToCreateFRCConfigurationɹ} ग़ྗͷ඼࣭ ಈըͷ෯ɺߴ͞ ಛ௃ྔͷܭࢉํ๏
18. © ZOZO, Inc. 18 VTFrameRateConversionConfigurationͷఆٛ ᶅ
    ϓϩάϥϜ guard let configuration = VTFrameRateConversionConfiguration( ɹɹɹɹframeWidth: width, ɹɹɹɹframeHeight: height, ɹɹɹɹusePrecomputedFlow: false, ɹɹɹɹqualityPrioritization: .normal, ɹɹɹɹrevision: .revision1 ) else {ɹthrow Fault.failedToCreateFRCConfigurationɹ} ग़ྗͷ඼࣭ ΞϧΰϦζϜͷઃఆ ಈըͷ෯ɺߴ͞ ը૾ಛ௃ͷܭࢉํ๏
19. © ZOZO, Inc. 19 ࣮૷ͷྲྀΕ ɾ75'SBNF3BUF$POWFSTJPO$PO fi ɾ75'SBNF1SPDFTTPSͷఆٛ ɾόοϑΝͷׂΓ౰ͯ ɾϑϨʔϜϨʔτͷม׵ॲཧ
20. © ZOZO, Inc. 20 VTFrameProcessorͷఆٛ ᶃ
    75'SBNF1SPDFTTPSͱ͸ ߴ౓ͳө૾ॲཧΛߦ͏Ϋϥε ᶄ
    ϓϩάϥϜ let frameProcessor = VTFrameProcessor() try frameProcessor.startSession(configuration: configuration) ઌ΄Ͳͷ
    75'SBNF3BUF$POWFSTJPO$PO fi HVSBUJPO
21. © ZOZO, Inc. 21 ࣮૷ͷྲྀΕ ɾ75'SBNF3BUF$POWFSTJPO$PO fi ɾ75'SBNF1SPDFTTPSͷఆٛ ɾόοϑΝͷׂΓ౰ͯ ɾϑϨʔϜϨʔτͷม׵ॲཧ
22. © ZOZO, Inc. 22 όοϑΝͷׂΓ౰ͯ ᶃ
    ʜͷલʹϑϨʔϜϨʔτม׵ͷΠϝʔδʢը૾਺
    ഒʣ  
23. © ZOZO, Inc. 23 όοϑΝͷׂΓ౰ͯ ᶃ
    ʜͷલʹϑϨʔϜϨʔτม׵ͷΠϝʔδʢϑϨʔϜϨʔτ
    ഒʣ      ͜͜Λੜ੒
24. © ZOZO, Inc. 24 όοϑΝͷׂΓ౰ͯ let sourceFrame = VTFrameProcessorFrame( buffer: pixelBuffer, presentationTimeStamp: sourcePTS ) let nextFrame = VTFrameProcessorFrame( buffer: pixelBuffer, presentationTimeStamp: nextPTS ) var intervals: [Float] = [0.25, 0.5, 0.75] let destinationFrames = try framesBetween( firstPTS: sourcePTS, lastPTS: nextPTS, interpolationIntervals: intervals ) ᶄ
    ϓϩάϥϜ     
25. © ZOZO, Inc. 25 όοϑΝͷׂΓ౰ͯ let sourceFrame = VTFrameProcessorFrame( buffer: pixelBuffer, presentationTimeStamp: sourcePTS ) let nextFrame = VTFrameProcessorFrame( buffer: pixelBuffer, presentationTimeStamp: nextPTS ) var intervals: [Float] = [0.25, 0.5, 0.75] let destinationFrames = try framesBetween( firstPTS: sourcePTS, lastPTS: nextPTS, interpolationIntervals: intervals ) ᶄ
    ϓϩάϥϜ     
26. © ZOZO, Inc. 26 όοϑΝͷׂΓ౰ͯ let sourceFrame = VTFrameProcessorFrame( buffer: pixelBuffer, presentationTimeStamp: sourcePTS ) let nextFrame = VTFrameProcessorFrame( buffer: pixelBuffer, presentationTimeStamp: nextPTS ) var intervals: [Float] = [0.25, 0.5, 0.75] let destinationFrames = try framesBetween( firstPTS: sourcePTS, lastPTS: nextPTS, interpolationIntervals: intervals ) ᶄ
    ϓϩάϥϜ     
27. © ZOZO, Inc. 27 όοϑΝͷׂΓ౰ͯ let sourceFrame = VTFrameProcessorFrame( buffer: pixelBuffer, presentationTimeStamp: sourcePTS ) let nextFrame = VTFrameProcessorFrame( buffer: pixelBuffer, presentationTimeStamp: nextPTS ) var intervals: [Float] = [0.25, 0.5, 0.75] let destinationFrames = try framesBetween( firstPTS: sourcePTS, lastPTS: nextPTS, interpolationIntervals: intervals ) ᶄ
    ϓϩάϥϜ     
28. © ZOZO, Inc. 28 όοϑΝͷׂΓ౰ͯ let sourceFrame = VTFrameProcessorFrame( buffer: pixelBuffer, presentationTimeStamp: sourcePTS ) let nextFrame = VTFrameProcessorFrame( buffer: pixelBuffer, presentationTimeStamp: nextPTS ) var intervals: [Float] = [0.25, 0.5, 0.75] let destinationFrames = try framesBetween( firstPTS: sourcePTS, lastPTS: nextPTS, interpolationIntervals: intervals ) ᶄ
    ϓϩάϥϜ     
29. © ZOZO, Inc. 29 ϑϨʔϜϨʔτͷม׵ॲཧ ग़ྗύϥϝʔλͷઃఆ
    
    ॲཧͷ࣮ߦ guard let parameters = VTFrameRateConversionParameters( sourceFrame: sourceFrame, nextFrame: nextFrame, opticalFlow: nil, interpolationPhase: intervalArray, submissionMode: .sequential, destinationFrames: destinationFrames ) else {ɹthrow Fault.failedToCreateFRCParametersɹ} try await frameProcessor.process(parameters: parameters)
30. © ZOZO, Inc. 30 ϑϨʔϜϨʔτͷม׵ॲཧ ग़ྗύϥϝʔλͷઃఆ
    
    ॲཧͷ࣮ߦ guard let parameters = VTFrameRateConversionParameters( sourceFrame: sourceFrame, nextFrame: nextFrame, opticalFlow: nil, interpolationPhase: intervalArray, submissionMode: .sequential, destinationFrames: destinationFrames ) else {ɹthrow Fault.failedToCreateFRCParametersɹ} try await frameProcessor.process(parameters: parameters) ϑϨʔϜม׵ͷग़ྗύϥϝʔλ
31. © ZOZO, Inc. 31 ϑϨʔϜϨʔτͷม׵ॲཧ ग़ྗύϥϝʔλͷઃఆ
    
    ॲཧͷ࣮ߦ guard let parameters = VTFrameRateConversionParameters( sourceFrame: sourceFrame, nextFrame: nextFrame, opticalFlow: nil, interpolationPhase: intervalArray, submissionMode: .sequential, destinationFrames: destinationFrames ) else {ɹthrow Fault.failedToCreateFRCParametersɹ} try await frameProcessor.process(parameters: parameters) ϑϨʔϜม׵ͷೖग़ྗύϥϝʔλ όοϑΝͷೖྗ
32. © ZOZO, Inc. 32 ϑϨʔϜϨʔτͷม׵ॲཧ ग़ྗύϥϝʔλͷઃఆ
    
    ॲཧͷ࣮ߦ guard let parameters = VTFrameRateConversionParameters( sourceFrame: sourceFrame, nextFrame: nextFrame, opticalFlow: nil, interpolationPhase: intervalArray, submissionMode: .sequential, destinationFrames: destinationFrames ) else {ɹthrow Fault.failedToCreateFRCParametersɹ} try await frameProcessor.process(parameters: parameters) ϑϨʔϜม׵ͷೖग़ྗύϥϝʔλ όοϑΝͷೖྗ ग़ྗͷ֨ೲઌ
33. © ZOZO, Inc. 33 ϑϨʔϜϨʔτͷม׵ॲཧ ग़ྗύϥϝʔλͷઃఆ
    
    ॲཧͷ࣮ߦ guard let parameters = VTFrameRateConversionParameters( sourceFrame: sourceFrame, nextFrame: nextFrame, opticalFlow: nil, interpolationPhase: intervalArray, submissionMode: .sequential, destinationFrames: destinationFrames ) else {ɹthrow Fault.failedToCreateFRCParametersɹ} try await frameProcessor.process(parameters: parameters) ϑϨʔϜม׵ͷೖग़ྗύϥϝʔλ όοϑΝͷೖྗ ग़ྗͷ֨ೲઌ ม׵ͷ࣮ߦ
34. © ZOZO, Inc. 34 ϑϨʔϜϨʔτͷม׵݁Ռ ೖྗ ग़ྗ
35. © ZOZO, Inc. 35 ·ͱΊ 75'SBNF1SPDFTTPSͳͲ৽ٕज़Λ༻͍ͨ
    ಈըΤϑΣΫτͷద༻ํ๏ͷ঺հ ଞͷΤϑΣΫτ΋໘ന͍ͷͰɺ
    ͥͻ৭ʑ৮ͬͯΈ͍ͯͩ͘͞ʂ
37. © ZOZO, Inc. 37 ࠷ޙʹαϥοͱ఻͍͑ͨ͜ͱ ᶃ 75'SBNF1SPDFTTPSͷग़ྗ
    ಈըͷܗࣜͰ͸ͳ͍
    ᶄ ॲཧ࣌ؒ
    Tʢ؀ڥ
    "QQMF
    .
    1SPɺಈըඵʣ
    ᶅ Ұ෦ͷΤϑΣΫτ
    NBD04
     ʢߴղ૾౓ԽͳͲʣ