What is CVBuffer/ROPPONGI.swift

Transcript

1. $7#V⒎FSͷ࿩
   30110/(*TXJGUୈճ๬೥ձ
   
   

   View Slide

2. OPQQF
   !
   1PDPDIBJ04ΤϯδχΞ
   "
   ͖ͭͶ͔Θ͍͍
   #
   30110/(*TXJGUॳࢀઓ
   $
   J04%$ͰඳըपΓͷ࿩Λ͠·͠
   ͨW
   
   

   View Slide

3. 
   

   View Slide

4. ಈըΛѻ͏ػձͷ૿Ճ
   w ಈը഑৴ΞϓϦ΍IFWDͷొ৔ɺ$PSF7JEFPʹ৮ΕΔػ
   ձ͕૿͍͑ͯΔ
   w σʔλ΍ϝσΟΞΛѻ͏#V⒎FSܥΫϥεͷར༻ස౓͸
   ૿Ճ
   w ΈΜͳɺؾ࣋ͪͰ$71JYFM#V⒎FSΛ࢖͍ͬͯ·ͤΜ͔ʁ
   
   

   View Slide

5. #V⒎FSܥΫϥεͷۙگ
   w ݹ͍ΫϥεͳͷͰɺ΄΅มߋ͸ͳ͍
   w ͔͠͠؀ڥ͸มԽɺΫϥΠΞϯτͰͷσίʔυ΍
   0QFO(-&4΍.FUBM΁ͷσʔλ౉͠ʹར༻͞ΕΔ
   
   

   View Slide

6. $7#V⒎FS
   
   

   View Slide

7. $7#V⒎FS
   w $7#V⒎FSͷ$7͸$PSF7JEFPͷ$7
   σʔλόοϑΝΛ௚઀৮Βͣʹ؆୯ʹಡΈॻ͖͢Δͨ
   Ίͷ*'
   
   

   View Slide

8. 
   

   View Slide

9. ୅දతͳ$7#V⒎FSͷ೿ੜ
   w $7*NBHF#V⒎FS
   w $71JYFM#V⒎FS
   w $70QFO(-&45FYUVSF
   
   

   View Slide

10. $7#V⒎FS͡Όͳ͍ํ
    w $.4BNQMF#V⒎FS
    ͜Ε͸ҧ͏
    w $.#MPDL#V⒎FS
    ͜Ε΋ҧ͏
    
    

    View Slide

11. ͲΜͳ࣌ʹऔಘͰ͖Δ΋ͷ͔
    DJ*NBHFQJYFM#V⒎FS@d
    ͱ͔
    MFUJC$.4BNQMF#V⒎FS(FU*NBHF#V⒎FS TC
    
    
    

    View Slide

12. $7#V⒎FSͷਖ਼ମ
    w $7*NBHF#V⒎FS
    public typealias CVImageBuffer = CVBuffer
    w $71JYFM#V⒎FS
    public typealias CVPixelBuffer = CVImageBuffer
    w $70QFO(-&45FYUVSF
    public typealias CVOpenGLESTexture = CVImageBuffer
    
    

    View Slide

13. $71JYFM#V⒎FSWT$7*NBHF#V⒎FS
    w 2UZQFBMJBTͳΜͩ͠ಉ͡Ͱ͠ΐʁ
    w "Զʹ΋Θ͔ΒΜ
    
    

    View Slide

14. $71JYFM#V⒎FSWT$7*NBHF#V⒎FS
    w $71JYFM#VGGFS
    ϝϞϦ಺ͷϐΫηϧόοϑΝʹΞΫηε͢ΔͨΊͷΫϥ
    ε
    w $7*NBHF#VGGFS
    ϝϞϦ಺ͷը૾ʹΞΫηε͢ΔͨΊͷΫϥε
    
    

    View Slide

15. ϐΫηϧ৘ใΞΫηεͷྫ
    w ॎԣͷαΠζ
    w σʔλαΠζ
    ը૾ΞΫηεͷྫ
    w Χϥʔεϖʔε
    
    

    View Slide

16. υΩϡϝϯτ
    $7*NBHF#VGGFS(FU%JTQMBZ4J[F @
    
    "$(4J[FTUSVDUVSFEFpOJOHUIFOPNJOBMEJTQMBZ
    TJ[FPGUIFCV⒎FS3FUVSOT[FSPTJ[FJGDBMMFE
    XJUIBOPO$7*NBHF#VGGFS3FGUZQFPS
    /6--
    
    

    View Slide

17. ݕূ
    var pb: CVPixelBuffer? = nil
    CVPixelBufferCreate(kCFAllocatorDefault,
    128, 128,
    kCVPixelFormatType_32BGRA, nil, &pb)
    CVImageBufferGetDisplaySize(pb!)
    // -> (128.0, 128.0)
    
    

    View Slide

18. ಈըΛѻ͏ػձͷ૿Ճ
    w ಈը഑৴ΞϓϦ΍IFWDͷొ৔ɺ$PSF7JEFPʹ৮ΕΔػ
    ձ͕૿͍͑ͯΔ
    w σʔλ΍ϝσΟΞΛѻ͏#V⒎FSܥΫϥεͷར༻ස౓͸
    ૿Ճ
    w ΈΜͳɺؾ࣋ͪͰ$71JYFM#V⒎FSΛ࢖͍ͬͯ·ͤΜ͔ʁ
    
    

    View Slide

19. ؾ࣋ͪͰ࢖͍ͬͯΔ
    
    

    View Slide

20. 6**NBHFͱͷҧ͍
    
    

    View Slide

21. 6**NBHFͱͷҧ͍
    w $7#V⒎FS
    ΞυϨεΛࢀর͍ͯ͠Δ͚ͩͳͷͰɺϩοΫ͸͢Δ͕
    ίϐʔ΍Ωϟογϡ͸͞Εͳ͍
    தؒϨϯμϦϯά΋উखʹ͞Εͳ͍
    ϏσΦͷΑ͏ʹߴ଎ʹॲཧ͢Δඞཁ͕͋ΔՕॴʹ࠷ద
    
    

    View Slide

22. ΞυϨεͷϩοΫ
    $7#V⒎FSͷσʔλόοϑΝʹ$16͔ΒΞΫηε͢Δ
    ৔߹͸ΞυϨεΛϩοΫ͢Δඞཁ͕͋Δ
    CVPixelBufferLockBaseAddress(pb, .readOnly)
    defer { CVPixelBufferUnlockBaseAddress(pb, .readOnly) }
    
    

    View Slide

23. $71JYFM#V⒎FSͷத਎Λදࣔ͢Δ
    
    

    View Slide

24. Ұ൪؆୯ͳํ๏
    $71JYFM#V⒎FS$**NBHF6**NBHF
    CIImage(cvPixelBuffer: CVPixelBuffer)
    UIImage(ciImage: ciImage)
    
    

    View Slide

25. .FUBMͰදࣔ͢Δ
    CVMetalTextureCacheܦ༝Ͱ
    $71JYFM#V⒎FS.5-5FYUVSF
    .5,7JFXͳͲͰදࣔ
    
    

    View Slide

26. 0QFO(-&4Ͱදࣔ͢Δ
    CVOpenGLESTextureCacheܦ༝Ͱ
    $71JYFM#V⒎FS0QFO(-&45FYUVSF
    (-,7JFXͳͲͰදࣔ
    
    

    View Slide

27. $.4BNQMF#V⒎FSͱ͸
    
    

    View Slide

28. 
    

    View Slide

29. $.4BNQMF#V⒎FSͱ͸
    ɾඞͣ͠΋$71JYFM#V⒎FS͕ೖ͍ͬͯΔͱ͸ݶΒͳ͍
    
    

    View Slide

30. ࿩ͦ͏ͱࢥ͍ͬͯͨ࿩୊
    ɾ$71JYFM#V⒎FS͔Β$.4BNQMF#V⒎FSΛ࡞Δ࿩
    ɾϢʔεέʔε
    ɾར఺
    
    

    View Slide

31. 
    

    View Slide