iOSでmp4をデコードして自分だけの動画プレーヤーを作ろう！/orecon

Transcript

1. J04ͰNQΛσίʔυͯࣗ͠෼ͩ ͚ͷಈըϓϨʔϠʔΛ࡞Ζ͏ʂ Զίϯ
   
   4VNNFS
   
   %BZ
   
   
   $ PSFDPO@JPT
   D
   
2. J04%$͓ർΕ༷Ͱͨ͠ʂʂ PSFDPO@JPT
   D
   
3. ϥΠϒ഑৴ΞϓϦͷΞΠςϜ࠶ੜΛ.FUBMͰ ࣮૷͢Δࣄʹͳͬͨ࿩ J04%$Ͱ݄೔ʹొஃ͠·ͨ͠ɻ ֤ํ໘ʹ͋Γ͕ͱ͏͍͟͝·͢ʂ IUUQTHPPHM#:X%/# PSFDPO@JPT
   D
   
4. OPQQF !
   גࣜձࣾσΟʔɾΤψɾΤʔ "
   ͖ͭͶ͔Θ͍͍ #
   ࠓ೔஀ੜ೔ PSFDPO@JPT
   D
   
5. "(&/%" w ಈըͷ࠶ੜํ๏ͱಛ௃ w ϏσΦͷߏ଄ཧղ w 4XJGUͰσίʔυॲཧΛॻ͘ w ·ͱΊ PSFDPO@JPT
   D
   
6. Ұ൪؆୯ͳํ๏ PSFDPO@JPT
   D
   
7. "71MBZFS$POUSPMMFS w "7,JUGSBNFXPSL w "71MBZFSΛ౉ͤ͹ద౰ʹ࠶ੜͯ͘͠ΕΔ w J04 PSFDPO@JPT
   D
   
8. "71MBZFS$POUSPMMFS ࢖͍ํ let vc = AVPlayerViewController() vc.player = AVPlayer(url: url) present(vc, animated: true, completion: nil) PSFDPO@JPT
   D
   
9. "71MBZFS$POUSPMMFS ! w 04΍σόΠε͝ͱʹ࠷దͳσβΠϯ w "JSQMBZͳͲʹ΋αϙʔτ w ૢ࡞6*͕ఏڙ͞ΕΔ ! w 6*΍ػೳͷΧελϚΠζੑ͸ͳ͍ PSFDPO@JPT
   D
   
10. 6*ΛΧελϚΠζ͍ͨ͠ͱ͖͸ʁ PSFDPO@JPT
    D
    
11. "71MBZFS-BZFS w "7'PVOEBUJPOGSBNFXPSL w "71MBZFSΛ౉ͯ͠ૢ࡞ w J04
     PSFDPO@JPT
    D
    
12. "71MBZFS-BZFS let player = AVPlayer(url: url) player.play() let layer = AVPlayerLayer(player: player) layer.frame = frame view.layer.addSublayer(layer) PSFDPO@JPT
    D
    
13. "71MBZFS-BZFS ! w $"-BZFSͱͯ͠ѻ͑ΔͷͰॊೈ ! w ಛʹͳ͠ PSFDPO@JPT
    D
    
14. ಛʹͳ͠ PSFDPO@JPT
    D
    
15. ಛʹͳ͠ʁ PSFDPO@JPT
    D
    
16. "71MBZFS-BZFSͰࣄ଍Γͳ͍࣌ w 73ΰʔάϧͰݟΕΔΑ͏ʹͯ͠ʈʈ w ө૾͔Βਓ͚ͩൈ͖ग़ͯ͠࠶ੜ͍ͨ͠ʙ w ಈըʹϦΞϧλΠϜͰΤϑΣΫτΛ͔͚͍ͨ PSFDPO@JPT
    D
    
17. "71MBZFS-BZFSͰࣄ଍Γͳ͍࣌ ө૾ࣗମΛ࿪·ͤͨΓɺϑΟϧλΛ͔͚Δʹ͸ "71MBZFS-BZFSͰ͸Ͱ͖ͳ͍ɻ ಛʹϦΞϧλΠϜͷॲཧʹͳΔ΄Ͳ೉͍͠ɻ PSFDPO@JPT
    D
    
18. PSFDPO@JPT
    D
    
19. "7"TTFU3FBEFS w "7"TTFU3FBEFS5SBDL0VUQVUͱ૊Έ߹ΘͤΔͱຖ ϑϨʔϜͷ$.4BNQMF#V⒎FS͕औΕΔ PSFDPO@JPT
    D
    
20. "7"TTFU3FBEFS let asset = AVURLAsset(url: url) let video = asset.tracks(withMediaType: .video).first! let reader = try! AVAssetReader(asset: asset) let output = AVAssetReaderTrackOutput(track: video) if reader.canAdd(output) { reader.add(output) } output.copyNextSampleBuffer() output.copyNextSampleBuffer() output.copyNextSampleBuffer() PSFDPO@JPT
    D
    
21. PSFDPO@JPT
    D
    
22. "7"TTFU3FBEFS ඳըઌ͸ࣗ༝ w 6**NBHF7JFX let image = CIImage(cvPixelBuffer: pb) imageView.image = UIImage(ciimage: image) w "74BNQMF#V⒎FS%JTQMBZ-BZFS let sb = output.copyNextSampleBuffer() displayLayer.enqueue(sb) PSFDPO@JPT
    D
    
23. "7"TTFU3FBEFS w .FUBM CVMetalTextureCacheCreateTextureFromImage(kCFAllocatorDefault, textureCache, imageBuffer, nil, pixelFormat, width, height, 0, &imageTexture) // ~ লུ commandBuffer.present(drawable) commandBuffer.commit() PSFDPO@JPT
    D
    
24. "7"TTFU3FBEFS ! w ຖϑϨʔϜͷ4BNQMFS#V⒎FS͕ ಘΒΕΔ ! w Ի੠͸ผͰॲཧ PSFDPO@JPT
    D
    
25. ͜ΕͰԿͰ΋ग़དྷͦ͏ PSFDPO@JPT
    D
    
26. ͜ΕͰԿͰ΋ग़དྷͦ͏ʁ PSFDPO@JPT
    D
    
27. ྫ͑͹TOBQTIPUͷ໰୊ PSFDPO@JPT
    D
    
28. TOBQTIPU໰୊ ωοτϫʔΫϦιʔεͷ63-Λࢦఆͯ͠࠶ੜ͢Δͱɺ ى͜Δ໰୊ɻ ࠶ੜ͍ͯ͠ΔಈըϦιʔεͷεφοϓγϣοτ͕ࡱΕͳ ͍ɻ PSFDPO@JPT
    D
    
29. TOBQTIPU໰୊ TOBQTIPU7JFX"GUFS4DSFFO6QEBU FT ਅͬ҉ "7"TTFU*NBHF(FOFSBUPS ϩʔΧϧͷΈ "7"TTFU3FBEFS PVUQVUΛ઀ଓͰ͖ͳ͍ 04ͷεΫγϣ ࡱΕΔ PSFDPO@JPT
    D
    
30. ٧Μͩ PSFDPO@JPT
    D
    
31. ٧ΜͰͳ͍ʂʂʂ PSFDPO@JPT
    D
    
32. ࣗ෼Ͱө૾Λσίʔυ͢Ε͹0, PSFDPO@JPT
    D
    
33. PSFDPO@JPT
    D
    
34. 5*14 w ϋʔυ΢ΣΞσίʔμ ϋʔυͱͯ͠νοϓʹ౥ࡌ͞Ε͍ͯΔσίʔμ ߴ଎ʹσίʔυՄೳ w ιϑτ΢ΣΞσίʔμ ιϑτ΢ΣΞͰ࣮૷͞Εͨσίʔμ جຊతʹ͸஗͍ɺ$16ϦιʔεΛ৯͏ ϋʔυ΢ΣΞ͕ରԠ͍ͯ͠ͳ͍ίʔσοΫΛ࠶ੜͰ͖Δ PSFDPO@JPT
    D
    
35. ιϑτ΢ΣΞσίʔμͷྫ w CSJPO0(7,JU 7171ͳͲͷιϑτ΢ΣΞσίʔμ͕࣮૷͞Ε͍ͯΔ w POFWDBU"1/(,JU BQOHΛιϑτ΢ΣΞσίʔμΛ࢖ͬͯ$(*NBHFʹσ ίʔυ PSFDPO@JPT
    D
    
36. 75%FDPNQSFTTJPO4FTTJPO w 7JEFP5PPMCPYGSBNFXPSL w J04 w ϋʔυ΢ΣΞσίʔμͷΠϯλʔϑΣΠε w σίʔυࡁΈͷ$71JYFM#V⒎FSΛฦ͢ PSFDPO@JPT
    D
    
37. .1ͷύʔε 
38. PSFDPO@JPT
    D
    
39. PSFDPO@JPT
    D
    
40. PSFDPO@JPT
    D
    
41. TXJGUͰNQΛCPY͝ͱʹύʔε͢Δ *OQVU4USFBNͰ  CPY4J[F
    
    ͷॱ൪ͰಡΈଓ͚Ε͹ 0, ಛఆͷCPYͰ͸ɺࣗ਎ͷCPYʹରͯ͠࠶౓ݕࡧΛߦ͏ let stream = InputStream(url: url) stream.open() while stream.hasBytesAvailable { let size = stream.readUint32() let type = stream.readAscii(4) let data = stream.read(size - 8) } 
    IUUQTHJUIVCDPNOPQQFGPYXPMG.1#PY%VNQFSTXJGU PSFDPO@JPT
    D
    
42. NQͷߏ଄ ftyp(24) moov(52997) trak(19399) trak(33461) ... mdat(8754890) ߏ଄ྫ PSFDPO@JPT
    D
    
43. GUZQ CZUF͝ͱʹαϙʔτ͍ͯ͠Δϒϥϯυ͕ฒͿ ઌ಄͸Major Brandɺͦͷ͋ͱ͸Compatible Brand Major Brand: mp42 Compatible Brand: isom Compatible Brand: mp42 
    .BKPSͱ$PNQBUJCMFͷؒʹ͸CZUFۭ͘ 
    IUUQXXXGUZQTDPN PSFDPO@JPT
    D
    
44. NEBU ಈըͱԻ੠ͷ࣮σʔλ͕֨ೲ͞Ε͍ͯΔɻ PSFDPO@JPT
    D
    
45. NPPW ଟ͘ͷCPYͰߏ੒͞ΕΔCPY NEBUͷͲͷҐஔʹͲͷσʔλ͕ೖ͍ͬͯΔ͔ͳͲ΋ɺ ͜ͷCPYͷதʹ͋ΔCPYͰఆٛ͞Ε͍ͯΔ PSFDPO@JPT
    D
    
46. 5*14 'BJS1MBZ
    %3.  NEBUʹ҉߸Խ͞ΕͨΦʔσΟΦσʔλ ϚελʔΩʔΛ҉߸Խͯ͠ίϯςφʹอଘ ϚελʔΩʔͷෳ߹Ωʔ͸ΞΧ΢ϯτͱ)8ࣝผࢠͰ؅ ཧ 
    IUUQTEFWFMPQFSBQQMFDPNTUSFBNJOHGQT PSFDPO@JPT
    D
    
47. .1͔Βө૾σʔλΛऔΓग़͢ NPPWʹؚ·ΕΔ৘ใΛݩʹɺNEBU͔Β୳͢ɻ ͷͰ͕͢ʜ PSFDPO@JPT
    D
    
48. ࠓ೔͸ɺࣄલʹऔΓग़ͨ͠΋ͷΛ༻ҙ͠·ͨ͠ʜ $ mp4box -raw 1 movie.mp4 Extracting MPEG-4 AVC-H264 stream to h264 PSFDPO@JPT
    D
    
49. Iͷߏ଄ͱσίʔυ 
    IUUQTTQFBLFSEFDLDPNOPQQFGPYXPMGWJEFPEFDPEFPOJPT PSFDPO@JPT
    D
    
50. IUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZXXED 
51. ొ৔ਓ෺ w *ϑϨʔϜ w #
    
    1
    ϑϨʔϜ w 414
    
    114 ͜ΕΒ͕/"-ͱݺ͹ΕΔߏ଄ʹೖͬͯฒΜͰ͍Δ PSFDPO@JPT
    D
    
52. *ϑϨʔϜ w I͸ɺ̍ຕͷը૾ͱͦͷࠩ෼Ͱ਺ඵͷө૾Λදݱ ͢Δ w *%3
    1JDUVSF͸ͦͷݩʹͳΔ̍ຕ w ΩʔϑϨʔϜͱ΋ݴ͏ PSFDPO@JPT
    D
    
53. 1
    
    #ϑϨʔϜ w *ϑϨʔϜ͔Βͷࠩ෼৘ใ w 1͕̍ຕ͔Β༧ଌͨ͠εϥΠε w #͕̎ຕ͔Β༧ଌͨ͠εϥΠε 
    #J 1SFEJDUJWF
    
    ༧ଌ PSFDPO@JPT
    D
    
54. 414
    
    4FRVFODF
    1BSBNFUFS
    4FU ϓϩϑΝΠϧɺϨϕϧ 114
    
    1JDUVSF
    1BSBNFUFS
    4FU ϐΫνϟͷූ߸Խ PSFDPO@JPT
    D
    
55. /"-ͷऔΓग़͠ํ 
56. PSFDPO@JPT
    D
    
57. /"-6
    IFBEFS /"-ͷछྨ͕ॻ͔Ε͍ͯΔ YdY
    εϥΠε Y
    *ϑϨʔϜ PSFDPO@JPT
    D
    
58. 75%FDPNQSFTT4FTTJPO ࣮ࡍ͸$ͷΠϯλʔϑΣΠεͳͷͰɺ4XJGUΠϯλʔ ϑΣΠεΛ࢖ͬͨٙࣅίʔυͰղઆ PSFDPO@JPT
    D
    
59. 75%FDPNQSFTT4FTTJPOͷॳظԽ let desc: CMVideoFormatDescription = ~~ let callback = { (imageBuffer: CVImageBuffer?) in } let attrib = [.pixelFormat : .gbra] let session = VTDecompressSession(desc, params, attrib, callback) PSFDPO@JPT
    D
    
60. $.7JEFP'PSNBU%FTDSJQUJPO let pps: [UInt8] = ~~ let sps: [UInt8] = ~~ let desc = CMVideoFormatDescriptionCreateFromH264ParameterSets([pps, pps]) PSFDPO@JPT
    D
    
61. 75%FDPNQSFTT4FTTJPO session.decodeFrame(sampleBuffer) PSFDPO@JPT
    D
    
62. σίʔμʹ౉͢4BNQMF#V⒎FS let packet = (IϑϨʔϜ΍B/PϑϨʔϜɾεϥΠε) let blockBuffer = CMBlockBuffer(packet) let sampleBuffer = CMSampleBuffer(blockBuffer) PSFDPO@JPT
    D
    
63. ԻपΓ "VEJP5PPMCPY PSFDPO@JPT
    D
    
64. "VEJP
    4FSWJDF
    2VFVF PSFDPO@JPT
    D
    
65. "VEJP
    4FSWJDF
    2VFVFͷॳظԽ let format: AudioStreamBasicDescription = file[kAudioFilePropertyDataFormat] let callback = { } let audioQueue = AudioQueue(format, callback) PSFDPO@JPT
    D
    
66. "VEJP2VFVF΁ͷFORVFVF let buffer = audioQueue.allocate(size) buffer.read(packet) audioQueue.enqueue(buffer) PSFDPO@JPT
    D
    
67. ·ͱΊ PSFDPO@JPT
    D
    
68. 75"5͸Ͳ͏͍͏࣌ʹ࢖͏΂͖ʁ w "7,JU"7'PVOEBUJPOͰ࣮૷ग़དྷͳ͍࣌ͷ࠷ऴฌث w SUNQͷετϦʔϛϯάͷදࣔͱ͔ PSFDPO@JPT
    D
    
69. ษڧํ๏ w TIPHP)BJTIJO,JUTXJGU NQͷCPYߏ଄͕Ϋϥεఆٛ͞Ε͍ͯͨΓ͢ΔͷͰɺ࣮૷ϕʔεͰཧղ͠΍͍͢ w վగࡾ൛
    )"7$ڭՊॻ
    ΠϯϓϨεඪ४ڭՊॻγϦʔζ ූ߸Խͷ࿩ͱߏ଄ͷ࿩͕೔ຊޠͰॻ͍ͯ͋Δɻগ͠ཧղ͔ͯ͠ΒಡΉͱಡΊͦ ͏ɻʢ8*1ʣ w ͋ͱ࢓༷ॻͱ͔ʜ PSFDPO@JPT
    D
    
70. Ҏ্Ͱ͢ʂʢͪΐͬͱએ఻ʣ PSFDPO@JPT
    D
    
71. ٕज़ॻయ̑ OPQQFMBC
    
    ͑ ຊग़͠·͢ʂʢ8*1
    ʣ PSFDPO@JPT
    D
    
72. 1PDPDIB ഑৴αʔϏεʹڵຯͷ͋ΔΤϯδχΞืूதʂ PSFDPO@JPT
    D
    
73. ͋Γ͕ͱ͏͍͟͝·ͨ͠ʂ ࠓޙͱ΋ΑΖ͓͘͠ئ͍͠·͢ PSFDPO@JPT
    D