Depth APIで簡易クロマキー合成 #geek_garage_ios/depth_api_ios11_20170627

Transcript

1. Depth APIͰ؆қΫϩϚΩʔ߹੒ GEEK GARAGE iOS vol3 2017/06/27 1

2. Profile Kazuya Ueoka Timers inc.ͷiOSΤϯδχΞ Twitter: @fromkk Github: fromkk Qiita:

   fromkk 2

3. WWDC 2017ʹߦͬͯདྷ·ͨ͠✈ ϒϩά͍͔ͭ͘ॻ͍ͨͷͰΑ͔ͬͨΒ؍ͯͶ! http://techblog.timers-inc.com/archive/category/ wwdc2017 3

4. ΫϩϚΩʔ߹੒ — ฐࣾͷݕ౼தࢪࡦͷதʹΫϩϚ Ωʔ߹੒͕ඞཁͳ෺͕͋ͬͨ — ࣸਅͷಛఆ৭ͷ෦෼ΛಁԽͯ͠എ ܠը૾ͱ߹੒(άϦʔϯόοΫ) — Ϣʔβʔ͕Ξοϓϩʔυ͢Δࣸਅ ͷഎܠ͕Ұ৭͚ͩͳΜͯ΄΅օແ

   ը૾ૉࡐ:εϚʔτϑΥϯͰࠓ໷ͷҿ ΈձΛ༧໿ʢάϦʔϯόοΫʣ 4

5. ͦΜͳத 5

6. WWDC 2017ͰDepth Api͕ެ։͞Ε·ͨ͠! 6

7. Sessions — 507 Capturing Depth in iPhone Photography — 508

   Image Editing with Depth 7

8. Depthͱ͸ — iPhone 7 PlusͷϙʔτϨʔτϞʔυͰࡱӨͨࣸ͠ਅ͔Β Ͱऔಘग़དྷΔ෺ମͷڑ཭ — ϙʔτϨʔτࡱӨͰ͸ԕ͘ʹ͍͘ʹ࿈Εͯڧ͍΅͔͠Τ ϑΣΫτΛೖΕ͍ͯΔ( CIDepthBlurEffect

   ) 8

9. Disparityͱ͸ — ೔ຊޠͰ͸֨ࠩ — ਂ౓Λը૾Ͱදݱͨ͠෺ͱউखʹղऍ 9

10. ͕ 10

11. ରԠ୺຤ iPhone 7 Plus iOS 11Ҏ্ ͷΈ! 11

12. ࢖͍͔ͨͬͨͷͰ ϝΠϯ࢖༻͍ͯ͠ΔiPhone 7 PlusʹiOS 11 betaΛΠϯε τʔϧ͠·ͨ͠! 12

13. ݪཧ — 2ͭͷΧϝϥͰࡱӨͨ͠ಛఆͷ2 ఺ͷڑ཭͕͍ۙํ͕खલɾ཭Εͯ Δํ͕Ԟ — σΟʔϓϥʔχϯάͷٕज़Λར༻ ͍ͯ͠ΔΒ͍͠ʢಛ௃఺ͷந ग़ʁʣ 13

14. ੍ݶࣄ߲ — iOS 11ͰࡱӨͨ͠ը૾͔Β͔͠Disparity͕औಘग़དྷͳ͍ — HEIFϑΥʔϚοτͷΈରԠ 14

15. HEIF — iOS 11͔ΒରԠͨ͠৽͍͠ը૾ϑΥʔϚοτ — ͍ܰʂ — Alphaνϟϯωϧ/Depth/ΞχϝʔγϣϯରԠ — λΠϧಡΈࠐΈରԠ

    — etc... 15

16. More info about HEIF — 503 Introducing HEIF and HEVC

    — 513 High Efficiency Image File Format 16

17. Disparityը૾ͷऔಘ — طʹࡱӨͨࣸ͠ਅ͔Βऔಘ — PhotoKitΛར༻ let asset: PHAsset = ...

    asset.requestContentEditingInput(with: nil) { (input, info) in guard let imageURL: URL = input?.fullSizeImageURL else { return } if let disparityImage: CIImage = CIImage(contentsOf: imageURL, options: [kCIImageAuxiliaryDisparity: true]) { self.disparityImageView.image = UIImage(ciImage: disparityImage) } } 17

18. ͪͳΈʹ self.asset.requestContentEditingInput(with: nil) { (input, info) in guard let imageURL:

    URL = input?.fullSizeImageURL else { return } guard let source = CGImageSourceCreateWithURL(imageURL as CFURL, nil) else { return } guard let sourceProperties = CGImageSourceCopyProperties(source, nil) else { return } print(sourceProperties) } ͱ͢Ε͹ 18

19. { "{FileContents}" = { ImageCount = 1; Images = (

    { AuxiliaryData = ( { AuxiliaryDataType = kCGImageAuxiliaryDataTypeDisparity; Height = 768; Width = 576; } ); } ); }; } ͱ͍ͬͨ৘ใ͕औಘग़དྷΔ 19

20. ը૾߹੒ͯ͠ΈΔ let ciImage: CIImage = CIImage(image: image) let wallImage: UIImage

    = #imageLiteral(resourceName: "wall") guard let wallCIImage: CIImage = CIImage(image: wallImage) else { return } let maskedImage: CIImage = ciImage.applyingFilter("CIBlendWithMask", withInputParameters: [ kCIInputBackgroundImageKey: wallCIImage, kCIInputMaskImageKey: disparityImage.applyingFilter("CIColorClamp", withInputParameters: nil), ]) self.disparityImageView.image = UIImage(ciImage: maskedImage) 20

21. ը૾ௐ੔ CIColorMatrix Λར༻ͯ͠άϨʔͷೱ͞Λௐ੔ let maskImage = disparityImage.applyingFilter("CIColorMatrix", withInputParameters: [ "inputRVector"

    : CIVector(x: value, y: 0, z: 0, w: 0), "inputGVector" : CIVector(x: 0, y: value, z: 0, w: 0), "inputBVector" : CIVector(x: 0, y: 0, z: value, w: 0), "inputBiasVector" : CIVector(x: bias, y: bias, z: bias, w: 0)]) 21

22. Sample https://github.com/fromkk/DepthAPISampleForiOS11 22

23. ϋϚͬͨࣄ — ͦ΋ͦ΋CIImageɺCIFilterશવ஌Βͳ͔ͬͨ — kCIImageAuxiliaryDepth Ͱ΋ը૾͕औಘग़དྷΔ͸ͣͳͷ ʹग़དྷͳ͔ͬͨ — ճస͍ͯ͠Δը૾ʹରԠग़དྷͳ͔ͬͨʢৄ͍͠ਓ͍ͨΒڭ ͑ͯԼ͍͞!ʣ

    — ͦ΋ͦ΋਺ֶతͳ஌͕ࣝແ͍ͷͰηογϣϯͷҙຯ͕͋· Γཧղग़དྷͳ͔ͬͨʢসʣ 23

24. Recap — ݸਓతʹ͸Ұ୴Disparityͷը૾͕औಘग़དྷͯ࠷௿ݶͷ߹ ੒͕ग़དྷͨͷͰຬ଍! — ݱ࣌఺ͰରԠ৚͕݅গͳ͔͘ͳΓχονͳػೳͳͷͰ࢖͍ ಓ͕೉͍͠" — iOS 11Ҏ߱ͰࡱӨͨࣸ͠ਅ͔͠Disparityը૾͕औಘग़དྷ

    ͳͯ͘൵͠Έ# 24

25. ͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠! 25