Depth APIͰ؆қΫϩϚΩʔ߹੒ GEEK GARAGE iOS vol3 2017/06/27 1 

Profile Kazuya Ueoka Timers inc.ͷiOSΤϯδχΞ Twitter: @fromkk Github: fromkk Qiita: fromkk 2 

WWDC 2017ʹߦͬͯདྷ·ͨ͠✈ ϒϩά͍͔ͭ͘ॻ͍ͨͷͰΑ͔ͬͨΒ؍ͯͶ! http://techblog.timers-inc.com/archive/category/ wwdc2017 3 

ΫϩϚΩʔ߹੒ — ฐࣾͷݕ౼தࢪࡦͷதʹΫϩϚ Ωʔ߹੒͕ඞཁͳ෺͕͋ͬͨ — ࣸਅͷಛఆ৭ͷ෦෼ΛಁԽͯ͠എ ܠը૾ͱ߹੒(άϦʔϯόοΫ) — Ϣʔβʔ͕Ξοϓϩʔυ͢Δࣸਅ ͷഎܠ͕Ұ৭͚ͩͳΜͯ΄΅օແ ը૾ૉࡐ:εϚʔτϑΥϯͰࠓ໷ͷҿ ΈձΛ༧໿ʢάϦʔϯόοΫʣ 4 

ͦΜͳத 5 

WWDC 2017ͰDepth Api͕ެ։͞Ε·ͨ͠! 6 

Sessions — 507 Capturing Depth in iPhone Photography — 508 Image Editing with Depth 7 

Depthͱ͸ — iPhone 7 PlusͷϙʔτϨʔτϞʔυͰࡱӨͨࣸ͠ਅ͔Β Ͱऔಘग़དྷΔ෺ମͷڑ཭ — ϙʔτϨʔτࡱӨͰ͸ԕ͘ʹ͍͘ʹ࿈Εͯڧ͍΅͔͠Τ ϑΣΫτΛೖΕ͍ͯΔ( CIDepthBlurEffect ) 8 

Disparityͱ͸ — ೔ຊޠͰ͸֨ࠩ — ਂ౓Λը૾Ͱදݱͨ͠෺ͱউखʹղऍ 9 

͕ 10 

ରԠ୺຤ iPhone 7 Plus iOS 11Ҏ্ ͷΈ! 11 

࢖͍͔ͨͬͨͷͰ ϝΠϯ࢖༻͍ͯ͠ΔiPhone 7 PlusʹiOS 11 betaΛΠϯε τʔϧ͠·ͨ͠! 12 

ݪཧ — 2ͭͷΧϝϥͰࡱӨͨ͠ಛఆͷ2 ఺ͷڑ཭͕͍ۙํ͕खલɾ཭Εͯ Δํ͕Ԟ — σΟʔϓϥʔχϯάͷٕज़Λར༻ ͍ͯ͠ΔΒ͍͠ʢಛ௃఺ͷந ग़ʁʣ 13 

੍ݶࣄ߲ — iOS 11ͰࡱӨͨ͠ը૾͔Β͔͠Disparity͕औಘग़དྷͳ͍ — HEIFϑΥʔϚοτͷΈରԠ 14 

HEIF — iOS 11͔ΒରԠͨ͠৽͍͠ը૾ϑΥʔϚοτ — ͍ܰʂ — Alphaνϟϯωϧ/Depth/ΞχϝʔγϣϯରԠ — λΠϧಡΈࠐΈରԠ — etc... 15 

More info about HEIF — 503 Introducing HEIF and HEVC — 513 High Efficiency Image File Format 16 

Disparityը૾ͷऔಘ — طʹࡱӨͨࣸ͠ਅ͔Βऔಘ — PhotoKitΛར༻ let asset: PHAsset = ... asset.requestContentEditingInput(with: nil) { (input, info) in guard let imageURL: URL = input?.fullSizeImageURL else { return } if let disparityImage: CIImage = CIImage(contentsOf: imageURL, options: [kCIImageAuxiliaryDisparity: true]) { self.disparityImageView.image = UIImage(ciImage: disparityImage) } } 17 

ͪͳΈʹ self.asset.requestContentEditingInput(with: nil) { (input, info) in guard let imageURL: URL = input?.fullSizeImageURL else { return } guard let source = CGImageSourceCreateWithURL(imageURL as CFURL, nil) else { return } guard let sourceProperties = CGImageSourceCopyProperties(source, nil) else { return } print(sourceProperties) } ͱ͢Ε͹ 18 

{ "{FileContents}" = { ImageCount = 1; Images = ( { AuxiliaryData = ( { AuxiliaryDataType = kCGImageAuxiliaryDataTypeDisparity; Height = 768; Width = 576; } ); } ); }; } ͱ͍ͬͨ৘ใ͕औಘग़དྷΔ 19 

ը૾߹੒ͯ͠ΈΔ let ciImage: CIImage = CIImage(image: image) let wallImage: UIImage = #imageLiteral(resourceName: "wall") guard let wallCIImage: CIImage = CIImage(image: wallImage) else { return } let maskedImage: CIImage = ciImage.applyingFilter("CIBlendWithMask", withInputParameters: [ kCIInputBackgroundImageKey: wallCIImage, kCIInputMaskImageKey: disparityImage.applyingFilter("CIColorClamp", withInputParameters: nil), ]) self.disparityImageView.image = UIImage(ciImage: maskedImage) 20 

ը૾ௐ੔ CIColorMatrix Λར༻ͯ͠άϨʔͷೱ͞Λௐ੔ let maskImage = disparityImage.applyingFilter("CIColorMatrix", withInputParameters: [ "inputRVector" : CIVector(x: value, y: 0, z: 0, w: 0), "inputGVector" : CIVector(x: 0, y: value, z: 0, w: 0), "inputBVector" : CIVector(x: 0, y: 0, z: value, w: 0), "inputBiasVector" : CIVector(x: bias, y: bias, z: bias, w: 0)]) 21 

Sample https://github.com/fromkk/DepthAPISampleForiOS11 22 

ϋϚͬͨࣄ — ͦ΋ͦ΋CIImageɺCIFilterશવ஌Βͳ͔ͬͨ — kCIImageAuxiliaryDepth Ͱ΋ը૾͕औಘग़དྷΔ͸ͣͳͷ ʹग़དྷͳ͔ͬͨ — ճస͍ͯ͠Δը૾ʹରԠग़དྷͳ͔ͬͨʢৄ͍͠ਓ͍ͨΒڭ ͑ͯԼ͍͞!ʣ — ͦ΋ͦ΋਺ֶతͳ஌͕ࣝແ͍ͷͰηογϣϯͷҙຯ͕͋· Γཧղग़དྷͳ͔ͬͨʢসʣ 23 

Recap — ݸਓతʹ͸Ұ୴Disparityͷը૾͕औಘग़དྷͯ࠷௿ݶͷ߹ ੒͕ग़དྷͨͷͰຬ଍! — ݱ࣌఺ͰରԠ৚͕݅গͳ͔͘ͳΓχονͳػೳͳͷͰ࢖͍ ಓ͕೉͍͠" — iOS 11Ҏ߱ͰࡱӨͨࣸ͠ਅ͔͠Disparityը૾͕औಘग़དྷ ͳͯ͘൵͠Έ# 24 

͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠! 25