Vision Framework 入門

potatotips #42 https://potatotips.connpass.com/event/60015/
※公開されている情報を元に構成されています

Transcript

1. 7JTJPO
   'SBNFXPSL
   ೖ໳ !NPUPLJFF QPUBUPUJQT
   
2. ࣗݾ঺հ w HJUIVC
   UXJUUFS
   !NPUPLJFF
   w ϝϧΧϦι΢κ΢
   J04ΤϯδχΞ
   w ϝϧΧϦ
   Χ΢ϧ
   νʔϜ
   w J04%$
   +BQBO
   
   ελοϑ
3. 7JTJPO
   'SBNFXPSLͱ͸
4. $PSF.-ͱ7JTJPOͷҧ͍͸ʁ
5. ΞϓϦέʔγϣϯ 7JTJPO /-1 $PSF.- "DDFMFSBUF .14 IUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZXXED
   Λࢀߟʹ࡞੒
6. ΞϓϦέʔγϣϯ 7JTJPO /-1
 /BUVSBM
   -BOHVBHF
   1SPDFTTJOH $PSF.- "DDFMFSBUF .14 %PNBJO
   4QFDJpD ಛఆͷλεΫʹಛԽͨ͠ը૾ղੳͷͨΊͷϑϨʔϜϫʔΫ
7. ΞϓϦέʔγϣϯ 7JTJPO /-1
 /BUVSBM
   -BOHVBHF
   1SPDFTTJOH $PSF.- "DDFMFSBUF .14 7JTJPO͸ը૾ղੳʹಛԽ͍ͯ͠Δ %PNBJO
   4QFDJpD
8. ΞϓϦέʔγϣϯ 7JTJPO /-1
 /BUVSBM
   -BOHVBHF
   1SPDFTTJOH $PSF.- "DDFMFSBUF .14 %PNBJO
   4QFDJpD 7JTJPO͸$PSF.-͕ϕʔεʹͳ͍ͬͯΔ
9. ΞϓϦέʔγϣϯ 7JTJPO /-1
 /BUVSBM
   -BOHVBHF
   1SPDFTTJOH $PSF.- "DDFMFSBUF .14 %PNBJO
   4QFDJpD ྡΓʹ͋Δ/-1͸'PVOEBUJPOʹ૊Έࠐ·Ε͍ͯͯɺ
   /4-JOHVJTUJD5BHHFSͳͲͰ࢖ΘΕ͍ͯΔͱͷ͜ͱ
10. ࠓճ΍Γ͔ͨͬͨͷ͸ɺ
    7JTJPOͰόʔίʔυΛݕग़͢Δ͜ͱ
11. Barcode Detection IUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZXXED
    ΑΓ
12. w 7JTJPOΛ࢖ͬͯόʔίʔυͷݕग़Λ͍ͨ͠
    w ݁࿦͔Βݴ͏ͱ7JTJPO .-
    &YBNQMFͱ͍͏88%$ ͷηογϣϯͰ΋࢖ΘΕ͍ͯͨαϯϓϧΛݩʹػց ֶशͷ஌͕ࣝͳͯ͘΋͢ΜͳΓ7JTJPO͸ಈ͔͢͜ͱ ͕Ͱ͖ͨ
    w ͨͩ͠ͱ͍͏࿩Λ͢Δ
13. ࣮૷ํ๏
14. IUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZXXED
    ΑΓ Analyzing an Image The Machinery The Results The Asks
15. IUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZXXED
    ΑΓ Analyzing an Image The Machinery The Results The Asks Requests VNDetectBarcodesRequest VNDetectFaceLandmarksRequest VNDetectFaceRectanglesRequest … Observations VNClassificationObservation VNDetectedObjectObservation VNFaceObservation … RequestHandler VNImageRequestHandler
16. w ը૾͔ΒόʔίʔυΛݕग़
    w 7/%FUFDU#BSDPEFT3FRVFTUΛ࢖ͬͯɺը૾͔Β όʔίʔυΛಡΈऔΔ
17. Analyzing an Image The Machinery The Results The Asks Requests VNDetectBarcodesRequest VNDetectFaceLandmarksRequest VNDetectFaceRectanglesRequest … Observations VNClassificationObservation VNDetectedObjectObservation VNFaceObservation … RequestHandler VNImageRequestHandler IUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZXXED
    ΑΓ
18. let handler = VNImageRequestHandler(ciImage: ciImage, orientation: orientation) try! handler.perform([barcodeClassificationRequest])
19. w ը૾͔Βόʔίʔυͷ*4#/ίʔυΛऔΓग़͢
20. Analyzing an Image The Machinery The Results The Asks Requests VNDetectBarcodesRequest VNDetectFaceLandmarksRequest VNDetectFaceRectanglesRequest … Observations VNClassificationObservation VNDetectedObjectObservation VNFaceObservation … RequestHandler VNImageRequestHandler IUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZXXED
    ΑΓ
21. lazy var barcodeClassificationRequest: VNDetectBarcodesRequest = { return VNDetectBarcodesRequest(completionHandler: { request, error in guard let observations = request.results as? [VNBarcodeObservation] else { return } let rects = observations.map { $0.boundingBox } DispatchQueue.main.async { [weak self] in for rect in rects { let view = UIView(frame: convertedRect(rect: rect, to: self!.imageView.frame.size)) view.backgroundColor = .green self?.imageView.addSubview(view) } } let _ = observations.flatMap { observation -> CIBarcodeDescriptor? in if let desc = observation.barcodeDescriptor as? CIBarcodeDescriptor { return desc } else { return nil } } }) }()
22. lazy var barcodeClassificationRequest: VNDetectBarcodesRequest = { return VNDetectBarcodesRequest(completionHandler: { request, error in guard let observations = request.results as? [VNBarcodeObservation] else { return } let rects = observations.map { $0.boundingBox } DispatchQueue.main.async { [weak self] in for rect in rects { let view = UIView(frame: convertedRect(rect: rect, to: self!.imageView.frame.size)) view.backgroundColor = .green self?.imageView.addSubview(view) } } let _ = observations.flatMap { observation -> CIBarcodeDescriptor? in if let desc = observation.barcodeDescriptor as? CIBarcodeDescriptor { return desc } else { return nil } } }) }()
23. ͱΓ͋͑ͣͰ͖ͨ
24. ͕ɺ
25. όʔίʔυ͕Ͳ͜ʹ͋Δ͔͸Θ͔͚ͬͨͲɺ
    ಺༰ʢ&"/ίʔυʣ͸෼͔Βͳ͔ͬͨʜ
26. lazy var barcodeClassificationRequest: VNDetectBarcodesRequest = { return VNDetectBarcodesRequest(completionHandler: { request, error in guard let observations = request.results as? [VNBarcodeObservation] else { return } let rects = observations.map { $0.boundingBox } DispatchQueue.main.async { [weak self] in for rect in rects { let view = UIView(frame: convertedRect(rect: rect, to: self!.imageView.frame.size)) view.backgroundColor = .green self?.imageView.addSubview(view) } } let _ = observations.flatMap { observation -> CIBarcodeDescriptor? in if let desc = observation.barcodeDescriptor as? CIBarcodeDescriptor { return desc } else { return nil } } }) }()
27. w $*#BS$PEF%FTDSJQUPSͰ&"/ίʔυ͕औಘͰ͖Δ͸ ͣɺͱࢥ͍͕ͬͯͨɺͦΜͳ΋ͷ͸ͳ͔ͬͨ
    w $*#BS$PEF%FTDSJQUPS͸/40CKFDUͷαϒΫϥεͰ ಛʹԿ΋࣮૷͞Ε͍ͯͳ͍
28. IUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZXXED
    ΑΓ Framework Barcode Support Several frameworks support various barcodes types AVFoundation.framework Vision.framework CoreImage.framework Detection of barcodes
 during capture Detection of barcodes
 after capture Rendering barcodes CIBarcodeDescriptor
29. IUUQTEFWFMPQFSBQQMFDPNEPDVNFOUBUJPODPSFJNBHFDJCBSDPEFEFTDSJQUPS
30. w ࣮૷͸$*#BS$PEF%FTDSJQUPSͷαϒΫϥεʹҕͶΒ Ε͍ͯͯɺ͍·ཉ͍͠΋ͷ&"/ίʔυʹରԠͨ͠ ΋ͷ͸ͳ͔ͬͨ IUUQTEFWFMPQFSBQQMFDPNEPDVNFOUBUJPODPSFJNBHFDJCBSDPEFEFTDSJQUPS
31. w $*23$PEF%FTDSJQUPS
    w $*"[UFD$PEF%FTDSJQUPS
    w $*1%'$PEF%FTDSJQUPS
    w $*%BUB.BUSJY$PEF%FTDSJQUPS ରԠ͍ͯ͠Δ̎࣍ݩίʔυ
32. Framework Barcode Support Several frameworks support various barcodes types AVFoundation.framework Vision.framework CoreImage.framework Detection of barcodes
 during capture Detection of barcodes
 after capture Rendering barcodes CIBarcodeDescriptor
33. ·ͱΊ w 7JTJPOΛ࢖͏ͱόʔίʔυ͕ը૾ͷதʹ͋Δͱ͍͏ ͜ͱ͸෼͔Δ
    w ը໘্ͷͲ͜ʹ͋Δ͔ͷ࠲ඪ͸औΕΔͷͰɺؤுͬ ͯ&"/ίʔυม׵·Ͱ͸Ͱ͖Δ͸ͣ
    w IUUQTEFWFMPQFSBQQMFDPNWJEFPTQMBZ XXED UJNF
34. ͓ΘΓ