New iPhone Camera Hack!

Mobile Act NAGOYA #2 の LT 資料
https://mobileactnagoya.connpass.com/event/38805/

- iPhone 7 Plus Dual Camera
- iOS 10 camera API

Transcript

1. 
2. 
3. 
4. 
5. 
6. 
9.  ➓
12. AVCaptureDeviceDiscoverySession let discoverySession = AVCaptureDeviceDiscoverySession( deviceTypes: [.builtInDuoCamera], mediaType: AVMediaTypeVideo, position: .back) let devices: [AVCaptureDevice]? = discoverySession?.devices
13. AVCaptureDeviceType .builtInWideAngleCamera .builtInTelephotoCamera .builtInDuoCamera
16. .builtInDuoCamera
17. .builtInTelephotoCamera .builtInTelephotoCamera let captureSession = AVCaptureSession() captureSession.addInput(wideAngleCameraDevice) captureSession.addInput(telephotoCameraDevice)
19. AVCaptureStillImageOutput AVCapturePhotoOutput
21. 
24. UIImagePickerController AVFoundation AVCapturePhotoOutput
25. AVCapturePhotoOutput let types = photoOutput.availableRawPhotoPixelFormatTypes let type = types.first!.uint32Value let settings = AVCapturePhotoSettings(rawPixelFormatType: type) photoOutput.capturePhoto(with: settings, delegate: self)
26. AVCapturePhotoCaptureDelegate rawSampleBuffer: CMSampleBuffer? func capture(_ captureOutput: AVCapturePhotoOutput, didFinishProcessingRawPhotoSampleBuffer rawSampleBuffer: CMSampleBu previewPhotoSampleBuffer: CMSampleBuffer?, resolvedSettings: AVCaptureResolvedPhotoSettings, bracketSettings: AVCaptureBracketedStillImageSettings?, error: Error?) { }
27. CVPixelBuffer “rgg4” kCVPixelFormatType_14Bayer_RGGB // CVPixelBuffer? let pixelBuffer = CMSampleBufferGetImageBuffer(rawSampleBuffer!)
28. // Data? let data = AVCapturePhotoOutput.dngPhotoDataRepresentation( forRawSampleBuffer: rawSampleBuffer!, previewPhotoSampleBuffer: previewPhotoSampleBuffer)
29. import CoreImage.framework CIFilter CIFilter CIImage let rawFilter = CIFilter(imageURL: rawURL, options: nil) // Noise Reduction let nrKey = kCIInputLuminanceNoiseReductionAmountKey if let nr = rawFilter?.value(forKey: nrKey) { rawFilter.setValue(nr.doubleValue + 0.1, forKey: nrKey) } let image: CIImage? = rawFilter?.outputImage // ‐> CGImage, UIImage, JPEG, ...
30. 