Share
Embed
ゼロから始める ARKit
【サポーターズCoLab勉強会】まだ間に合う!ゼロから始めるARKit入門!( https://supporterzcolab.com/event/423/ )での発表資料です。
Keisuke Tatsumi
June 13, 2018
Transcript
56 slides
-
Keisuke Tatsumi • Github, Qiita : cokaholic • Twitter :
@TK_u_nya • AppStore : Keisuke Tatsumi -
Agenda • Introduction • What’s ARKit • Hello, ARKit World
• Image Detection On ARKit • About ARKit 2 • Summary -
Agenda • Introduction • What’s ARKit • Hello, ARKit World
• Image Detection On ARKit • About ARKit 2 • Summary -
Agenda • Introduction • What’s ARKit • Hello, ARKit World
• Image Detection On ARKit • About ARKit 2 • Summary -
Devices supporting ARKit • iPhone6s Ҏ߱ • iPad Proʢୈ1ੈʣҎ߱ •
iPadʢୈ5ੈʣҎ߱ • iPod touch શ6ੈ͕શͯඇରԠ ʢiPod touchୈ7ੈʹظ…ʂʣ -
What’s ARKit • ࡢͷWWDC2017ʹͯApple͔Βൃද͞Εͨ ARΞϓϦ։ൃͷͨΊͷϑϨʔϜϫʔΫ • iOS 11Ҏ্͔ͭɺA9Ҏ߱ͷϓϩηοαΛࡌ͠ ͍ͯΔσόΠε͕ඞཁ •
౷߹։ൃڥXcode 9Ҏ্͕ඞཁ • macOS Sierra (10.12.4) Ҏ্͕ඞཁ -
Agenda • Introduction • What’s ARKit • Hello, ARKit World
• Image Detection On ARKit • About ARKit 2 • Summary -
Augmented Reality App Template ViewController.swift import UIKit import SceneKit import
ARKit class ViewController: UIViewController { @IBOutlet var sceneView: ARSCNView! override func viewDidLoad() { super.viewDidLoad() // Create a new scene let scene = SCNScene(named: "art.scnassets/ship.scn")! // Set the scene to the view sceneView.scene = scene } override func viewWillAppear(_ animated: Bool) { super.viewWillAppear(animated) // Create a session configuration let configuration = ARWorldTrackingConfiguration() // Run the view's session sceneView.session.run(configuration) } } -
ARSCNView ViewController.swift import UIKit import SceneKit import ARKit class ViewController:
UIViewController { @IBOutlet var sceneView: ARSCNView! • 3D SceneKitͷίϯςϯπΛΧϝϥͰARͱͯ͠ද ࣔ͢ΔͨΊͷView • AR App Template ͰॳظදࣔͷViewController ͷview ͷ subviewͱͯ͠ஔ͞Ε͍ͯΔ • ARSCNView ʹ scene: SCNScene ϓϩύςΟ͕ ͋Γɺ͜ͷ scene ʹ ඈߦػͳͲͷ node ΛՃ͢ Δ͜ͱͰɺΦϒδΣΫτΛදࣔͰ͖Δ -
Set SCNScene To ARSCNView ViewController.swift import UIKit import SceneKit import
ARKit class ViewController: UIViewController { @IBOutlet var sceneView: ARSCNView! override func viewDidLoad() { super.viewDidLoad() // Create a new scene let scene = SCNScene(named: "art.scnassets/ship.scn")! // Set the scene to the view sceneView.scene = scene } • ඈߦػΦϒδΣΫτͷݩͰ͋Δ ship.scn ϑΝΠϧ Λࢦఆͯ͠ੜͨ͠ SCNScene Λ ARSCNView ͷ scene ͱͯ͠ઃఆ͢Δ͜ͱͰද͍ࣔͯ͠Δ -
SCNScene • namedͷҾͰࢦఆͰ͖Δͷ .scnϑΝΠϧͷΈ // Create a new scene let
scene = SCNScene(named: "art.scnassets/ship.scn")! -
SCNScene • namedͷҾͰࢦఆͰ͖Δͷ .scnϑΝΠϧͷΈ • ಡΈࠐΜͰ .scnϑΝΠϧมͰ͖ΔϑΥʔϚοτ ‣ COLLADA (.dae)
‣ Alembic (.abc) ‣ PLY ϑΝΠϧϑΥʔϚοτ ‣ Standard Triangulated Language (.stl) ‣ Wavefront OBJ (.obj) ‣ Pixar Universal Scene Description (.usd/.usda) // Create a new scene let scene = SCNScene(named: "art.scnassets/ship.scn")! -
Augmented Reality App Template ViewController.swift import UIKit import SceneKit import
ARKit class ViewController: UIViewController { @IBOutlet var sceneView: ARSCNView! override func viewDidLoad() { super.viewDidLoad() // Create a new scene let scene = SCNScene(named: "art.scnassets/ship.scn")! // Set the scene to the view sceneView.scene = scene } override func viewWillAppear(_ animated: Bool) { super.viewWillAppear(animated) // Create a session configuration let configuration = ARWorldTrackingConfiguration() // Run the view's session sceneView.session.run(configuration) } } -
How To understand Statistics ViewController.swift import UIKit import SceneKit import
ARKit class ViewController: UIViewController { override func viewDidLoad() { super.viewDidLoad() // Show statistics such as fps and timing information sceneView.showsStatistics = true } } ϑϨʔϜϨʔτήʔδ Metal(Mt) / OpenGL(GL) ϑϨʔϜϨʔτ શମͷϙϦΰϯ υϩʔίʔϧ -
Agenda • Introduction • What’s ARKit • Hello, ARKit World
• Image Detection On ARKit • About ARKit 2 • Summary -
Using Good Images • ը࣭͕ྑ͍ • ಠಛͷಛ͕͋Δ • ίϯτϥετ͕͖ͬΓ͍ͯ͠Δ •
ը࣭͕ߥ͍ • ΧϥʔྖҬ͕ۉҰ͗͢Δ • ৭ຯʹϝϦϋϦ͕ͳ͍ © (ג)ΞΫτθϩ © ాதώϝ -
Set Detection Images // Create reference images guard let referenceImages
= ARReferenceImage.referenceImages(inGroupNamed: "AR Resources", bundle: nil) else { fatalError("Reference images not found.") } // Create a session configuration let configuration = ARWorldTrackingConfiguration() // Set detection images configuration.detectionImages = referenceImages // Run the view's session sceneView.session.run(configuration) • ݕ͍ͤͨ͞ը૾άϧʔϓ໊Ͱ͋ΔʮAR ResourcesʯΛࢦఆͯ͠ ARReferenceImage ΫϥεͷΠϯελϯεΛੜ͢Δ • configuration: ARWorldTrackingConfiguration ͷ detectionImages ʹੜͨ͠ ARReferenceImage Ληοτ͢Δͱɺ ը૾ΛݕͰ͖ΔΑ͏ʹͳΔ -
Get Detected Images extension ViewController: ARSCNViewDelegate { // MARK: -
ARSCNViewDelegate func renderer(_ renderer: SCNSceneRenderer, didAdd node: SCNNode, for anchor: ARAnchor) { // Check detected an image guard let imageAnchor = anchor as? ARImageAnchor, let imageName = imageAnchor.referenceImage.name else { return } // Check the detected image is "hime_tanaka" if imageName == "hime_tanaka" { print("Detected!") } } } • ը૾ͷݕग़ ARSCNViewDelegate ͷ func renderer(_ renderer: SCNSceneRenderer, didAdd node: SCNNode, for anchor: ARAnchor) ϝιουʹͯߦ͏ • ݕग़ͨ͠ը૾ͷ໊લʹΑͬͯɺͲͷը૾͕ݕग़͞Ε͔͕ͨΘ͔ΔͨΊɺ ը૾͝ͱʹԠΛม͑Δ͜ͱͰ͖Δ -
Agenda • Introduction • What’s ARKit • Hello, ARKit World
• Image Detection On ARKit • About ARKit 2 • Summary -
Devices supporting ARKit 2 • iPhone6s Ҏ߱ • iPad Proʢୈ1ੈʣҎ߱
• iPadʢୈ5ੈʣҎ߱ ॳARKit ͕͑ΔͳΒɺARKit 2͑Δ -
About ARKit 2 • ࠓͷWWDC2018ʹͯApple͔Βൃද͞Εͨ ARKitͷ࠷৽όʔδϣϯ • iOS 12Ҏ্͔ͭɺA9Ҏ߱ͷϓϩηοαΛࡌ ͍ͯ͠ΔσόΠε͕ඞཁ
• ౷߹։ൃڥXcode 10Ҏ্͕ඞཁ • macOS High Sierra (10.13.4) Ҏ্͕ඞཁ -
New Features of ARKit 2 • Saving and Loading Maps
‣ Ϛοϐϯάͨ͠ݱ࣮ੈքͷใΛอଘ͠ɺಡΈࠐΊΔ • Environment Texturing ‣ ޫΛࣹ͢ΔޮՌΛ࣋ͬͨ3DΦϒδΣΫτʹରͯ͠ɺपΓͷݱ࣮ͷ ෩ܠΛө͢͜ͱ͕Ͱ͖Δ • Image Tracking ‣ ը૾ΛARͷΞϯΧʔͱͯ͑͠Δ • Object Detection ‣ ࣄલʹεΩϟϯ͓͍ͯͨ͠ݱ࣮ͷΦϒδΣΫτΛೝࣝͰ͖Δ • Gaze and Tongue ‣ إೝࣝͰࢹઢͱઉΛೝࣝͰ͖Δ -
New Features of ARKit 2 • Saving and Loading Maps
‣ Ϛοϐϯάͨ͠ݱ࣮ੈքͷใΛอଘ͠ɺಡΈࠐΊΔ • Environment Texturing ‣ ޫΛࣹ͢ΔޮՌΛ࣋ͬͨ3DΦϒδΣΫτʹରͯ͠ɺपΓͷݱ࣮ͷ ෩ܠΛө͢͜ͱ͕Ͱ͖Δ • Image Tracking ‣ ը૾ΛARͷΞϯΧʔͱͯ͑͠Δ • Object Detection ‣ ࣄલʹεΩϟϯ͓͍ͯͨ͠ݱ࣮ͷΦϒδΣΫτΛೝࣝͰ͖Δ • Gaze and Tongue ‣ إೝࣝͰࢹઢͱઉΛೝࣝͰ͖Δ -
Saving and Loading Maps • ARWorldMap ͱ͍͏Ϋϥε͕Ճ͞ΕɺۭؒͷಛΛϚοϐϯάͨ͠ใΛڞ ༗͠ɺෳͷϢʔβʔͰಉ͡ARମݧ͕Ͱ͖ΔΑ͏ʹͳͬͨ • อଘͨ͠Ϛοϐϯάใ
Data ܕʹมͰ͖ΔͷͰɺMultipeer Connectivity αʔόʔΛհͯ͠ૹ৴͢Δ͜ͱ͕Ͱ͖Δ • ड͚औͬͨϚοϐϯάใ ARWorldTrackingConfiguration ͷ initialWorldMap: ARWorldMap ϓϩύςΟʹηοτ͢Δ͜ͱͰಡΈࠐΊΔ -
Image Tracking • ARImageTrackingConfiguration ͱ͍͏Ϋϥε͕Ճ͞ΕɺARSCNViewͷ session ͷ run ΛݺͿࡍͷҾͷ configuration
ͱͯ͠ࢦఆ͢Δ͜ͱͰɺը ૾ೝࣝʴτϥοΩϯά͕Ͱ͖ΔΑ͏ʹͳΔ • τϥοΩϯά͢Δը૾ը૾ೝࣝͷ߹ͱಉ͘͡ɺconfiguration: ARWorldTrackingConfiguration ͷ detectionImages ʹੜͨ͠ ARReferenceImage Ληοτ͢Δ -
Object Detection • ARObjectScanningConfiguration ͱ͍͏Ϋϥε͕Ճ͞ΕɺARSCNView ͷ session ͷ run ΛݺͿࡍͷҾͷ
configuration ͱͯ͠ࢦఆ͢Δ͜ͱͰɺ 3࣍ݩͷΦϒδΣΫτͷಛΛεΩϟϯ͢Δ͜ͱ͕Ͱ͖Δ • εΩϟϯͨ͠ΦϒδΣΫτ ARReferenceObject (.arobject) ͱͯ͠ѻ͏ ͜ͱ͕Ͱ͖ɺasset catalog ͰཧͰ͖Δ -
Agenda • Introduction • What’s ARKit • Hello, ARKit World
• Image Detection On ARKit • About ARKit 2 • Summary -
Summary • ARKit Λ͑ɺগͳ͍ίʔυྔͰARମݧΛ ࣮ݱͰ͖Δ • ARKit 2 ͷొʹΑΓɺ࣮Ͱ͖ΔARମݧͷ ෯͕͕ͬͨ
• ARٕज़ΛͬͨΞϓϦࠓޙͲΜͲΜ૿͑ ͍ͯ͘ͱߟ͑ΒΕΔ -
ࢀߟϦϯΫ • Introducing ARKit: Augmented Reality for iOS - WWDC
2017 - Videos - Apple Developer https://developer.apple.com/videos/play/wwdc2017/602 • What’s New in ARKit 2 - WWDC 2018 - Videos - Apple Developer https://developer.apple.com/videos/play/wwdc2018/602 • [iOS 11] ͡ΊͯͷARKit #WWDC2017 | Developers.IO https://dev.classmethod.jp/smartphone/ios-11-arkit/ • iOS Ͱ SceneKit Λࢼ͢(Swift 3) ͦͷ1 - ͡Ίʹ - Apple Engine http://appleengine.hatenablog.com/entry/2017/05/29/184901 • iOS Ͱ SceneKit Λࢼ͢(Swift 3) ͦͷ57 - SceneKit Ͱ༻Ͱ͖ΔΦϒδΣΫτϑΝΠϧ - Apple Engine http://appleengine.hatenablog.com/entry/2017/08/08/183538 • ARKit Tutorial: Working with 2D Image Recognition https://www.appcoda.com/arkit-image-recognition/ • ʮాதώϝʯ / ాதώϝˍླώφ ͞Μͷ࡞ - χίχཱମ http://3d.nicovideo.jp/works/td35317 • powroupi/blender_mmd_tools https://github.com/powroupi/blender_mmd_tools