Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
TypeSquare APIを活用したMixed Realityアプリケーション開発 [事例紹介]
Search
Sponsored
·
Your Podcast. Everywhere. Effortlessly.
Share. Educate. Inspire. Entertain. You do you. We'll handle the rest.
→
堀尾風仁 Futo Horio
February 14, 2019
Technology
4.3k
3
Share
TypeSquare APIを活用したMixed Realityアプリケーション開発 [事例紹介]
Developers Summit 2019
2/14(Thu) 14-E-5
APIを活用したフォントの使い方
〜MR(Mixed Reality)の実例紹介〜
セッション 登壇資料
堀尾風仁 Futo Horio
February 14, 2019
More Decks by 堀尾風仁 Futo Horio
See All by 堀尾風仁 Futo Horio
Azure Digital Twins と Azure SignalR Service を使って IoT データを Mixed Reality に接続する
futo23
0
320
MRTK Graphics Tools Overview - 概要説明
futo23
0
410
MRTK3 - DataBinding and Theming 入門
futo23
0
860
Microsoft Mesh に学ぶ Mixed Reality の気持ちの良い UX とは? ーMRTK v2.7.3 で実験してみた
futo23
0
570
MRTK Test Utilities で始めるテスト駆動開発 (TDD) 入門 | XR Kaigi 2021
futo23
1
1.4k
Azure Remote Rendering Recap - サービス概要と活用事例
futo23
1
3.2k
デブサミ2021 - 不確定要素が強い時代の生存戦略 ― U30が「好きなコト」で突き抜けるためには!?
futo23
1
1.8k
MR Dev Days Japan 前夜祭 - Azure Remote Rendering のご紹介
futo23
1
910
不確定要素の強い時代の生存戦略 ー U30が好きなコトで突き抜けるためには?[Session17]
futo23
0
3.6k
Other Decks in Technology
See All in Technology
そのSLO 99.9%、本当に必要ですか? 〜優先度付きSLOによる責任共有の設計思想〜 / Is that 99.9% SLO really necessary? Design philosophy of shared responsibility through prioritized SLOs
vtryo
0
830
AI時代に、 データアナリストがデータエンジニアに異動して
jackojacko_
0
1k
Gaussian Splattingの表現力を拡張する — 高周波再構成とインタラクションへのアプローチ —
gpuunite_official
0
190
続 運用改善、不都合な真実 〜 物理制約のない運用改善はほとんど無価値 / 20260518-ssmjp-kaizen-no-value-without-physical-constraints
opelab
2
250
Oracle AI Database@AWS:サービス概要のご紹介
oracle4engineer
PRO
4
2.6k
AWS WAFの運用を地道に改善し、自社で運用可能にするプラクティス
andpad
1
530
ワールドカフェ再び、そしてゴール・ルール・ロール・ツール / World Café Revisited, and the Goals-Rules-Roles-Tools
ks91
PRO
0
180
Purview 勉強会報告 Microsoft Purview 入門しようとしてみた
masakichixo
1
450
Terragrunt x Snowflake + dbt で作るマルチテナントなデータ基盤構築プラットフォーム
gak_t12
0
470
Sansan Engineering Unit 紹介資料
sansan33
PRO
1
4.5k
AI飲み会幹事エージェントを作っただけなのに
ykimi
0
240
最新技術を"今は選ばない"という技術選定
leveragestech
PRO
0
250
Featured
See All Featured
Building Adaptive Systems
keathley
44
3k
The Straight Up "How To Draw Better" Workshop
denniskardys
239
140k
StorybookのUI Testing Handbookを読んだ
zakiyama
31
6.7k
Building AI with AI
inesmontani
PRO
1
1k
How To Speak Unicorn (iThemes Webinar)
marktimemedia
1
460
Designing Experiences People Love
moore
143
24k
We Analyzed 250 Million AI Search Results: Here's What I Found
joshbly
1
1.3k
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
What’s in a name? Adding method to the madness
productmarketing
PRO
24
4k
What the history of the web can teach us about the future of AI
inesmontani
PRO
1
560
Future Trends and Review - Lecture 12 - Web Technologies (1019888BNR)
signer
PRO
0
3.5k
Prompt Engineering for Job Search
mfonobong
0
300
Transcript
ʲ Developers Summit 2019 ʳ TypeSquare API Λ׆༻ͨ͠ Mixed Reality
ΞϓϦέʔγϣϯ։ൃ [ ࣄྫհ ] ʲ 14-E-5 ʳ02/14 14:10 ~ 14:55 APIΛ׆༻ͨ͠ϑΥϯτͷ͍ํ ʙ MR (Mixed Reality) ͷ࣮ྫհ ʙ © 2019 Kobe Digital Labo Inc. All Rights Reserved.
Kobe Digital Labo Inc. ฌݿݝ ਆށࢢʹຊࣾΛஔ͘ɺγεςϜΠϯςάϨʔλʔɻ ैۀһɺ155໊ɻച্نɺ19.9ԯԁ (23ظ) ɻ Microsoft
HoloLens ൃച࣌ΑΓɺʮMR (Mixed Reality)ʯͷ Ϗδωεಋೖʹ͠ɺݚڀ։ൃΛ։࢝ɻ 20187݄ʹɺMicrosoftެࣜͷ։ൃύʔτφʔ ( MRPP ) ͷೝఆΛड͚Δɻ ΤϯδχΞɻxRͷݚڀɾ։ൃʹैࣄɻ 20171݄ɺϚΠΫϩιϑτ͔ࣾΒൃച͞Εͨ Microsoft HoloLensʹ͠ɺݚڀΛ࢝ΊΔɻ ࡢ10݄ʹɺ৽نࣄۀ෦ॺɺ ʮ৽ࣄۀ MR൝ʯΛ্ཱͪ͛ɺ Mixed RealityͷࣄۀԽʹʑɺฃಆதɻ ϗ Ϧ Φ ϑ τ ( 2 5 ) A B O U T M E F u t o _ H o r i o ງ ඌ ෩ ਔ SNSͰɺMR࠷৽ใΛ৴͍ͯ͠ΔͷͰɺ ྑ͔ͬͨΒɺνΣοΫͯ͠Έ͍ͯͩ͘͞ʂ © 2019 Kobe Digital Labo Inc. All Rights Reserved. x R Τ ϯ δ χ Ξ
ͳ ͥ ࠓ ɺ F o n t × M
R ͷ औ Γ Έ Λ ߦ ͬ ͯ ͍ Δ ͷ ͔ ʁ Agenda ࠓɺ͓͢Δ༰ Ϟ Ϧ α ϫ × K D L M R ࣄ ྫ հ Ξ ϓ Ϧ ։ ൃ Ͱ ɺ T y p e S q u a r e A P I Λ ׆ ༻ ͢ Δ ϝ Ϧ ο τ © 2019 Kobe Digital Labo Inc. All Rights Reserved. 1 . 2 . 3 . ʲ U n i t y C # ฤ ʳ
ͳ ͥ ࠓ ɺ F o n t × M
R ͷ औ Γ Έ Λ ߦ ͬ ͯ ͍ Δ ͷ ͔ ʁ σδλϧͷਐԽʹ͍ɺϑΥϯτͦͷ࢟ɺΧλνΛม͖͑ͯ·ͨ͠ɻ ࠓ͞Ε͍ͯΔʮMixed Realityʯٕज़ͱɺҰମԿͳͷ͔ʁ Mixed Reality ٕज़ͷ֓ཁͱɺϑΥϯτͷબఆͷॏཁੑʹ͍ͭͯɻ © 2019 Kobe Digital Labo Inc. All Rights Reserved.
ಥવͰ͕͢ɺɺ ʮϙετɾεϚϗʯʹ͍ͭͯɺ ߟ͑ͨ͜ͱ ͋Γ·͔͢ʁ © 2019 Kobe Digital Labo Inc.
All Rights Reserved.
ࢴ → PC → Moblie © 2019 Kobe Digital Labo
Inc. All Rights Reserved. σδλϧͷਐԽͱڞʹɺϑΥϯτΛදݱ͢Δॴ͕ଟ༷Խ 2019 σδλϧԽ (PC) ϚϧνσόΠεԽ (εϚʔτϑΥϯɺλϒϨοτ) Ξφϩά (ࢴ)
Mobile Nextʁ © 2019 Kobe Digital Labo Inc. All Rights
Reserved.
© 2019 Kobe Digital Labo Inc. All Rights Reserved. σδλϧ͕σΟεϓϨΠ͔Βղ͖์ͨΕΔະདྷ
ݱ࣮ۭؒɺશ͕ͯσδλϧίϯςϯπͷΞτϓοτઌʹ
Mobile → Mixed Reality © 2019 Kobe Digital Labo Inc.
All Rights Reserved. σδλϧ͕σΟεϓϨΠͷ֎ʹᕷΈग़͠ɺʮݱ࣮ۭؒʯͱʮσδλϧʯ͕༥߹ͨ͠ੈք https://cloudblogs.microsoft.com/industry-blog/manufacturing/2015/07/15/t he-future-of-design-engineering-how-microsoft-hololens-unlocks-new-possibilities/
ͦͯ͠ɺզʑ͕ ͍·࠷͍ͯ͠Δ MR σόΠε © 2019 Kobe Digital Labo Inc.
All Rights Reserved.
© 2019 Kobe Digital Labo Inc. All Rights Reserved. Microsoft
HoloLens
ؔॳɺMicrosoftެࣜ։ൃύʔτφʔೝఆ https://www.microsoft.com/en-us/hololens/partners?Region=Japan&page=1 © 2019 Kobe Digital Labo Inc. All Rights
Reserved. Microsoft HoloLensΛ׆༻ͨ͠ ΞϓϦέʔγϣϯاըɾ։ൃ
ͨͩɺ͜Ε·Ͱͷσδλϧͱҧͬͯ จࣈ͕ ѹత ʹݟͮΒ͍ © 2019 Kobe Digital Labo Inc.
All Rights Reserved.
© 2019 Kobe Digital Labo Inc. All Rights Reserved. Microsoft
HoloLens ऑ (ΟʔΫϙΠϯτ) ᶃಁաܕσΟεϓϨΠͳͷͰɺ ɹΞϓϦέʔγϣϯىಈॴʹ ɹΑͬͯɺഎܠ͕มΘΔ ᶄࢹ͕֯ڱ͍
ϑΥϯτͷมԽʹΑͬͯੜ͡Δ ɹϢʔβʔମݧ 69 ͷҧ͍ ϑΥϯτͷࢹೝੑͱσβΠϯੑ https://blogs.windows.com/japan/2018/07/17/ microsoft-mixed-reality-partnerprogram-4/#64rDUV6T5JAHlplt.97 ©
2019 Kobe Digital Labo Inc. All Rights Reserved. MRͷڞಉݚڀςʔϚ
۩ମతʹͲΜͳ͜ͱͬͯΔͷʁ © 2019 Kobe Digital Labo Inc. All Rights Reserved.
ϞϦαϫ × KDL MRࣄྫհ ࠃ࠷େखϑΥϯτϝʔΧʔ ϞϦαϫ༷ TypeSquare APIΛ׆༻ͨ͠ɺMixed Realityͷࣄྫհ Mixed
RealityͰɺͳͥϑΥϯτ͕ඞཁͳͷ͔ʁ ʲ Unity C#ฤ ʳ © 2019 Kobe Digital Labo Inc. All Rights Reserved.
Future of Mixed Reality ߪ ങ ମ ݧ © 2019
Kobe Digital Labo Inc. All Rights Reserved. U p d a t e ʲ Ӧ ۀ ʳ
Display Assistant ˏComputex © 2019 Kobe Digital Labo Inc.
All Rights Reserved.
© 2019 Kobe Digital Labo Inc. All Rights Reserved. DEMO
https://www.youtube.com/watch?v=E-yXbmUIzeY&t=19s
Design Tool Future of Mixed Reality © 2019 Kobe Digital
Labo Inc. All Rights Reserved. U p d a t e ʲ ࠂ σ β Π ϯ ۀ ʳ
Creative Design X @InterBEE ນுϝοη © 2019 Kobe Digital Labo
Inc. All Rights Reserved.
© 2019 Kobe Digital Labo Inc. All Rights Reserved. DEMO
https://www.youtube.com/watch?v=62lDfvwNV1o
࣮ࡍɺϞϦαϫϑΥϯτ ͬͯΈͯɺͲ͏ʁ © 2019 Kobe Digital Labo Inc. All Rights
Reserved.
MR্ۭؒͰɺϑΥϯτͷൺֱΛͯ͠Έ·ͨ͠ © 2019 Kobe Digital Labo Inc. All Rights Reserved.
© 2019 Kobe Digital Labo Inc. All Rights Reserved. UD৽ΰ ᴈϛϯ ϝΠϦΦ ඪ४తͳϑΥϯτ ԣઢΛଠ͘Ͱ͖Δ໌ேମ Ұ൪ࢹೝੑߴ͍ΰγοΫମ
ᴈϛϯ(ϨΠϛϯ) © 2019 Kobe Digital Labo Inc. All Rights Reserved.
63% 25% 19% UD৽ΰ R ᴈϛϯ Y40 M ϝΠϦΦ ͲͷϑΥϯτ͕ݟ͍͢ʁ
Q u e s t i o n . 1 © 2019 Kobe Digital Labo Inc. All Rights Reserved. ʢ ॏ ෳ ղ ؚ Ή ʣ
ͲͷϑΥϯτ͕͖ʁ Q u e s t i o n .
2 43% 38% 12% UD৽ΰ R ᴈϛϯ Y40 M ϝΠϦΦ © 2019 Kobe Digital Labo Inc. All Rights Reserved. ʢ ॏ ෳ ղ ؚ Ή ʣ
© 2019 Kobe Digital Labo Inc. All Rights Reserved.
εϙϯαʔηογϣϯ͔ͩΒ ͓લɺϞϦαϫʹ ᇪͼചͬͯΔΜ͡ΌͶʁ © 2019 Kobe Digital Labo Inc. All
Rights Reserved.
͍ɺɺਖ਼ͪΐͬͱ͚ͩ ։ൃͮ͠Β͍ɺɺɻͻ © 2019 Kobe Digital Labo Inc. All Rights
Reserved.
2.։ൃ ( Unity ) 3.Ϗϧυ ( Visual Studio ) 4.࣮ػ֬ೝ
( HoloLens ) ैདྷͷHoloLens։ൃͷྲྀΕ (PoC) 1.σβΠϯ ( illustrator ) ( photoshop ) ᶃΠϯϙʔτ ᶄUWPग़ྗ ᶅΠϯετʔϧ © 2019 Kobe Digital Labo Inc. All Rights Reserved.
ͦ͏ɺຖճillustratorͰɺ ը૾࡞ͬͯ։ൃ͢Δͷɺ ͔ͳΓ໘͍͘͞ɻ © 2019 Kobe Digital Labo Inc. All
Rights Reserved.
H o l o L e n s ։ ൃ
ͷ ՝ ( P o C ) (1) ͜Ε·Ͱͷσδλϧͱҧ͍ɺUIʹԞߦ͖(x,y,z)͕͋ΔͷͰɺը૾ͰͷରԠ͕͍͠ (2) ը૾ͰରԠ͢Δʹͯ͠ɺຖճillustrator(photoshop)Ͱը૾Λੜ͢Δͷඇޮ (3) ը૾ͩͱɺΠϯλϥΫςΟϒͳίϯςϯπʹෆ͖ (4) Ԥจͱҧ͍ɺຊޠॻମͷॏ͍σʔλΛϩʔΧϧʹ࣋ͭͷແବ͕ଟ͍ (5) Microsoft HoloLensͷΑ͏ͳ༰ྔͷগͳ͍ʹɺΞϓϦຖʹॻମσʔλΛ࣋ͨͤͨ͘ͳ͍ © 2019 Kobe Digital Labo Inc. All Rights Reserved. ͱ ʹ ͔ ͘ ՝ ͕ ଟ ͍
T y p e S q u a r e
A P I ͋ Γ · ͢ ! © 2019 Kobe Digital Labo Inc. All Rights Reserved.
2.։ൃ ( Unity ) 3.Ϗϧυ ( Visual Studio ) 4.࣮ػ֬ೝ
( HoloLens ) HoloLens։ൃͷྲྀΕ (TypeSquareಋೖޙPoC) 1.TypeSquare API ᶃAPIʹΑΔ ϑΥϯτσʔλऔಘ ᶄUWPग़ྗ ᶅΠϯετʔϧ © 2019 Kobe Digital Labo Inc. All Rights Reserved. 1.ॻମσʔλͷը૾Խ͕ෆඞཁʹ 2.։ൃதʹϩʔΧϧʹͳ͍ॻମ͕ࢼ༻Ͱ͖Δ 3.ඞཁͳॻମσʔλͷΈμϯϩʔυԽ (αϒηοτػೳ) TypeSquareಋೖϝϦοτ ᶆμϯϩʔυ
Ty p e S q u a r e A
P Iͷಛ ɾಋೖ͕༰қͰ͋Δ (αϒεΫϦϓγϣϯ) ɾαϒηοτػೳΛ͑ɺඞཁͳจࣈͷॻମσʔλͷΈऔಘՄೳ ɾBase64 → Binary ม͕ඞཁ (͕ඞཁ)
σδλϧมֵظͰɺPoC͕ٸ૿͍ͯ͠Δࠓͦ͜ ΤϯδχΞࣗΒɺϑΥϯτʹͩ͜ΘΔ͖ɻ © 2019 Kobe Digital Labo Inc. All Rights
Reserved. ࣮ࡍʹ։ൃͯ͠Έͯײͨ͜͡ͱ ސ٬ͷຬ → Ҋ݅ԽUP
© 2019 Kobe Digital Labo Inc. All Rights Reserved. Thanks
ΤϯδχΞͦ͜ɺϑΥϯτʹͩ͜ΘΕɻ