【暫定版】App Intentsの新機能から見るApple Intelligenceと近い未来

WWDC24のセッションビデオ「What’s new in App Intents」は『App Intentsは、Apple Intelligenceやコントロールの体験を構築するためのコア』であるとのコメントで始まります。
そこでApp Intentsの新機能から、どのような種類・分野のアプリケーションがApple Intelligenceと連携すると良いのか・できるのか、その叩き台としてまとめてみました。

Transcript

1. "QQ
   *OUFOUTͷ৽ػೳ͔ΒݟΔ "QQMF
   *OUFMMJHFODFͱ͍ۙະདྷ .04"
   ͍͚ͩ͡ΎΜ͡ ࢑ఆ൛
2. "QQ
   *OUFOUT͸ɺγϣʔτΧοτɺ4QPUMJHIUɺ ΢ΟδΣοτɺΞΫγϣϯϘλϯɺ৽͍͠ "QQMF
   1FODJMͷߜΓػೳͳͲɺଟ͘ͷػೳΛ࢖ͬ ͯૉ੖Β͍͠ମݧΛΞϓϦʹఏڙ͢Δ͜ͱΛՄ ೳʹ͠·ͨ͠ɻ
   ͦͯ͠ࠓ೥ɺ
   "QQ
   *OUFOUT͸ɺ"QQMF
   *OUFMMJHFODF΍ ίϯτϩʔϧͷମݧΛߏங͢ΔͨΊͷίΞ
   ͱͳ͍ͬͯ·͢ɻ IUUQTEFWFMPQFSBQQMFDPNKQWJEFPTQMBZXXED 88%$
   ηογϣϯϏσΦ What’s new in App Intents
3. GPS
   "QQMF
   *OUFMMJHFODF
   BOE
   GPS
   $POUSPMT GPS
   "QQMF
   *OUFMMJHFODF
   BOE
   GPS
   $POUSPMT GPS
   "QQMF
   *OUFMMJHFODF
   BOE
   GPS
   $POUSPMT GPS
   "QQMF
   *OUFMMJHFODF
   BOE
   GPS
   $POUSPMT GPS
   "QQMF
   *OUFMMJHFODF
   BOE
   GPS
   $POUSPMT GPS
   "QQMF
   *OUFMMJHFODF
   BOE
   GPS
   $POUSPMT GPS
   "QQMF
   *OUFMMJHFODF
   BOE
   GPS
   $POUSPMT GPS
   "QQMF
   *OUFMMJHFODF
   BOE
   GPS
   $POUSPMT
5. 
   *OEFYFE&OUJUZ
   ϓϩτίϧ
   
   5SBOTGFSBCMF
   
   'JMF&OUJUZ
   
   63-3FQSFTFOUBCMF&OUJUZͱ63-3FQSFTFOUBCMF*OUFOU
   
   6OJPO7BMVF
   ϚΫϩ
   
   9DPEF
   
   ͷվળ
20. Core ML • Bring your large language models and diffusion models to Apple silicon with more granular and composable weight compression techniques in Core ML Tools. • New MLTensor type provides an efficient, simple, and familiar API for expressing operations on multi-dimensional arrays. Create ML • Object tracking helps you track real-world objects in your visionOS app. • New data preview functionality has been added to the Create ML app, and new Swift APIs from Create ML Components can enhance your customized model training workflow. Apple Intelligence brings powerful, intuitive, and integrated personal intelligence to Apple Platforms — designed with privacy from the ground up. And enhancements to our machine learning frameworks let you build, train, and run your machine learning & AI models on Apple devices like never before. Machine Learning & AI Highlights ML-powered APIs • The new Translation API helps to translate text across different languages in your app. • The Vision framework API has been redesigned to leverage modern Swift features. Writing Tools Help users rewrite, proofread, and transform text. Your app will automatically get the ability to add Writing Tools if you’re using any standard UI framework to render text fields. Apple Intelligence • Apps that already use SiriKit automatically benefit from Siri’s enhanced conversational capabilities. • Take hundreds of new actions in and across apps using App Intents. • Invoke menus and take actions across apps. Siri with App Intents Image Playground Adopt the Image Playground API to let your users quickly create delightful images using context from within your app. Genmoji Let users create a new emoji to match any moment. Machine Learning ػցֶशͱ"*ͷϋΠϥΠτ "QQMF
    *OUFMMJHFODF͸ɺ"QQMFϓϥοτϑΥʔϜʹڧྗͰ௚ײతͰ౷߹͞Εͨύʔ ιφϧΠϯςϦδΣϯεΛ΋ͨΒ͠·͢ɻ·ͨɺػցֶशϑϨʔϜϫʔΫͷڧԽʹ ΑΓɺ͜Ε·Ͱʹͳ͍΄Ͳ"QQMFσόΠεͰػցֶशͱ"*ϞσϧΛߏஙɺτϨʔχ ϯάɺ࣮ߦ͢Δ͜ͱ͕Ͱ͖·͢ɻ Ϣʔβʔ͕ςΩετΛॻ͖׵͑ɺߍਖ਼͠ɺม׵͢Δͷʹ໾ཱͪ·͢ɻඪ४ͷ6* ϑϨʔϜϫʔΫΛ࢖༻ͯ͠ςΩετϑΟʔϧυΛϨϯμϦϯά͍ͯ͠Δ৔߹ɺΞ ϓϦ͸ࣗಈతʹϥΠςΟϯάπʔϧΛ௥Ճ͢ΔػೳΛऔಘ͠·͢ɻ *NBHF
    1MBZHSPVOE
    "1*Λ࠾༻ͯ͠ɺϢʔβʔ͕ΞϓϦ಺ͷίϯςΩετΛ࢖༻ ָ͍ͯ͠͠ը૾Λ͢͹΍͘࡞੒Ͱ͖ΔΑ͏ʹ͠·͢ɻ Ϣʔβʔ͕͍ͭͰ΋Ϛον͢Δ৽͍͠ֆจࣈΛ࡞੒Ͱ͖ΔΑ͏ʹ͠·͢ɻ w
    ͢Ͱʹ4JSJ,JUΛ࢖༻͍ͯ͠ΔΞϓϦ͸ɺࣗಈతʹ4JSJͷڧԽ͞Εͨձ࿩ػೳͷԸܙ
    
    
    
    Λड͚·͢ɻ
    w
    "QQ
    *OUFOUTΛ࢖༻ͯ͠ɺΞϓϦ಺͓ΑͼΞϓϦؒͰԿඦ΋ͷ৽͍͠ΞΫγϣϯΛ
    
    
    
    ࣮ߦ͠·͢ɻ
    w
    ϝχϡʔΛݺͼग़͠ɺΞϓϦؒͰΞΫγϣϯΛ࣮ߦ͠·͢ɻ w
    ΦϒδΣΫττϥοΩϯά͸ɺWJTJPO04ΞϓϦͰݱ࣮ੈքͷΦϒδΣΫτΛ௥੻͢Δ
    ɹͷʹ໾ཱͪ·͢ɻ
    w
    $SFBUF
    .-ΞϓϦʹ৽͍͠σʔλϓϨϏϡʔػೳ͕௥Ճ͞Εɺ$SFBUF
    .-
    
    ɹ$PNQPOFOUTͷ৽͍͠4XJGU
    "1*͸ɺΧελϚΠζ͞ΕͨϞσϧτϨʔχϯάϫʔΫ
    ɹϑϩʔΛڧԽͰ͖·͢ɻ ɾ$PSF
    .-
    5PPMTͰɺΑΓৄࡉͰߏ੒Մೳͳॏྔѹॖٕज़Λ࢖༻ͯ͠ɺେن໛ͳݴޠϞ σϧͱ֦ࢄϞσϧΛ"QQMFγϦίϯʹ΋ͨΒ͠·͢ɻ
    
    w
    ৽͍͠.-5FOTPSλΠϓ͸ɺଟ࣍ݩ഑ྻͷૢ࡞Λදݱ͢ΔͨΊͷޮ཰తͰγϯϓϧͰ ࢖͍׳Εͨ"1*Λఏڙ͠·͢ɻ
    w
    ৽͍͠຋༁"1*͸ɺ͞·͟·ͳςΩετΛ຋༁͢Δͷʹ໾ཱͪ·͢ΞϓϦͷݴޠɻ
    w
    7JTJPO
    'SBNFXPSL
    "1*
    ʹ͸ɺ׆༻͢ΔͨΊʹ࠶ઃܭ͞Ε·ͨ͠࠷৽ͷ4XJGUͷػೳ
    ɹ͕͋Γ·͢ɻ