Slide 1

Slide 1 text

Ϧϣ΢ @RyoDeveloper Foundation Models framework Ͱը૾෼ੳ WWDC26 Recap - Japan-\(region).swift

Slide 2

Slide 2 text

Ϧϣ΢ • @RyoDeveloper • גࣜձࣾLuup iOS Engineer

Slide 3

Slide 3 text

Foundation Models framework Apple Intelligenceͷج൫ͱͳΔେن໛ݴޠϞσϧΛ Swift API͔Βར༻Ͱ͖ΔϑϨʔϜϫʔΫ • ϓϥΠόγʔͷ֬อ • ΦϑϥΠϯ࣮ߦ΋Մೳ • OSʹ૊Έࠐ·Ε͍ͯΔ • ແྉͰར༻Մೳ

Slide 4

Slide 4 text

WWDC26ͰͷFoundation Models frameworkͷΞοϓσʔτ • ը૾ೖྗ • Evaluations framework • ίΞϑϨʔϜϫʔΫͷΦʔϓϯιʔεԽ • ৽͍͠ΦϯσόΠεϞσϧ • Private Cloud Compute • αʔυύʔςΟϞσϧରԠ

Slide 5

Slide 5 text

No content

Slide 6

Slide 6 text

LUUPΞϓϦͰͷ ׆༻ ※PoCͱ࣮ͯ͠૷ͨ͠Πϝʔδ Ͱ͢

Slide 7

Slide 7 text

Foundation Models frameworkͷը૾ೖྗ let session = LanguageModelSession() let response = try await session.respond { "͜ͷը૾ʹ͍ࣸͬͯΔं྆ʹ๨Ε෺͕ͳ͍͔ڭ͑ͯɻ" Attachment(image) } let content = response.content ͜ͷं྆ͷલΧΰʹ͸ࠇ͍ϦϡοΫ͕ೖ͍ͬͯ·͢ɻ

Slide 8

Slide 8 text

Guided Generation @Generable struct ForgottenItemPresence { @Guide(description: "ं྆ʹ๨Ε෺͕͍ࣸͬͯΔ͔") let hasForgottenItem: Bool } let session = LanguageModelSession() let response = try await session.respond( generating: ForgottenItemPresence.self ) { "͜ͷը૾ʹ͍ࣸͬͯΔं྆ʹ๨Ε෺͕ͳ͍͔ڭ͑ͯɻ" Attachment(image) } let hasForgottenItem = response.content.hasForgottenItem true

Slide 9

Slide 9 text

Evaluations framework ΞϓϦͷΠϯςϦδΣϯτػೳͷ඼࣭Λଌఆ͢Δ SwiftϑϨʔϜϫʔΫ • Swift Testingͱ౷߹͠ɺϓϩϯϓ τΛௐ੔͠ͳ͕Βਫ਼౓ΛଌఆͰ ͖Δ

Slide 10

Slide 10 text

ධՁ var dataset: ArrayLoader> { ArrayLoader(samples: [ ModelSample( prompt: Prompt { "͜ͷը૾ʹ͍ࣸͬͯΔं྆ʹ๨Ε෺͕ͳ͍͔ڭ͑ͯɻ" Attachment(imageURL: withLuggageURL) }, expected: true ), ModelSample( prompt: Prompt { "͜ͷը૾ʹ͍ࣸͬͯΔं྆ʹ๨Ε෺͕ͳ͍͔ڭ͑ͯɻ" Attachment(imageURL: withoutLuggageURL) }, expected: false ), ]) }

Slide 11

Slide 11 text

No content

Slide 12

Slide 12 text

Foundation Models frameworkͷ஫ҙ఺ • σόΠεɾ஍Ҭ౳ͷ੍໿ • AI͕ੜ੒͢Δग़ྗʹ͸ޡΓؚ͕·ΕΔՄೳੑ • ༻్ʹ߹ΘͤͯଞͷϑϨʔϜϫʔΫͱͷ࢖͍෼͚΋ݕ౼

Slide 13

Slide 13 text

·ͱΊ • Foundation Models frameworkͷը૾ೖྗ͸؆୯ʹ૊ΈࠐΊΔ • Evaluations frameworkͰਫ਼౓ΛܧଓతʹධՁ͠ɺ඼࣭Λ୲อ • ಛੑΛཧղͯ͠ɺదͨ͠৔໘Ͱ׆༻͢Δ