Slide 1
Slide 1 text
Meet the Foundation Models
framework
Takeshi Tanaka (@p0dee)
ू·ΕSwift͖ʂSwiftѪձεϐϯΦϑ WWDC25ηογϣϯཁձ @ DeNA
2025/06/26
Slide 2
Slide 2 text
Tanaka Takeshi
X: p0dee
iOS/Android Engineer
झຯδϟζͱےτϨͰ͢ɻ
Slide 3
Slide 3 text
ΦϯσόΠεͰͷɺେنݴޠϞσϧͷར༻ΛՄೳʹ͢ΔϑϨʔϜϫʔΫ
• macOSɺiOSɺiPadOSɺvisionOSͰར༻Մೳ
• ΦϯσόΠεͷͨΊɾɾɾ
• ϓϥΠόγʔอޢͱAIମݧͷΈࠐΈཱ͕྆Մ 👍
• ߴͳਪʹෆ͖ 😕
• ͕ࣝݶΒΕɺࣄ࣮ݕূ͕ඞཁ 😕
Foundation Models framework
Slide 4
Slide 4 text
Foundation Models framework
• ίϯςϯπੜʗੜతରʗΞϓϦϢʔβʔΨΠυʗੜతΫΠζʗ
ύʔιφϥΠζʗྨʗཁʗηϚϯςΟοΫݕࡧʗચ࿅ɾਫ਼៛Խʗ࣭Ԡ
ʗΧελϚΠζֶशʗλάੜʗΤϯςΟςΟநग़ʗτϐοΫݕग़
• ηογϣϯϏσΦͰɺཱྀఔܭըɺήʔϜͰͷNPCͱͷձ
Slide 5
Slide 5 text
#Playground {
let session = LanguageModelSession()
let response = try await session.respond(to:
ɹɹɹɹɹɹ“WWDCͷେͳηογϣϯϏσΦΛޮΑ͘ফԽ͢ΔΞΠσΞΛ͍ͩ͘͞ʂ"
)
}
Foundation Models framework
🤖💭 “ޮΑ͘WWDCͷηογϣϯϏσΦΛফԽ͢Δํ๏͍͔ͭ͋͘Γ·͢ɻ·ͣɺڵ
ຯͷ͋ΔτϐοΫΛࣄલʹௐͯɺಈըͷλΠτϧ༰ΛνΣοΫ͢Δͱྑ͍Ͱ
͠ΐ͏ɻ࣍ʹɺಈըΛ1ͭͷηογϣϯͰ·ͱΊΔಈըཁಈըΛ୳͢ͷ༗ޮͰ
͢ɻ·ͨɺཁΛ·ͱΊࠐΜͩεϥΠυهࣄΛಡΉͱɺཧղ͕ਂ·Γ͍͢Ͱ͢ɻ
࠷ޙʹɺࣗݾল͠ͳ͕Βɺ࣍ͷΞοϓσʔτʹ͚ͯ४උΛ͑ͯΈ·͠ΐ͏ɻ”
Slide 6
Slide 6 text
No content
Slide 7
Slide 7 text
• ߏԽ͞Εͨग़ྗΛอূ͢Δػೳ
• SwiftͷܕγεςϜΛ׆༻ͯࣗ͠વݴޠϓϩϯϓτΛิڧ
• @GenerableɿϞσϧʹੜͯ͠ཉ͍͠ܕΛఆٛ
• @GuideɿϓϩύςΟʹઆ໌Λ༩͠ɺੜΛ੍ޚ͢Δ
• ϓϦϛςΟϒܕɺྻɺGenerableܕɺ࠶ؼతͳߏαϙʔτ
Guided generation
Slide 8
Slide 8 text
@Generable(description: "ΦϒδΣΫτͷઆ໌Ͱ͢")
struct ObjectDescription {
@Guide(description: “આ໌จͷྻ", .maximumCount(3))
var descriptions: [String]
}
—-
let session = LanguageModelSession(
instructions: “͋ͳͨɺ༩͑ΒΕͨΦϒδΣΫτͷ໊લΛͱʹɺ
ͦͷΦϒδΣΫτͷҙ֎ͳ౾ࣝΛڭ͑ͯ͘ΕΔത࢜Ͱ͢ɻ”
)
ΦϒδΣΫτͷ໊લ͔Βɺ؆୯ͳઆ໌จΛ࠷େ̏ͭग़ྗ͍ͤͨ͞
Slide 9
Slide 9 text
@Guided ͰࢦఆՄೳͳ੍
\w+/
Slide 10
Slide 10 text
@Generable(description: "ΦϒδΣΫτͷઆ໌Ͱ͢")
struct ObjectDescription {
@Guide(description: “આ໌จͷྻ”, .maximumCount(3))
var descriptions: [String]
}
—-
let session = LanguageModelSession(
instructions: “͋ͳͨɺ༩͑ΒΕͨΦϒδΣΫτͷ໊લΛͱʹɺ
ɹɹɹɹɹɹɹͦͷΦϒδΣΫτͷҙ֎ͳ౾ࣝΛڭ͑ͯ͘ΕΔത࢜Ͱ͢ɻ”
)
Slide 11
Slide 11 text
Snapshot streaming
{ greenting _to
: _Cup
τʔΫϯ : …
let stream = session.streamResponse(
to: text,
generating: Message.self)
for try await partial in stream {
print(partial)
// Snapshot streaming
Message.PartiallyGenerated(greeting: nil)
Message.PartiallyGenerated(greeting: "")
Message.PartiallyGenerated(greeting: "Welcome")
Message.PartiallyGenerated(greeting: "Welcome to")
Message.PartiallyGenerated(greeting: "Welcome to Cup")
}
Slide 12
Slide 12 text
// Expanded @Generable Macro
nonisolated struct PartiallyGenerated: Identifiable, ConvertibleFromGeneratedContent {
var id: GenerationID
var descriptions: [String].PartiallyGenerated?
nonisolated init(_ content: FoundationModels.GeneratedContent) throws {
self.id = content.id ?? GenerationID()
self.descriptions = try content.value(forProperty: "descriptions")
}
}
@Generable ϚΫϩʹΑΓࣗಈੜ͞ΕΔ PartiallyGenerated
Slide 13
Slide 13 text
Tool calling
• ֎෦ใݯͱͷ౷߹ɺϞσϧ͕ΞϓϦͷίʔυ(Tool)Λ࣮ߦՄೳ
• ֎෦ใݯͱͷΓऔΓΛ࣮ʢe.g. δΦίʔυ͔ΒॅॴɺҐஔใ͔Βఱؾʣ
• πʔϧͷઆ໌จʢdescriptionʣΛఆٛ͢Δ͜ͱͰɺϞσϧ͕πʔϧΛࣗ
తʹݺͼग़͠ɺ࠷ऴϨεϙϯεʹΈࠐΉ
• ಈతੜεΩʔϚʹΑΓɺμΠφϛοΫͳఆ͕ٛՄೳʢDeep dive in… Ͱઆ໌ʣ
Slide 14
Slide 14 text
import FoundationModels
struct GetWeatherTool: Tool {
let name = "getWeather"
let description = "Retrieve the latest weather information for a city"
@Generable
struct Arguments {
@Guide(description: "The city to fetch the weather for")
var city: String
}
func call(arguments: Arguments) async throws -> ToolOutput {
let places = try await CLGeocoder().geocodeAddressString(arguments.city)
let weather = try await WeatherService.shared.weather(for: places.first!.location!)
let temperature = weather.currentWeather.temperature.value
let content = GeneratedContent(properties: ["temperature": temperature])
let output = ToolOutput(content)
return output
}
}
…
let session = LanguageModelSession(
tools: [GetWeatherTool()],
instructions: "Help the user with weather forecasts."
)
Slide 15
Slide 15 text
Stateful session
• LanguageModelSession ঢ়ଶΛอ࣋
• ϞσϧͱͷରίϯςΩετʹอ࣋͞ΕΔ
• ηογϣϯͷաڈͷΓͱΓΛࢀরɺཧղͰ͖Δ
• ͨͩ͠ɺίϯςΫετͷ্ݶ 4096 τʔΫϯ
• ա࣌৽͍͠ηογϣϯΛ࡞͠Ҿ͖ܧ͙ඞཁ͕͋Δʢʣ
• session.transcript ͰաڈͷΓऔΓΛग़ྗՄೳ
Slide 16
Slide 16 text
ؔ࿈ηογϣϯ
- Deep dive into the Foundation Models framework
- Code-along: Bring on-device AI to your app using the
Foundation Models framework
- Explore prompt design & safety for on-device foundation
models
- Explore large language models on Apple silicon with MLX
↑ Foundation Models Ͱͳ͘ɺΦϯσόΠεLLM ͰࣗલσʔλΛՃֶश͍ͤͨ͞έʔε
Slide 17
Slide 17 text
Meet the Foundation Models
framework
Takeshi Tanaka (@p0dee)
ू·ΕSwift͖ʂSwiftѪձεϐϯΦϑ WWDC25ηογϣϯཁձ @ DeNA
2025/06/26