Share
Embed
Transcript
33 slides
-
Stream • ੲ͔Β͋ͬͨ • جຊతʹͯ͢ͷͷ͜ͷߟ͑ํͰදݱͰ ͖Δ • σʔλͷมݩ͕͋ͬͯม͠ͳ͕Βมઌ ʹૹΔ 4PVSDF
5SBOTGPSN %FTUJOBUJPO -
Stream • ϓϩάϥϛϯάͷ௨ৗͷϝϯλϧϞσϧ • ҰؾʹಡΈࠐΉɺҰؾʹม͢ΔɺҰؾʹॻ͖ग़͢ • ͰͦΕͩͱ͔ͬͨΓɺϝϞϦΛଟେʹফඅͨ͠Γ͢Δ • ͳͷͰɺಡΈࠐΈͳ͕Βมͯ͠ॻ͖ग़͍ͬͯ͢͏ߟ͑ํ •
ྫ: Zip͔ΒಡΈࠐΜͰల։ͯ͠อଘ • 4PVSDF 5SBOTGPSN %FTUJOBUJPO -
Stream // Stream Λ࡞Δ࣌ const { Readable } = require('stream');
const controller = new AbortController(); const read = new Readable({ read(size) { // σʔλΛಡΈࠐΉ࣌ͷຊॲཧ }, signal: controller.signal // cancel ͢Δ࣌ (AbortController͕͑Δ) }); -
Stream // Stream ͔ΒσʔλΛಡΈࠐΉ࣌ readableStream.on("data", (chunk) => { // chunk
ΛಡΈࠐΜͰͳΜ͔͢Δ }); readableStream.on("end", () => { // ऴྃॲཧ }); readableStream.on("error", () => { // ྫ֎ॲཧ }); -
Stream // pipe Ͱ chain ͯ͠ॻ͚Δɻ readableStream.pipe(transformStream).pipe(writableStream); // error ͕͋ͬͨΒ͜͏ॻ͘ɻ
readableStream.on("error", (err) => { // ྫ֎ॲཧ }).pipe(transformStream).on("error", (err) => { // ྫ֎ॲཧ }).pipe(writableStream).on("error", (err) => { // ྫ֎ॲཧ }); -
Stream // error propagate ͕໘ͳΒ͜͏ॻ͚ͨΓ͢Δɻ const { pipeline } =
require('stream'); pipeline( readableStream, transformStream, writableStream, (err) => { if (err) { console.error('Pipeline failed.', err); } else { console.log('Pipeline succeeded.'); } }, ); // ͜ΕΛ promisify ͢Ε async/await Ͱॻ͚ͨΓ͢Δɻ -
Stream // promisify ͞Εͨͭ͋Δɻ const { pipeline } = require('stream/promises');
await pipeline( readableStream, transformStream, writableStream, ).catch(console.error); -
Stream • Node.js ʹੲ͔Β͋Δߟ͑ํ͕ͩɺ Promiseͱ͏·͘౷߹Ͱ͖ͳ͍ɻ • Promise ͷ಄ɺٴͼ async/await ʹΑͬͯେΘΕʹ͘͘ͳ͖ͬͯͨɻ
• ੲͦΕͦ͜ Callback Ͱ EventEmitter ͳߟ͑ํ͔͠ͳ͔ͬͨ࣌ͩͬ ͕ͨɺࠓ͏ΈΜͳ async/await ͬͯͬͯΔ • Stream Λ AsyncIteratorʹͯͬͨ͠Γɺ pipeline/promises Λ͑ async/await ͱ౷߹ͯ͠͏͜ͱՄೳʹͳ͕ͬͨɺͦΕΑΓͦͦ WHATWG Stream ଆͷํࣜʹҠͯ͠͠·ͬͨ΄͏͕ ecosystem friendly ͱ͍͏ߟ͑ํ -
WHATWG Stream • WHATWG ଆͰఏҊ͞Ε͍ͯΔ Stream • Node.js ͷ Stream
ͷӨڹଟগड͚ͯΔͱࢥ͏͕ جຊผ • ओʹॲཧͷ࠷খ୯Ґͷߟ͑ํ͕ҧ͏ɻ Node.js Stream event ʹొ͞ΕͨλεΫ୯Ґɺ WHATWG Promise Λجຊ୯Ґʹ͢Δ -
WHATWG Stream // WHATWG Stream Λ࡞Δ࣌ import { ReadableStream
} from 'node:stream/web'; const stream = new ReadableStream({ async start(controller) { // σʔλΛಡΈࠐΈ࢝ΊΔॲཧ ※ controller ޙड़ } async pull(controller) { // ஞ࣍తʹಡΉॲཧ } async cancel() { // Ωϟϯηϧ࣌ͷॲཧ } }); -
WHATWG Stream // WHATWG Stream Λσʔλ͔ΒಡΈࠐΉ࣌ // reader ΛऔΓग़ͯ͠ const
reader = readableStream.getReader(); // Ұճ͚ͩݺͿͳΒ͜ΕͰΦοέʔ const data = await reader.read(); console.log(data); -
WHATWG Stream // WHATWG Stream Λσʔλ͔ΒಡΈࠐΉ࣌ // ஞ࣮࣍ߦͰऔΔͳΒ const reader
= stream.getReader(); let result = ""; let chunk; do { chunk = await reader.read(); if (chunk.value != undefined) result += chunk.value; } while (!chunk.done); // ΊΜͲ͍ɺ do-while ͳΜͯॻ͖ͨ͘ͳ͍ -
WHATWG Stream // WHATWG Stream Λσʔλ͔ΒಡΈࠐΉ࣌ // ஞ࣮࣍ߦͰऔΔͳΒ stream ͕
AsyncIterator ͳͷͰɺ for await of ͰऔΕ Δ let result = ""; for await (const chunk of stream) { result += chunk; } console.log(result); -
WHATWG Stream // pipeThrough ͰՃ͠ͳ͕Β ࠷ऴతʹ writable Stream ʹॻ࣌͘ readableStream.pipeThrough(transformStream)
// Stream .pipeTo(writableStream) // Promise .then(() => console.log("done")) .catch(console.error); // Promise ͕ؼͬͯ͘Δͬͯ͜ͱasync/awaitͰॻ͚Δɻ try { await readableStream.pipeThrough(transformStream).pipeTo(writableStream); console.log("done"); } catch(e) { console.error(e); } -
WHATWG Stream example import { ReadableStream } from 'node:stream/web'; import
{ setInterval as every } from 'node:timers/promises'; import { performance } from 'node:perf_hooks'; const stream = new ReadableStream({ async start(controller) { for await (const _ of every(1000)) controller.enqueue(performance.now()); } }); for await (const value of stream) console.log(value); -
WHATWG Stream • ByteࢦͷReadable Stream ࡞ΕΔ • BYOB (Bring Your
Own Buffer) Stream • ReadableStream ࡞࣌ʹ type Λ 'bytes' ʹ͢Δ ͱ BYOB ʹͳΔ • ͜Ε byte ୯ҐͰࡉ͔͘ಡΈࠐΉ੍ޚΛߦ͍͍ͨ ࣌ʹ࣮ࢪ͢Δͷ -
WHATWG Stream • Queueing Strategy • ࡉ͔͘ Queueing ͢ΔઓུΛܾΊ੍ͯޚͤ͞Δ͜ͱ͕Ͱ͖Δ •
highwatermark ͱݺΕΔ͖͍͠ΛܾΊͯͦΕҎ্ͩͬͨΒ backpressure Λ͔͚ͯಡΈࠐ·ͳ͘͢Δ • 4PVSDF 5SBOTGPSN %FTUJOBUJPO RVFVF RVFVF highwatermark -
WHATWG Stream • Queueing Strategy • ByteLengthQueueingStrategy: όΠταΠ ζͷ্ݶΛܾΊͯͦ͜·ͰಡΈࠐΉઓུ •
CountQueueingStrategy: ԿճΩϡʔʹॻ͖ ࠐΜ͔ͩͷճ੍ޚ -
WHATWG Stream ͷΓ͍ͯ ͳ͍ͷ • Node.js Writable ʹ͋Δ͕ɺ flush ͱ͍ͬͨ
Ұؾʹు͖ग़͢ ͕ؔͳ͍ • Θ͟Θ͟ΩϡʔΠϯάͨ͠ΓόοϑΝϦϯάͨ͠Γ͠ͳ͍͍ͯ࣌͘ʹҰؾ ʹు͖ग़͍͚ͨ͠Ͳɺݱঢ়ͩͱͦ͏͍͏ Controller ͳ͍͍ͧͬͯ͏Λ ͍ͯ͠Δɻ • -
WHATWG Stream • ·ͩ·ͩ discussion ଓ͘ • Node.js Ͱ·ͩ Stability
1: Experimental -
ࠓͳͥՃͨ͠ͷ͔? • ͍͔ͭ͋͘Δ • Web Compat ͷڧԽ • fetch ͷ࣮ͷͨΊͷύʔπ࡞Γ
• deno ͳͲͷڝ߹ͷଘࡏ -
·ͱΊ • Stream ͷࠓੲ • Node.js Stream͔ΒWHATWG Stream • WHATWG
Stream ͷࡉ͔͍ • WHATWG Stream ͰΓͯͳ͍ͷ·ͩ·ͩ͋Δ • ࠓ·ͩ unstable ͏࣌ؾΛ͚ͭͯ • ࠓNode.js࣍ͷ10ʹ͚ͯͷมֵظɺ͜ͷ͋ͨΓͷਐԽ݁ߏΊ͟·͍͠ • ࠓޙͷNode.jsΛ໘ന͍ͯ͘͜͠͏ɻ