怖くないメモリ肥大化

ා͘ͳ͍ ϝϞϦංେԽ

͓͓͍͔ͭ͠͞ !UTVLBTB@PJTIJ

'"5"-&33033FBDIFEIFBQMJNJU"MMPDBUJPOGBJMFE +BWB4DSJQUIFBQPVUPGNFNPSZ

ຊ൪͚ͩى͜ Δ

ຊ൪ͰϓϩϑΝ ΠϦϯά͢Δ͠ ͔ͳ͍

IUUQT[FOOEFWVCJF@EFWBSUJDMFTCGBFGF

͍͍ͩͨͷ৔ॴΛ ݟ͚ͭΔͷ͕ Ұ൪େมͳͷͰ ͜͜ΛΫϦΞͰ͖ͨΒ ͋ͱ͸ॗʑͱ΍Δ͚ͩ

ςετ Λॻ͘

ίʔυ ΛಡΉ

($͕͔͔Βͳ͍ύλʔϯ

const cache: Map<string, any> = new Map(); άϩʔόϧม਺ʹେ͖ͳσʔλ΍ঃʑʹ૿͑ΔσʔλΛ࣋ͨͤΔ

($͕͔͔ΔલʹώʔϓΛѹഭ͢Δύλʔϯ

ϧʔϓॲཧͰେྔͳΦϒδΣΫτΛੜ੒ function generateLargeNumberOfObjects() { const objects: { id: number; data:
string }[] = []; for (let i = 0; i < 1000000; i++) { const obj = { id: i, data: ‘aaa….’ }; objects.push(obj); } return objects; }

ΫϩʔδϟʔͰ૿͑ΔσʔλΛอ࣋ function createDataAccumulator() { let data: number[] = []; return
function addData(newData: number): void { data.push(newData); }; } Const accumulateData = createDataAccumulator(); accumulateData(1); accumulateData(2); …

େ͖ͳσʔλΛҰ౓ʹѻ͏ const data = fs.readFileSync(filePath, 'utf8');

Կ͔ͷด͡๨Ε

const connection = mysql.createConnection({…}); connection.query('SELECT * FROM hoge_table’); // connection.end();

ࣗ෼ͨͪͷॻ͍ͨίʔυ͕ݪҼͳΒ ͍͍ͩͨίʔυಡΊ͹ݟ͔ͭΔ

ࣗ෼ͨͪͷॻ͍ͨίʔυͰͳ͍৔߹ ͸ϓϩϑΝΠϥʔ͕ͳ͍ͱݫ͍͠

νϟοτͷ ձ࿩͕૿͑Δ ͱΤϥʔ

ɾຊ൪؀ڥͰͷΈൃੜ͢Δ ɹɾ,T.#ϝϞϦ ɾϩʔΧϧ։ൃ؀ڥͰ͸ϓϩηεͷϝϞϦݟͯ΋.#͘Β͍ ɹɾ.BD(#ϝϞϦ '"5"-&33033FBDIFEIFBQMJNJU"MMPDBUJPOGBJMFE +BWB4DSJQUIFBQPVUPGNFNPSZ

IFBQPVUPG NFNPSZ

NODE_OPTIONS=—max-old-space-size=250

const chatPrompt = ChatPromptTemplate.fromMessages([ [ "system", "You are a helpful
assistant that translates {input_language} to {output_language}.", ], ["human", "{text}"], ["human", "{text}"], ["human", "{text}"], ["human", "{text}"], ["human", "{text}"], ["human", "{text}"], ["human", "{text}"], ["human", “{text}"], … ["human", “{text}"], ]);

memoryCheck() { const heap = process.memoryUsage(); const msg = [];
for (const key in heap) { msg.push(`${key}: ${Math.round(heap[key] / 1024 / 1024)} MB`); } console.log(msg.join(', ')); }

start rss: 164 MB, heapTotal: 31 MB, heapUsed: 28 MB
end rss: 1137 MB, heapTotal: 999 MB, heapUsed: 959 MB

ίʔυ͸େৎ෉ͦ͏

σόοΨʔ

ৄࡉ͸هࣄʹ͋Γ·͢ IUUQT[FOOEFWVCJF@EFWBSUJDMFTGEE

export async function getEncoding( encoding: TiktokenEncoding, options?: { signal?: AbortSignal;
extendedSpecialTokens?: Record<string, number>; } ) { (লུ) return new Tiktoken( await cache[encoding], options?.extendedSpecialTokens ); }

start rss: 110 MB, heapTotal: 58 MB, heapUsed: 34 MB
end rss: 231 MB, heapTotal: 116 MB, heapUsed: 93 MB

·ͱΊ

ϓϩϑΝΠϥʔ Λ࢖͑ΔΑ͏ʹ ͓ͯ͘͠

Α͋͘Δ ύλʔϯ Λ஌͓ͬͯ͘

࠶ݱςετ ͕ॻ͚Ε͹ ҆৺

͓͠·͍

怖くないメモリ肥大化

怖くないメモリ肥大化

More Decks by Tsukasa OISHI

Other Decks in Programming

Featured

Transcript