怖くないメモリ肥大化

Nihonbashi.js #9のLTで発表しました。
Node.jsでのメモリ肥大化にどう対応するかというお話です。

Transcript

1. ා͘ͳ͍
   ϝϞϦංେԽ
2. ͓͓͍͔ͭ͠͞ !UTVLBTB@PJTIJ
3. '"5"-
   &3303
   3FBDIFE
   IFBQ
   MJNJU
   "MMPDBUJPO
   GBJMFE
   +BWB4DSJQU
   IFBQ
   PVU
   PG
   NFNPSZ
4. ຊ൪͚ͩى͜ Δ
6. ຊ൪ͰϓϩϑΝ
   ΠϦϯά͢Δ͠
   ͔ͳ͍
7. IUUQT[FOOEFWVCJF@EFWBSUJDMFTCGBFGF
8. ͍͍ͩͨͷ৔ॴΛ
   ݟ͚ͭΔͷ͕
   Ұ൪େมͳͷͰ ͜͜ΛΫϦΞͰ͖ͨΒ
   ͋ͱ͸ॗʑͱ΍Δ͚ͩ
9. ᶃ
10. ςετ
    Λॻ͘
11. ᶄ
12. ίʔυ
    ΛಡΉ
13. ($͕͔͔Βͳ͍ύλʔϯ
14. const cache: Map<string, any> = new Map(); άϩʔόϧม਺ʹେ͖ͳσʔλ΍ঃʑʹ૿͑ΔσʔλΛ࣋ͨͤΔ
15. ($͕͔͔ΔલʹώʔϓΛѹഭ͢Δύλʔϯ
16. ϧʔϓॲཧͰେྔͳΦϒδΣΫτΛੜ੒ function generateLargeNumberOfObjects() { const objects: { id: number; data: string }[] = []; for (let i = 0; i < 1000000; i++) { const obj = { id: i, data: ‘aaa….’ }; objects.push(obj); } return objects; }
17. ΫϩʔδϟʔͰ૿͑ΔσʔλΛอ࣋ function createDataAccumulator() { let data: number[] = []; return function addData(newData: number): void { data.push(newData); }; } Const accumulateData = createDataAccumulator(); accumulateData(1); accumulateData(2); …
18. େ͖ͳσʔλΛҰ౓ʹѻ͏ const data = fs.readFileSync(filePath, 'utf8');
19. Կ͔ͷด͡๨Ε
20. const connection = mysql.createConnection({…}); connection.query('SELECT * FROM hoge_table’); // connection.end();
21. ࣗ෼ͨͪͷॻ͍ͨίʔυ͕ݪҼͳΒ
    ͍͍ͩͨίʔυಡΊ͹ݟ͔ͭΔ
22. ࣗ෼ͨͪͷॻ͍ͨίʔυͰͳ͍৔߹
    ͸ϓϩϑΝΠϥʔ͕ͳ͍ͱݫ͍͠
23. ྫ
25. νϟοτͷ
    ձ࿩͕૿͑Δ
    ͱΤϥʔ
26. ɾຊ൪؀ڥͰͷΈൃੜ͢Δ
    ɹɾ,T
    
    .#ϝϞϦ
    ɾϩʔΧϧ։ൃ؀ڥͰ͸ϓϩηεͷϝϞϦݟͯ΋.#͘Β͍
    ɹɾ.BD
    
    (#ϝϞϦ '"5"-
    &3303
    3FBDIFE
    IFBQ
    MJNJU
    "MMPDBUJPO
    GBJMFE
    +BWB4DSJQU
    IFBQ
    PVU
    PG
    NFNPSZ
27. ($
28. IFBQ
    PVU
    PG
    
    NFNPSZ
29. NODE_OPTIONS=—max-old-space-size=250
30. const chatPrompt = ChatPromptTemplate.fromMessages([ [ "system", "You are a helpful assistant that translates {input_language} to {output_language}.", ], ["human", "{text}"], ["human", "{text}"], ["human", "{text}"], ["human", "{text}"], ["human", "{text}"], ["human", "{text}"], ["human", "{text}"], ["human", “{text}"], … ["human", “{text}"], ]);
31. memoryCheck() { const heap = process.memoryUsage(); const msg = []; for (const key in heap) { msg.push(`${key}: ${Math.round(heap[key] / 1024 / 1024)} MB`); } console.log(msg.join(', ')); }
32. start rss: 164 MB, heapTotal: 31 MB, heapUsed: 28 MB end rss: 1137 MB, heapTotal: 999 MB, heapUsed: 959 MB
33. ίʔυ͸େৎ෉ͦ͏
34. σόοΨʔ
35. ৄࡉ͸هࣄʹ͋Γ·͢
    IUUQT[FOOEFWVCJF@EFWBSUJDMFTGEE
36. export async function getEncoding( encoding: TiktokenEncoding, options?: { signal?: AbortSignal; extendedSpecialTokens?: Record<string, number>; } ) { (লུ) return new Tiktoken( await cache[encoding], options?.extendedSpecialTokens ); }
37. start rss: 110 MB, heapTotal: 58 MB, heapUsed: 34 MB end rss: 231 MB, heapTotal: 116 MB, heapUsed: 93 MB
39. ·ͱΊ
40. ϓϩϑΝΠϥʔ
    Λ࢖͑ΔΑ͏ʹ
    ͓ͯ͘͠
41. Α͋͘Δ
    ύλʔϯ
    Λ஌͓ͬͯ͘
42. ࠶ݱςετ
    ͕ॻ͚Ε͹
    ҆৺
43. ͓͠·͍