コンテナの仕組みとエコシステム - Haconiwaを通じて眺めてみる /container-ecosystem-and-haconiwa

Transcript

1. )BDPOJXBΛ௨ͯ͡ோΊͯΈΔ ۙ౻͏͓ͪ
   
   (.0
   1FQBCP
   *OD
   ೔ຊ044ਪਐϑΥʔϥϜओ࠵
   ୈճΞϓϦέʔγϣϯ෦ձษڧձ ίϯςφͷ࢓૊ΈͱΤίγεςϜ

2. ΤϯδχΞ ۙ౻͏͓ͪ
   !VE[VSB (.0ϖύϘ
   ٕज़෦ٕज़ج൫νʔϜ IUUQIBDPOJXBNSVCZPSH

3. !VE[VSB
   ུྺ &$αΠτɺιʔγϟϧήʔϜͷ։ൃͳͲΛܦͯɺ
 ೥ΑΓ(.0ϖύϘٕज़ج൫νʔϜɺ
 ಉ೥෱ԬʹҠॅɻ޷͖ͳΧϨʔ͸5JLJɻ
   ஶॻʹʰύʔϑΣΫτ3VCZ
   PO
   3BJMTʱ΄͔ɻ
   3VCZ,BJHJ
   ʹࣗ࡞ίϯςφϥϯλΠϜ
 ʮ)BDPOJXBʯͷ࿩͕࠾୒͞ΕΔɻ
   ΄͔ɺ3VCZ΍ίϯςφʹؔ͢Δ׆ಈଟ਺ɻ

4. ෱Ԭ3VCZձٞ
   ! IUUQSFHJPOBMSVCZLBJHJPSHGVLVPLB
   Ұൠνέοτ
   DPNJOH
   TPPO

5. ϋογϡλά
   IBDPOJXBSC

6. ࠓ೔ͷΰʔϧ 

7. ίϯςφͷҰาઌͷཧղΛ wʮͨͩ࢖͏ʯ͚ͩͰ͸ͳ͍ɺίϯςφͷຊ࣭తͳͱ͜ΖΛ͔ͭΉɻ
   wίϯςφͷར༻γʔϯʹؔ͢Δ༷ʑͳϥϯλΠϜɺιϑτ΢ΣΞɺ
 ϛυϧ΢ΣΞɺن֨ͳͲΛ੔ཧ͢Δɻ
   w͔ͬ͠Γͱͨ͠جૅ஌ࣝΛ͚ͭͯɺʮ࢖ΘΕΔʯͰ͸ͳ͘ʮ࢖͏ʯͨ Ίʹίϯςφʹ৮ΕΒΕΔΑ͏ʹͳΓ·͠ΐ͏ʂ

8. ίϯςφͷҰาઌͷཧղΛ wʮͨͩ࢖͏ʯ͚ͩͰ͸ͳ͍ɺίϯςφͷຊ࣭తͳͱ͜ΖΛ͔ͭΉɻ
   wίϯςφͷར༻γʔϯʹؔ͢Δ༷ʑͳϥϯλΠϜɺιϑτ΢ΣΞɺ
 ϛυϧ΢ΣΞɺن֨ͳͲΛ੔ཧ͢Δɻ
   w͔ͬ͠Γͱͨ͠جૅ஌ࣝΛ͚ͭͯɺʮ࢖ΘΕΔʯͰ͸ͳ͘ʮ࢖͏ʯͨ Ίʹίϯςφʹ৮ΕΒΕΔΑ͏ʹͳΓ·͠ΐ͏ʂ Ұॹʹษڧ͠·͠ΐ͏

9. )BDPOJXBͷ঺հ 

10. )BDPOJXB

11. )BDPOJXBͱ͸ɻ w-JOVYίϯςφϥϯλΠϜͷҰͭɻ
    w1BB4αʔϏεͰͷίϯςφར༻ͷܦݧΛ΋ͱʹ։ൃ͞Εͨ
    wಛ௃
    wNSVCZ
    ʹΑΓ։ൃ͞Ε͍ͯΔ
    w%4-ʹΑΓίϯςφͷઃఆ͕هड़Ͱ͖Δ
    w͞Βʹɺ༷ʑͳϑοΫΛϓϩάϥϛϯάͰ੍ޚՄೳͰ͋Δ

12. -JOVYίϯςφϥϯλΠϜͱ͸ʁ w0$*ʢޙड़ʣͷఆٛΛഈआ
    wʮઃఆΛಡΈࠐΈɺίϯςφϓϩηεΛ࡞੒͠ɺఀࢭɺ࡟আͳͲ༷ʑ ͳΞΫγϣϯΛߦ͏࣮૷ʯ
    w(MPTTBSZΑΓ
    wIUUQTHJUIVCDPNPQFODPOUBJOFSTSVOUJNFTQFDCMPC NBTUFSHMPTTBSZNESVOUJNF

13. l*U
    SFBET
    UIF
    DPOpHVSBUJPO
    pMFT
    GSPN
    B
    CVOEMF
    VTFT
    UIBU
    JOGPSNBUJPO
    UP
    DSFBUF
    B
    DPOUBJOFS
    MBVODIFT
    B
    QSPDFTT
    JOTJEF
    UIF
    DPOUBJOFS
    BOE
    QFSGPSNT
    PUIFS
    MJGFDZDMF
    BDUJPOTz IUUQTHJUIVCDPNPQFODPOUBJOFSTSVOUJNFTQFD
    

14. NSVCZͱ͸ʁ wF.CFEEFE
    3VCZ
    w͍ΘΏΔ૊ΈࠐΈػث޲͚ͷ3VCZͱͯ͠։ൃ͞Εͨʮܰྔʯ3VCZ
    wͦͷ݁ՌɺόΠϯσΟϯά͕ඇৗʹॻ͖΍͘͢ɺϛυϧ΢ΣΞͳͲʹ ΋૊ΈࠐΈ͕༰қͰ͋Δͱ͍͏ಛੑ͕͋Δɻ
    wݱࡏ"QBDIF
    )551%ɺ/HJOYͦͷଞͷʮ$POpHVSBUJPO
    BT
    $PEFʯ ͷ༻్ʹ΋޿·ΓΛݟ͍ͤͯΔ
    wDG
    -VB

15. FH
    OHY@NSVCZ wIUUQOHYNSVCZPSH
    w͜Ε͚ͩͷίʔυͰɺಈతͳϦόʔεϓϩΩγʹɻ

16. %4-ͱ͸ʁʁ w%4-
    
    %PNBJO
    4QFDJpD
    -BOHVBHFɺ͋Δ໨తʹಛԽͨ͠ݴޠ
    w)BDPOJXBͰ͸ɺ3VCZΛίϯςφ੍ޚͷͨΊͷ%4-ͱͯ͠࢖͑Δɻ
    w%4-Λܦ༝ͯ͠
    wίϯςφͷઃఆΛಈతʹܾఆ
    w༷ʑͳϑοΫʢϥΠϑαΠΫϧɺλΠϜΞ΢τɺγάφϧϋϯυϥɺ ఆظ࣮ߦʣΛهड़

17. ίϯςφͷઃఆͷಈత੍ޚ wίϯςφͷߏ੒ཁૉ͸ͦ΋ͦ΋ಈతʹ૊Έ߹Θ͕ͤՄೳͰ͋Δɻ
 ʢߏ੒ཁૉ͸ޙड़ʣͳͷͰɺίʔυͰܾఆͰ͖ΔͱศརͰ͋Δɻ Haconiwa.define do |c| #... client = Redis.new

    "127.0.0.1", 6379, 2 data = JSON.parse(client.get(ENV[‘CONTAINER_ID’])) c.cgroup :v1 do |cg| cg[‘cpu.cfs_period_us’] = data[‘period’] cg[‘cpu.cfs_quota_us’] = data[‘quota’] end end ྫ͑͹ɺىಈ࣌ʹ3FEJT͔Β
    ίϯςφͷ৘ใΛͱ͖ͬͯͯ
    ಈతʹ$16ׂ౰ͷઃఆ͕Մೳ

18. ϑοΫͷϓϩάϥϛϯά wίϯςφىಈఀࢭ౳ϥΠϑαΠΫϧʹԠͨ͡ॲཧ
    w·ͨɺγάφϧϋϯυϥɺίϯςφ͕ىಈͨ͠Ұఆ࣌ؒޙʹಛఆͷॲ ཧΛ૸ΒͤΔʢλΠϜΞ΢τʣɺఆظ࣮ߦ͢ΔॲཧΛهड़Մೳ Haconiwa.define do |c| #... c.add_handler :TTOU

    do |b, _| cpu = ::Cgroup::CPU.new(b.name) cpu.cfs_quota_us = cpu.cfs_quota_us + 10000 cpu.modify end end 4*(5506Λ
    εʔύόΠβʔʹૹΔͱ
    $16ׂ࣌ؒ౰Λ্͛Δ

19. ϑοΫʹΑΔ
    ίϯςφࣗମͷϥΠϑαΠΫϧ

20. ϥΠϑαΠΫϧͷ੍ޚ wίϯςφ͕ɺࣗ෼͕ੜ·Εɺͦͯ͠ऴྃ͢ΔαΠΫϧΛࣗ෼Ͱ
 ੍ޚՄೳͳੈքΛߟ͑Δ
    w)BDPOJXBʹ͓͍ͯ͸ɺҰఆ͕࣌ؒܦաͨ͠Βࣗ෼ࣗ਎ʹ4*(5&3. ΛૹΔ͜ͱͰɺϥΠϑαΠΫϧͷ͋ΔίϯςφΛ࣮ݱͰ͖Δ c.add_async_hook min: 30 do |b|

    # b.pid = ίϯςφͷPID=1 ::Process.kill :TERM, b.pid end ෼Ͱ
    ࣗ෼ʹ4*(5&3.ΛૹΔ

21. 'BTU$POUBJOFSΞʔΩςΫνϟ΁ wϖύݚদຊࢯఏҊͷ'BTU$POUBJOFSΞʔΩςΫνϟ
    w'BTU$(*Λώϯτʹͨ͠ίϯςφ؅ཧετϥςδ
    wϓϩηεΛͭʹ෼ྨʢ*NNPSUBM.PSUBM4IPSU-JWFEʣ
    wʮϦΞΫςΟϒʹ্ཱ͕ͪΓɺҰఆظؒॲཧΛଓ͚Δʯ
 ίϯςφΛఆٛɾ࡞੒͢Δ
    wؔ࿈ൃද΋͝ࢀর
    ʮίϯςφ࣌୅ͷ8FCαʔϏεج൫Ϟσϧ
    
    'BTU$POUBJOFSͷݚڀൃදΛ͖ͯ͠·ͨ͠ʯ
 IUUQTSBOEQFQBCPDPNBSUJDMFJPUNBUTVNPUPSZ
    

22. ίϯςφϥϯλΠϜͷൺֱ

23. "1*ͷެ։ํ਑ w%PDLFS ଞ0$*΂ʔεͷ΋ͷ ɺ-9%
    ͸)551ϕʔεͰ͋Δ
    w-9$͸ɺ$ͷΠϯλϑΣʔε͕͋ΔʢMJCMYDʣɻ͔͜͠͠ͷϥΠϒϥϦ ࣗମ͸ίϯςφઃఆΛ͍͡ΔͨΊͷ"1*Λ࣋ͨͳ͍ɻ
    w)BDPOJXB͸3VCZͷΠϯλʔϑΣʔε͕͋ΓɺϓϩάϥϜͰ͖Δɻ
 ઃఆ΋ϑοΫ΋"1*Λ༻ҙ͓ͯ͠Γɺૢ࡞Մೳ
    wMJCIBDPOJXB
    తͳ΋ͷ͸ݕ౼͍ͯ͠Δஈ֊

24. ϑοΫͷ࣮ݱܗࣜ w%PDLFS ଞ0$*΂ʔεͷ΋ͷ ͸ϥΠϑαΠΫϧ"1*ͷ؂ࢹͱ͍͏ܗͰ ࣮ݱ͢Δܗʹͳ͍ͬͯΔɻผ్؂ࢹˠϑοΫͷ࣮૷͕ඞཁɻ
    w-9$͸ઃఆʹϥΠϑαΠΫϧϑοΫ͕͋Δ
    wˠίϚϯυܗࣜͰɺҾ਺ͷࢦఆ
    w)BDPOJXB͸"1* %4-ͷ࢓༷

    ࣗମʹ֤छϑοΫ͕࣮૷͞Ε͓ͯΓɺ 3VCZͰ֤ॲཧΛهड़Մೳɻઃఆ΋ϑοΫ΋ಉ͡ݴޠͰɻ
    IUUQTMJOVYDPOUBJOFSTPSHKBMYDNBOQBHFTNBOMYDDPOUBJOFSDPOGIUNMMC#$

25. ϑοΫͷछྨ w%PDLFSɺ-9$ʹ͸ϥΠϑαΠΫϧϑοΫͷΈͷαϙʔτ
    w)BDPOJXB͸ϥΠϑαΠΫϧͷଞɺҎԼ΋αϙʔτ
    wλΠϜΞ΢τϑοΫ
    wఆظ࣮ߦϑοΫ
    wγάφϧϋϯυϥ
    wʢλΠϜΞ΢τఆظ࣮ߦʹΑΓ'BTU$POUBJOFS͕࣮ݱ͠΍͍͢໘ʣ

26. Πϝʔδͱͷ࿈ܞ w%PDLFS͸%PDLFSIVC͔Βམͱ͔͢ɺ0$*ޓ׵ͷUBSΛར༻
    w-9$͸ࣗ෼ͷΤίγεςϜʹMYDUFNQMBUFTΛ͍࣋ͬͯΔ
    wDG
    3BJMDBS
 ಠࣗͷNJDSPDPOUBJOFSTܗࣜɺπʔϧ PSBDMFTNJUI Λఏএ͍ͯ͠Δ
    w)BDPOJXB͸%4-ͰΠϝʔδ࡞੒΋αϙʔτ͢Δ
    wEFCPPUTUSBQMYDUBNQMBUFTͷྲྀ༻ɺHJU
    SFQPͷνΣοΫΞ΢τɺ
 UBSͰݻΊͨSPPUGTͳͲʢ0$*ޓ׵Πϝʔδͷαϙʔτ΋ೖΕ͍ͨʣ

27. ·ͱΊɿද هड़ݴޠ ίϯςφઃఆ "1* ϑοΫ࣮૷ ϑοΫͷछྨ Πϝʔδઓུ %PDLFS
    SVOD (PMBOH

    %PDLFSpMF
    ίϚϯυϥΠϯ )551
    "1* ϥΠϑαΠΫϧ
 ؂ࢹ ϥΠϑλΠϜ %PDLFSIVC
 0$*४ڌ -9$ $ JOJ
    pMF MJCMYD ϑοΫઃఆ߲໨ ϥΠϑλΠϜ MYDUFNQMBUF
    -9% (PMBOH 1SPpMF )551
    "1*    3BJM$BS 3VTU 0$*४ڌ
 KTPO 0$*४ڌ KTPO ະαϙʔτ  0$*४ڌ
    NJDSPDPOUBJOFST )BDPOJXB NSVCZ
    $ 3VCZ
    %4- 3VCZ
    %4- 3VCZ
    %4- ϥΠϑλΠϜ 
 λΠϜΞ΢τଞछ MYDUFNQMBUF
 ྲྀ༻ଞ

28. )BDPOJXBͷ໨ࢦ͢ੈք

29. %PDLFS0$*
    ͳͲͷํ޲ੑ w͜͜·ͰͷൺֱͰɺ%PDLFSͳͲͱ)BDPOJXBͷҧ͍Λྻڍͨ͠
    wݸਓతʹɺ%PDLFSͷ໨ࢦ͢ํ޲͸ʮ7.ͷ࠶ൃ໌ʯతʹࢥ͑Δ
    wϢʔβʔ͔ΒɺʮԾ૝؀ڥʯͷৄࡉ͸Ӆ͞Ε͍ͯͯɺ
 ܾ·ͬͨ"1*Λܦ༝ͯ͠σϓϩΠɾΦʔέετϨʔγϣϯΛߦ͏
    wDG
    ,VCFSOFUFT#PSH
    ʢ͜Ε΋ޙड़ʣ
    wͦ͏͍͏ந৅Խࣗମ͸ɺҰͭͷํ޲ੑͰ͸͋Δ

30. $POUBJOFS
    &DPTZTUFN
    BT
    $PEF w)BDPOJXB
    ͱɺͦͷपลͰ໨ࢦ͍ͨ͠ͱ͜Ζ
    wجຊతͳϦιʔεׂ౰΍ݖݶ෼཭ͳͲͷઃఆ͸ίʔυԽͰ͖Δ
    w·ͨɺଞͷϥϯλΠϜͱൺ΂ͯ΋๛෋ͳϑοΫΛ༻ҙ͠ɺίϯςφͷ ৼΔ෣͍ɾϥΠϑαΠΫϧΛίʔυԽͰ͖Δ
    w͔͜͜ΒɺίʔυԽͷൣғΛ޿Ί͍͖͍ͯͨɻ
 ྫ͑͹ωοτϫʔΫ૚΍ɺϑΝΠϧγεςϜؔ܎ɺ04ͷηΩϡϦςΟɾ ؂ࠪͷ࢓૊Έʢ-JOVYͷ-4.ʣͳͲ΋ίʔυԽͷൣғʹͰ͖ͳ͍͔ʁ

31. ίϯςφΤίγεςϜʹ
 ίʔυͰ౿ΈࠐΉೖΓޱʹͳΔ

32. ͜ΕΒΛ౿·͑ͯ
    ίϯςφͷੈքΛπΞʔ͠·͠ΐ͏

33. վΊͯ
    ίϯςφͱ͸Կ͔ 

34. ίϯςφ͸ొ৔ਓ෺͕ଟ͗͢Δ w-JOVYΧʔωϧࣗମɺγεςϜίʔϧ
    w֤छίϯςφϥϯλΠϜ
    wΦʔέετϨʔγϣϯπʔϧ܈
    wΫϥ΢υαʔϏεͦͷଞ
    wͳͲͳͲ
    wˠશମ؍Λࣔͭͭ͠ɺ੔ཧ͠·͢

35. ίϯςφ͸ొ৔ਓ෺͕ଟ͗͢Δ w-JOVYΧʔωϧࣗମɺγεςϜίʔϧ
    w֤छίϯςφϥϯλΠϜ
    wΦʔέετϨʔγϣϯπʔϧ܈
    wΫϥ΢υαʔϏεͦͷଞ
    wͳͲͳͲ
    wˠશମ؍Λࣔͭͭ͠ɺ੔ཧ͠·͢ ·ͣ͸
    ͜͜Λԡ͑͞Δ

36. Ծ૝Խͱ͸ʁ wྫ
    ϋΠύʔόΠβܕʢωΠςΟϒϋΠύʔόΠβʣ
    wઐ༻ͷ04΍ɺ-JOVY
    ,FSOFMࣗମΛϋΠύʔόΠβͱͯ͠࢖͍ɺͦͷ ্Ͱ04Λ૸ΒͤΔ
    wྫ
    ϗετ04ܕʢϗετϋΠύʔόΠβʣ
    w൚༻తͳ04ͷ্ʹɺ7JSUVBM#PYͷΑ͏ͳԾ૝ԽͷͨΊͷઐ༻ιϑτ ΢ΣΞΛೖΕͯ૸ΒͤΔ
    wίϯςφܕ
    ˠ
    

37. ʮίϯςφԾ૝Խʯ w͍ΘΏΔ,7.΍9FO΍7.XBSF
    W4QIFSF΍7JSUVBM#PYͷར༻ͱɺ
    wίϯςφʹΑΔʮԾ૝Խʯ͸ɺҰઢΛը͍ͯ͠Δ
    wϋʔυ΢ΣΞΛԾ૝Խ͢ΔΘ͚Ͱ͸ͳ͍
    wΧʔωϧΛબ΂ΔΘ͚Ͱ͸ͳ͍
    wͰ͸ɺͲ͏΍ͬͯಠཱͨ͠؀ڥΛ࡞͍ͬͯΔʁ
    

38. ίϯςφ͸
 ϓϩηεͰ͋Δ

39. ίϯςφ͸
 ʮʓʓʯ
 ͨ͠ϓϩηεͰ͋Δ

40. ϓϩηεΛ
    ίϯςφʹ͢Δ

41. 04ϦιʔεΛϗετ͔Β෼཭͢Δ  wϧʔτϑΝΠϧγεςϜʢSPPUGTʣͷಠཱԽ
    wDISPPU 
    ͱ͍͏ίϚϯυΛ༻͍ͯɺ͋ΔαϒπϦʔʹ࡞ͬͨϑΝΠ ϧπϦʔʹೖΓࠐΉ͜ͱ͕Ͱ͖Δɻ
    wCJOE
    NPVOU
    Λ༻͍ͯɺ
 ͦͷSPPUGTΛ͍͔ͭ͘ͷ֎෦ͷ
 σΟϨΫτϦͰߏஙՄೳ
    

    wΑΓ৚݅͸ݫ͍͕͠ɺ҆શʹͳΔQJWPU@SPPU  Λ࢖͏͜ͱ΋͋Δ
    IUUQTXXXBRVJDLMPPLBUDPNMJOVYMJOVYEFWFMPQFSDISPPU
    

42. 04ϦιʔεΛϗετ͔Β෼཭͢Δ  w-JOVY
    OBNFTQBDF
    wϗετͱಠཱͨ͠04ͱͯ͠ͷϦιʔεΛ࣋ͨͤΔ͜ͱ͕Ͱ͖Δɻ
 ྫ͑͹ɿ
    wϗετ໊
    w*1$ͷϦιʔε
    wωοτϫʔΫ IUUQTTQFBLFSEFDLDPNVE[VSBDSFBUJOHDPOUBJOFSTXJUIHPMBOH

43. ྫ
    ωοτϫʔΫ໊લۭؒ FUI EPDLFS WFUIIPTU WFUIHVFTU WFUIIPTU WFUIHVFTU WFUIIPTU WFUIHVFTU FH
    

    FH
        ඞཁʹԠ͡/"5ͳͲ /FUXPSL
    /BNFTQBDFʹΑΓɺ
    ίϯςφϓϩηε͕ϗετͱ͸ผͷ/*$*1ΛೝࣝͰ͖Δ ͻͱͭͷ)PTU CSJEHF

44. 04ϦιʔεΛ੍ݶ͢Δ wDHSPVQ
    $POUSPM
    (SPVQ
    wϓϩηεʢεϨουΛؚΉ৔߹΋͋ΔʣΛάϧʔϐϯάͯ͠ɺͦͷ୯ ҐͰϦιʔεͷར༻ঢ়گͳͲΛ੍ݶɺ͋Δ͍͸౷ܭ৘ใΛऔಘͰ͖Δ
    wDG
    VMJNJU 
    SMJNJU
    
    ϓϩηεʢࢠؚΉʣ୯Ґ
    w੍ݶͰ͖Δ΋ͷ
    $16ɺϝϞϦɺ*0ɺϓϩηε਺ͳͲ

45. ίϯςφͷϓϩηε਺Λ੍ݶ͢Δྫ w·ͨ͸
    GPSL
    CPNCରࡦ
    wEPDLFSͳΒ
    --pids-limit
    Ͱར༻ग़དྷΔ

46. ݖݶΛ੍ݶ͠ɺηΩϡΞʹ͢Δ w-JOVYΧʔωϧʹ͸͍͔ͭ͘ɺͦ͏͍͏࢓૊Έ͕ଘࡏ͠ɺͦΕΒ͕૊ Έ߹Θ͍ͬͯ͞Δɻ
    wSPPUͷݖݶΛ෼ׂ͠ɺҰ෦ͷΈΛ౉͢ʢ-JOVY
    DBQBCJMJUZʣ
    wγεςϜίʔϧͷݺͼग़͠ΛϑΟϧλʔ͢ΔʢTFDDPNQʣ
    wڧ੍ΞΫηε੍ޚʢ."$
    FH
    4&-JOVYɺ"QQ"SNPSʣ

47. ':*
    εΠενʔζϞσϧ wҰͭҰͭʹ͕ۭ͍͍݀ͯͨͱͯ͠΋ɺ
 ͨ͘͞ΜॏͶΔ͜ͱͰɺશͯͷ݀Λൈ͚Δ͜ͱ͸
 ඇৗʹ೉͘͠ͳΔɻ *NBHF
    $$
    IUUQTQJYBCBZDPNQ
    

48. ʮʓʓʯͨ͠ϓϩηε wίϯςφͷਖ਼ମ͸ɺ-JOVYΧʔωϧͷ༷ʑͳػೳΛ༻͍ͯɺ
    w04Ϧιʔεͷ෼཭
    w04Ϧιʔεͷར༻੍ݶ
    wݖݶͷߜΓࠐΈ
    wΛߦ͍ɺϗετͱಠཱ҆͠શͳঢ়ଶʹͨ͠ϓϩηεͰ͋Δͱݴ͑Δ

49. ࣮ࡍʹͲ͏ͳ͍ͬͯΔ͔
    ೷͍ͯΈ·͠ΐ͏

50. %PDLFS IUUQTXXXqJDLSDPNQIPUPT!/
    $$
    CZTB
    

51. %PDLFSͰίϯςφΛ࡞Ζ͏ w൚༻తͳ-JOVYʢࠓճ͸6CVOUV
    [FTUZʣͰ
    w%PDLFSΛೖΕɺίϯςφΛ࡞ͬͯΈΔ

52. ϓϩηε͕ग़དྷ্͕Δ wEPDLFSE

    
    a
    DPOUBJOFSE

    
    
    
    
    
    
    a
    SVOD

53. ϓϩηεͷؾ࣋ͪʹͳΔʹ͸ wQSPD
    ϑΝΠϧγεςϜ
    w೷͍ͯΈͨ͜ͱ͋Γ·͔͢ʁ

54. /BNFTQBDFΛ೷͍ͯΈΔ wQSPD1*%OT
    σΟϨΫτϦ
    wͦ͜ʹɺ/4Λදݱ͢ΔϑΝΠϧ΁ͷγϯϘϦοΫϦϯΫ͕͋Δɻ
    w௨ৗͷϓϩηεͱ͍ࠩͯ͠Δ΋ͷ͕ҧ͏ͱ
    Θ͔Δ %FGBVMU
    /BNFTQBDF $POUBJOFS
    /BNFTQBDF

55. ॴଐ͢ΔDHSPVQΛ೷͍ͯΈΔ wQSPD1*%DHSPVQ
    ʹ͋ΔʢWͷ৔߹ʣɻ
    wରԠ͢ΔDHSPVQΛ௚઀ૢ࡞͢Δ͜ͱ΋Ͱ͖ͨΓɻ

56. ݖݶ͕ߜΒΕ͍ͯΔͷΛ೷͍ͯΈΔ wQSPD1*%TUBUVT
    w$BQ
    ͱ͍͏ߦ͕ɺී௨ͷSPPUͱҧ͏ͱ֬ೝͰ͖Δ
    w͜ͷͦΕͧΕͷϏοτ͕ɺҰͭҰͭ$BQBCJMJUZʹରԠ %FGBVMU
    SPPU $POUBJOFS
    SPPU

57. ίϯςφͷػೳΛ୯ମͰ࢖͏͜ͱ΋Ͱ͖Δ wVOTIBSF 
    ίϚϯυͷྫ
    w1*%
    /BNFTQBDFɺ.PVOU
    /BNFTQBDFɺ654
    /BNFTQBDFΛ
 ෼཭ͨ͠৽͍͠γΣϧ্ཱ͕͕ͪΔɻ࣮ࡍɺQSPDͳͲΛϚ΢ϯτ͠ ௚͢ͱɺ1*%͕͔Βʹ
    wϗετ໊΋ಠཱ $ unshare

    --fork --pid --mount --uts

58. ίϯςφͷػೳΛ୯ମͰ࢖͏͜ͱ΋Ͱ͖Δ wDBQTI 
    ίϚϯυͷྫ
    w্ཱͪ͛ͨγΣϧͰ͸ɺ
    SPPU
    Ͱ͸͋Δ͕ϗετͷ࣌ؒͷૢ࡞ʹࣦഊ ͢ΔɻʮݖݶΛ੍ݶ͞ΕͨSPPUʯͱͳΔ $ sudo capsh --drop==cap_sys_time

    -- -l

59. ͜ͷষͷ·ͱΊ wίϯςφ͸ɺʮϗετ͔ΒϦιʔεΛ෼཭ɾ੍ݶ͠ɺݖݶΛߜͬͯ҆ શʹʯͨ͠ϓϩηεͰ͋Δɻ
    wͲͷΑ͏ͳ࣮૷ʢ%PDLFSɺ-9$ɺͦͷଞʣͰ΋ڞ௨ͯ͠ɺͦͷΑ͏ ͳϓϩηεΛ࡞ͬͯίϯςφͱ͍ͯ͠Δɻ

60. ίϯςφք۾ͷۙگ 

61. ίϯςφ͸ొ৔ਓ෺͕ଟ͗͢Δ w-JOVYΧʔωϧࣗମɺγεςϜίʔϧ
    w֤छίϯςφϥϯλΠϜ
    wΦʔέετϨʔγϣϯπʔϧ܈
    wΫϥ΢υαʔϏεͦͷଞ
    wͳͲͳͲ
    wˠશମ؍Λࣔͭͭ͠ɺ੔ཧ͠·͢

62. ίϯςφ͸ొ৔ਓ෺͕ଟ͗͢Δ w-JOVYΧʔωϧࣗମɺγεςϜίʔϧ
    w֤छίϯςφϥϯλΠϜ
    wΦʔέετϨʔγϣϯπʔϧ܈
    wΫϥ΢υαʔϏεͦͷଞ
    wͳͲͳͲ
    wˠશମ؍Λࣔͭͭ͠ɺ੔ཧ͠·͢ ͜ͷষ͸͜͜

63. ֤छίϯςφϥϯλΠϜͷొ৔ wίϯςφͷ࣮૷͸
    ࣮͸ͦΜͳʹ೉͘͠ͳ͍
    w؆୯ʹ෼ྨ͢Δͱ
    w6/*9తπʔϧʢDISPPU΍JQ
    OFUOTʣɺ-9$
    w%PDLFSϓϩδΣΫτͱ͔ͦ͜Βग़͖ͯͨ.PCZ
    wSLU΍$3*0ͳͲͷ։ൃɺͦΕʹ͙࣍3BJM$BS
    wࣗ෼ͷͨΊͷίϯςφʢKBJMJOHɺESPPUଞʣ

64. ֤छίϯςφϥϯλΠϜͷొ৔ wίϯςφͷ࣮૷͸
    ࣮͸ͦΜͳʹ೉͘͠ͳ͍
    w؆୯ʹ෼ྨ͢Δͱ
    w6/*9తπʔϧʢDISPPU΍JQ
    OFUOTʣɺ-9$
    w%PDLFSϓϩδΣΫτͱ͔ͦ͜Βग़͖ͯͨ.PCZ
    wSLU΍$3*0ͳͲͷ։ൃɺͦΕʹ͙࣍3BJM$BS
    wࣗ෼ͷͨΊͷίϯςφʢKBJMJOHɺESPPUଞʣ 0QFO$POUBJOFS
    *OJUJBUJWF
    ४ڌͷίϯςφͨͪ
    ʢ·ͨ͸ͦΕΛ໨ࢦ͢΋ͷʣ

65. ίϯςφͷඪ४Խ

66. ίϯςφͷඪ४Խ w0QFO
    $POUBJOFS
    *OJUJBUJWF IUUQTXXXPQFODPOUBJOFSTPSHɹ

67. 0QFO
    $POUBJOFS
    *OJUJBUJWF wίϯςφͷඪ४࢓༷Λࡦఆ͢ΔͨΊͷஂମ
    wϝϯόʔ͸$PSF04ɺ%PDLFSɺ3FE)BUɺ.JDSPTPGUɺ(PPHMF
    w%PDLFSͷ͍࣋ͬͯͨ࢓༷͕͜ͷஂମʹدଃ͞ΕɺͦΕΛ΋ͱʹ ೥݄ʹ0$*
    W͕ࡦఆ͞Εͨ
    wྫ͑͹ɺίϯςφ͕ຬͨ͢΂͖γεςϜతཁ݅ɺઃఆͰ͖Δ΂͖߲໨ɺ αϙʔτ͢ΔϥΠϑαΠΫϧɺΠϝʔδͷϑΥʔϚοτͳͲΛఆٛ IUUQTHJUIVCDPNPQFODPOUBJOFSTSVOUJNFTQFD
    

68. 0$*ͷن໿Λຬͨ͢ͱ wྫ͑͹ɺEPDLFSίϚϯυΛܦ༝ͯͦ͠ͷϥϯλΠϜΛ্ཱͪ͛ΒΕΔ
    wEPDLFS͔ΒσϑΥϧτͰ্ཱ͕ͪΔSVOD΋ɺ0$*४ڌͷίϯςφͷ Ұͭʹա͗ͳ͍ͱݟ၏͢͜ͱ͕Ͱ͖Δɻ
    w3BJMDBS
    ͷྫ $ dockerd ...--add-runtime "railcar=/path/to/railcar" $

    docker run -it --rm --runtime railcar hello

69. ΦʔέετϨʔγϣϯπʔϧͷོ੝ w,VCFSOFUFTͱ/PNBE͕୅දతɻ,VCFSOFUFT͕ͱʹ͔͘ڧ͍ɻ
 ଞʹɺ%PDLFS
    $PNQPTF4XBSNͳͲ΋ؚ·ΕΔ͔΋͠Εͳ͍ɻ
    w,VCFSOFUFTͱ/PNBE͸ɺ(PPHMFࣾͷࣾ಺ج൫ʮ#PSHʯΛϕʔεʹ ։ൃ͞Ε͍ͯΔɻ

70. DG
    *OGSBTUSVDUVSF
    BT
    $PEF w%ZOBNJD
    *OGSBTUSBDUVSF
    ͷίʔυԽͷ
 Ԇ௕ઢ্ʹɺίϯςφΠϯϑϥͷ
 ίʔυԽ͕͋Δ͔΋͠Εͳ͍ɻ
    IUUQNJ[[ZPSHCMPH

71. #PSH
    QBQFS wಛ௃ɺૂ͍ͳͲ
    w
    ϦιʔεϚωδϝϯτ΍ΤϥʔॲཧΛϢʔβ͔ΒӅ͢
    w
    ඇৗʹߴ͍৴པ౓΍Մ༻ੑ΍ఏڙ͢Δ
    w
    ਺ສ୆ͷϚγϯΛޮ཰Α͘࢖͍δϣϒΛ࣮ߦ͢Δ
    w43&ຊʹ΋ɺ#PSH΍#PSHNPOͷ࿩͕ग़͍ͯΔͦ͏
    w1BYPTͷ୅ΘΓʹ3BGU

    FUDE ɺ#PSHMFUͱ1PEͳͲɺӨڹ͕ਵॴʹ IUUQTTUBUJDHPPHMFVTFSDPOUFOUDPNNFEJBSFTFBSDIHPPHMFDPNKBQVCTBSDIJWFQEG

72. l,VCFSOFUFT
    USBDFT
    JUT
    MJOFBHF
    EJSFDUMZ
    GSPN
    #PSHz IUUQCMPHLVCFSOFUFTJPCPSHQSFEFDFTTPSUP LVCFSOFUFTIUNM
    

73. ίϯςφΞʔΩςΫνϟͷ
    ϨΠϠԽ

74. ίϯςφΞʔΩςΫνϟͷϨΠϠԽ w֤ॴͰఏҊ͕ࢼ͞Ε͍ͯΔɻ
    FH
    .PCZ
    1SPKFDU
    wίϯϙωϯτΛϥϯλΠϜɺΦʔέετϨʔγϣϯͳͲϨΠϠԽ͠ɺ
 ૊Έ߹Θ͍ͤͨ IUUQTNPCZQSPKFDUPSH

75. ྫ
    ϖύݚͷఏҊϞσϧ wετϥςδ૚ͷಋೖ
    w'BTU$POUBJOFSɺ
 3BODIFSͳͲͷҐஔ෇͚ IUUQTSBOEQFQBCPDPNBSUJDMFJPUNBUTVNPUPSZ
    

76. ૚ಉ࢜ͷ࢓༷ͷఆٛͷҰྫ w,VCFSOFUFTͷ$3*ͷྫ
    w
    Each container runtime has it own strengths
    w
    Kubelet

    communicates with the container runtime... over Unix sockets using the gRPC framework w$3*ʹԊ࣮ͬͯ૷͢Ε͹ɺྫ͑͹,VCFSOFUFTͷ্Ͱ)BDPOJXBΛಈ͔ ͢͜ͱ΋Ͱ͖ΔͰ͋Ζ͏ɻ IUUQCMPHLVCFSOFUFTJPDPOUBJOFSSVOUJNFJOUFSGBDFDSJJOLVCFSOFUFTIUNM
    

77. ͜ΕΒΛ౿·͑ͯ
    վΊͯ

78. ࠞಱͱ͢Δίϯςφؔ࿈ιϑτ΢ΣΞଞ EPDLFS SVOD DSJP MYD MYE SBJMDBS IBDPOJXB LVCFSOFUFT OPNBE

    VOTIBSF SLU TXBSN (,& .BHOVN DISPPU &$4 "$* SLUMFU SBODIFS NPCZ

79. ͷ͏ͪɺʮϥϯλΠϜʯͷօ͞Μ EPDLFS SVOD DSJP MYD MYE SBJMDBS IBDPOJXB LVCFSOFUFT OPNBE

    VOTIBSF SLU TXBSN (,& .BHOVN DISPPU &$4 "$* SLUMFU SBODIFS NPCZ

80. ϥϯλΠϜʹ΋
    ෼ྨ͕ඞཁ

81. վΊͯ
    EPDLFSE
    ͷϓϩηεπϦʔͷྫ /usr/bin/dockerd --debug -l debug -H fd:// --... \_ docker-containerd

    -l unix:///var/run/docker/... \_ docker-containerd-shim 95b86b... docker-runc \_ /bin/bash

82. /usr/bin/dockerd --debug -l debug -H fd:// --... \_ docker-containerd -l

    unix:///var/run/docker/... \_ docker-containerd-shim 95b86b... docker-runc \_ /bin/bash େ·͔ͳ໾ׂ෼୲ EPDLFSE
    IUUQ
    ϦΫΤετΛड͚औΔ

83. /usr/bin/dockerd --debug -l debug -H fd:// --... \_ docker-containerd -l

    unix:///var/run/docker/... \_ docker-containerd-shim 95b86b... docker-runc \_ /bin/bash େ·͔ͳ໾ׂ෼୲ EPDLFSE
    IUUQ
    ϦΫΤετΛड͚औΔ DPOUBJOFSE
    EPDLFSE͔ΒͷϦΫΤετΛड͚औΓ
 ίϯςφ؀ڥΛηοτΞοϓͯ͠
    DPOUBJOFSETIJN
    ʹ౉͢

84. /usr/bin/dockerd --debug -l debug -H fd:// --... \_ docker-containerd -l

    unix:///var/run/docker/... \_ docker-containerd-shim 95b86b... docker-runc \_ /bin/bash େ·͔ͳ໾ׂ෼୲ EPDLFSE
    IUUQ
    ϦΫΤετΛड͚औΔ DPOUBJOFSE
    EPDLFSE͔ΒͷϦΫΤετΛड͚औΓ
 ίϯςφ؀ڥΛηοτΞοϓͯ͠
    DPOUBJOFSETIJN
    ʹ౉͢ DPOUBJOFSETIJN
    ܾ·ͬͨϓϩτίϧͰ
    SVOD
    ଞϥϯλΠϜΛىಈ͢Δ

85. /usr/bin/dockerd --debug -l debug -H fd:// --... \_ docker-containerd -l

    unix:///var/run/docker/... \_ docker-containerd-shim 95b86b... docker-runc \_ /bin/bash େ·͔ͳ໾ׂ෼୲ EPDLFSE
    IUUQ
    ϦΫΤετΛड͚औΔ DPOUBJOFSE
    EPDLFSE͔ΒͷϦΫΤετΛड͚औΓ
 ίϯςφ؀ڥΛηοτΞοϓͯ͠
    DPOUBJOFSETIJN
    ʹ౉͢ DPOUBJOFSETIJN
    ܾ·ͬͨϓϩτίϧͰ
    SVOD
    ଞϥϯλΠϜΛىಈ͢Δ ίϯςφԽͨ͠ϓϩηεࣗମ

86. ͜͏͍͏࣮૷Λ౿·͑ͯ෼͚ͯΈͨ
    EPDLFSE
    
    DPOUBJOFSE
    
    NPCZ
    
    DPOUBJOFSE
    
    DSJP
    
    SLUMFU
    SVOD
    
    SLU
    
    SBJMDBS
    

    
    
    MYE
    MYD
    IBDPOJXB

87. ͜͏͍͏࣮૷Λ౿·͑ͯ෼͚ͯΈͨ %PDLFS
    "1*ɺ$3*ͳͲΛ
    ड͚औͬͯίϯςφͷͨΊͷ४උͱ
    ىಈϓϩηεΛ୲౰͢Δ
    EPDLFSE
    
    DPOUBJOFSE
    
    NPCZ
    
    DPOUBJOFSE
    
    DSJP
    
    SLUMFU

    
    SVOD
    
    SLU
    
    SBJMDBS
    
    
    MYE
    MYD
    IBDPOJXB ࣮ࡍʹɺΧʔωϧͷ
    γεςϜίʔϧΛݺͿͳͲͯ͠
    ίϯςφϓϩηεΛ࡞੒͢Δ

88. ͜͏͍͏࣮૷Λ౿·͑ͯ෼͚ͯΈͨ %PDLFS
    "1*ɺ$3*ͳͲΛ
    ड͚औͬͯίϯςφͷͨΊͷ४උͱ
    ىಈϓϩηεΛ୲౰͢Δ $PNNVOJDBUPS
    Ծ -PDBUFS
    Ծ
    EPDLFSE
    
    DPOUBJOFSE
    

    
    NPCZ
    
    DPOUBJOFSE
    
    DSJP
    
    SLUMFU
    SVOD
    
    SLU
    
    SBJMDBS
    
    
    MYE
    MYD
    IBDPOJXB ࣮ࡍʹɺΧʔωϧͷ
    γεςϜίʔϧΛݺͿͳͲͯ͠
    ίϯςφϓϩηεΛ࡞੒͢Δ

89. ͜ͷষͷ·ͱΊ wίϯςφʹؔ͢Δಈ͖͸ɺίϯςφࣗ਎ͷ࣮૷ͷ಺༰Χʔωϧత࿩ ୊ͱͱ΋ʹɺೋͭͷ఺Λԡ͑͞Δͱྑ͍ͩΖ͏ɻ
    w
    ίϯςφʹ͸ඪ४Խͷಈ͖͕͋Γɺඪ४ʹԊͬͯ໨తͷͨΊͷί ϯςφΛ࡞͍ͬͯ͘ಈ͖͕Մೳʹͳ͍ͬͯ͘
    w
    ίϯςφͷΤίγεςϜ͸ɺͦΕͧΕͷίϯϙωϯτ͕ϨΠϠԽ͞ Ε࣮ͯ૷͕ू໿͞Ε͍ͯ͘Ͱ͋Ζ͏ɻϨΠϠࣗମ΍ɺ,VCFSOFUFTͷ $3*ͷΑ͏ͳɺϨΠϠಉ࢜ͷΠϯλʔϑΣʔε΋੔උ͞ΕΔɻ͸ͣ

90. )BDPOJXBͷࠓޙ 

91. ຊ෦ձ͸ɺιϑτ։ൃεΩϧ͕اۀ಺ʹด͡ɺۀքશମͷεΩ ϧ޲্ʹͳ͓ͬͯΒͣɺ͔ͭɺ೔ຊൃͷάϩʔόϧڝۀྗͷ͋ Διϑτ͕গͳ͍ݱঢ়Λةዧ͠ɺ೔ຊͷಛ௃Λ׆͔ͨ͠044Ξ ϓϦέʔγϣϯΛ։ൃ͠ɺར༻ऀͷཱ৔ͰϏδωεϞσϧΛఏ Ҋͯ͠ɺ044ͷීٴɺ͓Αͼɺιϑτ։ൃऀͷεΩϧ޲্΁ͷ ߩݙΛ໨ࢦ͢΋ͷͰ͋Δ ΞϓϦέʔγϣϯ෦ձ
    ʮ໨తͱഎܠʯΑΓ

92. ϏζχεϞσΡ

93. ϩϦϙοϓʂ
    ϚωʔδυΫϥ΢υ

94. )BDPOJXBΛόοΫΤϯυʹ࠾༻ w΋ͱ΋ͱʮ1BB4ϗεςΟϯάΛ΋ͬͱ͍͍ײ͡ʹ͍ͨ͠ʯͱ͍͏
 Ϟνϕʔγϣϯ͔Β࢝·ͬͨ044Ͱ͋Δ͜ͱͱগͭ͠ͳ͕Δ
    w'BTU$POUBJOFSʴ)BDPOJXBͰɺ΍Γ͍ͨ8FCαʔϏεΛ࡞Δ IUUQTQFQBCPDPNOFXTQSFTT
    

95. ۝भେֶͱͷڞಉݚڀ

96. Ϋϥ΢υେن໛࣮ݧͷج൫ͱͯ͠ wlίϯςφܕԾ૝Խٕज़Λج൫ʹ༻͍ͨΫϥ΢υϗεςΟϯάʹؔ͢ Δڞಉݚڀ։ൃΛ։࢝z
    w΋ͪΖΜɺ͜ͷ
    lίϯςφܕԾ૝Խٕज़z
    ͷॏཁͳҰ୺͕)BDPOJXB
 Ͱ͋Δʂʂʂ̍
    ʢઌड़ͷϚωʔδυΫϥ΢υͷԠ༻ͳͷͰʣ
    wৄࡉ͸ϓϨεϦϦʔε
    Ͱɻࠓޙ΋΍͍͖ͬͯ·͢
    IUUQTQFQBCPDPNOFXTQSFTT
    
    
    
    
    
    IUUQTXXXLZVTIVVBDKQG@@QEG
    

97. )BDPOJXB
    ͷ
    ໨ࢦ͢ੈք

98. ࠶ܝ%PDLFS0$*
    ͳͲͷํ޲ੑ w͜͜·ͰͷൺֱͰɺ%PDLFSͳͲͱ)BDPOJXBͷҧ͍Λྻڍͨ͠
    wݸਓతʹɺ%PDLFSͷ໨ࢦ͢ํ޲͸ʮ7.ͷ࠶ൃ໌ʯతʹࢥ͑Δ
    wϢʔβʔ͔ΒɺʮԾ૝؀ڥʯͷৄࡉ͸Ӆ͞Ε͍ͯͯɺ
 ܾ·ͬͨ"1*Λܦ༝ͯ͠σϓϩΠɾΦʔέετϨʔγϣϯΛߦ͏
    wDG
    ,VCFSOFUFT#PSH
    ʢ͜Ε΋ޙड़ʣ
    wͦ͏͍͏ந৅Խࣗମ͸ɺҰͭͷํ޲ੑͰ͸͋Δ ΤίγεςϜͷಈ͖͸ɺ
    ͜͜Λิڧ͍ͯ͠Δͱ
    ཧղ͢ΔͱΘ͔Γ΍͍͢͸ͣ

99. ࠶ܝ$POUBJOFS
    &DPTZTUFN
    BT
    $PEF w)BDPOJXB
    ͱɺͦͷपลͰ໨ࢦ͍ͨ͠ͱ͜Ζ
    wجຊతͳϦιʔεׂ౰΍ݖݶ෼཭ͳͲͷઃఆ͸ίʔυԽͰ͖Δ
    w·ͨɺଞͷϥϯλΠϜͱൺ΂ͯ΋๛෋ͳϑοΫΛ༻ҙ͠ɺίϯςφͷ ৼΔ෣͍ɾϥΠϑαΠΫϧΛίʔυԽͰ͖Δ
    w͔͜͜ΒɺίʔυԽͷൣғΛ޿Ί͍͖͍ͯͨɻ
 ྫ͑͹ωοτϫʔΫ૚΍ɺ04ͷηΩϡϦςΟɾ؂ࠪͷ࢓૊Έʢ-JOVY ͷ-4.ʣͳͲ΋ίʔυԽͷൣғʹͰ͖ͳ͍͔ʁ

100. ࠓίʔυԽ͍ͯ͠Δͱ͜Ζ Χʔωϧࣗମ Χʔωϧ֦ுͳͲ γεςϜίʔϧ /BNFTQBDF DHSPVQ $BQBCJMJUZ DISPPU౳ TFDDPNQ 

     )PPLT /FUXPSL
     ؔ࿈ઃఆ ΦʔέετϨʔγϣϯ૚ͱͷ࿈ܞ )BDPOJXB
     %4-

101. ͜Ε͔Β Χʔωϧࣗମ Χʔωϧ֦ுͳͲ γεςϜίʔϧ /BNFTQBDF DHSPVQ $BQBCJMJUZ DISPPU౳ TFDDPNQ 

     )PPLT /FUXPSL
     ؔ࿈ઃఆ ΦʔέετϨʔγϣϯ૚ͱͷ࿈ܞ ίʔυԽͰ͖Δ
     ൣғΛ૿΍͢
     ίϯςφϋοΫ
 ͷͨΊͷ
     ೖΓޱʹ

102. ΍͍͖͍ͬͯͨ w҆ఆԽʂʢಛʹɺUISFBEपΓʣ
     wωοτϫʔΫपΓͷ%4-ͷ࣮૷
     w0$*΁ͷରԠʢίϚϯυϓϩτίϧɺΠϝʔδαϙʔτଞʣ
     w)551
     "1*ϨΠϠ
     
     $PNNVOJDBUPS૚ͷಋೖ
     w)BDPOJXBपลͷ-JOVY֦ுͷ࣮૷ʢQSPDGTతͳ)BDPOJXBGTͱ͔ɺ )BDPOJXBʹ౷߹͞Εͨ-4.Έ͍ͨͳͷΛ૝૾தʣ

103. ऴΘΓʹ 

104. ϑΫΦΧ3VCZେ৆Ͱޠͬͨ͜ͱ wंྠͷ࠶ൃ໌ΛڪΕ͗͢ͳ͍͜ͱ

105. ࣗ෼ͷதʹ
     นΛ࡞Βͳ͍
     Ұาઌʹ౿ΈࠐΉ

106. ຊ౰ͷ͜ͱΛ
     ஌Γ͚ͨΕ͹
     खΛಈ͔͔͢͠ͳ͍ʂ

107. 13 9

108. ίϯςφ௿ϨΠϠͷ࢓ࣄ
     ෱ԬͰͷࠊΛਾٕ͑ͨज़త੒௕
     ͝ڵຯ͕͋Ε͹
     ͬͦ͜Γ͝૬ஊʹ৐Γ·͢