論文紹介：Weight Uncertainty in Neural Networks

2016/11/14/の論文紹介ゼミで使用したスライドです．
論文： C. Blundell, J. Cornebise, K. Kavukcuoglu, and D. Wierstra, “Weight Uncertainty in Neural Networks,” In Proceedings of the 32nd International Conference on Machine Learning (ICML 2015), May 2015.

http://jmlr.org/proceedings/papers/v37/blundell15.html

Transcript

1. ࿦จ঺հ $
   #MVOEFMM
   +
   $PSOFCJTF
   ,
   ,BWVLDVPHMV
   BOE
   %
   8JFSTUSB
   l8FJHIU
   6ODFSUBJOUZ
   JO
   /FVSBM
   /FUXPSLT z
   *O
   1SPDFFEJOHT
   PG
   UIF
   OE
   *OUFSOBUJPOBM
   $POGFSFODF
   PO
   .BDIJOF
   -FBSOJOH *$.-
   
   .BZ
    ੪౻ ᠳଡ ೥݄೔
2.  • $
   #MVOEFMM
   +
   $PSOFCJTF
   ,
   ,BWVLDVPHMV
   BOE
   %
   8JFSTUSB
   l8FJHIU
   6ODFSUBJOUZ
   JO
   /FVSBM
   /FUXPSLT z
   *O
   1SPDFFEJOHT
   PG
   UIF
   OE
   *OUFSOBUJPOBM
   $POGFSFODF
   PO
   .BDIJOF
   -FBSOJOH
   *$.-
   
   .BZ
    • ޯ഑ʹϊΠζΛ৐ͤΔख๏ͷ࿦จʹͯɼ ઌߦݚڀͷͭͱͯ͠ڍ͛ΒΕ͍ͯͨͨΊ • ଔۀݚڀʹ͓͍ͯ΋ɼ͜ͷ࿦จͷߟ͑ํ͕ ࢖͑ΔͷͰ͸ͱײͨͨ͡Ί จݙ৘ใɾ͜ͷ࿦จΛબΜͩཧ༝ 
3.  •χϡʔϥϧωοτϫʔΫͷॏΈΛ ֬཰ม਺ͱͯ͠ଊ͑ɼͦͷ֬཰෼෍Λ ֶश͢ΔΞϧΰϦζϜΛఏҊ • ͜ͷΞϧΰϦζϜΛ#BZFT
   CZ
   #BDLQSPQ ͱݺͿ •पล໬౓Λ࠷খԽ͢Δ͜ͱʹΑͬͯɼ ॏΈΛਖ਼ଇԽ •./*45ʹΑΔ࣮ݧͰ͸ɼ%SPQPVUʹ ඖఢ͢Δਖ਼ଇԽੑೳΛ࣋ͭ •͞ΒʹڧԽֶशͷλεΫʹ΋࢖༻  ֓ཁ
4.  •ॱ఻ൖܕͷ//͸աֶशΛى͜͠΍͍͢ • τϨʔχϯάσʔλͷෆ࣮֬ੑΛਖ਼͘͠ ධՁͰ͖ͳ͍͜ͱ͕ݪҼ •ωοτϫʔΫͷॏΈʹෆ࣮֬ੑΛಋೖ • ม෼ϕΠζֶश Λ༻͍ͯωοτ ϫʔΫΛֶश  *OUSPEVDUJPO
5.  •֤ॏΈͷઁಈͷେ͖͞΋ֶश͞ΕΔ • #BZFT
   CZ
   #BDLQSPQ͸୯Ұͷ ωοτϫʔΫΛֶश͢Δ͔ΘΓʹɼ ΞϯαϯϒϧΛֶश͢Δ • ଞͷΞϯαϯϒϧख๏ͱൺֱͯ͠ɼ ύϥϝʔλ਺ͷ૿Ճྔ͕ഒͰࡁΉ •ෆภੑΛ࣋ͭϞϯςΧϧϩਪఆʹΑͬͯ ޯ഑Λਪఆ • ਪఆͨ͠ޯ഑ͰΞϯαϯϒϧΛֶश  *OUSPEVDUJPO
6.  • ɿ//ͷ֬཰Ϟσϧ • ɿೖྗσʔλ • ɿਖ਼ղϥϕϧ • ɿωοτϫʔΫͷॏΈ •෼ྨ໰୊Ͱ͋Ε͹ɼ ͸ΧςΰϦͷू߹ • ͸ΧςΰϦͷ֬཰෼෍ •ճؼ໰୊Ͱ͋Ε͹ɼ • ͸ਖ਼ن෼෍ ೋ৐ଛࣦʹରԠ  1PJOU
   &TUJNBUFT
   PG
   /FVSBM
   /FUXPSLT P( y | x , w ) y 2 Y x 2 Rp w Y P( y | x , w ) Y 2 R P( y | x , w )
7.  •ॏΈ ͸࠷໬ਪఆ .-& ͰֶशͰ͖Δ •τϨʔχϯάηοτ ʹର͠ɼ ࠷໬ਪఆʹΑͬͯಘͨॏΈ ͸࣍ࣜ • ͸ޯ഑߱Լ๏ͰಘΔ͜ͱ͕Ͱ͖Δ • ޡࠩٯ఻ൖ͕࢖༻Մೳ  1PJOU
   &TUJNBUFT
   PG
   /FVSBM
   /FUXPSLT w D = ( xi, yi )i wMLE wMLE = arg max w log P ( D|w ) = arg max w X i log P (yi | xi, w) wMLE ʹΑͬͯ ෼෍͸ҟͳΔ w
8.  •ਖ਼ଇԽ͸ࣄલ෼෍ Λஔ͖ɼ ࣄޙ֬཰͕࠷େͱͳΔॏΈ Λ ٻΊΕ͹Α͍ •ࣄલ෼෍ʹΑͬͯɼਖ਼ଇԽͷछྨ͕มԽ • ਖ਼ن෼෍ͳΒ-ਖ਼ଇԽ PS
   8FJHIU
   %FDBZ • ϥϓϥε෼෍ͳΒ-ਖ਼ଇԽ  1PJOU
   &TUJNBUFT
   PG
   /FVSBM
   /FUXPSLT P(w) wMAP wMAP = arg max w log P ( w|D ) = arg max w log P ( D|w ) + log P ( w )
9.  •ςετσʔλ ʹର͢Δະ஌ͷϥϕϧ ͷ༧ଌ͸࣍ࣜ •ॏΈͷࣄޙ෼෍ ͷ΋ͱͰ ظ଴஋ΛऔΔ͜ͱ͸ɼແݶͷ਺ͷ//ͷ ΞϯαϯϒϧΛߟ͑Δ͜ͱͱ౳͍͠ •ͦ͜Ͱม෼ۙࣅΛֶशʹ࢖༻ • ม෼ϕΠζֶश  #FJOH
   #BZFTJBO
   CZ
   #BDLQSPQBHBUJPO ˆ x ˆ y P(ˆ y |ˆ x ) = E P (w|D) [P(ˆ y |ˆ x , w )] P(w|D)
10.  •ม෼ ϕΠζ ֶशͱ͸ɼਅͷࣄޙ෼෍ ͱ,-%JWFSHFODF͕࠷খͱͳΔ ෼෍ ͷύϥϝʔλ ΛٻΊΔ͜ͱ  #FJOH
    #BZFTJBO
    CZ
    #BDLQSPQBHBUJPO P(w|D) q(w|✓) ✓⇤ ✓⇤ = arg min ✓ KL[q(w|✓)kP(w|D)] = arg min ✓ Z q ( w|✓ ) log q ( w|✓ ) P ( w ) P ( D|w ) d w = arg min ✓ KL[q(w|✓)kP(w)] E q(w|✓)[log P ( D|w )]
11.  •มܗͯ͠ಘͨ࣍ࣜ͸ɼࣗ༝ΤωϧΪʔ ͋Δ͍͸ظ଴Լݶͱͯ͠஌ΒΕ͍ͯΔ •͜ͷؔ਺ Λෳࡶ౓ίετͱݺͿ • σʔλ ͷෳࡶ͞ͱࣄલ֬཰ ͷ ୯७͞ͷτϨʔυΦϑΛද͍ͯ͠Δ • ͷ࠷খ஋ΛղੳతʹٻΊΔ͜ͱ ͸Ͱ͖ͳ͍ͷͰɼޯ഑ۙࣅ͕ඞཁ  #FJOH
    #BZFTJBO
    CZ
    #BDLQSPQBHBUJPO E q(w|✓)[log P ( D|w )] F(D, ✓) = KL[q(w|✓)kP(w)] F(D, ✓) D P(w) F(D, ✓)
12.  f  
    6OCJBTFE
    .POUF
    $BSMP
    HSBEJFOUT Λ֬཰ີ౓ؔ਺ ʹै͏֬཰ม਺ ͱ͠ɼ Λܾఆ࿦తͳؔ਺ͱ͢Δɽ ͱ͓͖ɼ ͷपลີ౓ؔ਺ ͕ Λຬͨ͢ͱԾఆ͢Ε͹ɼ ͷ ʹର͢Δಋؔ਺ʹ͍͕ͭͯ࣍੒ཱ 1SPQPTJUJPO
     ✏ q(✏) t(✓, ✏) w = t(✓, ✏) w q(w|✓) q(✏)d✏ = q(w|✓)dw @ @✓ E q(w|✓) [f(w, ✓)] = E q(✏) h@f(w, ✓) @w @w @✓ + @f(w, ✓) @✓ i w
13.  • ͸ύϥϝʔλͷͳ͍ϊΠζ ͷ αϯϓϧͱม෼ࣄޙ෼෍ͷύϥϝʔλ Λม׵͢Δؔ਺ • ม׵ʹ͸ม෼ࣄޙ෼෍ͷαϯϓϧΛ࢖༻ •Ҏޙɼਖ਼ن෼෍Λ༻͍ͨ৔߹Λߟ͑Δ  
    6OCJBTFE
    .POUF
    $BSMP
    HSBEJFOUT ✏ ✓ t(✓, ✏)
14.  •ෳࡶ౓ίετͷ࠷దԽʹ1SPQPTJUJPO Λద༻ •ؔ਺ Λ࣍ࣜͱ͢Δ • ͜ͷΑ͏ʹ͓͚͹ɼ1SPQPTJUJPOͷࠨลͷ ظ଴஋͕ෳࡶ౓ίετ ͱҰக •ظ଴஋ܭࢉͷͨΊʹϞϯςΧϧϩ๏Λ ༻͍Δ • ม෼ϕΠζਪ࿦ͷͨΊͷޡࠩٯ఻ൖ ΞϧΰϦζϜΛಘΔ -F$VO ͳͲ  
    6OCJBTFE
    .POUF
    $BSMP
    HSBEJFOUT f ( w, ✓ ) = log q ( w|✓ ) log P ( w ) P ( D|w ) f(w, ✓) F(D, ✓)
15.   
    6OCJBTFE
    .POUF
    $BSMP
    HSBEJFOUT •ϞϯςΧϧϩਪఆʹΑͬͯɼۙࣅ͞Εͨ ෳࡶ౓ίετ ͸࣍ࣜ •ۙࣅͨ͠ίετͷ֤߲͸ม෼ࣄޙ෼෍ ͔Βಋ͔ΕΔॏΈʹґଘ͍ͯ͠Δ •$PNNPO
    3BOEPN
    /VNCFSTͱݺ͹Ε Δ෼ࢄݮগख๏ͷͭ F(D, ✓) F ( D, ✓ ) ⇡ n X i=1 log q ( w(i)|✓ ) log P ( w(i) ) log P ( D|w(i) )
16.  •ม෼ࣄޙ෼෍͕ର֯੒෼ͷΈͷਖ਼ن෼෍ ͱԾఆ •ඪ४ภࠩΛ ͱ͢Δ ͜ͱͰɼඪ४ภࠩ͸ৗʹඇෛ • ม෼ࣄޙ෼෍ͷύϥϝʔλ͸ •ॏΈ ͸࣍ࣜͰαϯϓϦϯά͞ΕΔ  
    (BVTTJBO
    WBSJBUJPOBM QPTUFSJPS = log(1 + exp( ⇢ )) ✓ = (µ, ⇢) w w = t ( ✓, ✏ ) = µ + log(1 + exp( ⇢ )) ✏
17.   
    (BVTTJBO
    WBSJBUJPOBM QPTUFSJPS 1SPQPTJUJPO ΑΓಋग़
18.  •4FDUJPOͷߋ৽ϧʔϧʹΑͬͯɼ ॏΈͷࣄલ෼෍ɾࣄޙ෼෍͸௚઀ߋ৽ ͤ͞Δ͜ͱ͸ͳ͘ͳͬͨ •ࣄલ෼෍ ͷܾఆʹɼTDBMF NJYUVSFΛಋೖ •ࣄલ෼෍ͷϋΠύʔύϥϝʔλ͸Ϋϩε όϦσʔγϣϯͰܾΊͨ΄͏͕ྑ͍ • ֶशதʹߋ৽͢Δͱܦݧ෼෍ʹϋϚΓ ਅͷσʔλ෼෍ΛֶशͰ͖ͳ͍৔߹͕͋Δ  
    4DBMF
    NJYUVSF
    QSJPS P(w)
19.  •ͭͷਖ਼ن෼෍Λ4DBMF
    NJYUVSF͢Δ • ͸ωοτϫʔΫͷK൪໨ͷॏΈ •ֶशσʔλʹ߹Θͤͨࣄલ෼෍ͷઃఆΛ ͢Δඞཁ͕ͳ͘ͳͬͨ • ࠓ·Ͱ͸ܦݧ෼෍ʹϋϚΒͳ͍Α͏ʹઃఆ ͢Δඞཁ͕͋ͬͨ  
    4DBMF
    NJYUVSF
    QSJPS P(w) = Y j ⇡N(wj |0, 2 1 ) (1 ⇡)N(wj |0, 2 2 ) ( 1 > 2) wj
20.  •ෳࡶ౓ίετ ͸ϛχόονͰͷ ࠷దԽʹద͍ͯ͠Δ •(SBWFT  ͸ϛχόον͝ͱͷίε τΛ࠷খԽ͢Δํ๏ΛఏҊ͍ͯ͠Δ • ͸αϒηοτͷݸ਺ •  
    .JOJCBUDIFT BOE
    ,-
    SFXFJHIUJOH F(D, ✓) FEQ i (Di, ✓) = 1 M KL[q(w|✓)kP(w)] E q(w|✓)[log P ( Di |w )] M X i FEQ i (Di, ✓) = F(D, ✓)
21.  •ॏΈ෇͚ͷํ๏͸ଞʹ΋͋Δ • ྫ͑͹ • • ࠷ॳͷ͏ͪ͸ॏΈ͕ߋ৽͞ΕͮΒ͍  
    .JOJCBUDIFT BOE
    ,-
    SFXFJHIUJOH F⇡ i (Di, ✓) = ⇡iKL[q(w|✓)kP(w)] E q(w|✓)[log P ( Di |w )] ⇡ 2 [0, 1]M , M X i=1 ⇡i = 1 E M [F⇡ i (Di, ✓)] = F(D, ✓) ⇡i = 2M i 2M 1
22.  •$POUFYUVBM
    #BOEJUTͱ͸Ӭଓతͳঢ়ଶ Λ࣋ͨͳ͍γϯϓϧͳڧԽֶशͷ໰୊ •֤εςοϓʹ͓͍ͯɼΤʔδΣϯτʹ ͕࣍༩͑ΒΕΔ • ίϯςΩετ • ݸͷத͔Βબ୒͞Εͨߦಈ •ҟͳΔߦಈʹΑͬͯใु ͕༩͑ΒΕΔ •ΤʔδΣϯτ͸ใुΛ࠷େԽ͢ΔΑ͏ʹ ߦಈΛબ୒  
    $POUFYUVBM
    #BOEJUT x K a r
23.  •ίϯςΩετ͸ɼҎલͷΞΫγϣϯɼ ใुɼίϯςΩετͱ͸ಠཱͯ͠ఏࣔ • 
    ΤʔδΣϯτ͕ߏங͢Δ ใुͷ֬཰෼෍ • ͜ΕΛ༻͍ͯɼ࣍ͷΞΫγϣϯΛબ୒ • બ୒͠ͳ͔ͬͨߦಈʹର͢Δใु͸ෆ໌ • ΦϯϥΠϯͰϞσϧΛ܇࿅ • ୳ࡧΛ͠ͳ͍ݶΓɼ४࠷దʹߦಈ  
    $POUFYUVBM
    #BOEJUT P ( r | x, a, w)
24.  • ͸//ͰϞσϧԽՄೳ •5IPNQTPO
    4BNQMJOH • ׆༻ ϕετͳߦಈΛͱΔ͜ͱ ͱ ୳ࡧ ࠷దͰ͸ͳ͍ߦಈΛͱΔ͜ͱ ͷ ͲͪΒͷߦಈΛऔΔ͔બͿํ๏ • 
    ϞσϧύϥϝʔλΛηοτˠ 
    ظ଴͞ΕΔใु͕ߴ͍ߦಈΛબ୒ˠ 
    ϞσϧύϥϝʔλΛΞοϓσʔτˠ΁ • ϞσϧύϥϝʔλͷϕΠζతॲཧ͕ඞཁ  5IPNQTPO
    4BNQMJOH
    GPS
    /FVSBM
    /FUXPSLT P ( r | x, a, w)
25.  •4FDʹج͍ͮͨ5IPNQTPO
    4BNQMJOH
    
    
    
    
    
    
     5IPNQTPO
    4BNQMJOH
    GPS
    /FVSBM
    /FUXPSLT
26.  •͸͡Ίͷ͏ͪ͸ɼม෼ࣄޙ֬཰͸ લͷঢ়ଶʹ͍ۙ • ߦಈ͸Ұ༷ʹબ͹ΕΔ •ΤʔδΣϯτ͕ߦಈ͍ͯ͘͠͏ͪʹ ม෼ࣄޙ֬཰͕ऩଋ͠͸͡ΊΔ • ใु͕ߴ͔ͬͨߦಈʹߜΒΕ͍ͯ͘ • ߦಈબ୒͕ΑΓܾఆ࿦తʹมԽ  5IPNQTPO
    4BNQMJOH
    GPS
    /FVSBM
    /FUXPSLT
27.  •ม෼๏͸ෆ࣮֬ੑΛաখධՁ͕ͪ͠ͳ ͜ͱ͕஌ΒΕ͍ͯΔ • ୳ࡧ͕ෆे෼Ͱૣظऩଋʹͭͳ͕ΔڪΕ •͔͠͠ɼࠓճͷ࣮ݧͰ͸ૣظऩଋ͸ɼ ݟΒΕͳ͔ͬͨ  5IPNQTPO
    4BNQMJOH
    GPS
    /FVSBM
    /FUXPSLT
28.  •࣮ݧͰߦͬͨλεΫ͸ͭ • ./*45෼ྨ • ඇઢܗճؼ • $POUFYUVBM
    #BOEJUT  
    &YQFSJNFOUT
29.  •ڞ௨ઃఆ • લॲཧ 
    ϐΫηϧ஋ΛͰׂ͓ͬͯ͘ • ӅΕ૚ 
    ૚ • ׆ੑԽؔ਺ 
    3F-6 • CBUDITJ[F 
     • ֶश཰ 
    ɼɼ͔Βબ୒  
    $MBTTJGJDBUJPO
    PO
    ./*45
30.  •#BZFT
    CZ
    #BDLQSPQͷઃఆ • αϯϓϧ਺ 
    
    
    
    ͔Βબ୒ • 4DBMF
    .JYUVSFͷॏΈК
    
    ¡ɼ¢ɼ£
    ͔Βબ୒ • 4DBMF
    .JYUVSFͰ༻͍Δ෼෍ͷ෼ࢄ 
     
    $MBTTJGJDBUJPO
    PO
    ./*45 log 1 2 { 0 , 1 , 2 } log 2 2 { 6 , 7 , 8 }
31.   
    $MBTTJGJDBUJPO
    PO
    ./*45 • ˒͖ͭ͸ͭͷ ωοτϫʔΫΛ Ξϯαϯϒϧ
32.  •4DBMF
    .JYUVSFΛೖΕͨ#BZFT
    CZ
    #BDLQSPQͱ4(% %SPQPVU )JOUPO FU
    BM ͕ಉఔ౓ͷੑೳʢ5FTU
    &SSPS
    
    ʣ •4(% %SPQPVU )JOUPO
    FU
    BM ͸ ສσʔλશͯΛֶशʹճ͍ͯ͠Δ •#BZFT
    CZ
    #BDLQSPQ͸ສσʔλ͔͠ ࢖͍ͬͯͳ͍͕ಉఔ౓ͷੑೳ͕ग़͍ͯΔ  
    $MBTTJGJDBUJPO
    PO
    ./*45
33.   
    $MBTTJGJDBUJPO
    PO
    ./*45 •ӅΕ૚ 
    ૚ •Ϣχοτ਺͸શͯ
34.  •4(%͸࠷΋ૣ͘ऩଋ • ૣ͍ஈ֊Ͱ௿͍ΤϥʔΛه࿥ͯ͠ɼ Ҏޙ͸աֶश •%SPQPVUͱ#BZFT
    CZ
    #BDLQSPQ͕ ಉ༷ʹऩଋ •#BZFT
    CZ
    #BDLQSPQ͸%SPQPVUͷ ໿ഒ͕͔͔࣌ؒΔ • ͔͠͠ɼFQPDIޙ͸%SPQPVUΑΓ ༏ΕͨςετΤϥʔʹऩଋ  
    $MBTTJGJDBUJPO
    PO
    ./*45
35.  • ֶशޙͷॏΈͷ෼෍ΛώετάϥϜͰදࣔ  
    $MBTTJGJDBUJPO
    PO
    ./*45
36.  •%SPQPVU΍#BZFT
    CZ
    #BDLQSPQͰ ਖ਼ଇԽ͞ΕͨωοτϫʔΫ • θϩ͕த৺Ͱ͋Δ͜ͱ͸4(%ͱಉ༷ • ෼෍ͷ੄ ෼ࢄ ͕େ͖͘ͳ͍ͬͯΔ •#BZFT
    CZ
    #BDLQSPQ͸࠷େͷൣғͷ ॏΈΛ࢖༻͍ͯ͠Δ  
    $MBTTJGJDBUJPO
    PO
    ./*45
37.  •ωοτϫʔΫͷ৑௕ੑΛௐ΂ΔͨΊʹ ॏΈͷม෼ࣄޙ෼෍Λθϩʹݻఆ •܇࿅ࡁΈͷωοτϫʔΫʹର͠ɼ ॏΈΛ4/ൺ ʹม׵ •࠷খͷ4/ൺͰॏΈΛআڈ •ॏΈΛऔΓআ͍ͯ΋ੑೳ͸ ΄ͱΜͲมΘΒͳ͍  
    $MBTTJGJDBUJPO
    PO
    ./*45 (|µi |/ i)
38.  •ӅΕ૚ɿ૚ •Ϣχοτ਺ɿݸ  
    $MBTTJGJDBUJPO
    PO
    ./*45
39.  •5BCMFͷݕূʹ͍ͭͯɼ 4/ൺͱີ౓ΛάϥϑԽ  
    $MBTTJGJDBUJPO
    PO
    ./*45 
    $VUPGG
40.  •5BCMFͷݕূʹ͍ͭͯɼ 4/ൺͱ$%' ྦྷੵີ౓ ΛάϥϑԽ  
    $MBTTJGJDBUJPO
    PO
    ./*45 
    $VUPGG
41.  •ͷΧοτΦϑ͕ͭͷϐʔΫΛ ෼཭͢Δ •5BCMF͔Β΋ͷΧοτΦϑ͔Β ੑೳͷ௿Լ͕࢝·Δ͜ͱ͕Θ͔Δ •4/ൺʹΑΔώϡʔϦεςΟοΫ͕ ςετੑೳʹӨڹΛٴ΅͍ͯ͠Δ •ଞͷݚڀʹൺ΂ͯɼੑೳΛམͱ͢͜ͱ ͳ͘ଟ͘ͷॏΈΛফڈͰ͖Δ  
    $MBTTJGJDBUJPO
    PO
    ./*45
42.  •ϊΠζ͕ૠೖ͞Ε͍ͯΔ࣍ͷۂઢΛֶश •ೋ৐ޡࠩΛ࠷খԽ͢ΔλεΫ •σʔλ͕গͳ͍۠ؒʹେ͖ͳҧ͍ • #BZFT
    CZ
    #BDLQSPQ͸෼ࢄ͕޿͕Δ • ௨ৗͷ//͸σʔλ఺͕গͳ͍৔߹΋ ෼ࢄΛখ͘͞͠Α͏ͱ͢Δ  
    3FHSFTTJPO
    DVSWFT y = x + 0 . 3 sin(2 ⇡ ( x + ✏ )) + 0 . 3 sin(4 ⇡ ( x + ✏ )) + ✏ ✏ ⇠ N(0, 0.02)
43.  •੺ઢ 
    ਪఆͷฏۉɼ੨ࢵ 
    ࢛෼Ґൣғ  
    3FHSFTTJPO
    DVSWFT
44.  •6$*
    .VTISPPNTσʔληοτΛ࢖༻ • ֤Ωϊίʹ͸৯༻ಟੑͷϥϕϧ͕෇༩ •ΤʔδΣϯτͷΞΫγϣϯ͸ ΩϊίΛ৯΂Δ͔ɼ৯΂ͳ͍͔ • ৯༻ΩϊίΛ৯΂Δͱ ͷใु • ಟੑΩϊίΛ৯΂ΔͱͰͷใुɼ ͦΕҎ֎͸  • ৯΂ͳ͍৔߹ɼใु͸θϩ  
    #BOEJUT
    PO
    .VTISPPN
    5BTL
45.  •৯༻Ωϊίͷظ଴஋͸  •ಟੑΩϊίͷظ଴஋͸ •ϦάϨοτ͸ΦϥΫϧͷใुͱ ΤʔδΣϯτͷใुͷࠩͰଌఆ • ΦϥΫϧ͕৯༻ΩϊίΛ৯΂Δͱ ͷใु • ΦϥΫϧ͕ಟੑΩϊίΛ৯΂Δͱͷใु •ӅΕ૚૚ Ϣχοτ਺ݸ ͷ//Λ ࢖༻  
    #BOEJUT
    PO
    .VTISPPN
    5BTL
46.  •ϦάϨοτͷྦྷੵ࿨ΛάϥϑԽ  
    #BOEJUT
    PO
    .VTISPPN
    5BTL
47.  •ᩦཉ๏Ͱߦಈ͢ΔΤʔδΣϯτ͸ɼ ࠷ॳΩϊίΛ৯΂Α͏ͱ͠ͳ͍ • σʔλ͕ͦΖ͏ͱ 4UFQ΄Ͳ ΩϊίΛ৯΂࢝ΊɼϦάϨοτͷ্ঢ͕ খ͘͞ͳΔ •#BZFT
    CZ
    #BDLQSPQͷΤʔδΣϯτ͸ɼ ͸͡Ί͔ΒΩϊίΛ৯΂Δ • ΄΅ϑϥοτͳϦάϨοτͰऩଋ  
    #BOEJUT
    PO
    .VTISPPN
    5BTL
48.  •#BZFT
    CZ
    #BDLQSPQͱ͍͏ॏΈʹ ෆ࣮֬͞Λ࣋ͭ//Λֶश͢Δ ΞϧΰϦζϜΛఏҊ •./*45Ͱ͸%SPQPVUͱಉఔ౓ͷੑೳ •ඇઢܗճؼͰ͸ෆ࣮֬ੑʹΑͬͯσʔλ ͷগͳ͍۠ؒͰ߹ཧతͳ༧ଌ͕Մೳʹ •$POUFYUVBM
    #BOEJUTͰ͸ɼ୳ࡧͱ׆༻ ͷτϨʔυΦϑΛࣗಈతʹֶश  
    %JTDVTTJPO
49.  •#BZFT
    CZ
    #BDLQSPQ͸ɼγϯϓϧͳ ޯ഑ߋ৽Λ࢖͍ͬͯΔ • ඇಉظॲཧ΍෼ࢄॲཧͰεέʔϧ͠΍͍͢ • (16Ͱ༰қʹ࣮૷͕ՄೳͰ͋Δ  
    %JTDVTTJPO