Share
Embed
線型計算の数理入門 / Introduction to Theoretical Numerical Linear Algebra
社内勉強会でつかったスライドです
Y Enokida
April 09, 2020
Transcript
15 slides
-
ࠓ͓΅͑ͯؼͬͯ΄͍͜͠ͱ ܭࢉػͰ 1 ࣍ํఔࣜΛղ͘ͷ·ͬͨͬͯ͘؆୯Ͱͳ͍ ࠓʢ΄Μͱ͏ʹʣ͍Ζ͍ΖͳΛ٧ΊࠐΉ͚ΕͲɼ͜Ε͚ͩೲಘ͍͚ͯͨͩ͠ΕͦΕ ͰॆͰ͢ 1 ࣍ํఔࣜͷܭࢉ ݪཧతʹɼத 1
Ͱशͬͨղ͖ํͰઈରʹղ͚Δ ͜ͷ͜ͱΛཧ༝ʹʮ1 ࣍ํఔࣜ؆୯ʯͱ͍͏ͷૣܭ ܭࢉػ্ͰΖ͏ͱ͢Δͱ͕͘͜͠ͳΔ ʮܭࢉػʹ༗ݶͷढ͍͕͔͔͍ͬͯΔʯ͜ͱʹΑΔ ʮ͜Ε͚͍ͩ͑ͭͰ OK ͳສೳղ๏ʯ͍·ͷͱ͜Ζͳ͍ ҰํͰՊֶܭࢉʹ͓͚ΔॏཁͳҐஔΛΊΔ ʮͲΜͳܭࢉઢܕܭࢉʢ1 ࣍ํఔࣜʣʹؼண͢ΔʯͱݴͬͯաݴͰͳ͍ ࠓͰ༷ʑͳख๏ͷ։ൃ͕ਐΊΒΕ͍ͯΔ -
ઢܕܭࢉͷҰൠʹ͍ͭͯ͏গ͚ͩ͠ ͖ΐ͏ѻ͏ղ๏ʢLU ղʣʮফڈ๏ʯͱݺΕΔख๏ͷҰͭ มΛʮফڈʯ͍ͯ͘͠ɼதֶੜͰशͬͨํ๏ʢͷԠ༻ʣ ʢॴʣޡ͕ࠩͳ͘Ұҙͳղ͕ଘࡏ͢Δঢ়گͳΒɼ༗ݶճͷܭࢉͰݫີղΛ༩͑Δ ʢॴʣߦྻͷ n2 ݸΛͯ͢ϝϞϦʹ֨ೲ͢Δඞཁ͕͋Δ ֶͷܭࢉͰ n2
ΛϝϞϦʹ࣋ͯͳ͍΄Ͳ n ͕ڊେͳ߹͕͋Δ ֶͷܭࢉͰཁૉͷେ͕ 0 ʹͳΔʢߦྻ͕ʮૄʯͰ͋Δʣ͜ͱ͕ଟ͘ɼ0 Λ֨ೲ͢ΔͨΊ͚ͩʹ ϝϞϦΛ༻ҙ͢Δͷແବ ʢॴʣ ʮঢ়گ͕ѱ͍ʯํఔࣜʹର͢ΔৼΔ͍͕҆ఆ͠ͳ͍ ਓؒతͳײɿ ʮํఔࣜͷ͕গ͔͠͠มΘͬͯͳ͚Εɼղগ͔͠͠มΘΒͳ͍ʯ ˢશͬͯͦ͘Μͳ͜ͱͳ͍ɽ͍͘ΒͰྫ͕ڍ͕Δʢ͋ͱͰྫΛग़͠·͢ʣ ͜ͷʮঢ়گͷѱ͞ʯʮߦྻͷ݅ʯͱ͍͏͜ͱͰݫີʹड़Δ͜ͱ͕Ͱ͖Δʢ͕ɼࠓͦͷ ͠ͳ͍ʣ ʮফڈ๏ʯͱᘳΛ͢ղ๏܈ͱͯ͠ʮ෮๏ʯ͕͋Δ దͳॳظ͔Βελʔτͯۙ͠ࣅղΛੜ͠ɼݫີղͱͷဃΛখ͍ͯ͘͘͞͠ํ๏ ʢॴʣඇྵཁૉͷΈΛϝϞϦʹ֨ೲ͢ΕΑ͍ ʢॴʣ෮ճʹԠͯ͡ղͷਫ਼্͕͢Δ దͳ݅ԼͰʮۙࣅղ͕ݫີղʹऩଋ͢Δ͜ͱʯ͓ΑͼʮऩଋͷεϐʔυʯΛݟੵΔ͜ͱ͕Ͱ ͖Δ ʢॴʣ͍͠ɽઃܭΛؒҧ͑Δͱਖ਼͘͠ղ͚ͳ͍ -
First Example ํఔࣜ " `1 20 4 `5 # "
x1 x2 # = " `21 9 # Λղ͖͍ͨɽͪͳΈʹݫີղ " 1 `1 # ɽ Α͋͘Δղ A = " a b c d # ͷٯߦྻʢAB = BA = I ͱͳΔΑ͏ͳߦྻ B ͷ͜ͱɼୠ͠ I ୯ҐߦྻɽA`1 ͱॻ ͘ʣ A`1 = 1 ad ` bc " d `b `c a # Ͱ༩͑ΒΕΔɽ1 ࣍ํఔࣜܥ Ax = b ͕༩͑ΒΕͨ࣌ɼx = A`1b Ͱ͋ΔɽͳͷͰɼٯߦ ྻΛ্ͷࣜͰܭࢉͯ͠ɼbʢ͜ͷ߹ " `21 9 # ʣʹ͔͚ΕΑ͍ɽ -
ͬͯΈͨ Python Ͱ͓͕ͯΔܭࢉͯ͠ΈͨʢఴϑΝΠϧ naive.py ࢀরʣ Motivating Example ํఔࣜ " 10
0:9999999999999999 100 10 # " x1 x2 # = " 9:0000000000000001 90 # Λղ͖͍ͨɽͪͳΈʹݫີղ " 1 `1 # ɽ ͬͯΈΑ͏ ͜ΜͳͷதֶੜͰͰ͖ΔΜ͔ͩΒܭࢉػͳΒઈରͰ͖ΔΑʂ ͕͑ζϨͯͨΒͷԼʹຒΊͯΒͬͯߏΘͳ͍Α -
݁ ઌఔͷํͩͱʮֶతʹਖ਼͍͠ʯ͕ʮֶతʹޡΓʯͰ͋Δ Կ͕·͍͔ͣɿad ` bc ͰׂΓࢉ͍ͯ͠Δ෦͕ʮ΄΅θϩআࢉʯʹͳͬͯ͠·ͬͯ ͍Δ ܭࢉػʹ՝ͤΒΕͨʮ༗ݶͷढ͍ʯ ʢ=ුಈখԋࢉͷ༷ʣ͕ൃಈ͢Δ 1=0:001
= 1000 ͕গ͠ζϨΔ͚ͩͰ 1=0:002 = 500 ʹͳͬͯ͠·͏ ·ͨɼมͷݸ͕૿͑ͨ߹ͷ֦ுੑۃΊͯѱ͍ 2x2 ߦྻͷٯߦྻ؆୯͕ͩɼҰൠͷ߹ͷٯߦྻͱͯෳࡶ ٯߦྻΛ༩͑Δ Cramer ͷެࣜܭࢉʹ O(n!) ͔͔Δ্ʹతʹෆ҆ఆ ํ ଞͷํʹΓ͑Δඞཁ͕͋Δɽ -
؆୯ʹղ͚Δํఔࣜʢԋश 28.1-1ʣ ํఔࣜ 2 6 4 1 0 0 4
1 0 `6 5 1 3 7 5 2 6 4 x1 x2 x3 3 7 5 = 2 6 4 3 14 `7 3 7 5 ΛલਐೖʹΑͬͯղ͚ɽ ղ લਐೖͱ͍͏ݴ༿ΛΒͳͯ͘ɼͱΓ͋͑ͣ x1 = 3 ͙͢Θ͔Δɽ ࣍ʹ x2 = 14 ` 4x1 Θ͔Δɽx1 = 3 Λೖͯ͠ x2 = 2ɽ ࣍ʹ x3 = `7 + 6x1 ` 5x2 Θ͔Δɽx1 = 3; x2 = 2 Λೖͯ͠ x3 = `1ɽ લਐೖ/ޙୀೖ ߦྻ͕ʮԼࡾ֯ʯߦྻͳΒɼx1 ; ´ ´ ´ ; xi Λʮೖͯ͠ʯxi+1 ͷ͕Θ͔Δɽఴ͑ ࣈ͕ʮલ͖ʹʯਐΜͰ͍Δɽ ߦྻ͕ʮ্ࡾ֯ʯߦྻͳΒɼxn ; xn`1 ; ´ ´ ´ ; xn`k+1 Λʮೖͯ͠ʯxn`k ͷ͕ Θ͔Δɽఴ͑ࣈ͕ʮޙΖ͖ʹʯਐΜͰ͍Δʢޙୀೖʣ ɽ -
ؾ࣋ͪ ߦྻ͕ʮࡾ֯ʯߦྻͳΒํఔࣜΛղ͘ͷਵ؆୯Ͱɼ΄ͱΜͲͦͷ··ҰൠԽͰ ͖ΔΜ͚ͩͲͳ͊ʜ ඈͼಓ۩ ҙͷਖ਼ଇߦྻ A ্ࡾ֯ߦྻ U ͱԼࡾ֯ߦྻ L
ͷੵʹղ͢ΔʢLU ղʣ͜ͱ͕ ΒΕ͍ͯΔɽ ʮߦྻ͕ਖ਼ଇʯʜ͜͜ͰͱΓ͋͑ͣʮํఔ͕ࣜͨͩҰͭͷղΛ࣋ͭʯͷݴ͍͑ͩͱࢥͬͯ ͓͚ྑ͍ ͜ΕΛ͑ Ax = b LUx = b ͱॻ͖ͤΔɽy = Ux ͱஔ͘ͱɼLy = bɽ Ly = b ΛલਐೖͰղ͚ y ͕Θ͔Δɽ͋ͱ Ux = y ΛޙୀೖͰղ͚ x ͕ Θ͔Δɽ Exercise** LU ղΛܭࢉ͢Δ͜ͱͱɼதֶੜͰश͏ফڈ๏ຊ࣭తʹಉ͡ͳͷͰ͕͢ɼͦΕΛ໌ʹ ड़Δʹ͕࣌ؒΓͳ͍ͷͰ֤ࣗͷԋशͱ͠·͢ʢcf. ਿݪɾࣨాʮઢܗܭࢉͷཧʯ p.23ʣ ɽ -
LU ղͷྫʢԋश 28.1-2ʣ ߦྻ 2 6 4 4 `5 6
8 `6 7 12 `7 12 3 7 5 ͷ LU ղΛܭࢉͤΑɽୠ͠ɼԼࡾ֯ߦྻͷର֯ 1 ͱͳΔΑ͏ʹબɽ -
ղ 2 6 4 4 `5 6 8 `6 7
12 `7 12 3 7 5 = 2 6 4 1 0 0 l21 1 0 l31 l32 1 3 7 5 2 6 4 u11 u12 u13 0 u22 u23 0 0 u33 3 7 5 Λ࣮ࡍʹ͝ͱʹղ͍ͯΈΕྑ͍ɽ͜Ε࣮ࡍʹखΛಈ͔͢ͱͳΜͱͳ͘Θ͔Δʢ͠ɼ खΛಈ͔͞ͳ͍ͱͨͿΜ͋Μ·ΓΘ͔Βͳ͍ʣͷͰɼࢼ͠ʹܭࢉΛ֤ࣗͰͬͯΈΔ͜ͱΛ ڧ͓͘͢͢Ί͠·͢ɽҎԼΛॱ൪ʹߟ͍͚͑ͯΑ͍Ͱ͢ʀ L ͷୈ 1 ߦͱ U ͷୈ 1,2,3 ྻͷֻ͚ࢉ L ͷୈ 2 ߦͱ U ͷୈ 1,2,3 ྻͷֻ͚ࢉ L ͷୈ 3 ߦͱ U ͷୈ 1,2,3 ྻͷֻ͚ࢉ 2 6 4 4 `5 6 8 `6 7 12 `7 12 3 7 5 = 2 6 4 1 0 0 2 1 0 3 2 1 3 7 5 2 6 4 4 `5 6 0 4 `5 0 0 4 3 7 5 LU ղͷΞϧΰϦζϜͱ࣌ؒܭࢉྔ ͜ͷܭࢉΛʢϕλॻ͖ͤͣʹʣfor จΛͬͨܗʹͤͦͷ··ΞϧΰϦζϜͱͯ͠ػೳ ͢Δɽܭࢉ͢Δม͕ n2 ݸ͋Γɼ֤ม͝ͱͷฏۉ࣌ؒܭࢉྔ͕ ˆ(n) ͱͳΔͷͰɼશମ ͷฏۉ࣌ؒܭࢉྔ ˆ(n3)ɽ -
ؼೲతͳ LU ղͷߏ ڭՊॻͰؼೲతʹ LU ղΛߏ͍ͯ͠Δɽ A = " a11
w> v A0 # = " 1 0 v=a11 I # " a11 w> 0 A0 ` vw>=a11 # ͳΔղΛར༻͢ΕؼೲతʹͰ͖Δʢ͕ɼLU ղ͕ଘࡏ͢Δߦྻʹରͯ͠ղΛٻΊ ΒΕͳ͍ϦεΫ͕͋ΔɽͦΕΏ͑ݸਓతʹ͖Ͱͳ͍ɽൃදͰѻΘͳ͍ʣ ɽ͜͜Ͱ࣍Λ ར༻͍ͯ͠Δʀ ϒϩοΫߦྻʹର͢Δܭࢉ 2 ͭͷਖ਼ํߦྻ X; Y Λɼ X = " A B C D # ; Y = " E F G H # ͱϒϩοΫʹׂ͢Δ͜ͱΛߟ͑Δɽୠ͠ɼA ͱ E ͷαΠζ͕ಉ͡ʹͳΔΑ͏ʹ͢Δɽ͜ ͷͱ͖ɼX ͱ Y ͷੵʮ2 ߦ 2 ྻͷߦྻΛܭࢉ͢Δͷͱಉ༷ʹʯܭࢉ͢Δ͜ͱ͕Ͱ͖Δɽ ΑΓਖ਼֬ʹड़Εɼ͕࣍Γཱͭʀ XY = " AE + BG AF + BH CE + DG CF + DH # -
ํఔ͕ࣜղΛ͕࣋ͭ LU ղ͕ػೳ͠ͳ͍ྫʢԋश 28.1-3 վʣ 2 6 4 0 2
3 5 1 4 8 5 2 3 7 5 2 6 4 x1 x2 x3 3 7 5 = 2 6 4 9 12 5 3 7 5 Λղ͚ɽ όά ͜ͷߦྻͷ LU ղଘࡏ͠ͳ͍ʢଘࡏ͢ΔͱԾఆͨ͠Βໃ६͕ग़Δʣ ɽ ͷ͕ͩɼ͜ͷํఔࣜ།Ұͭͷղ 2 6 4 `1=19 `3=19 59=19 3 7 5 Λ࣋ͭɽ Կ͕ͳͷ͔ʁ ର֯ͷ 0ʢಛʹ (1,1) ʹ 0 ͕͍Δ͍ͤͰ LU ղ͕ଘࡏ͠ͳ͍ʣ ʮର֯ͰׂΔૢ࡞ʯඞਢɽͦͷ͜ͱ͔Βɼ0 ɼ0 ʹ͍ܴۙͰ͖ͳ͍ ʮ࣠બʯ ʢpivotingʣΛ͢Δඞཁ͕͋Δ -
࣠બ ͻΒ͍ͨ͑͘ʮର֯ΛͳΔ͚ͩେ͖͘ͳΔΑ͏ʹߦͷೖΕସ͑Λ͢Δʯ͜ͱɽ 2 6 4 0 2 3 5 1
4 8 5 2 3 7 5 2 6 4 x1 x2 x3 3 7 5 = 2 6 4 9 12 5 3 7 5 ্ͷࣜͰ (1,1) ͕େ͖͘ͳΔΑ͏ʹߦͷೖΕସ͑Λ͍ͨ͠ɽݟͨͱ͜Ζ 3 ߦͱೖΕ ସ͑Δͱྑͦ͞͏ɽ 2 6 4 8 5 2 5 1 4 0 2 3 3 7 5 2 6 4 x1 x2 x3 3 7 5 = 2 6 4 5 12 9 3 7 5 ࣍ʹ (2,2) ͕େ͖͘ͳΔΑ͏ʹߦͷೖΕସ͑Λ͍ͨ͠ɽݟͨͱ͜Ζ 1 ߦͱೖΕସ͑ ͨ͘ͳΔ͕ɼͦΕΛΔͱ͏·͘ಈ͔ͳ͍͜ͱ͕͋Δʢײɿྫ͑ॱ܁ΓʹೖΕସ͑ͯ ͍ͬͯɼ݁ہԿ͠ͳ͔ͬͨ߹ͱҰॹʹͳΓ͑ΔʣͷͰɼࣗʢ2 ߦʣҎ߱ͷߦͱݟൺ Δɽ3 ߦͱೖΕସ͑Δͱྑͦ͞͏ɽ 2 6 4 8 5 2 0 2 3 5 1 4 3 7 5 2 6 4 x1 x2 x3 3 7 5 = 2 6 4 5 9 12 3 7 5 -
࣠બͨ͠ߦྻʹର͢Δ LU ղ ͔ͯ࣍͘͠ͷํఔ͕ࣜಘΒΕͨʀ 2 6 4 8 5 2
0 2 3 5 1 4 3 7 5 2 6 4 x1 x2 x3 3 7 5 = 2 6 4 5 9 12 3 7 5 ͜ͷߦྻ LU ղ͢Δ͜ͱ͕Ͱ͖Δʀ 2 6 4 8 5 2 0 2 3 5 1 4 3 7 5 = 2 6 4 1 0 0 0 1 0 5=8 `17=16 1 3 7 5 2 6 4 8 5 2 0 2 3 0 0 95=16 3 7 5 ͖ΐ͏ͷͰলུ͢Δ͜ͱ ͍·ͷʮมͷೖΕସ͑ʯɼߦྻͷ͜ͱͰॻ͚Δ ڵຯ͕͋ΕʮஔߦྻʯͰௐ͍ͯͩ͘͞ LU ղଘࡏ͢ΔͱݶΒͳ͍͕ɼߦΛదʹೖΕସ͑Ε LU ղ͕Ͱ͖Δ͜ͱΛݟ ͨɽ͜ͷʮߦΛదʹೖΕସ͑ͨ LU ղʯͷ͜ͱΛ LUP ղͱݺͿɽ LU(P ) ղͷଘࡏ͢Δ݅ͱͦͷৄࡉʹ͍ͭͯ ͚݁ͩड़Δͱɼ ʮҙͷਖ਼ํߦྻʹରͯ͠ LUP ղଘࡏ͢Δʯ ɽ ʮਖ਼ଇߦྻʹର͠ɼͦ ͷ LU ղ͕ଘࡏ͢Δ͜ͱͱɼͦͷͯ͢ͷट࠲খߦྻ͕ࣜඇྵͰ͋Δ͜ͱಉʯ ɽ