Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields
by
peisuke
×
Copy
Open
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Slide 1
Slide 1 text
Mip-NeRF 360: Unbounded Anti- Aliased Neural Radiance Fields Authors: Jonathan T. Barron, Ben Mildenhall, Dor Verbin Presenter: @peisuke
Slide 2
Slide 2 text
ࣗݾհ ໊લɿ౻ຊ ܟհ ॴଐɿ"#&+"ʢ-BCTϥϘʣ ෭ۀɿ.-Λத৺ʹ૬ஊ͔Β։ൃ·Ͱͬͯ·͢ ੋඇ͓͕͚Լ͍͞ ׆ಈɿ5XJUUFS!QFJTVLF (JUIVC IUUQTHJUIVCDPNQFJTVLF 2JJUB IUUQTRJJUBDPNQFJTVLF 4MJEF4IBSF IUUQTXXXTMJEFTIBSFOFU'VKJNPUP,FJTVLF 4QFBLFS%FDL IUUQTTQFBLFSEFDLDPNQFJTVLF গ͚ͩ͠ॻ͍ͯ·͢
Slide 3
Slide 3 text
֓ཁ • ͲΜͳจʁ • /F3'ͰϘϦϡʔϜϨϯμϦϯάʹ͓͍֤ͯͷ৭ɾີΛ//Ͱ ग़ྗ͢Δ͜ͱͰը૾Λੜ • /F3'ʹ͓͍ͯɺத৺͔Βԕ͍େͳۭؒΛ//Ͱ࠶ݱ͢Δ͜ͱ͕͠ ͘ɺத৺Ҏ֎ͷ෮ݩ͕͔ͬͨ͠Λղܾ • ʁ • ۭؒΛมͯ͠ԕ͍ྖҬΛখ͍͞ྖҬʹຒΊࠐΉ͜ͱͰԕ͞ͷΛ ղܾ • ͦͷଞʹɺৠཹʹΑΔߴԽɾਖ਼نԽʹΑΔϊΠζݮͳͲΛ͍ͯ͠ Δ
Slide 4
Slide 4 text
ख๏ͷσϞ
Slide 5
Slide 5 text
/F3'ͷ֓ཁʢʣ • ۭؒͷʢҐஔ͖ͷ࣍ݩʣʹؔ͢Δ৭ɾີΛ༧ଌ͢Δ ωοτϫʔΫ • ΧϝϥͷҐஔΛܾΊΔͱɺωοτϫʔΫͷग़ྗ͢ΔΛݩʹϘ ϦϡʔϜϨϯμϦϯά͢Δ͜ͱͰը૾Λੜ 1PTJUJPOBM&ODPEJOH͞Εͨͷ ใ ࣍ϖʔδͰઆ໌ ີ͔Β XΛܭࢉ
Slide 6
Slide 6 text
/F3'ͷ֓ཁʢʣ • ۭؒͷΛߴ࣍ݩͷಛྔʹมʢQPTJUJPOBMFODPEJOHɺ 1&ʣ͢Δ͜ͱͰߴਫ਼Խ 𝛾 𝒙 = sin 2!𝒙𝜋 , cos 2!𝒙𝜋 , … , sin 2"𝒙𝜋 , cos 2"𝒙𝜋
Slide 7
Slide 7 text
NJQ/F3'ͷ֓ཁʢʣ • 𝛾 𝒙 Λͱͯ͠ѻ͍ɺͦͷҐஔͷ৭ΛϨϯμϦϯά͢Δͱɺ पғͷใΛಘΒΕͣδϟΪʔ͕ൃੜ͢Δ • ࢹઢΛίʔϯͰଊ͑ɺίʔϯͷੵΛ༻͍ΔࣄͰߴਫ਼Խ • ίʔϯΛΨεͰۙࣅɺ1&ͷظΛ͏͜ͱͰɺੵΛ ؆қతʹܭࢉ Ͱͳ͘ɺ֤ྖҬͷ 1&ͷظΛ͏
Slide 8
Slide 8 text
NJQ/F3'ͷ֓ཁʢʣ • 1&ͨ͠ಛྔͷظΛऔΔͱɺࢹ͔Βԕ͍ྖҬͰߴपྖ Ҭ͕খ͘͞ͳΔ • ڑʹԠͨ͡ૈ͞ΛՃຯͯ͠ωοτϫʔΫ͕৭Λग़ྗͯ͘͠ΕΔ ࢹۙ͘Ͱɺ͕ ڱ͍ͨΊߴपྖҬͷ ใ͕Δ ࢹ͔ΒΕΔͱɺ ͕͘ͳΔͨΊप ͷΈʹͳΔ
Slide 9
Slide 9 text
NJQ/F3'ͷ՝ • Χϝϥ͔Βԕ͍ྖҬίʔϯ ͕େ͖͘ͳΔ • த৺ʹ͋ΔମҎ֎ͷपғ ڥͷ෮ݩ͕ࠔ த৺ྖҬ΄Ͳࡉ͔ ͍ใ͕ඞཁ पғͷใૈͯ͘ྑ͍ ֎ଆͷྖҬͷσʔλ͕ૄʹͳΔͨΊɺ ্ख͘෮ݩͰ͖ͳ͍
Slide 10
Slide 10 text
4DFOFBOE3BZ1BSBNFUFSJ[BUJPO • த৺͔ΒܘͷྖҬ·ͰมΘΒͣ • ܘҎ্ͷྖҬɺԕ͘ͳΔ΄ͲڑΛॖΊɺܘͷྖҬʹ ແݶԕํ͕ऩ·ΔΑ͏ʹม • ࣍ۙࣅͯ͠ϠίϏߦྻΛ͍ΨεΛม ਤͷପԁҎԼͰม
Slide 11
Slide 11 text
ৠཹΛ༻͍ͨߴԽʢʣ • NJQ/F3'Ͱɺ·ͣશҬΛૈཻ͍ͰϨΠτϨʔγϯά͠ɺମ͕Կ ॲʹ͋Δͷ͔Λେ·͔ʹѲ • ࣍ʹɺମ͕ଘࡏ͢ΔҐஔʹ੍ݶ͠ɺ࠶ϨΠτϨʔγϯά • ͜ΕΛ܁Γฦ͢͜ͱͰৄࡉͳܗঢ়Λ෮ݩՄೳɺܭࢉ͕͍ͱ͍͏՝͕͋ Δ
Slide 12
Slide 12 text
ৠཹΛ༻͍ͨߴԽʢ̎ʣ • ૈ͍ྖҬ୳ࡧϑΣʔζͰɺ৭ͷใΛ࣋ͨͳ͍ɺΑΓখ͞ͳϞσϧ ʢ1SPQ.-1ʣͰମͷҐஔΛ୳ࡧ • ࠷ޙͷϨϯμϦϯάͷΈɺ৭ͷใΛ࣋ͭϞσϧʢ/F3'.-1ʣͰ୳ࡧ • ֤ϞσϧʹҰ؏ੑΛ࣋ͨͤΔͨΊɺωοτϫʔΫͷৠཹΛ༻͍Δ
Slide 13
Slide 13 text
ωοτϫʔΫͷৠཹʹ͍ͭͯ • /F3'.-1͔ΒಘΒΕΔମͷҐஔͷใΛ༻͍ͯɺ1SPQ.-1Λֶश ͢Δ͜ͱͰҰ؏ੑΛอͭ • ྆ํͷωοτϫʔΫؒͰඞཁͱͳΔCJOͷີҟͳΔͷͰ Λൺֱͨ͠ৠཹ͕ग़དྷͳ͍ • /F3'.-1͔ΒಘΒΕΔॏΈͷώετάϥϜΑΓɺ1SPQ.-1ͷώε τάϥϜ͕େ͖͘ͱ͍͏੍Λ͏ • ͜ΕͪΐͬͱෳࡶͳͷͰ࣍ͷϖʔδͰઆ໌ ࠷ऴతʹɺମྖҬʹ͓ ͍ͯX͕େ͖͘ͳΔɻ· ͨɺૈ͍CJOͷ1SPQ.-1 ͕ಘΒΕΔ
Slide 14
Slide 14 text
• ϨΠ্ʹ͋ΔମͷॏΈXͷώετάϥϜΛߟ͑Δ ώετάϥϜͷൺֱ ϨΠ্ͷମͷॏΈ w ମͷॏΈͷώετάϥϜ
Slide 15
Slide 15 text
ώετάϥϜͷൺֱ /F3'.-1ͷ ώετάϥϜ 1SPQ.-1ͷ ώετάϥϜ /F3'.-1ͷͱ͋ΔྖҬ5JͷॏΈXJ ΑΓɺ5JΛؚΉྖҬ5Kͷώετά ϥϜXKͷ໘ੵͷํ͕େ͖͘ͳΔ
Slide 16
Slide 16 text
ਖ਼ଇԽ • /F3'Λֶश͢Δͱɺಛʹԕ͍ΤϦΞʹ͓͍ͯܗঢ়෮ݩͷͨ Ίͷใ͕Γͣෆྑઃఆ͕ൃੜ͠ɺϊΠζ͕ൃੜ • ਖ਼ଇԽʹΑͬͯϊΠζͷݮΛߦ͏
Slide 17
Slide 17 text
ਖ਼ଇԽ • ॏΈ͆ͷ͕ͳΔ͘σϧλؔʹۙ͘ͳΔΑ͏ͳ੍Λͭ ͚Δ σϧλؔʹͳΔͱɺ X V ɺX W ͕ڞʹͷ࣌ ʹɺVW͕ʹ͖ۙͮɺͦ ΕҎ֎ɺΑ্ͬͯࣜ θϩʹۙͮ͘ 𝑢 ≠ 𝑣ͷ࣌ʹɺw 𝑢 , 𝑤 𝑣 > 0 Ͱ͋ΔͱϖφϧςΟͱͳΔ
Slide 18
Slide 18 text
ਖ਼ଇԽ • ઌఔͷੵܭࢉͰ͖ͳ͍͕ɺX֤ΠϯλʔόϧͰҰఆ ʹͳΔͷͰɺҎԼͷΑ͏ʹॻ͖දͤΔ • ޯΛܭࢉ͢ΔͱɺਤͷΑ͏ͳํʹॏΈ͕มԽ͢Δྗ͕ಇ͘
Slide 19
Slide 19 text
࠷దԽ • ը૾ͷ෮ݩϩεɺਖ਼ଇԽʹΑͬͯ/F3'.-1Λɺ࠷ޙͷ߲Ͱ 1SPQ.-1Λֶश • Ϟσϧ • 1SPQ.-1ύϥϝʔλͷӅΕΛ࣋ͭɺϨΠϠʔͷ.-1 • /F3'.-1ύϥϝʔλͷӅΕΛ࣋ͭɺϨΠϠʔͷ.-1 ը૾ͷ෮ݩϩε ਖ਼ଇԽ߲ 1SPQ.-1ͷֶश
Slide 20
Slide 20 text
࣮ݧ݁Ռ • σʔλ • ৽͍͠σʔληοτɺͭͷ֎ɺͭͷ • ݅ • /F3' NJQ/F3' /F3'ͱൺֱ • $0-."1ͰࣗݾҐஔਪఆ • ܭࢉڥ • 516WXJUIDPSFT • ࢦඪ • 14/3 44*. -1*14
Slide 21
Slide 21 text
ఆྔධՁ
Slide 22
Slide 22 text
ఆੑධՁ
Slide 23
Slide 23 text
·ͱΊ • NJQ/F3'ͷ՝Ͱ͋ͬͨԕํͷྖҬΛਫ਼ྑ͘෮ݩ͢Δख๏ ΛఏҊ • 4DFOFBOE3BZ1BSBNFUFSJ[BUJPOʹΑΔԕํ෮ݩߴਫ਼Խɺ ৠཹʹΑΔߴԽɺਖ਼ଇԽʹΑΔϊΠζআڈΛఏҊ