Link
Embed
Share
Beginning
This slide
Copy link URL
Copy link URL
Copy iframe embed code
Copy iframe embed code
Copy javascript embed code
Copy javascript embed code
Share
Tweet
Share
Tweet
Slide 1
Slide 1 text
ҩ༻ը૾ͷసҠֶश·ͱΊ Transfusion: Understanding Transfer Learning for Medical Imaging
Slide 2
Slide 2 text
Uchihashi Kenshi uchi_k @wednesdaymuse About me •yuni, inc CEO •Freelance Machine Learning Engineer / Researcher •xpaper.challenge ӡӦ •former ະ౿, ژେใӃ ੴҪݚڀࣨ), FreakOut Machine Learning Engineer
Slide 3
Slide 3 text
#Abstract #ImageNet #datasize #global / local tecsture ࣗવը૾ͱҩ༻ը૾ʹଟ͘ͷҧ͍͕͋Δ *NBHF/FU SFUJOBMGVOEVTQIPUPHSBQIT $IF9QFSU ௨ৗɺҩྍը૾ॲཧλεΫɺؔ৺ͷ͋ΔମྖҬͷେ͖ͳը૾͔Β ࢝·ΓɺපมΛࣝผ͢ΔͨΊʹϩʔΧϧςΫενϟͷόϦΤʔγϣϯ Λ༻͍͕ͯ͘͠ɺ͜ΕશମతͳओΛಛఆ͍ͨ͠*NBHF/FUͷ λεΫͱରత ບͷ؟ఈը૾Ͱɺখ͞ͳԫ৭ͷʮʯ͕ඍখಈ຺ᚅͱපੑ ບͷஹީͰ͋Γʢ""0ɺʣɺڳ෦9ઢͰɺہॴతͳന͍ෆ ಁ໌ͳൗ͕ѹີͱഏԌͷީ *NBHF/FUສຕͷը૾͕͋Δͷʹରͯ͠ɺҩ༻ը૾ઍʙ ेສͷΦʔμʔɻ͔ͭɺʢϩʔΧϧςΫενϟΛ༻͢ΔͨΊʹʣ αΠζͷେ͖͍ը૾ͩͬͨΓ͢Δ
Slide 4
Slide 4 text
#Abstract #class number #transfer learning ࣗવը૾Ͱֶशͨ͠ϞσϧΛҩ༻ը૾ʹసҠֶश͢Δͷຊʹ༗ޮʁ *NBHF/FU SFUJOBMGVOEVTQIPUPHSBQIT $IF9QFSU *NBHF/FUΫϥεྨ͕ͩɺපੑບஅΫϥε Ͱɺ9ઢʹΑΔڳ෦පมஅʙΫϥε ͦͷΫϥεͷଟ͔͞Βɺඪ४ͷ*NBHF/FUͰޙஈͷϨΠϠʔʹύ ϥϝʔλ͕ूத͓ͯ͠Γɺҩ༻ը૾ͷస༻ʹ࠷దͰͳ͍Մೳੑ͕ ͋Δ ࣗવը૾ͰҰൠతͳ*NBHF/FU͔Βɺҩ༻ը૾ͰҰൠతͳͭͷσʔ λʹసҠֶशΛߦ͍ɺਫ਼ϑΟϧλʔɺֶशͳͲͷ؍͔Βղ ੳͨ͠
Slide 5
Slide 5 text
#Conclusion ͔݁Βݴ͏ͱ సҠֶश͕ඪ४తʹߦΘΕΔͭͷେنͳҩྍ༻ը૾ॲཧλεΫͰɺ *NBHF/FUͷඪ४ΞʔΩςΫνϟɺ͓Αͼඪ४Ͱͳ͍͕খ͘͞γϯ ϓϧͳϞσϧϑΝϛϦʔͷύϑΥʔϚϯεΛධՁ ˠ*NBHF/FUͰͷਫ਼Δ͔ʹ͍ʹ͔͔ΘΒͣɺసҠֶशͰύ ϑΥʔϚϯε͕େ෯ʹ্͢Δ͜ͱͳ͘ɺখ͞ͳϞσϧಉͷύ ϑΥʔϚϯεΛൃشͨ͠ ࣄલֶशࡁΈͷॏΈΛ༻͢ΔͱɺϥϯμϜͳॳظԽͱҟͳΔֶश දݱ͕ಘΒΕΔ͔Ͳ͏͔Λௐࠪ ˠϥϯμϜͰݟΒΕͳ͍(BCPSMJLFͳϑΟϧλʔ͕ಘΒΕ͍ͯΔ ͷ͕֬ೝͰ͖ͨɻ͕͜ΕॳظԽ͔࣌ΒసҠֶशʹΑͬͯϞσϧ͕ಈ ͔ͳ͔ͬͨʹա͗ͳ͍
Slide 6
Slide 6 text
#Conclusion ͔݁Βݴ͏ͱ సҠֶश͕͋·Γਐ·ͳ͔ͬͨཧ༝Λௐࠪ ˠPWFSQBSBNFUSJ[BUJPOͷ݁ՌͰ͋Δͱߟ͑ΒΕΔɻͨͩ͠ɺҙຯ ͷ͋Δ෦ͷΈநग़͢Δ͜ͱՄೳ సҠֶशͷརଞʹͳ͍͔ௐͯΈͨ ˠਫ਼ಛʹ্͕Βͳ͍͕ΑΓ༏ΕͨεέʔϦϯάͷॏΈ͕ಘΒΕͨ ͷʹՃ͑ɺऩଋ্͕ͬͨ
Slide 7
Slide 7 text
#Dataset #AUC-ROC ࣗવը૾ͱͯ͠*NBHF/FUΛɺҩ༻ը૾ͱͯ͠ບը૾ͱڳ෦9ઢը૾ΛऔΓ্͛Δ ບը૾ͷσʔληοτͰɺ؟ఈ͔ΒࡱӨͨ͠ºͷը૾ɻ පੑບʢ%3ʣͳͲͷ؟࣬ױͷஅʹར༻͞ΕΔɻάϨʔυ ͷॱʹॏ͕ߴ·Γɺ"6$30$Λ༻͍ͯධՁ͞ΕΔ *NBHF/FU SFUJOBMGVOEVTQIPUPHSBQIT $IF9QFSU SFUJOBMGVOEVTQIPUPHSBQIT $IF9QFSU ڳ෦9ઢը૾ͷσʔληοτͰɺºͷը૾ɻͭͷҟͳΔڳ෦ පมʢແؾഏɺ৺ංେɺѹີɺුजɺڳਫʣͷஅʹར༻͞ΕΔɻ"6$ Λ༻͍ͯධՁɻ ͖͍͠Λ͍Ζ͍Ζม͑ͨͱ͖ͷਅཅੑ ͱِཅੑͷׂ߹มԽΛϓϩοτͨ͠ͷ
Slide 8
Slide 8 text
#Model #ResNet50 #Inception-v3 #CNN 3FT/FU *ODFQUJPOW ελϯμʔυͳ$//Λύλʔϯ༻ ҩྍܥసҠֶशͰจ࣮͕͋Δ3FT/FU *ODFQUJPOWΛ࠾༻ EDPOWPMVUJPO CBUDIOPSNBMJ[BUJPO 3F-6ΛੵΈॏͶΔجຊత ͳߏͷͷΛ$#3ͱͯ͠ఆٛ͠ɺ*NBHF/FUͷඪ४αΠζͱൺ ͯ -BSHF 5JOZ ͷϞσϧΛ࡞ͬͨ
Slide 9
Slide 9 text
#Result #Figure సҠֶशʹΑͬͯਫ਼্͕ݟΒΕΔ͔ʁݩλεΫͰͷਫ਼ؔ͋Δʁ ϥϯμϜͱൺֱͯ͠ɺసҠֶशʹΑͬͯਫ਼͕ྑ͘ͳ͍ͬͯͳ͍ ݩλεΫͰ͋Δ*NBHF/FUͰͷਫ਼ɺసҠֶशʹΑΔਫ਼্ʹ ແؔɻٯʹݴ͏ͱɺͳΜͰͳ͍Α͏ͳϞσϧͰ*NBHF/FUବ Ͱগͳ͘ͱບσʔλʹؔͯ͠DPNQBUJCMF ͰଞʹసҠֶशʹΑΔϝϦοτͳʹ͔ͳ͍͔ʁऩଋͱ͔ɾɾɾ
Slide 10
Slide 10 text
#Result #Figure సҠֶशͱϥϯμϜͰਫ਼͕มΘΒͳ͍ͷͰ͋Εɺಛදݱಉ͡ʁ શͯͷϞσϧʹ͍ͭͯɺϥϯμϜؒͷ$$"ͷํ͕ϥϯμϜసҠֶशؒͷ $$"ΑΓߴ͍ $$"ʢ$BOPOJDBM$PSSFMBUJPO"OBMZTJTʣͰͭͷϞσϧʹ͍ͭͯ ֤ϨΠϠʔͷBDUJWBUJPOWFDUPS͔ΒྨࣅੑΛଌΔ ਫ਼ಉ͡ͰɺసҠֶशʹΑͬͯಛදݱʹԿΒ͔ͷଌఆՄೳͳมԽ ͕ੜ͍ͯ͡ΔʢϞσϧαΠζӨڹ͢Δʣ
Slide 11
Slide 11 text
#Result #Figure సҠֶशʹΑͬͯྑ͍ಛදݱ͕ಘΒΕ͍ͯΔͱ͍͏ΑΓɺ ୯ʹࣄલֶशͨ͠ॏΈ͕มԽ͍ͯ͠ͳ͍͚ͩͰʁ $$"ʢ$BOPOJDBM$PSSFMBUJPO"OBMZTJTʣͰॳظঢ়ଶͱऩଋޙʹͭ ͍֤ͯϨΠϠʔͷBDUJWBUJPOWFDUPS͔ΒྨࣅੑΛଌΔ సҠֶशɺ୯ʹϞσϧ͕ॳظঢ়ଶ͔Β΄΅มԽͤͣɺࣄલֶश͞Εͨ ॏΈ͕ͦͷ··༻͍ΒΕ͍ͯΔʹա͗ͳ͍ʢͱ͍͏িܸͷࣄ࣮ʣ
Slide 12
Slide 12 text
#Figure #weight scaling #Xavier algorithm సҠֶशʹɺֶश͞Εͨಛͱؔͳ͘ ॏΈͷεέʔϦϯά͕վળ͢Δͱ͍͏ϝϦοτ͕͋Δ ॏΈͷεέʔϦϯάʹɺ9BWJFSΞϧΰϦζϜ͕Α͘༻͍ΒΕΔ USVODBUFE ΨεΛ༻͍ͯॳظԽɻOͦΕͧΕଓɻ ͜Εʹର͠ɺࣄલֶश͞ΕͨॏΈͷฏۉͱࢄͷΈΛͬͯʢpMUFS શࣺͯͯͯʣˣਖ਼ن͔ΒJJEʹऔΓग़ͨ͠ॏΈͰॳظԽ͢Δͱɺ ࣄલֶश͞ΕͨεέʔϦϯάใͷΈΛอ͍࣋ͯ͠Δ͜ͱͱՁͰ͋ Δɻ సҠֶशͷॏΈεέʔϦϯάվળͷ෦ͷΈΛऔΓग़ͯ͠ɺऩଋ ͷد༩Λௐ͍ͨ
Slide 13
Slide 13 text
#Figure #convergence speed #weight scaling సҠֶशٴͼεέʔϦϯάվળʹΑͬͯऩଋ͕ૣ͘ͳΔ ऩଋޙͷ"6$ʹ΄ͱΜͲ͕ࠩͳ͍͕ɺసҠֶशΛ͢Δͱ࠷ऩଋ͕ ૣ͘ɺ.FBO7BS*OJUͰϥϯμϜΑΓ͔ͳΓऩଋ͕ૣ͘ͳ͍ͬͯ Δ εέʔϦϯάใͷΈΛอ࣋ͨ͠.FBO7BS*OJUͰૣ͘ͳ͍ͬͯΔ ͷͰɺऩଋͷߴԽɺ͘Β͍ॏΈͷεέʔϦϯάͷվળ͔ Βى͍ͬͯ͜Δͱߟ͑ΒΕΔ
Slide 14
Slide 14 text
#Figure #feature extraction *NBHF/FU͔ΒͷసҠֶशʹΑͬͯ(BCPSMJLFϑΟϧλʔ͕ಘΒΕΔ సҠֶश ϥϯμϜ ॏΈͷεέʔϦϯάͷΈసҠͷͭͰॳஈͷϑΟϧ λʔΛՄࢹԽൺֱͨ͠ *NBHF/FU͔ΒసҠֶशͨ͠߹ͷΈ(BCPSMJLFϑΟϧλʔ͕ಘΒ Ε͍ͯΔɻεέʔϦϯάͰಛ͕ࣦΘΕΔͷͰײͱ߹͏ ͦͦసҠֶशͰ΄ͱΜͲϞσϧ͕ಈ͍͍ͯͳ͍͚ͩͱࢥΘΕΔɾɾɾ ͳͥ͜ͷΑ͏ͳ͕ൃੜ͢Δͷ͔ʁ
Slide 15
Slide 15 text
#Figure #feature re-use సҠֶशʹΑͬͯϞσϧ͕ͲΕ͚ͩಈ͔͘ΛධՁ͢Δ ઙ͍ϨΠϠʔͰڑ͕͘ͳΓʢ࠶ར༻͕ڧ͍ʣɺਂ͍ϨΠϠʔͰ ڑ͕͘ͳͬͨʢ࠶ར༻͕ऑ͍ʣ εέʔϦϯάใͷΈΛอ࣋ͨ͠.FBO7BS*OJUͰૣ͘ͳ͍ͬͯΔ ͷͰɺऩଋͷߴԽɺ͘Β͍ॏΈͷεέʔϦϯάͷվળ͔ Βى͍ͬͯ͜Δͱߟ͑ΒΕΔ ॳظԽ͞ΕͨॏΈΛX ऩଋޙͷॏΈΛX5ͱͯ͠ɺˢͷύϥϝʔλؒ ਖ਼نԽڑΛܭࢉ͢Δ͜ͱͰϞσϧͷಈ͖ΛධՁ͢Δɻ
Slide 16
Slide 16 text
#Figure #weight ϨΠϠʔຖͷॏΈมԽΛධՁ͢Δ DPOWͰɺ*NBHF/FUͷࣄલֶशΑΓϥϯμϜͷํ͕େ͖ͳมԽ ͕͋ͬͨͷʹରͯ͠ɺ*NBHF/FUͷࣄલֶशΑΓଟ͘ͷϨΠϠʔͰ มԽ 3FT/FU͕*NBHF/FUͷదͳύϥϝʔλΛ͍࣋ͬͯΔՄೳੑΛ ͍ࣔࠦͯ͠Δ͕ɺҩྍλεΫͰPFWSQBSBNFUSJ[FE
Slide 17
Slide 17 text
#Conclusion ͓࣋ͪؼΓͯ͠΄͍͠ݟʢ࠶ܝʣ సҠֶश͕ඪ४తʹߦΘΕΔͭͷେنͳҩྍ༻ը૾ॲཧλεΫͰɺ *NBHF/FUͷඪ४ΞʔΩςΫνϟɺ͓Αͼඪ४Ͱͳ͍͕খ͘͞γϯ ϓϧͳϞσϧϑΝϛϦʔͷύϑΥʔϚϯεΛධՁ ˠ*NBHF/FUͰͷਫ਼Δ͔ʹ͍ʹ͔͔ΘΒͣɺసҠֶशͰύ ϑΥʔϚϯε͕େ෯ʹ্͢Δ͜ͱͳ͘ɺখ͞ͳϞσϧಉͷύ ϑΥʔϚϯεΛൃشͨ͠ ࣄલֶशࡁΈͷॏΈΛ༻͢ΔͱɺϥϯμϜͳॳظԽͱҟͳΔֶश දݱ͕ಘΒΕΔ͔Ͳ͏͔Λௐࠪ ˠϥϯμϜͰݟΒΕͳ͍(BCPSMJLFͳϑΟϧλʔ͕ಘΒΕ͍ͯΔ ͷ͕֬ೝͰ͖ͨɻ͕͜ΕॳظԽ͔࣌ΒసҠֶशʹΑͬͯϞσϧ͕ಈ ͔ͳ͔ͬͨʹա͗ͳ͍
Slide 18
Slide 18 text
#Conclusion ͓࣋ͪؼΓͯ͠΄͍͠ݟʢ࠶ܝʣ సҠֶश͕͋·Γਐ·ͳ͔ͬͨཧ༝Λௐࠪ ˠPWFSQBSBNFUSJ[BUJPOͷ݁ՌͰ͋Δͱߟ͑ΒΕΔɻͨͩ͠ɺҙຯ ͷ͋Δ෦ͷΈநग़͢Δ͜ͱՄೳ సҠֶशͷརଞʹͳ͍͔ௐͯΈͨ ˠਫ਼ಛʹ্͕Βͳ͍͕ΑΓ༏ΕͨεέʔϦϯάͷॏΈ͕ಘΒΕͨ ͷʹՃ͑ɺऩଋ্͕ͬͨ