Slide 1

Slide 1 text

"$-໢ཏతαʔϕΠใࠂձ ҩྍݴޠσʔλͱඇݴޠҩྍσʔλͷڠಇ 2019. 11. 2 Yuta Nakamura

Slide 2

Slide 2 text

ࣗݾ঺հ தଜ ༏ଠ (ͳ͔ΉΒ Ώ͏ͨ) ɾ౎಺ۈ຿ͷ์ࣹઢՊҩ ɾ౦ژେֶେֶӃ ҩֶത࢜՝ఔ1೥ (ࣗવݴޠॲཧΛར༻ͨ͠ը૾਍அࢧԉ) @iBotamon

Slide 3

Slide 3 text

લஔ͖

Slide 4

Slide 4 text

/-1͔Βͷࢹ఺ ҩྍػؔ಺ͷσʔλΛ࢖͏λεΫ ྫɿ਍அࢧԉ ← ࠓճ͸ͪ͜Β จॻ࡞੒ࢧԉ ඇߏ଄Խσʔλͷߏ଄Խ ҩྍػؔ֎ͷσʔλΛ࢖͏λεΫ ྫɿҩֶݚڀࢧԉ SNS͔Βͷༀ෺༗֐ࣄ৅ͷൃݟʢࢢൢޙௐࠪʣ SNS͔Βͷ࣬පྲྀߦ༧ଌ ݈߁૬ஊͷͨΊͷର࿩γεςϜ

Slide 5

Slide 5 text

ҩྍ͔Βͷࢹ఺ ͳͥ “ඇݴޠσʔλͱͷڠಇ” ͕໘ന͍͔ʁ ैདྷͷྟচݚڀ ʹ ໖ີʹσβΠϯͨ͠ྟচࢼݧ ɾհೖ܈ / ରর܈ Λ৻ॏʹίϯτϩʔϧ ʴ ৽͍͠ྟচݚڀ ʹ େن໛σʔλ͔Β஌ݟΛಘΔ ɾҩྍݱ৔Ͱ೔ʑ஝ੵ͞Ε͍ͯ͘σʔλΛར༻ (Real World Data) ɾݱࡏ͸ඇݴޠσʔλΛ࢖͏΋ͷ͕ଟ͍ ↑ ࠓޙNLP΋ؔΘ͍ͬͯ͘Մೳੑ େ ҩༀ඼։ൃʹ͓͚ΔϦΞϧϫʔϧυσʔλ׆༻΁ͷظ଴ –੡ༀاۀͷࢹ఺ΑΓ- ༀࡎӸֶ. 2019; 24(1): 19-30.

Slide 6

Slide 6 text

࿦จ঺հ

Slide 7

Slide 7 text

࿦จͱ໰୊ઃఆ ٸੑ஬ਨԌΛɼ ɾٹٸ֎དྷͷΧϧςจॻʢʹݴޠσʔλʣ ɾٹٸ֎དྷͷ݂ӷݕࠪσʔλʢʹඇݴޠσʔλʣ ͔Βࣗಈ਍அ͢Δ BioNLP 2019: 18th ACL Workshop on Biomedical Natural Language Processing Steven Kester Yuwono et al. Learning from the Experience of Doctors: Automated Diagnosis of Appendicitis Based on Clinical Notes

Slide 8

Slide 8 text

TL;DR ᶃΧϧςจॻΛΫϦʔχϯάͤͣʹ࢖༻ ᶄඇݴޠσʔλ΋࢖༻ → ҩࢣͱ΄΅ಉ౳ͷ਍அੑೳ

Slide 9

Slide 9 text

Background: ٸੑ஬ਨԌ appendicitis ɾ஬ਨʹੜͨ͡ײછ঱ɼ͍ΘΏΔ “໡௎” ɾ঱ঢ়ɿయܕతʹ͸Έ͓ͧͪ → ӈԼෲ෦ʹҠಈ͢Δ௧Έ ɾ࣏ྍɿ߅ەༀ (߅ੜ෺࣭) or खज़ ʰ࠷৽ΨΠυϥΠϯ४ڌ ফԽث࣬ױ਍அɾ࣏ྍࢦ਑ʱ. தࢁॻళ. pp.338-340.

Slide 10

Slide 10 text

Background: ٸੑ஬ਨԌ appendicitis ɾ਍அɿ (1) ঱ঢ়΍֤छݕࠪΛ;·͑૯߹తʹ൑அ (2) είΞϦϯάγεςϜΛར༻ 9-10: very probable 7-8: probable 5-6: possible ʰ࠷৽ΨΠυϥΠϯ४ڌ ফԽث࣬ױ਍அɾ࣏ྍࢦ਑ʱ. தࢁॻళ. pp.338-340.

Slide 11

Slide 11 text

Background: ਍அ→࣏ྍ·ͰͷྲྀΕ དྷӃ ֎དྷ਍࡯ ɾ໰਍಺༰ɼ਎ମॴݟ ← ࢖͏ (ݴޠσʔλ) ɾ݂ӷݕࠪ ← ࢖͏ (ඇݴޠσʔλ) ɾը૾ݕࠪ (௒Ի೾, Xઢ, CT) ← ࢖Θͳ͍ ஬ਨԌͷՄೳੑߴ ஬ਨԌͷՄೳੑ௿ ೖӃ → ͞ΒͳΔݕࠪ ࣏ྍ → ୀӃ ɾ࠷ऴతͳ਍அ ← ୀӃαϚϦʔʹهࡌ ← Ground Truth ஬ਨԌ ஬ਨԌͰͳ͍ ࣏ྍ → ୀӃ

Slide 12

Slide 12 text

໰୊ઃఆ (࠶ܝ) ٸੑ஬ਨԌΛɼ ɾٹٸ֎དྷͷΧϧςจॻ ɾٹٸ֎དྷͷ݂ӷݕࠪσʔλ ͔Βࣗಈ਍அ͢Δ free-textͷٹٸ֎དྷΧϧς + ݂ӷݕࠪ਺஋σʔλ ↓ ٸੑ஬ਨԌͷ probability score (0ʙ1) ೖྗ ग़ྗ

Slide 13

Slide 13 text

Materials & Methods σʔληοτ ɾγϯΨϙʔϧࠃཱେֶෟଐපӃͷ ٹٸ֎དྷΧϧς & ୀӃαϚϦʔ 180,000 ૊ ɾClass: positive 1.6%, negative 98.4% ࢦඪ ɾF0.5 score (precisionΛॏࢹ)

Slide 14

Slide 14 text

ͪͳΈʹʜ ҩྍݴޠσʔλ͸かなりԚ͍ ๩͍͠਍ྍͷ߹ؒʹॻ͔ΕΔ ↓ ɾஅยత ɾՕ৚ॻ͖ ɾུޠ ɾޡࣈɼ୤ࣈ nkda complain of rif pain – since this afternoon - no vomiting / diarrhea - no fever o/e: afebrile vitals stable h l clear a soft, rif tenderness, rebound positive fbc renal panel tw

Slide 15

Slide 15 text

Convolution Encoder-Decoder CoNLL-2014 จ๏ޡΓగਖ਼λεΫ F0.5 45.36 (baseline:38.54) Chollampatt S et al. A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error Correction. AAAI 2018.

Slide 16

Slide 16 text

Embedding (word2vec (300d) Λ train dataͰ܇࿅) 1D Convolution (window = 3, filter = 300) Residual Connection 1 LSTM Residual Connection 2 Self Attention ݂ӷݕࠪͷ਺஋σʔλΛ جఈؔ਺ʹ௨ͯ͠concat Affine + Sigmoid score pad Convolutional Residual Recurrent Model (CR2 Model)

Slide 17

Slide 17 text

Result Baseline 1 ٹٸ֎དྷͰͷҩࢣͷ਍அ Alvarado score ≧ 7఺ CR2 model Baseline 1 Baseline 2 Model F0.5 0.686 F0.5 0.539 F0.5 0.579 '1͸গͳ͍͕ '/͸ଟ͍

Slide 18

Slide 18 text

Result Baseline 1 ٹٸ֎དྷͰͷҩࢣͷ਍அ Alvarado score ≧ 7఺ CR2 model Baseline 1 Baseline 2 Model F0.5 0.686 0.900 F0.5 0.539 0.821 F0.5 0.579 0.895 1PTJUJWFOFHBUJWF͔ͭ /FHBUJWF΋͢΂ͯෲ෦࣬ױͷEBUBTFU

Slide 19

Slide 19 text

Result Attention Layer ͸ “஬ਨԌΒ͍͠঱ঢ়” ͱ “஬ਨԌΒ͘͠ͳ͍঱ঢ়” Λ ೝ͍ࣝͯͨ͠ ӈෲ෦௧ ӈ௎ࠎᜰͷ௧Έ ൓௓௧ ᙤ௧ Լཀྵ

Slide 20

Slide 20 text

Discussion ҙຯ͸͋Δͷ͔ʁ → ը૾ݕࠪΛҰ੾࢖͍ͬͯͳ͍ͷ͕ಛ௃ ஬ਨԌͷ਍ྍͰCT͕ࡱ૾͞ΕΔػձ͕ٸ૿͍ͯ͠Δ͕ ਍ྍͷoutcomeʹد༩͍ͯ͠ͳ͍ͱ͍͏ࢦఠ͕͋Δ → ແବͳը૾ݕࠪΛݮΒͤΔՄೳੑ Michael D Repplinger et al. J Am Coll Radiol. 2016; 13(9): 1050-1056. Sheraz R Markar et al. Int J Surg. 2014; 12(4): 357-360.

Slide 21

Slide 21 text

கࢮత͕ͩ਍அ΋೉͍͠ɼٸੑݺٵଅഭ঱ީ܈(ARDS) Λ ूத࣏ྍࣨͰૣظൃݟ͢ΔͨΊͷݚڀ Free-text ਍ྍه࿥ͷ΄͔, ଟ͘ͷඇݴޠҩྍσʔλΛ࢖༻ (ICD code, όΠλϧαΠϯ, ݂ӷݕࠪ, ݺٵঢ়ଶ, ҙࣝঢ়ଶ) → AUC 92.61ʙ93.59 ಉछͷ΄͔ͷ࿦จ BioNLP 2019: 18th ACL Workshop on Biomedical Natural Language Processing Emilia Apostolova et al. Combining Structured and Free-text Electronic Medical Record Data for Real-time Clinical Decision Support

Slide 22

Slide 22 text

ɾҩྍݴޠॲཧͱඇݴޠσʔλͷڠಇΛѻͬͨ ACL BioNLP Workshop ͷ࿦จΛ঺հ͠·ͨ͠ ɾࠓޙ·͢·͢ൃల͕ظ଴͞ΕΔྖҬ ·ͱΊ