minne での検索改善の歴史

by shiro16

Slide 1

Slide 1 text

ޙ౻རത(.01FQBCP *OD ୈճ&MBTUJDTFBSDIษڧձʮݕࡧฤʯ NJOOFͰͷݕࡧվળͷྺ࢙

Slide 2

Slide 2 text

νʔϑςΫχΧϧϦʔυ 5PTIJIJSP(PUP!@TIJSP NJOOFࣄۀ෦!(.0ϖύϘ

Slide 3

Slide 3 text

·ͣ͸NJOOFͷ঺հ

Slide 4

Slide 4 text

NJOOF

Slide 5

Slide 5 text

NJOOFͷ঺հ wࠃ಺࠷େͷϋϯυϝΠυϚʔέοτ wѻ͏ΧςΰϦʔ͸ΞΫηαϦʔ͔ΒՈ۩΍৯඼·Ͱ༷ʑ wαʔϏε։࢝ wࠓ݄ ʹΞϓϦ%-਺ສಥഁ wੈా୩ਆށ෱ԬʹͯNJOOFͷΞτϦΤͱݺ͹ΕΔ࡞ՈࢧԉεϖʔεΛӡӦ wϦΞϧΠϕϯτ΋ଟ਺։࠵

Slide 6

Slide 6 text

ϦΞϧΠϕϯτͷ༷ࢠ

Slide 7

Slide 7 text

ࠓ೔ͷ಺༰ wߏ੒ͷ͓࿩ wTPMS͔Β&MBTUJDTFBSDIҠߦલޙ w&MBTUJDTFBSDIҠߦޙͷߏ੒มߋ wݕࡧʹ͍ͭͯ wܭଌͷ͸ͳ͠ w"#ςετͷ࿩ wTVHHFTUFSͷ࿩ wࣙॻ؅ཧͷ࿩

Slide 8

Slide 8 text

·ͣ͸ߏ੒ͷ࿩

Slide 9

Slide 9 text

˞࡞඼σʔλ͕ߋ৽͞Εͨࡍͷॲཧͷ؆қਤ Ҏ߱ ·Ͱ

Slide 10

Slide 10 text

wݕࡧΤϯδϯ͸4PMS wσʔλͷ൓ө͸ఆظCBUDI w࡞඼ͷݕࡧͷΈ͕ଘࡏ wݕࡧΤϯδϯ͸&MBTUJDTFBSDI wσʔλͷ൓ө͸ߋ৽࣌ʹඇಉظ ॲཧ wҠߦ࣌͸࡞඼ݕࡧͷΈ͕ͩଓʑ ૿͑Δ ·Ͱ Ҏ߱

Slide 11

Slide 11 text

σʔλ൓өͷҧ͍͸ݕࡧΤϯδϯͷҧ͍Ͱ ͸ͳ͘ҠߦλΠϛϯάͰྑ͖ΞʔΩςΫνϟ Λબ୒͚ͨͩ͠

Slide 12

Slide 12 text

NJOOFY&MBTUJDTFSDIͷྺ࢙

Slide 13

Slide 13 text

NJOOFY&MBTUJDTFBSDIୈظ wͷ4PMS͔ΒҠߦͨ͠ࡍ͸'PVOE ݱ&MBTUJD$MPVE Λ࢖༻ wࣾ಺Ͱӡ༻ͷϊ΢ϋ΢΋ͳ͔ͬͨ wͱΓ͋͑ͣҠߦεϐʔυΛ༏ઌ͔ͨͬͨ͠ w࢖༻͍ͯ͘͠͏ͪʹ໰୊͕ൃੜͨ͠ wεέʔϧΞοϓ͕େม wࣙॻ͕࢖͑ͳ͍ ಋೖ౰ॳ͔ΒΘ͔ͬͯ͸͍ͨ wQMVHJOͷ௥Ճ ಋೖ౰ॳ͔ΒΘ͔ͬͯ͸͍ͨ

Slide 14

Slide 14 text

౰࣌'PVOEͰ໰୊ʹͳ͍ͬͯͨ͜ͱ͸  &MBTUJD$MPVEͰ͸ղফ͞Ε͍ͯΔ͸ͣʂʁ

Slide 15

Slide 15 text

NJOOFY&MBTUJDTFBSDIୈظ w"84&$ʹࣗલͰΫϥελΛߏங wͳͥ"NB[PO&MBTUJDTFBSDI4FSWJDFΛબ୒͠ͳ͔ͬͨʁ w౰࣌͸&MBTUJDTFBSDIͷWFSTJPO͕ݹ͔ͬͨ ࠷৽͕࣌୅ʹ wࣙॻΛ࢖͑ͳ͍໰୊͸ղܾ͠ͳ͔ͬͨ wݱࡏͷ&MBTUJDTFBSDIͷWFSTJPO͸Y

Slide 16

Slide 16 text

͜͜·Ͱͷ·ͱΊ

Slide 17

Slide 17 text

͜͜·Ͱͷ·ͱΊ wNJOOF͸4PMS͔Β&MBTUJDTFBSDIʹҠߦ͠·ͨ͠ wॳظ͸&MBTUJD$MPVE wޙʹ"84&$ʹΫϥελΛߏங w&MBTUJDTFBSDIΛબΜͩཧ༝͸

Slide 18

Slide 18 text

͔͜͜Βݕࡧͷ࿩

Slide 19

Slide 19 text

ݕࡧ݁Ռͷྑ͠ѱ͠ͱ͸

Slide 20

Slide 20 text

ݕࡧ݁Ռͷྑ͠ѱ͠ w࠶ݱ཰ ద߹཰͔Βܭࢉ͢Δ͜ͱ͸Մೳ wຊ౰ʹϢʔβ͕ٻΊΔݕࡧ͔ʁ͸දࣔ͢Δॱ൪΋Өڹ͢Δ wͳΜͱͳ͘ྑͦ͞͏Ͱݕࡧ݁ՌΛ͍͍ͬͯ͘͡ͱ w࣮͸Ϣʔβ͔ΒݟͨΒΰϛΈ͍ͨͳݕࡧ݁Ռʹ੒௕͍ͯ͠ΔՄೳੑ΋ wϢʔβ͕ٻΊ͍ͯͨ΋ͷ͕࠷ޙͷϖʔδʹ͋Γશ͘ݟ͔ͭΒͳ͍౳ͷ໰୊͕

Slide 21

Slide 21 text

Ϣʔβ͕ٻΊ͍ͯͨ΋ͷΛݟ͚ͭΒΕ͔ͨʁ Λ஌Δʹ͸ʁ

Slide 22

Slide 22 text

ܭଌ͢Δ͔͠ͳ͍

Slide 23

Slide 23 text

NJOOFͰ͸ߦಈϩάΛ࢖ͬͯܭଌ

Slide 24

Slide 24 text

ϩάΛ஝ੵ͢Δਤ

Slide 25

Slide 25 text

͜͜ʹݟग़͕͠ೖΓ·͢ wϢʔβͷߦಈϩάΛ5%౳ʹ஝ੵ͢Δ wߦಈϩάʹ͸Ͳ͏͍͏৚݅Ͱݕࡧ͞Ε͔ͨʁͱ͍͏৘ใͳͲ΋ؚ·ΕΔ w஝ੵ͞ΕͨߦಈϩάΛूܭ͠$53౳ͷࢦඪΛSFEBTI౳Ͱݟ͑ΔԽ wݕࡧ݁ՌΛม͑ͨ͜ͱʹΑͬͯ$53͕Ͳ͏มԽ͔ͨ͠ʁΛ௥͏

Slide 26

Slide 26 text

ܭଌ४උ͕Ͱ͖ͨͷͰ"#ςετ

Slide 27

Slide 27 text

ݕࡧ݁Ռͷ"#ςετ wϢʔβΛ"#ʹ෼ྨ wϥϯμϜͰৼΓ෼͚ͯDPPLJFʹ৘ใΛ৯ΘͤΔ౳ wϢʔβͷߦಈϩάʹࣗ෼͕"#ͲͪΒͳͷ͔ʁͱ͍͏৘ใΛ෇༩͢Δ w"#ͦΕͧΕͷࢦඪΛݟ͑ΔԽ͠ͲͪΒ͕ྑ͍͔ʁΛൺֱ͢Δ wࢦඪ͕ߴ͍ํΛ࠾༻࣍͠ͷ"#Λߦ͏ w̋̋ԁҎ্ߪೖͰ̋̋ΩϟϯϖʔϯͳͲ͕͋Δͱࢦඪ͕ϒϨΔ͜ͱ͕͋ΔͷͰ ஫ҙ͕ඞཁ

Slide 28

Slide 28 text

ݕࡧͷߦಈϩάΛ஝ੵ͢Δͱ ଞʹ΋ྑ͍͜ͱ͕

Slide 29

Slide 29 text

ϩάΛ஝ੵ͢Δ͜ͱͷϝϦοτ wࡢ೥ͷϩάΛݟͯτϨϯυΛ஌Δ͜ͱ͕Ͱ͖Δ wNJOOFͷΑ͏ͳ഑ૹʹ͕͔͔࣌ؒΔαʔϏεͩͱ࣮ࡍͷτϨϯυͱඍົʹͣ Ε͍ͯͨΓ͢Δ wޙड़ͷΦʔτίϯϓϦʔτར༻Մೳ wFUD

Slide 30

Slide 30 text

NJOOFͰ͸ͲΜͳ"#ςετΛ ͍ͯ͠Δ ͍ͯͨ͠ ͔ʁ

Slide 31

Slide 31 text

'VODUJPO4DPSF2VFSZΛ࢖͍είΞΛมߋ wߪೖ͞Εͨճ਺͕ଟ͍ w͓ؾʹೖΓͷ਺͕ଟ͍ wಛఆͷ୯ޠ قઅతͳ ؚ͕·Ε͍ͯͨΒείΞΛ্Լ wϢʔβͷଐੑ͝ͱʹείΞΛมߋ wΧςΰϦʔ͝ͱʹείΞ্͕ঢ͢Δ৚݅Λมߋ wFUD

Slide 32

Slide 32 text

GET /_search # likes ͷ஋ΛείΞʹ൓ө͢Δ { "query": { "function_score": { "field_value_factor": { "field": "likes", "factor": 1.2, "modifier": "sqrt" } } } }

Slide 33

Slide 33 text

"#ςετ͸͏·͍͔͘ͳ͍͜ͱ΋ଟ͍

Slide 34

Slide 34 text

͏·͍͔͘ͳ͔ͬͨͱ͍͏ ஌͕ࣝ஝ੵ͞ΕΕ͹ྑ͍

Slide 35

Slide 35 text

$PNQMFUJPO4VHHFTUFSͷ͓࿩

Slide 36

Slide 36 text

No content

Slide 37

Slide 37 text

$PNQMFUJPO4VHHFTUFSͱ͸ʁ w(PPHMFͰݕࡧ͢Δ࣌ʹ్த·Ͱೖྗ͢Δͱީิ͕ग़ͯ͘ΔΞϨ Φʔτίϯϓ Ϧʔτͱݺ͹ΕΔ΋ͷ w&4·Ͱ͸ઐ༻ͷFOEQPJOU @TVHHFTU ͕ଘࡏ͍ͯͨ͠ w&4͔Β͸௨ৗͷݕࡧ @TFBSDI ʹ4VHHFTUFS༻ͷΫΤϦΛ౤͛Δ

Slide 38

Slide 38 text

GET /_search { "suggest": { "minne-suggest": { "prefix": "minne", "completion": { "field": "suggest", "size": 10 } } } }

Slide 39

Slide 39 text

TVHHFTUͱͯ͠ొ࿥͢Δ୯ޠʹ͍ͭͯ

Slide 40

Slide 40 text

TVHHFTUͱͯ͠ొ࿥͢Δ୯ޠʹ͍ͭͯ wߦಈϩά͔ΒաڈO೔ؒͷݕࡧ͞Εͨ୯ޠΛूܭ͢Δ wूܭͨ͠୯ޠΛ$PNQMFUJPO4VHHFTUFS༻ͷ୯ޠͱͯ͠ొ࿥͢Δ wݕࡧճ਺Λج४ʹXFJHIUΛઃఆ͢Δ

Slide 41

Slide 41 text

ྨٛޠ΍ࣙॻ؅ཧͷ͓࿩

Slide 42

Slide 42 text

ྨٛޠ w"84ͱ"NB[PO8FC4FSWJDFT౳ͷจࣈͱͯ͠͸ҧ͏͕ҙຯ͕ಉ͡΋ͷΛҰ ॹʹѻͬͯ͘ΕΔΑ͏ʹͳΔΞϨ wྨٛޠΛࣗ෼Ͱఆٛ͢Δ͜ͱ͕Մೳ w4ZOPOZN5PLFO'JMUFSΛ࢖͏

Slide 43

Slide 43 text

ྨٛޠϦετΛͲ͏࡞͔ͬͨ wXJLJQFEJB͔Β࡞੒ wݕࡧ͞Εͨ୯ޠͷ্Ґ/݅ΛோΊͯϦετʹ௥Ճ w࠷ऴతʹ͸ਓྗͰϦετΛνΣοΫ

Slide 44

Slide 44 text

ྨٛޠϦετͷ՝୊

Slide 45

Slide 45 text

ྨٛޠϦετͷ՝୊ wݱঢ়͸ਓྗͳͷͰେม wఆظతʹߋ৽͕Ͱ͖͍ͯΔΘ͚Ͱ͸ͳ͍ w͋Δఔ౓ࣗಈԽΛ͍ͨ͠ wϋϯυϝΠυϚʔέοτͱ͍͏ಛੑ্ҰൠతͰ͸ͳ͍୯ޠ͕ଟ਺ଘࡏ

Slide 46

Slide 46 text

ࣙॻ؅ཧ

Slide 47

Slide 47 text

ࣙॻ wܗଶૉղੳΛ௨ͨ͠ࡍʹ૝ఆ֎ͷ୯ޠʹ෼ׂ͞ΕΔ͜ͱ͕͋Δ wϋϯυϝΠυͱ͍͏୯ޠ͕ϋϯυͱϝΠυʹ෼ׂ͞ΕΔ ͋͘·Ͱྫ w͜ͷΑ͏ͳ໰୊Λղܾͯ͘͠ΕΔͷ͕ࣙॻ

Slide 48

Slide 48 text

ࣙॻΛͲ͏࡞͔ͬͨ wաڈʹݕࡧ͞Εͨ୯ޠͷ্Ґ/݅Λऔಘ wऔಘͨ͠୯ޠΛ&MBTUJDTFBSDIͷ"OBMZ[Fʹ͔͚Δ w݁Ռͱͯ͠ෳ਺ͷτʔΫϯʹ෼͔Εͨ৔߹ɺࣙॻʹొ࿥ͨ͠ํ͕ྑ͍͔΋͠Ε ͳ͍୯ޠͱݴ͑Δ w্هͷϦετΛ࡞੒͋͠ͱ͸ਓ͕൑அ

Slide 49

Slide 49 text

GET /_analyze { "analyzer": "standard", "text" : "this is a test" }

Slide 50

Slide 50 text

΋͏গָ͍ͨ͠͠

Slide 51

Slide 51 text

ਏ͍ͷͰࣗಈԽ

Slide 52

Slide 52 text

ࣙॻ࡞੒ࣗಈԽୈظ wલ೔ʹݕࡧ͞Εͨ୯ޠΛूܭɺ্Ґ/݅Λऔಘ wऔಘͨ͠୯ޠΛ"OBMZ[Fʹ͔͚Δ w"OBMZ[Fʹ͔͚ͨ݁Ռෳ਺ͷτʔΫϯʹ෼ׂ͞Εͨ୯ޠΛTMBDLʹ௨஌ w্هΛखಈͰࣙॻʹ௥Ճ͢Δ wࣙॻ͸QVQQFUͷϦϙδτϦͰ؅ཧ͍ͯ͠Δ w։ൃ؀ڥͳͲͰ΋ຊ൪ͱಉࣙ͡ॻ͕࢖͑ΔΑ͏ʹͳΔ

Slide 53

Slide 53 text

No content

Slide 54

Slide 54 text

΋͏গָ͍ͨ͠͠

Slide 55

Slide 55 text

No content

Slide 56

Slide 56 text

ࣙॻ࡞੒ࣗಈԽୈظ wલ೔ʹݕࡧ͞Εͨ୯ޠΛूܭɺ্Ґ/݅Λऔಘ wऔಘͨ͠୯ޠΛ&MBTUJDTFBSDIͷ"OBMZ[Fʹ͔͚Δ w݁Ռͱͯ͠ෳ਺ͷτʔΫϯʹ෼͔Εͨ৔߹ɺ%#ʹอଘ wಡΈԾ໊ͳͲ͸खಈͰ؅ཧը໘͔Βొ࿥ wCBUDIͰ%#͔ΒࣙॻΛ࡞੒͠&MBTUJDTFBSDIʹEFQMPZ w্هCBUDIͰQVQQFUͷϦϙδτϦʹ1VMM3FRVFTUΛ࡞੒

Slide 57

Slide 57 text

ࣙॻʹొ࿥͢Δจࣈͷ͜ͱ͚ͩ ߟ͑Δ͜ͱ͕Ͱ͖ΔΑ͏ʹͳͬͨ

Slide 58

Slide 58 text

ࠓճ঺հͨ͠ࣄྫҎ֎Ͱ΋ &MBTUJDTFBSDIΛ࢖ͬͯ·͢

Slide 59

Slide 59 text

ͦͷଞͷࣄྫ w࡞Ոʹఏڙ͍ͯ͠ΔΞΫηεղੳػೳ w࡞Ոݕࡧ w೥લͷͲͷΑ͏ͳ୯ޠͰݕࡧ͞Ε͔ͨʁΛूܭ͢Δ͜ͱʹΑͬͯτϨϯυΛ ஌Δ wΫϦεϚε޲͚ͷ࡞඼͕೥લ͸Ͳͷ͘Β͍ͷ࣌ظ͔Β୳͞Ε࢝Ί͔ͨͳͲ wFUD

Slide 60

Slide 60 text

·ͱΊ

Slide 61

Slide 61 text

·ͱΊ wݕࡧͷΈͰ΋े෼ͳػೳ wϩάΛ૊Έ߹ΘͤΔ͜ͱͰߋʹڧྗ w"#ςετʹΑΓɺΑΓྑ͍ݕࡧ݁ՌΛ໨ࢦ͢ w$PNQMFUJPO4VHHFTUFSΛ࢖༻ͨ͠ΦʔτίϯϓϦʔτ wྨࣅޠ΍ࣙॻ؅ཧ͸େม w͋Δఔ౓ࣗಈԽ͢Δ͜ͱ͸ग़དྷΔ w͜͜Ͱ΋ϩά͕͍͖ͯ͘Δ

Slide 62

Slide 62 text

͋Γ͕ͱ͏͍͟͝·ͨ͠