今日から始める全文検索

2019年1月22日に開催された【とらのあな主催】オタクが最新技術を追うライトニングトークイベント２回目のライトニングトーク資料です。

Transcript

1.        Copyright (C) 2019 Toranoana Inc. All Right Reserved. 
     
   ΦλΫ͕࠷৽ٕज़Λ௥͏ϥΠτχϯάτʔΫΠϕϯτ̎ճ໨     
2.        Copyright (C) 2019 Toranoana Inc. All Right Reserved.   • 2018 10   • Fantia 
    Ruby, JavaScript Java 2  
3.        Copyright (C) 2019 Toranoana Inc. All Right Reserved. •   •  •    •  •    • 
    •  3 
   
4.        Copyright (C) 2019 Toranoana Inc. All Right Reserved. <,+%'> $)-2< &10: #0: 69   <(;> • $)-2753 
   8 0* • $)-2"/ .4 !  * 4 
   
5. EB EB EB EB E B EB Copyright (C) 2019 Toranoana Inc. All Right Reserved. 0<>C 0<>CH## #
   D: Full text searchI 
   &,(*-'
   F;<=H)$% +I?8<72">C )$%+4 >C3.)$%+1<72>CA
   F;<= 
   <=5! 0<"9G >C:6/@ !  HWikipediaI 5 F;<=()$%+)5! 0<7"9G>C
6.        Copyright (C) 2019 Toranoana Inc. All Right Reserved.    
      6
7. $" $" $" $" $ " $" Copyright (C) 2019 Toranoana Inc. All Right Reserved. 7 !#  !# !# Apache Lucene)Java* Whoosh)Python*  Apache Solr Elasticsearch Groonga)C&'*  Google!# Fess    % 
    !# (
8. $ " $ " $ " $ " $ " $ " Copyright (C) 2019 Toranoana Inc. All Right Reserved. #  
    #% #& ≒  # ! 8
9. 
    
    
    
    
    
    Copyright (C) 2019 Toranoana Inc. All Right Reserved. 
      • grep  •    9
10.        Copyright (C) 2019 Toranoana Inc. All Right Reserved.  grep ⇒ 
      10
11. 4 1 4 1 4 1 4 1 4 1 4 1 Copyright (C) 2019 Toranoana Inc. All Right Reserved. 7-,2 .) <.)> • "'
    6
    9 %8*( 7/ & 5+
    : <$> • Linux grep! • #30  Ctrl+F ,2 11
12.             Copyright (C) 2019 Toranoana Inc. All Right Reserved.    ⇒   
       12
13. ) $ ) $ ) $ ) $ ) $ ) $ Copyright (C) 2019 Toranoana Inc. All Right Reserved. '- ,! *!% !& #     13
    Ruby(,Ruby +2" 
14. %! %! %! %! % ! %! Copyright (C) 2019 Toranoana Inc. All Right Reserved. ##  < > #&
    #(
    *( #
    ) <> • Google"#   • RDB  (B-Tree) • #  ('$  ) 14
15. $! $! $! $! $ ! $! Copyright (C) 2019 Toranoana Inc. All Right Reserved. %# " "
    '&"  ( 15
16. 3 / 3 / 3 / 3 / 3 / 3 / Copyright (C) 2019 Toranoana Inc. All Right Reserved. 72 -% <-%> 56(1#$)&) .2*04,9 +18"<8=&)! > : &)  =2,3> 1# (';"!
    
    16
17. ($ ($ ($ ($ ( $ ($ Copyright (C) 2019 Toranoana Inc. All Right Reserved. & ! " "ID  1  2  - 
    3  17 )+.&+/ "ID  2, 3  1, 2  3  1, 2, 3  1, 3 - 2 
    2 & (,' ) N-Gram %*# . "/
18. . * . * . * . * . * . * Copyright (C) 2019 Toranoana Inc. All Right Reserved. &)+ , <>
     )+ →
    
     '! &(% / 03+$04 &(ID  2, 3  1, 2  3  1, 2, 3 " 1, 3 2 2  2 &(ID # 1 " 2 2  3 " 18 +$ (1-) &(
19. & # & # & # & # & # & # Copyright (C) 2019 Toranoana Inc. All Right Reserved. ') " )+  () .%)
    )
    ) ,!$ *- 19 ⇒)  
20. . , . , . , . , . , . , Copyright (C) 2019 Toranoana Inc. All Right Reserved. /2 %$* 25  12 9&(2
     2
    6 2 74 !38 20 ⇒  ...  $*+  • "#-0)7'8 • N-Gram
21. ( & ( & ( & ( & ( & ( & Copyright (C) 2019 Toranoana Inc. All Right Reserved.  ')$ +"%
     !# *, '-  ,"- 21
22.             Copyright (C) 2019 Toranoana Inc. All Right Reserved.   <>   ↓   ...   
    !6 22
23. 5 0 5 0 5 0 5 0 5 0 5 0 Copyright (C) 2019 Toranoana Inc. All Right Reserved. $(16* /% <.> +2#  83 :N-Gram" 
    +2  ' +2!4 <,.> 9) &4  +2  7  ;+2-< 23
24.       Copyright (C) 2019 Toranoana Inc. All Right Reserved. N-Gram ! "  
    N    24
25.        Copyright (C) 2019 Toranoana Inc. All Right Reserved. N-Gram <> 2-Gram "  ↓ 2  ... " "  
    !#10 25
26. :4 :4 :4 :4 : 4 :4 Copyright (C) 2019 Toranoana Inc. All Right Reserved. N-Gram3( < 2> /61
    A?9 %9 /67. < B <02> /6" >8@')5;- #
    N(,&+$*)!= /6
    26
27. 63 63 63 63 6 3 63 Copyright (C) 2019 Toranoana Inc. All Right Reserved.
    04#! -*04 "$@-*81 04:(, 047 @%<'-*  04  -*A >).=-*+29;&? 27  045/
28. 82 82 82 82 8 2 82 Copyright (C) 2019 Toranoana Inc. All Right Reserved. 15! <!> . > • )+4:/A9$ <→. > . >&,315
     >& ,-15 ?(#7";@ • 2-GramA9$ <→.  >  >&,-1560$ 
      =%*' ⇨15 28
29.        Copyright (C) 2019 Toranoana Inc. All Right Reserved. N- Gram 29     
    
    N-Gram
    
    
30. 94 94 94 94 9 4 94 Copyright (C) 2019 Toranoana Inc. All Right Reserved. &" • &,06BA6(#
     C?.@(D • &,066(
    
    >8!  • >8! :'=#-)+5; /N-GramE – 0627< ⇒ N-Gram% –
    
    * ⇒ )+5;/% – 0621
    
    *06
    ⇒ N-Gram + )+5;/ $3 30
31. %! %! %! %! % ! %! Copyright (C) 2019 Toranoana Inc. All Right Reserved. %! Fantia  # $
    #  ' • "& ( N-Gram   31
32.       Copyright (C) 2019 Toranoana Inc. All Right Reserved.
       32