Slide 1
Slide 1 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
~ ~
ΦλΫ͕࠷৽ٕज़Λ͏ϥΠτχϯάτʔΫΠϕϯτճ
Slide 2
Slide 2 text
.* .* .* .* .
* .*
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
"%
• 201810# .*)
• Fantia2'31&
• /0
- Ruby, JavaScript, Java
•
- , SAO
• $!
- (,
2
-+
Slide 3
Slide 3 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
● *%-(
● )..
○
○ /101'*
● /101)
"
!#
&)2$3
● /101)
+
● ,'-
3
Slide 4
Slide 4 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
2747+'
*%
&!-"
● 0/ 1!#83965
1$&.#'
● 27471$&.#(01
,/)'
4
Slide 5
Slide 5 text
%" %" %" %" %
" %"
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
(
• !#+*
#
,' )
-
• !##&$
5
Slide 6
Slide 6 text
%! %! %! %! %
! %!
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
#
ID
1
2
*
3
7
&(+#(, ID
2, 3
1, 2
3
1, 2, 3
1, 3
* 2
2
#
()$ )
"'
or
N-Gram
Slide 7
Slide 7 text
3. 3. 3. 3. 3
. 3.
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
!&9
• 8247'#%/5
(
N-Gram>
– )0+16 ⇒ N-Gram
– $ ⇒ #%/5(
– )0+*$)0
⇒ N-Gram + #%/5( ,
<>-; :"=
8
Slide 8
Slide 8 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
9
Slide 9
Slide 9 text
$" $" $" $" $
" $"
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
1
0
!#
!#
!#
Apache Lucene)Java*
Whoosh)Python*
Apache Solr
Elasticsearch
Groonga)C&'*
Google!#
Fess
%
!#(
Slide 10
Slide 10 text
$
" $
" $
" $
" $
" $
"
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
#
#% #&
≒ # !
11
Slide 11
Slide 11 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
1. Groonga
2. Apache Lucene
3. MySQL
12
Slide 12
Slide 12 text
$ $ $ $ $
$
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
1. Groonga!
• #"
Groonga &%
13
Slide 13
Slide 13 text
F> F> F> F> F
> F>
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
GroongaMN
• L=C67'
67J;*:DM#% /
9A?N
• 9A%
CIJ!!
")<,D
• N-Gram23@H8(Mecab)&4)<,D
• 50G.B- )
!$K
1MMroonga, PGroonga?N
14
+E(COGroonga#
Slide 14
Slide 14 text
<
6 <
6 <
6 <
6 <
6 <
6
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
Mroonga@A
• Groonga '
MySQL$'&&
• SQL!&Groonga)@SQL01
=
+/28A
• MySQL
*,3:@$#'"&7A)
• Groonga5.)4
• MySQL
FULLTEXT&
?>
15
-;(9BGroonga%
Slide 15
Slide 15 text
3 - 3 - 3 - 3 - 3
- 3 -
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
PGroonga4
5
• PostgreSQL %$*1
• Groonga, 1
• LIKE+."4'#SQL!(
&)/ 15
16
206Groonga
Slide 16
Slide 16 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
Groonga
• Mroonga PGroongaCloudSQL
GCP RDSAWS
17
Slide 17
Slide 17 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
2. Apache Lucene
• Apache Lucene
18
Slide 18
Slide 18 text
.+ .+ .+ .+ .
+ .+
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
Apache Lucene
2
3
• Apache1)Java/!%&,
23
• Java(jar)$
• "(-
19
Apache LuceneApache Software Foundation*0#'#'
Slide 19
Slide 19 text
@; @; @; @; @
; @;
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
Apache Solr
H
''I
• ApacheD9Lucene#'5='!
• '"&'
• C/.>(2006/~)*F1G
• N-Gram02
Slide 20
Slide 20 text
62 62 62 62 6
2 62
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
Elasticsearch
: !
;
• $"0(,4
• Elastic19/Lucene!,4!
• ! !
• RESTful API
CRUD*#&5:-8
) ;
• %+.57':Kibana, Logstash3;
21
Slide 21
Slide 21 text
)% )% )% )% )
% )%
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
Kibana-.
• Elastic$+
• Elasticsearch
!&
"'
*#
22
,( https://www.elastic.co/jp/products/kibana
Slide 22
Slide 22 text
OI OI OI OI O
I OI
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
Elasticsearch
V
)W
• &"#" )'(J1V&"#0=SR
W
• N-Gram:.D2M
• Apache Solr;GVv1.020149~W/$%
NH7Q
T9U-
68
• 4D3
@L(!(AEC5*F,B
23
Slide 23
Slide 23 text
@< @< @< @< @
< @<
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
Elasticsearch
E)
F
• $!) 0)"15-
– Amazon Elasticsearch Service
• AWS968
,:/?
4BA
• AWS()'*
=.&+3
• #&(Kibana, Logstash
• %))2>C7;D
24
Slide 24
Slide 24 text
KF KF KF KF K
F KF
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
Elasticsearch
M .N
• '".!7.$8;2
– Elastic CloudMAWS, GCPN
• @:ElasticE;2
%,'".!.$M.#J
0AWS, GCP4DN
• 3&*-1D6I
• (..9HL>1
• ?<#.)-++.=1
• #.)- &G5
•
A/+.)-CBAWS
25
Slide 25
Slide 25 text
E? E? E? E? E
? E?
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
Elasticsearch
H
.
I
• (%.$6.& 7:1
– ElasticsearchHGoogle Click to DeployI
• A3* ! Elasticsearch"',4C
• - !- D/D2@<
9F
• 5>'*-)..8BG;0=4C
HD2- #.+
9FI
26
Slide 26
Slide 26 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
1. Groonga
– Groonga"!
– Mroonga"MySQLGroonga
– Gproonga"PostgreSQLGroonga
2. Apache Lucene
– Apache Solr"
– Elasticsearch"
27
Slide 27
Slide 27 text
'
# '
# '
# '
# '
# '
#
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
3.
…
• MySQLHyper EstraierNamazu$
(
)"!
MySQL
&%
29
Slide 28
Slide 28 text
'# '# '# '# '
# '#
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
MySQLFULLTEXT
• MySQL! &+v3.23.23*,
• v5.7 )
• N-Gram$((Mecab)"
&
• SQL%&
• CloudSQLRDS"&
30
Slide 29
Slide 29 text
! ! ! ! !
!
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
#
1. %$
&
#
2. "#
31
Slide 30
Slide 30 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
32
MySQL PostgreSQL
Oracle
Slide 31
Slide 31 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
MySQL
33
MySQL
FULLTEXT
Slide 32
Slide 32 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
PostgreSQL
34
PostgreSQL
Slide 33
Slide 33 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
Oracle
35
Oracle
Slide 34
Slide 34 text
,
+ ,
+ ,
+ ,
+ ,
+ ,
+
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
-(
MySQLMroonga
/
.*& %$FULLTEXT
0
PostgreSQLPGroonga
"Elasticsearch
#) Elasticsearch!'
Elasticsearch
36
Slide 35
Slide 35 text
#
#
#
#
#
#
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
#
Fantia
!"
!
&
<%> DB)CloudSQL'MySQL(
→Mroonga
Elasticsearch$
37
Slide 36
Slide 36 text
Copyright (C) 2019 Toranoana Inc. All Right Reserved.
38