Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Percolatorを用いたカテゴリ分類
INA Lintaro
August 02, 2018
Programming
0
1.9k
Percolatorを用いたカテゴリ分類
2018-08-02 Elasticsearch勉強会
https://www.meetup.com/ja-JP/Tokyo-Elastic-Fantastics/events/252971593/
INA Lintaro
August 02, 2018
Tweet
Share
More Decks by INA Lintaro
See All by INA Lintaro
計算ファースト vs. 型ファースト / Computation First vs. Type First
tarao
4
20k
10年でどう変わった? はてなブックマークでのPerlの使い方
tarao
9
7.4k
Other Decks in Programming
See All in Programming
Gradle build: The time is now
nonews
1
480
Showkase、Paparazziを用いたビジュアルリグレッションテストの導入にチャレンジした話 / MoT TechTalk #15
mot_techtalk
0
120
Findy - エンジニア向け会社紹介 / Findy Letter for Engineers
findyinc
2
42k
[2023년 1월 세미나] 데이터 분석가 되면 어떤 일을 하나요?
datarian
0
600
SwiftPMのPlugin入門 / introduction_to_swiftpm_plugin
uhooi
2
110
OIDC仕様に準拠した Makuake ID連携基盤構築の裏側
ymtdzzz
0
560
Prácticas de Seguridad en Kubernetes
pablokbs
0
130
TypeScript 4.9のas const satisfiesが便利
tonkotsuboy_com
9
2.3k
Cloudflare WorkersでGoを動かすライブラリを作っている話
syumai
1
320
Listかもしれない
irof
1
280
フロントエンドで 良いコードを書くために
t_keshi
3
1.6k
良質な技術記事を量産する秘訣 / #MeetsPro
jnchito
10
3.4k
Featured
See All Featured
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
318
19k
How to name files
jennybc
47
73k
jQuery: Nuts, Bolts and Bling
dougneiner
57
6.6k
Bash Introduction
62gerente
601
210k
Building Your Own Lightsaber
phodgson
96
4.9k
Build The Right Thing And Hit Your Dates
maggiecrowley
22
1.4k
Making the Leap to Tech Lead
cromwellryan
117
7.7k
Visualization
eitanlees
128
12k
In The Pink: A Labor of Love
frogandcode
132
21k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
349
27k
A Tale of Four Properties
chriscoyier
149
21k
A Modern Web Designer's Workflow
chriscoyier
689
180k
Transcript
Percolator id:tarao @oarat 2018-08-02 Elasticsearch
(id:tarao @oarat) 2008-10 ( ) 2010-04 (DC1) 2013-04 2013-12 2017-02
◮ ◮ , ◮ ◮ Scala
None
◮ (2015 ) ◮
None
:
◮ ◮ ◮
pull ◮ (Complement Naive Bayes) ◮ ◮ ◮ N ◮
◮
pull
pull ◮ ◮ ◮ Elasticsearch ◮ Memcached
pull
pull ◮ ◮ ◮ ◮ ( ) ◮ N (
N ) ◮
push ◮ ( ) ◮ ( )
push
◮ ◮
◮ ◮ ⇒ Percolator
Percolator https://en.wikipedia.org/wiki/Coffee_percolator
Percolator (Scala) createIndex(MainIndex).mappings( mapping("issue_item_query") fields percolatorField("query")) val query = issueItem.query.toCategorizingQuery.toFilteredQuery
register(query) into(MainIndex / "issue_item_query", "query") withId issueItemId.toPercolatorId search(MainIndex / "issue_item_query") query { percolateQuery("entry", "query") usingSource entry.toEsEntry.toJsonString }
Percolator (API) PUT /MainIndex/issue_item_query { "mappings": { "_doc": { "properties":
{ "query": { "type": "percolator" } } } } } PUT /MainIndex/issue_item_query/issueItemId { "query": query } GET /MainIndex/issue_item_query/_search { "query": { "percolate": { "document_type": "entry", "field": "query", "document": entry } } }
◮ ◮ OR
◮ ◮ ◮ ◮
◮ ×8 ◮ ×250+ ◮ ×800+
None
◮ ◮ 1 ◮ ◮ ( ) ◮ ◮
◮ ◮ ◮ ? ( kuromoji ) ◮ ◮ →
◮ ◮ ◮ Percolator ◮ Percolator ? ◮
◮ push ◮ Percolator ◮ push ◮