Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Faceting analyzed fields with some sprinkles of probability theory
Search
Boaz Leskes
June 04, 2013
Technology
0
37
Faceting analyzed fields with some sprinkles of probability theory
Talk given at Berlin buzzwords 2013
Boaz Leskes
June 04, 2013
Tweet
Share
More Decks by Boaz Leskes
See All by Boaz Leskes
Every Shard Deserves a Home - Shard Allocation in Elasticsearch
bleskes
0
300
Life of a Document in Elasticsearch
bleskes
3
3.1k
Resiliency in Elasticsearch & Lucene
bleskes
0
500
Resiliency in Elasticsearch & Lucene
bleskes
0
210
Designing Concurrent Distributed Sequence Numbers for Elasticsearch
bleskes
2
680
Not all Nodes are Created Equal - Scaling Elasticsearch
bleskes
1
350
Not all Nodes are Created Equal - Scaling Elasticsearch
bleskes
6
630
The ELK Stack: For Real-Time Enlightenment
bleskes
1
1.7k
Staying Ahead of Users And Time - two use cases of scaling data with Elasticsearch
bleskes
1
300
Other Decks in Technology
See All in Technology
Reducing Cross-Zone Egress at Spotify with Custom gRPC Load Balancing Recap
koh_naga
0
200
Terraformあれやこれ/terraform-this-and-that
emiki
8
1.4k
ServiceNow Knowledge 24の歩き方 EYストラテジー・アンド・コンサルティング
manarobot
0
190
AOAI をきっかけに 社内の Azure 管理を見直した話
recruitengineers
PRO
1
270
Google Cloud Next '24でブログを10本書いた方法と勉強会を沸かせた方法
yasumuusan
0
290
長期運用プロジェクトでのMySQLからTiDB移行の検証
colopl
2
850
JAWS-UG Bedrock Claude Night
yamahiro
3
570
VS CodeでAWSを操作しよう
smt7174
7
1.6k
KubeCon EU 2024 Recap “Kubernetes Policy Time Machine: Where to Next?”
ryysud
0
210
Cloud Native Java with Spring Boot (CNCF Aarhus, April 2024)
thomasvitale
1
170
ワールドカフェI /チューターを改良する / World Café I and Improving the Tutors
ks91
PRO
0
120
20分で完全に理解するGrafanaダッシュボード
hamadakoji
3
410
Featured
See All Featured
Stop Working from a Prison Cell
hatefulcrawdad
266
19k
Scaling GitHub
holman
457
140k
How to train your dragon (web standard)
notwaldorf
73
5.2k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
659
120k
The Language of Interfaces
destraynor
151
23k
Build your cross-platform service in a week with App Engine
jlugia
225
17k
Become a Pro
speakerdeck
PRO
11
4.5k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
187
16k
How To Stay Up To Date on Web Technology
chriscoyier
782
250k
Clear Off the Table
cherdarchuk
84
310k
Designing on Purpose - Digital PM Summit 2013
jponch
110
6.5k
GraphQLとの向き合い方2022年版
quramy
32
12k
Transcript
Faceting analyzed fields with some sprinkles of probability theory conjures
trending topic analysis and other interesting insights Boaz Leskes Elasticsearch @bleskes work done for Buzzcapture
Trending?
© Buzzcapture
© Buzzcapture
reference reference topic © Buzzcapture
topic reference ≠
topic reference P(w|T) = kDt |w 2 Dt k kDt
k
None
topic reference P(w|T) = kDt |w 2 Dt k kDt
k
P(w|T) = kDt |w 2 Dt k kDt k
brown dog fox quick 2 5 10 12 5 6
12 13 2 5 6 10 12 13 brown dog fox quick
In our index. • Terms = 12GB • “Arrows” =
41GB
{ tweet: { type: "string", analyzer: "whitespace" fielddata: { filter:
{ regex: "^#.*", frequency: { min: 10 } } } } } Drop terms which occur too little
Drop docs with too many terms
reference reference topic © Buzzcapture
iculture 10,122 floor 8,998 cover 6,874 toy 4,402 ground 3,841
4.0 7,878 4.1 4,292 rtacties 4,078 jelly 2,905 bean 2,857