Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
全文検索システムFESSを使った Web+DB PRESS 総集編の全文検索
Search
Tetsuya Tatsumi
June 03, 2018
Technology
0
290
全文検索システムFESSを使った Web+DB PRESS 総集編の全文検索
全文検索システムFESSを使って WEB+DB PRESS 総集編を全文検索しました。
Tetsuya Tatsumi
June 03, 2018
Tweet
Share
More Decks by Tetsuya Tatsumi
See All by Tetsuya Tatsumi
LINE Thingsで視力検査
dokechin
0
74
筋トレ応援団.pdf
dokechin
1
240
How to define the relationship in vuex's state
dokechin
1
410
ダンドリーキッチン
dokechin
0
380
ダンドリーキッチン
dokechin
0
1.1k
Other Decks in Technology
See All in Technology
サーバーレスAPI(API Gateway+Lambda)とNext.jsで 個人ブログを作ろう!
shuntaka
PRO
0
560
Azure AI ことはじめ
tsubakimoto_s
0
130
AIアシスタントの活用で品質の向上と開発ワークフローのスピードアップ
nagix
1
210
MySQLのロックの種類とその競合
yoku0825
6
1.6k
Git 研修 Basic【MIXI 24新卒技術研修】
mixi_engineers
PRO
0
310
大規模ドラレコデータ収集・機械学習基盤を支える AWS CDK 〜導入・運用事例紹介〜
pemugi
0
110
目標設定は好きですか? アジャイルとともに目標と向き合い続ける方法 / Do you like target Management?
kakehashi
10
3k
簡単に始めるSnowflakeの機械学習
nayuts
1
190
ペパボのオブザーバビリティ研修2024 説明資料
kesompochy
0
1.1k
さらに高品質・高速化を目指すAI時代のテスト設計支援と、めざす先 / AI Test Lab vol.1
shift_evolve
0
190
AutomatedLabを使って内部ペンテストを勉強しよう! -やられ社内ネットワークの自動構築-
n_etupirka
1
610
How to Think Like a Performance Engineer
csswizardry
4
590
Featured
See All Featured
For a Future-Friendly Web
brad_frost
173
9.2k
Why Our Code Smells
bkeepers
PRO
332
56k
The Invisible Customer
myddelton
117
13k
Ruby is Unlike a Banana
tanoku
96
10k
How to Ace a Technical Interview
jacobian
274
23k
What's in a price? How to price your products and services
michaelherold
239
11k
A Tale of Four Properties
chriscoyier
155
22k
10 Git Anti Patterns You Should be Aware of
lemiorhan
652
58k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
129
32k
How To Stay Up To Date on Web Technology
chriscoyier
784
250k
Making the Leap to Tech Lead
cromwellryan
127
8.7k
The Language of Interfaces
destraynor
151
23k
Transcript
શจݕࡧγεςϜ'&44Λͬͨ 8FC %#13&44૯ूฤͷશจݕࡧ Mishima.pm #3 @dokechin
8FC %#13&44
֓ཁ • 2000݄̍̎ץɻ • ٕज़ධࣾൃߦɻִ݄ൃചʢۮ݄ʣ • Webٕज़ܥࡶࢽɻ • ݱࡏɹWPM
૯ूฤ • vol.1-24 2005ൃߦɹCD-ROM • vol.1-36 2007ൃߦɹCD-ROM • vol.1-60 2011ൃߦɹDVD-ROM
• vol.1-72 2013ൃߦɹDVD-ROM • vol.1-84 2015ൃߦɹDVD-ROM • vol.1-102 2018ൃߦɹDVD-ROM
WPM • PDF༰ྔ4.4G • αΠζॱʹฒΔͱWPM (240M) ɺWPM (76.8M)ɺvol.66(69.5M)
'&44ͱ
֓ཁ • ΣϒϑΝΠϧγεςϜΛରͱͨ͠Φʔϓϯιʔ εͷશจݕࡧγεςϜ • ApacheϥΠηϯε
ΞʔΩςΫνϟ • Javaϕʔε • ݕࡧΤϯδϯ&MBTUJDTFBSDI • ݕࡧը໘ɺཧը໘ɺΫϩʔϥಉࠝ
ڥߏங
%PDLFSͷ෮श IUUQTEPDTEPDLFSDPNFOHJOFEPDLFSPWFSWJFXEPDLFSBSDIJUFDUVSF
ڥߏஙखॱ • Docker for MacOS ͷઃఆ • ϝϞϦαΠζͷมߋ 2G->3.5G •
ΠϝʔδDPEFMJCTGFTT͔Βίϯςφىಈ • FESSͷνϡʔχϯά • ࠷େϑΝΠϧαΠζ • ώʔϓαΠζ • Ϋϩʔϧઃఆ • Ϋϩʔϧ
%PDLFSGPS.BD04 • https://store.docker.com/editions/ community/docker-ce-desktop-mac
.FNPSZ4FUUJOH
ίϯςφىಈ docker run -d -p 8080:8080 --name fess -v /Users/dokechin/Downloads/
webdb_sp_001-102/:/webdb_sp_001-102 codelibs/fess:latest
ύϥϝʔλνϡʔχϯά docker exec -it fess bash perl -i -pe 's/10485760/248000000/'
/usr/ share/fess/app/WEB-INF/classes/crawler/ contentlength.xml perl -i -pe 's/-Xms1g/-Xms2g/' /etc/ elasticsearch/jvm.options perl -i -pe 's/-Xmx1g/-Xmx2g/' /etc/ elasticsearch/jvm.options exit
QFSMJQF
QFSMEPDQFSMSVO -i[extension] specifies that files processed by the "<>" construct
are to be edited in-place.
.0%FQBSTF perl -MO=Deparse -i -pe 's/-Xms1g/- Xms2g/' /etc/elasticsearch/jvm.options BEGIN {
$^I = ""; } LINE: while (defined($_ = <ARGV>)) { s/-Xms1g/-Xms2g/; } continue { die "-p destination: $!\n" unless print $_; } -e syntax OK
Ϋϩʔϧઃఆ
ݕࡧ
'&44ͷόʔδϣϯ্͕͕ Δͨͼʹύϥϝʔλͷνϡʔ χϯά͢Δͷʁ
%PDLFSpMFʹࠩΛهड़ FROM codelibs/fess:latest LABEL maintainer "dokechin" RUN perl -i -pe
's/10485760/248000000/' /usr/share/ fess/app/WEB-INF/classes/crawler/contentlength.xml RUN perl -i -pe 's/-Xms1g/-Xms2g/' /etc/elasticsearch/ jvm.options RUN perl -i -pe 's/-Xmx1g/-Xmx2g/' /etc/elasticsearch/ jvm.options
ΠϝʔδϏϧυɹˍɹ36/ # FESSͷόʔδϣϯΞοϓͷλΠϛϯάͰ docker build -t dokechin/fess . docker run
-d -p 8080:8080 --name fess -v /Users/dokechin/Downloads/ webdb_sp_001-102/:/webdb_sp_001-102 dokechin/fess
࣮ѱखɻ ઃఆมߋΛ%PDLFSΠϝʔ δʹ͠ͳ͍ʂ
ઃఆϑΝΠϧΛϩʔΧϧʹอଘ docker cp fess:/usr/share/ fess/app/WEB-INF/classes/ crawler/contentlength.xml .
ىಈ࣌ʹ͢ docker run -d -p 8080:8080 --name fess -e 'ES_JAVA_OPTS="-Xms2g
- Xmx2g"' -v $PWD/contentlength.xml:/ usr/share/fess/app/WEB-INF/classes/ crawler/contentlength.xml -v $PWD/ webdb_sp/:/webdb_sp codelibs/fess