GREEにおける全文検索の歴史

Transcript

1. 1.

   GREEʹ͓͚Δ
   શจݕࡧͷྺ࢙ GREE Inc. Infrastructure Platform Development Nobutoshi Ogata (@nobu666)

2. 2.

   about me • @nobu666 • ย۱Ͱ͘͢Ϳ͍ͬͯ·͢ • ೣͱ΢ΠεΩʔͱϫΠϯ

3. 3.

   GREEͷݕࡧ

4. 4.

   ݕࡧͷྺ࢙ (1) • Senna • 2007೥ͱ͔ͦͷลͷ࿩…? • ҆ఆՔಇ͠ͳ͔ͬͨ

5. 5.

   ݕࡧͷྺ࢙ (1) • Tritonn • 2009೥͘Β͍·Ͱ • σʔλϑΝΠϧ͕յΕΔ • ΍ͬͺΓ҆ఆ͠ͳ͍

   • MySQLͷόʔδϣϯ͍͋͛ͨ
6. 6.

   ݕࡧͷྺ࢙ (3) • Lucene • 2012೥ॳ಄·Ͱ • खಈindex optimizeͱͷઓ͍

7. 7.

   ݕࡧͷྺ࢙ (4) • Solr • ΠϚίί • 2012೥ॳ಄͔Β

8. 8.

   SolrԽͷԸܙ • ΄΅ϝϯςφϯεϑϦʔ • SPoFϑϦʔ • શମతͳݕࡧ଎౓޲্

9. 9.

   Lucene͔ΒSolr3.6΁

10. 10.

    ·ͣ΍Δ͜ͱ

11. 11.

    ·ͣ͜ΕΛങ͏Μͩ!!

12. 12.

    ͍ͭങ͏͔?

13. 13.

    SolrԽ΁ͷલఏ৚݅ • ଞϓϩμΫτ΁ӨڹΛग़͞ͳ͍ • ϑϩϯτΤϯυ͔Βͷݺͼग़͠͸
 ޓ׵ੑΛҡ࣋͢Δ • Ease of maintenance

14. 14.

    ޙํޓ׵ • HTTP GETΛड͚ͯXMLΛฦ٫ • Lucene+TomcatͰड͚෇͚͍ͯͨ
 ΫΤϦΛSolr޲͚ʹม׵ • Solrͷฦ٫͢ΔXMLΛΧελϚΠζ •

    IndexingґཔͷI/F΋ม͑ͳ͍
15. 15.

    Ease of maintenance • ͢΂ͯͷαʔόʔΛ৑௕Խ • αʔϏεӨڹͳ͠ʹindex optimize

16. 16.

    ←WebΞϓϦ͕Queue΁ొ࿥ ←indexer͕Master΁ొ࿥ ɹ͜͜Ͱఆظతʹoptimize ←ΫΤϦͷड෇ɺฦ٫ ←ΫΤϦͱϨεϙϯεͷม׵
 ɹ ΫϥΠΞϯτ͔ΒͷΫΤϦड෇ query translation

17. 17.

    ؆୯ʹઆ໌ • ݱঢ়7schema • αʔόʔ୆਺40୆ͪΐͬͱ • ϚϧνίΞ࢖͑͹΋ͬͱ٧ΊΒΕΔ • શ෦Ͱ250qps+ ͘Β͍

18. 18.

    None
19. 19.

    None
20. 20.

    ෛՙͷ܏޲ • େຌ0:00෇ۙʹෛՙͷϐʔΫ • schemaʹΑͬͯ͸΄ͱΜͲ
 ࢖ΘΕ͍ͯͳ͍ • Range Query࢖͍·͘ΓͳͷͰ
 slave͕Ұ൪ॏ͘ͳΔ

21. 21.

    ࡞Γ͜Έ͕ඞཁͩͬͨ෦෼(1) • Indexer • Master΁෼ࢄͯ͠Indexing • ϚϧνεϨουͰޮ཰తʹ

22. 22.

    ࡞Γ͜Έ͕ඞཁͩͬͨ෦෼(2) • Query Translation • ෛͷҨ࢈ͷܧঝ • SchemaຖͷಛघͳϑΟϧλ෇༩ • ੨গ೥อޢͳΜͪΌΒ͚

    • ਓྗ؂ࢹͱͷ݉Ͷ߹͍ • ؂ࢹ • Replication, SSH, Ping, Solr Ping
23. 23.

    ࠓͰ΋໘౗ͳ͜ͱ • εΩʔϚมߋΛແఀࢭͰ΍Δͷ
 ͍͢͝ΊΜͲ͍ • SlaveΛMasterʹঢ֨͢ΔɺͳͲͷ
 ૢ࡞͸खಈͰઃఆϑΝΠϧΛ͍͡Δ

24. 24.

    ݕࡧͷ͜Ε͔Β

25. 25.

    վળ͍ͨ͠ͱ͜ • ਫ਼౓ • ೔ຊޠҎ֎Ͱ΋࢖ΘΕΔͷͰ
 ࣙॻΛ࢖͏&ϝϯς͢Δͷ͕
 ࣄ্࣮೉͍͠ • ͞ΒͳΔࣗಈԽ

26. 26.

    ࢼ͍ͨ͜͠ͱ • AmazonͷαʔϏε͡Όͳ͍͜ͱͰ
 ͓ͳ͡ΈͷElasticSearch • Solr Cloud • ͜Ε΋ͬͱલʹ͋ͬͨΒԶ͸
 ͜ΜͳʹؤுΒͳͯ͘ྑ͔ͬͨઆ

27. 27.

    Any Questions?

28. 28.

    Join us!
    http://jobs.gree.net/