High-performance Jackson #渋谷Java

Transcript

1. High-performance Jackson ौ୩Java #17 2016-10-01 KOMIYA Atsushi (@komiya_atsushi)

2. KOMIYA Atsushi @komiya_atsushi

3. Today’s topic

4. Jackson

5. = JSON parser / generator Ͱ͸ͳ͍ (ݫີʹ͸)

6. “Jackson is a suite of data- processing tools for Java”

   https://github.com/FasterXML/jackson/blob/master/README.md

7. JSON parer / generator
 ʰ΋ʱඪ४αϙʔτ͍ͯ͠Δ σʔλॲཧϥΠϒϥϦ

8. Jackson • JSON processor • Streaming API • Data binding

   (POJO to and from JSON) • Other formats • XML, YAML • Avro, CBOR, CSV, Smile, Protobuf

9. Popular JSON Libraries • 4,180 usages: Jackson Databind • 2,820

   usages: Gson • 1,238 usages: Json (org.json) • 516 usages: JSON.simple • 494 usages: Jersey Json ※mvnrepository.com ௐ΂ɺ2016-10-01 ࣌఺

10. Jackson as JSON processor • Pros • γϦΞϥΠζɾσγϦΞϥΠζͱ΋ʹ଎͍ • ࠷଎Ͱ͸ͳͦ͞͏͚ͩͲ…

    • ػೳ͕๛෋Ͱɺᙱ͍ͱ͜Ζʹख͕ಧ͖΍͍͢ • ৼΔ෣͍ͷΧελϚΠζ͸·͋·͋͠΍͍͢ • ͍͍ҙຯͰރΕ͍ͯΔ ※ݸਓͷײ૝Ͱ͋Γɺੑೳɾੑ࣭Λอূ͢Δ΋ͷͰ͸͋Γ·ͤΜ

11. Jackson as JSON processor • Cons • ମܥతʹهड़͞Εͨྑ࣭ͳ೔ຊޠυΩϡϝϯτ͸ͳ͍ • ػೳ͕๛෋ա͗Δ͕Ώ͑ʹɺ࢖͍͜ͳ͢ͷ͸೉͍͠

    • ʮ͜͏͍͏͜ͱ͸Ͱ͖Δͷ͔ͳʁʯ
 ʮͲ͏΍ͬͯઃఆ͢Ε͹͍͍Μͩʁʯ • ࣮૷͸៉ྷ͚ͩͲɺΫϥε਺͕ଟͯ͘ॳݟࡴ͠ײ͕͋ Δ ※ݸਓͷײ૝Ͱ͋Γɺੑೳɾੑ࣭Λอূ͢Δ΋ͷͰ͸͋Γ·ͤΜ

12. High-performance Jackson

13. (JSON prosessor ͱͯ͠͸ ࠷଎Ͱ͸ͳ͍͔΋͠Εͳ͍͕)
 Jackson Λ࠷଎ʹར༻͍ͨ͠❗

14. Shortest path to high-performance • Presentation: Jackson Performance • https://github.com/FasterXML/jackson-docs/

    wiki/Presentation:-Jackson-Performance • Jackson Best Practices: Performance • http://wiki.fasterxml.com/ JacksonBestPracticesPerformance

15. ৄ͘͠͸ͪ͜ΒΛ͝ࢀরԼ͍͞ http://qiita.com/komiya_atsushi/items/803f69b51426ed476a75

16. ϕετϓϥΫςΟεʹै͏͜ͱͰ ͲΕ͘Β͍଎͘ͳΔͷ͔ʁ

17. ࠓճର৅ͱ͍ͯ͠ΔλεΫ • 1 ߦ͝ͱʹ JSON ͕ه࿥͞ΕͨϑΝΠϧ
 (= Line delimited JSON)

    ͕༩͑ΒΕ͍ͯΔ • JSON 1 ݅͝ͱʹಛఆͷॲཧΛ͍ͨ͠ • 㱺 JSON ͷσγϦΞϥΠζΛ࠷଎ʹ❗

18. ۩ମతͳαϯϓϧλεΫ • Twitter Streaming API Ͱ 1,000 ݅ͷ tweet Λऩूͯ͠ɺ̍ͭ

    ͷϑΝΠϧʹ·ͱΊ͓ͯ͘ ǖ DVSM
    HFU
    IUUQTTUSFBNUXJUUFSDPNTUBUVTFTTBNQMFKTPO
    ǘ
    • શ෦Ͱ໿ 4MB = JSON 1 ͭ͋ͨΓ 4KB ͙Β͍ • ্هϑΝΠϧΛಡΈࠐΈɺ೔ຊޠ tweet ͷ݅਺Λ਺্͑͛Δ • ೔ຊޠ͔൱͔͸ “lang” ଐੑͷ஋Ͱ൑ఆ͢Δ • ͜ͷλεΫͷεϧʔϓοτ (ops/s) Λ JMH Ͱଌఆ͢Δ

19. Baseline implementation • Best practice ʹࢥ͍͖ͬΓ൓͢Δɺ͋͑ͯ
 ඇޮ཰ͳ࣮૷͔Β࢝ΊΔ • ϑΝΠϧ͔Β 1

    ߦͣͭจࣈྻͱͯ͠ಡΈࠐΉ • Data-binding Ͱ JSON → POJO ʹσγϦΞϥ Πζ͢Δ • ͜ͷॲཧͷ౎౓ɺObjectMapper Λੜ੒͢Δ

20. Baseline implementation 2.596 ops/s ͜Ε͕࠷΋ඇޮ཰

21. 1. ObjectMapper Λ࠶ར༻͢Δ • POJO from JSON ͷ data-binding Λ͢Δͷʹ

    ຖճੜ੒͍ͯͨ͠ ObjectMapper Λ࢖͍·Θ͢ • ObjectMapper ͷΦϒδΣΫτੜ੒͸ಛʹॏ ͍ॲཧ • ObjectMapper ͸εϨουηʔϑ ☺

22. 1. ObjectMapper Λ࠶ར༻͢Δ 32.533 ops/s (12.53x)

23. 2. ObjectReader Λར༻͢Δ • ObjectMapper ͷ୅ΘΓʹ ObjectReader Λ ࢖͏ •

    ObjectMapper Λ࢖͏ΑΓͪΐͬͱ͚ͩ
 ޮ཰͕͍͍

24. 2. ObjectReader Λར༻͢Δ 33.306 ops/s (1.024x)

25. 3. ObjectReader
 #readValues(InputStream) • 1 ߦͣͭจࣈྻͱͯ͠ಡΈࠐΉͷΛ΍Ίɺ InputStream ͷ··Ͱ Jackson ʹ༩͑Δ

    • Jackson ͸ byte[] ΍ InputSteam ͳͲͷ
 ೖྗιʔεʹରͯ͠࠷దԽ͍ͯ͠Δ • String ͷೖྗιʔεʹ͸ͦΜͳʹ࠷దԽ͍ͯ͠ ΔΘ͚Ͱ͸ͳ͍

26. ࢀߟهࣄ (InfoQ) https://www.infoq.com/jp/news/2014/05/jackson-founder-responds

27. ࢀߟهࣄ (InfoQ) https://www.infoq.com/jp/news/2014/05/jackson-founder-responds “Jackson͕RESTͷج൫Ͱ͋Δ όΠτετϦʔϜɼ͋Δ͍͸ ϑΝΠϧετϨʔδΛపఈత ʹ࠷దԽ͍ͯ͠Δ”

28. 3. ObjectReader
 #readValues(InputStream) 43.641 ops/s (1.310x)

29. (ิ଍) ObjectMaper → JsonFactory → JsonParser ͱ͍͏ํ๏΋͋Δ

30. 4. Afterburner ϞδϡʔϧΛ࢖͏ • POJO to and from JSON ͷ

    data-binding Λߴ଎Խ͢ ΔϞδϡʔϧ • POJO ͷੜ੒΍ getter / setter ͷݺͼग़͠Λɺ
 ϦϑϨΫγϣϯͳ͠ʹόΠτίʔυੜ੒ͨ͠΋ͷͰ ࣮ݱ͢Δ • primitive ͳ஋ͷ boxing ΋ආ͚Δ͜ͱ͕Ͱ͖Δ • طଘͷίʔυ͸΄ͱΜͲมߋෆཁͰಋೖָ͕

31. 4. Afterburner ϞδϡʔϧΛ࢖͏ 49.764 ops/s (1.140x) ͜ΕΛ௥ه

32. 5. Streaming API Λར༻͢Δ • POJO to and from JSON

    ͸ɺͲ͏଍ૡ͍ͯ΋ॏ͍ ॲཧͰ͋Δ͜ͱʹ͸มΘΒͳ͍ • POJO ͷΦϒδΣΫτ͸ੜ੒͠ͳ͘ͱ΋ɺ Streaming API Λ࢖͑͹ JSON ͸ύʔεͰ͖Δ • Streaming API Ͱ໨తͷॲཧΛ࣮૷͢Δͷ͸େม ͕ͩɺ଎౓໘ʹ͓͍ͯ͸Ұ൪ޮՌత❗

33. 5. Streaming API Λར༻͢Δ 77.969 ops/s (1.567x) ͜ͷ࣮૷ΛؤுΔ

34. Benchmark & result

35. Benchmark app https://github.com/komiya-atsushi/
 java-playground/tree/master/jackson-performance

36. Result: table 4DPSF
    <PQTT> #BTFMJOF  3FVTF
    0CKFDU.BQQFS  6TF
    0CKFDU3FBEFS  0CKFDU3FBEFSSFBE7BMVFT

     "GUFSCVSOFS  4USFBNJOH
    "1* 

37. Result: chart 2x~ faster !

38. Conclusion

39. Conclusion • Jackson Ͱ POJO to and from JSON ͷγϦΞϥΠζɾσγϦΞ

    ϥΠζΛߴ଎ʹॲཧ͍ͨ͠ͷͰ͋Ε͹: • Jackson ͷΦϒδΣΫτ (ObjectMapper, ObjectReader ͳͲ) ͸ੵۃతʹ࠶ར༻͠Α͏ • ͳΔ΂͘ InputStream ΦϒδΣΫτΛ Jackson ʹ༩͑ΔΑ͏ ʹ͠Α͏ • Afterburner ΋࢖͏͜ͱΛݕ౼͠Α͏ • ΋ͬͱ଎౓ΛՔ͍͗ͨͷͰ͋Ε͹ɺStreaming API Λར༻͠Α͏

40. Thank you !