pixivにおけるPlayとThrift

Play Meetup 2015

Transcript

1. pixivʹ͓͚ΔPlayͱThrift
2. ࣗݾ঺հ • ߴࢁ Թ @edvakf • pixivͷອըࣄۀͷ։ൃ੹೚ऀ • ීஈॻ͍ͯΔͷ͸Scala΍PHPɺͨ·ʹJS΍Ruby΍Go • ࠷ۙϦʔυΤϯδχΞͱ͍͏ݞॻʹ • ձࣾͷٕज़બ୒ʹ੹೚Λ࣋ͭ • ʮࣾ಺ͷΤϯδχΞ͕޾ͤʹಇͨ͘Ίʹ͸ʯΛߟ࣮͑ݱ͢Δۀ
3. pixivͱPlay • ڈ೥ࣾ಺πʔϧͰಋೖ • ࠓ೥ʹͳ͔ͬͯΒpixivϚϯΨͱ͍͏εϚϗΞϓϦͷAPI αʔόʔͱͯ͠ຊ൪౤ೖ • ࠓ೥தʹ΋͏Ұͭ૿͑ͦ͏
4. pixivϚϯΨ༻API
5. Thrift • RPCϑϨʔϜϫʔΫ • ಠࣗͷΠϯλʔϑΣΠεهड़ݴޠͰαʔϏεͷఆٛΛॻ͘ ͱɺ͍ΖΜͳݴޠͷRPCαʔόʔɺΫϥΠΞϯτͷΠϯ λʔϑΣΠεΛग़ྗͰ͖Δ • ಠࣗͷιέοτϓϩτίϧ΍HTTPͳͲΛαϙʔτ • pixivͰ͸PHPͷαʔόʔͱScalaͷΫϥΠΞϯτͰ HTTPͰ΍ΓͱΓ͍ͯ͠Δ
6. ScalaͱThrift • Thriftͷຊମ͸Javaαϙʔτ͕खް͍͕ɺScala͸ରԠͯ͠ͳ͍ • Twitterͷ࡞ͬͨScroogeͱ͍͏ͷ͕͋Δ • ࢖͓͏ͱࢥͬͯௐ΂ͨ࣌͸Scala 2.10·Ͱ͔͠αϙʔτ͍ͯ͠ͳ ͔ͬͨ • ࠓ͸2.11΋͋Δ͕ɺͦ΋ͦ΋࢖͍ํ͕Α͘Θ͔Βͳ͍orz • Finagleͱ߹Θͤͯ͡Όͳ͍ͱ࢖͑ͳ͍ʁ • →ૉ௚ʹJavaͷϥΠϒϥϦΛ࢖͏͜ͱʹ
7. ࢖༻ྫ // Thrift service MyService { string someMethod(1:int input), } // Scala val transport = new THttpClient(url) val protocol = new TBinaryProtocol(transport) val client = new MyService.Client(protocol) transport.open() val output = client.getSomeMethod(input) transport.close()
8. ThriftͱAsync • ઌͷྫͰ͸ಉظϦΫΤετͳͷͰεϨουΛϒϩοΫ͠ ͯ͠·͏ • Playͱ͍͑͹Futureʢʁʣ • ThriftͷJava࣮૷ʹ͸AsyncClientͱ͍͏ͷ͕͋Δ • ͕ɺίʔυΛಡΜͰΈΔͱHTTPͰ͸࢖͑ͳ͍ • ͠ΐ͏͕ͳ͍͔ΒPlayͷWSΛ࢖ͬͯؤுΔ
9. ඇಉظ൛ʢલ൒ʣ val sendTransport = new TMemoryBuffer(128) val sendProtocol = new TBinaryProtocol(sendTransport) val recvTransport = new TMemoryInputTransport() val recvProtocol = new TBinaryProtocol(recvTransport) val client = new MyService.Client(recvProtocol, sendProtocol) sendTransport.open() recvTransport.open()
10. ඇಉظ൛ʢޙ൒ʣ client.sendSomeMethod(input) WS.url(url).withHeaders( "Content-Type" -> “application/x-thrift") .post(sendTransport.getArray) .map { response => recvTransport.reset( response.underlying[NettyResponse] .getResponseBodyAsBytes) val output = client.recvSomeMethod(input) } andThen { case _ => sendTransport.close() recvTransport.close() }
11. ͓͠·͍ • Τϥʔॲཧ΍ίϝϯτΛ෇͚ͨ΋ͷ͸gistʹஔ͍͓͖ͯ ·ͨ͠ • https://goo.gl/hQ2ALh