Swarrot, a library to consume them all!

Swarrot, a library to consume them all!

Talk given at BlaBlaCar Tech Meetup in Warsaw

418997665c4a3368515ecf9c3d746b95?s=128

Olivier Dolbeau

October 20, 2015
Tweet

Transcript

  1. 1.
  2. 3.
  3. 5.

    We send an email to the driver. We index the

    trip in ElasticSearch. We send the comment to moderation spooler. We store all relevant informations in Hadoop for BI.
  4. 7.
  5. 8.
  6. 9.

    “RabbitMQ is a message broker. The principal idea is pretty

    simple: it accepts and forwards messages.”
  7. 12.

    We send an email to the driver. We index the

    trip in ElasticSearch. We sent the comment in moderation. We store all relevant informations in Hadoop for BI.
  8. 13.

    RabbitMQ Application mail publication indexation bi Consumer mail Consumer bi

    Consumer indexation Consumer moderation moderation
  9. 14.
  10. 20.

    Expect errors. Deal with them. • Catch them! • Retry

    when needed. • Don’t stop your consumer.
  11. 22.
  12. 23.
  13. 33.
  14. 35.
  15. 38.

    Sometimes, dealing with consumers can be a pain, BUT you

    should definitively use a Message Broker! <3 Olivier Dolbeau @odolbeau