1M tickets, 50 lang and 35 currencies

Transcript

1. 1M tickets, 50 langs and 35 currencies no database hits

2. @jgargallo Jose Gargallo

3. A marketplace where fans can buy and sell tickets

4. Vendo boli, regalo entradas para los Rolling

5. ~ 400 employees ~ 50 countries ~ 90 m€ in

   2015

6. #Tickets histogram

7. ~ 1M tickets ~ 50 langs ~ 35 currencies scenario

   ~ legal res. ~ logistic res. ~ high traffic

8. CAP theorem Consistency Availability Partition tolerance

9. CAP theorem Consistency Availability Partition tolerance ¡you can’t have it

   all!

10. CAP theorem Consistency Availability Partition tolerance

11. Ticketbis architecture

12. Python daemons . . . . . .

13. Python daemons Getting context

14. Python daemons Running daemon

15. Redis queues

16. Redis queues (1) A LUA script recovers all failed tickets

17. Redis queues (2) Changed tickets are pushed to the queue

    (LPUSH). (3) Consumer process. RPOPLPUSH allows us to keep queues reliable, if the process fails, the script will recover unprocessed entities. (4) Items are removed from the processing queue.

18. ~ 1M tickets ~ 50 langs ~ 35 currencies Denormalization

    ~ legal res. ~ logistic res. ~ Event stats

19. ~ 1M tickets ~ 50 langs ~ 35 currencies Denormalization

    ~ legal res. ~ logistic res. ~ Event stats

20. Decimal Arithmetic Benchmark float cdecimal decimal 0.12s 0.27s 17s

21. cdecimal in Python 2 __init__.py ~ cdecimal has been integrated

    into CPython 3.3, where it supersedes the pure Python version ~ cdecimal shipped with CPython 3.3 is significantly faster for numerical workload than cdecimal-2.3

22. There are only two hard things in Computer Science: cache

    invalidation and naming things -- Phil Karlton

23. Project name: Ironman

24. ~ Inverted indexing ~ TTL Cache invalidation

25. Cache invalidation Inverted indexing ~ Categories ~ Countries ~ others

26. Cache invalidation TTLs EXPIRE Redis command allows us to set

    timeouts on keys based on event’s date

27. Ticketbis architecture

28. Elasticsearch

29. ~ A distributed RESTful search engine ~ Apache Lucene is

    the search engine lib behind ES Elasticsearch

30. ~ public data: categories & events ~ private data: purchases,

    users, ... ~ Ticket prices log Elasticsearch: clusters

31. Elasticsearch: Ticket log World cup semifinal 2014 average ticket prices

    BRA - GER qualified 1day left

32. Next steps ~ Use Redis as an LRU cache allkeys-lru,

    volatile-lru, ... ~ API hitting cached data

33. Thank you! Jose Gargallo @jgargallo

34. We are hiring! itjobs@ticketbis.com @TicketbisEng ...and we are remote friendly!