How to deal with events backpressure in Elixir

In this presentation I quickly introduce what is backpressure and how Elixir GenStage can help us deal with these scenarios.

I also present an Example Project where I compare using and not using GenStage and show the results of doing a HTTp benchmark. Results shown that with GenStage it was possible to double the throughput.

Transcript

1. How to deal with events backpressure in Elixir 21 Nov 2018
2. André Freitas Software Engineer at Talkdesk Data Platform Team
4. Backpressure in the context of information technology “Backpressure refers to the buildup of data at an I/O switch when buffers are full and not able to receive additional data.” https://www.techopedia.com/definition/24131/backpressure
5. Backpressure Events processor Datastore Under pressure!
6. Genstage way Producer Datastore Consumer Ask for events queue Process events enqueue
7. Restaurants deal with backpressure
8. Elixir GenStage
9. GenStage to Track Video Watch Progress Elixir Conf 2018 - Emerson Macedo
10. Sensors API Example Sensors API [HTTP - Elixir] API to send temperature and wind measurements. Stores measurements Sensor 1 Sensor 2 Sensor 3 Sends measurement Sends measurement Sends measurement
11. Sensors API Benchmark
12. Thank you! Slides goo.gl/4xFyiu Code github.com/andrefreitas/talks-sensors-api andrefreitas.pt