Pressing Play at Spotify

http://techtalks.nsu.ru/54/

Spotify — один из самых популярных в мире сервисов стриминга музыки. Он появился в Швеции, стране, где 10 лет назад практически все онлайн-потребление музыки происходило через The Pirate Bay. За последние несколько лет Spotify не только обогнал все легальные и нелегальные способы распространения музыки в Скандинавии, но и начал активно завоевывать себе пространство по всей планете. Сейчас Spotify – это 58 стран и более 40 миллионов пользователей. Сервис быстро растет и при этом остается быстрым, устойчивым и постоянно доступным. К тому же так вышло, что архитектура, которую мы последовательно выстраиваем последние 6 лет, сравнительно недавно получила новое имя "Microservices" и стала дико популярна среди хипстеров от программирования. Мы поговорим о том, как это все выглядит изнутри и почему все получилось именно так. Митболлы и смуззи брать на лекцию не обязательно.

Transcript

1. Play Pressing at Spotify https://www.flickr.com/photos/aneil4lom/9484487433/
2. https://www.flickr.com/photos/aneil4lom/9484487433/ Spotify Tons of music 58 markets and counting
3. Tell something about Spotify backends architecture “ https://www.flickr.com/photos/dbraaten/323401934/
4. Put electricity, software and hardware here https://www.flickr.com/photos/dbraaten/323401934/ Get music and everything
5. https://www.flickr.com/photos/dbraaten/323401934/
6. Sergey Vysotskiy @goblingame https://www.flickr.com/photos/ingmar/5724262065/ vsp@spotify.com
7. https://www.flickr.com/photos/question_everything/3677506157/
8. GeoDNS https://www.flickr.com/photos/question_everything/3677506157/
9. for clients https://www.flickr.com/photos/question_everything/3677506157/ More DNS distribution and more
10. AP C https://www.flickr.com/photos/question_everything/3677506157/
11. AP C Perimeter service https://www.flickr.com/photos/archer10/2213475574/
12. Rate Limits Accesspoint Routing Logging Auth State https://www.flickr.com/photos/archer10/2213475574/
13. AP C C C C https://www.flickr.com/photos/archer10/2213475574/
14. Microservices https://www.flickr.com/photos/intherough/3573333256/
15. Monolithic https://www.flickr.com/photos/intherough/3573333256/
16. Microservices Monolithic https://www.flickr.com/photos/intherough/3573333256/
17. Make each program do one thing well. To do a new job, build afresh rather than complicate old programs by adding new features. “ - Unix philosophy https://www.flickr.com/photos/intherough/3573333256/
18. https://www.flickr.com/photos/intherough/3573333256/ Design for failure
19. AP C Let’s find a song! https://www.flickr.com/photos/nasamarshall/5511379566/
20. Service ! Discovery https://www.flickr.com/photos/nasamarshall/5511379566/
21. _search._http.spotify.net 3600 SRV 10 50 8081 host.spotify.net SRV to the rescue https://www.flickr.com/photos/nasamarshall/5511379566/
22. _search._http.spotify.net 3600 SRV 10 50 8081 host.spotify.net Service Name https://www.flickr.com/photos/nasamarshall/5511379566/
23. _search._http.spotify.net 3600 SRV 10 50 8081 host.spotify.net Protocol https://www.flickr.com/photos/nasamarshall/5511379566/
24. _search._http.spotify.net 3600 SRV 10 50 8081 host.spotify.net Time to live https://www.flickr.com/photos/nasamarshall/5511379566/
25. _search._http.spotify.net 3600 SRV 10 50 8081 host.spotify.net Priority https://www.flickr.com/photos/nasamarshall/5511379566/
26. _search._http.spotify.net 3600 SRV 10 50 8081 host.spotify.net Weight https://www.flickr.com/photos/nasamarshall/5511379566/
27. _search._http.spotify.net 3600 SRV 10 50 8081 host.spotify.net Port https://www.flickr.com/photos/nasamarshall/5511379566/
28. _search._http.spotify.net 3600 SRV 10 50 8081 host.spotify.net Host Name https://www.flickr.com/photos/nasamarshall/5511379566/
29. DNS world ! as a bonus https://www.flickr.com/photos/nasamarshall/5511379566/
30. AP C Let’s find a song! Yeah, but… https://www.flickr.com/photos/nasamarshall/5511379566/
31. Searchview View Service AP C https://www.flickr.com/photos/nasamarshall/5511379566/
32. Searchview Search Metadata AP C https://www.flickr.com/photos/nasamarshall/5511379566/ Data Service
33. Searchview Search Metadata Hadoop here AP C https://www.flickr.com/photos/nasamarshall/5511379566/
34. Content ingestion Hadoop here AP C https://www.flickr.com/photos/nasamarshall/5511379566/
35. Where’s music? AP https://www.flickr.com/photos/krienke/13812387795/
36. piece by piece from CDN https://www.flickr.com/photos/krienke/13812387795/ Pick
37. aggressively everywhere https://www.flickr.com/photos/krienke/13812387795/ CACHE
38. Prefetch next song https://www.flickr.com/photos/krienke/13812387795/
39. The End https://www.flickr.com/photos/skohlmann/10960938633/