Beyond Cloud: A road trip into AWS and back to bare metal

Public cloud services have become a commodity asset in the past years. Shopping24 though is currently running all systems on pure bare metal. With this we’re not alone: Etsy is a popular example for choosing a classic datacenter over a cloud one. In this use case, I’ll lay out Shopping24’s move into the Amazon AWS cloud a few years back and our recent journey back into a classic datacenter. Myths about pricing, noisy neighbors and machine sizing will get busted (or approved). The bottom line for doing effective DevOps in both classic and cloud infrastructure is automatization. I’ll explain how this can be achieved with the right toolset (Ansible) and the modern server chassis and how Kubernetes came to the rescue.

Transcript

1. Torsten Bøgh Köster | torsten.koester@s24.com | @tboeghk | developer.s24.com
   Beyond Cloud
   

   View Slide

2. @tboeghk
   #cto, Search Technology Meetup Hamburg, #kubernetes, #roadbike, #landscapephotography
   Torsten Bøgh Köster | torsten.koester@s24.com | @tboeghk | developer.s24.com
   

   View Slide

3. Bester Arbeitgeber Deutschlands im Handel und Konsum laut Arbeitgeber-Ranking
   e-commerce search. 60M products.
   2k images/s. 1k searches/s.
   1.4k cpu. 12tb ram. 54tb images.
   all baremetal.
   Torsten Bøgh Köster | torsten.koester@s24.com | @tboeghk | developer.s24.com
   

   View Slide

4. Open Source Power
   Delivered.
   

   View Slide

5. product images @ AWS
   

   View Slide

6. Back then
   

   View Slide

7. (0) basics
   

   View Slide

8. (1) evolution
   

   View Slide

9. scaling images on the fly
   Internet CloudFront
   Edge Location Public ELB
   Image-Cache
   Image-Cache
   Internal ELB
   Image-Resizer
   Image-Resizer
   Resized Images
   Original Images
   

   View Slide

10. welcome autoscaling
    Internal ELB
    Image Resizer
    Auto Scaling
    Image-Resizer
    Image-Resizer
    Image-Resizer
    Original Images
    Image
    Imag
    

    View Slide

11. configuration management is a must
    

    View Slide

12. hi kids
    

    View Slide

13. byebye #diy. hello spot-instances
    Internal ELB
    Image Resizer
    c1.xlarge
    c4.2xlarge
    c4.2xlarge
    c4.2xlarge
    Image Resizer
    c3.xlarge
    Image Resizer
    c3.2xlarge
    Image Resizer
    c4.xlarge
    Image Resizer
    c1.xlarge
    c4.xlarge
    ¢
    c4.xlarge
    ¢
    c3.2xlarge
    ¢
    c3.xlarge
    ¢
    c1.xlarge
    ¢
    c1.xlarge
    ¢
    c1.xlarge
    ¢
    c3.2xlarge
    ¢
    c3.2xlarge
    ¢
    

    View Slide

14. infrastructure as code is a plus must
    

    View Slide

15. (2) key moments
    

    View Slide

16. AWS as disaster backup
    

    View Slide

17. software
    is not
    cloud-native
    

    View Slide

18. the classic
    firewall
    
    is a massive
    
    bottle neck
    Shopping24 Data Center
    Hamburg
    Internet
    eu-west-1
    VPN Gateway
    

    View Slide

19. Die Rechnungssumme
    steigt
    

    View Slide

20. do we have a
    vendor lock-in?
    

    View Slide

21. View Slide

22. Limitierung der
    Services
    

    View Slide

23. AWS migration is not
    „lift and shift"
    

    View Slide

24. (3) truth or dare
    

    View Slide

25. „all in“ @ AWS
    

    View Slide

26. Was wenn unsere
    Ausgangsbasis falsch ist?
    

    View Slide

27. A real world exampe …
    € 0
    € 3.500
    € 7.000
    € 10.500
    € 14.000
    Compute Store (19TB)
    

    View Slide

28. (4) back to baremetal
    

    View Slide

29. Automation?
    

    View Slide

30. ... welcome to the
    modern server chassis
    

    View Slide

31. Virtualization
    sorry, worst choice of stock footage ever "
    

    View Slide

32. Avoid GUIs –
    strive for automation
    

    View Slide

33. Kubernetes
    

    View Slide

34. Current Kubernetes Setup
    

    View Slide

35. next step: federated Kubernetes
    …
    search
    gpu
    ssd
    

    View Slide

36. –Paul Maritz, CEO VMware
    „Cloud is about how you
    do computing, not where
    you do computing.“
    

    View Slide

37. Im dritten Jahr in Folge bester Arbeitgeber Deutschlands laut Arbeitgeber-Ranking
    Thank you! Questions?
    @shopping24 | @tboeghk | developer.s24.com
    yes, we’re hiring!
    

    View Slide