The DNA of data streams

This talk was presented at London HalfStack meetup on the 5th of Feb '19.

Transcript

1. The DNA of
   Data Streams
   @Srushtika | Ably Realtime | London HalfStack | Feb ‘19
   

   View Slide

2. Hi there,
   I’m Srushtika
   Developer
   Advocate
   

   View Slide

3. Quick sneak peek
   In this talk, we’ll see:
   ● Realtime messaging & streams
   ● Evolution of the data sharing
   economy
   @Srushtika | Ably Realtime | London HalfStack Feb ‘19
   

   View Slide

4. How does data move around?
   WebSockets
   Long Polling
   @Srushtika | Ably Realtime | London HalfStack Feb ‘19
   HTTP
   

   View Slide

5. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
   WebSockets
   in action
   https://giveitalob.com
   

   View Slide

6. Pub/Sub
   @Srushtika | Ably Realtime | London HalfStack Feb ‘19
   Channels
   

   View Slide

7. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
   

   View Slide

8. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
   

   View Slide

9. Open-source
   tools to spin up
   your own
   WebSockets
   server
   ws faye-
   websocket
   Socket
   Cluster
   Socket.io SockJS
   @Srushtika | Ably Realtime | London HalfStack Feb ‘19
   Websocketd
   

   View Slide

10. Challenges
    Interoperability Scalability Failover
    and Continuity
    @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    Message
    ordering
    

    View Slide

11. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    Distributed
    Systems
    

    View Slide

12. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    Data Stream
    Network
    or DSN
    

    View Slide

13. Publish-Subscribe
    using a Data Stream Network
    @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    Publisher
    Subscriber
    

    View Slide

14. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    How (and why) did the
    web get to DSN?
    

    View Slide

15. storage
    cacheing
    traffic
    @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    Evolution of the online data sharing economy
    websites
    B2C
    Examples of CDN
    service providers:
    - MaxCDN
    - Cloudflare
    - Google App Engine
    CDN
    

    View Slide

16. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    Evolution of the online data sharing economy
    websites APIs
    analytics
    rate limiting
    adapter
    B2C B2B
    CDN
    Examples of CDN
    service providers:
    - MaxCDN
    - Cloudflare
    - Google App Engine
    

    View Slide

17. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    Evolution of the online data sharing economy
    APIs
    websites
    B2C B2B
    CDN
    API
    management
    tool
    Examples of CDN
    service providers:
    - MaxCDN
    - Cloudflare
    - Google App Engine
    Examples of API
    management tool
    service providers:
    - Apigee
    - Mulesoft
    - Apiary
    

    View Slide

18. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    Evolution of the online data sharing economy
    APIs
    websites Realtime
    websites
    websockets
    ordering
    scalability
    B2C B2B
    CDN
    API
    management
    tool
    Examples of CDN
    service providers:
    - MaxCDN
    - Cloudflare
    - Google App Engine
    Examples of API
    management tool
    service providers:
    - Apigee
    - Mulesoft
    - Apiary
    

    View Slide

19. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    Evolution of the online data sharing economy
    APIs
    websites Realtime
    websites
    B2C
    B2C B2B
    CDN
    API
    management
    tool
    DSN
    Examples of CDN
    service providers:
    - MaxCDN
    - Cloudflare
    - Google App Engine
    Examples of API
    management tool
    service providers:
    - Apigee
    - Mulesoft
    - Apiary
    Examples of DSN
    service providers:
    - Ably
    - PubNub
    - Pusher
    

    View Slide

20. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    Evolution of the online data sharing economy
    APIs
    websites Realtime
    websites
    Realtime
    APIs
    infrastructure
    interoperability
    analytics
    B2C B2B B2C B2B
    CDN
    API
    management
    tool
    DSN
    Examples of CDN
    service providers:
    - MaxCDN
    - Cloudflare
    - Google App Engine
    Examples of API
    management tool
    service providers:
    - Apigee
    - Mulesoft
    - Apiary
    Examples of DSN
    service providers:
    - Ably
    - PubNub
    - Pusher
    

    View Slide

21. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    Evolution of the online data sharing economy
    APIs
    websites Realtime
    websites
    Realtime
    APIs
    B2C B2B B2C B2B
    CDN
    API
    management
    tool
    DSN DSX
    Examples of CDN
    service providers:
    - MaxCDN
    - Cloudflare
    - Google App Engine
    Examples of API
    management tool
    service providers:
    - Apigee
    - Mulesoft
    - Apiary
    Examples of DSN
    service providers:
    - Ably
    - PubNub
    - Pusher
    Examples of DSX
    service providers:
    - Ably
    

    View Slide

22. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    DSX as an extension of DSN
    End-to-End data sharing
    DSN DSX
    Company ABC Company XYZ
    CDN
    DSN
    Realtime messaging spectrum
    

    View Slide

23. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    DSX as an extension of DSN
    End-to-End data sharing
    DSN
    DSX
    

    View Slide

24. @Srushtika | Ably Realtime | London HalfStack Feb ‘19
    https://go.ably.io/hub-early-access
    The Open Data Streaming Programme (ODSP)
    

    View Slide

25. Thanks!
    Any questions?
    You can find me at @Srushtika
    

    View Slide