Kafka - A Little Introduction

Kafka - A Little Introduction

This is a presentation I gave on Kafka (http://incubator.apache.org/kafka/)- a persistent, distributed messaging system developed at LinkedIn.

I gave it during one of our monthly tech presentation evenings in our office.

3aa708adb3ecf15173f7e6f2f9eefc6c?s=128

Paul Ingles

May 01, 2012
Tweet

Transcript

  1. 2.
  2. 4.
  3. 5.
  4. 6.
  5. 7.
  6. 9.
  7. 11.

    Disk/Memory Performance Source: http://queue.acm.org/detail.cfm?id=1563874 Disk SSD Memory 1 10 100

    1,000 10,000 100,000 1M 10M 100M 1000M Random access Sequential Access Read values/second
  8. 12.

    Disk/Memory Performance Source: http://queue.acm.org/detail.cfm?id=1563874 Disk SSD Memory 1 10 100

    1,000 10,000 100,000 1M 10M 100M 1000M Random access Sequential Access Read values/second
  9. 13.

    Disk/Memory Performance Source: http://queue.acm.org/detail.cfm?id=1563874 Disk SSD Memory 1 10 100

    1,000 10,000 100,000 1M 10M 100M 1000M Random access Sequential Access Read values/second
  10. 14.

    Disk/Memory Performance Source: http://queue.acm.org/detail.cfm?id=1563874 Disk SSD Memory 1 10 100

    1,000 10,000 100,000 1M 10M 100M 1000M Random access Sequential Access Read values/second Sequential disk read faster than random memory read
  11. 16.
  12. 17.
  13. 18.
  14. 20.
  15. 21.
  16. 22.
  17. 23.

    Token Offset: 0 Broker: kafka.local Topic: Testing Input MR Job

    Output Offset: 130098 Broker: kafka.local Topic: Testing Output Sequence File
  18. 24.

    Token Offset: 0 Broker: kafka.local Topic: Testing Input MR Job

    Output Offset: 130098 Broker: kafka.local Topic: Testing Output Sequence File
  19. 25.