Massive Data Collection for your BigData with Fluentd

Transcript

1. Massive Data Collection for your BigData with Fluentd Abhishek Parolkar http://www.parolkar.com With love from:
2. WHO AM I http://fluentd.org
3. FLUENTD courtesy: @just_do_neet
4. FLUENTD
5. SCALE on Platform-as-a-Service platform
6. FLUENTD ON HEROKU watch the screencast http://youtu.be/J9CX8zfH6lU
7. FLUENTD PLUGINS fluent-plugin-amplifier-filter (0.1.1) fluent-plugin-amqp (0.0.0) fluent-plugin-cassandra (0.0.2) fluent-plugin-couch (0.5.0) fluent-plugin-datacalculator (0.0.3) fluent-plugin-datacounter (0.3.0) fluent-plugin-delayed (0.0.1) fluent-plugin-dstat (0.1.0) fluent-plugin-dynamodb (0.1.7) fluent-plugin-file-alternative (0.1.2) fluent-plugin-flowcounter (0.1.5) fluent-plugin-flume (0.1.1) fluent-plugin-forest (0.1.0) fluent-plugin-growl (0.0.5) fluent-plugin-growthforecast (0.1.2) fluent-plugin-hipchat (0.1.0) fluent-plugin-hoop (0.1.3) fluent-plugin-http-enhanced (0.0.3) fluent-plugin-ikachan (0.1.0) fluent-plugin-imkayac (0.0.1) fluent-plugin-kanicounter (0.0.1) fluent-plugin-kestrel (0.2.2) fluent-plugin-librato-metrics (0.2.3) fluent-plugin-mongo (0.6.7) fluent-plugin-zmq (0.0.3) fluent-plugin-msgpack-rpc (0.2.1) fluent-plugin-mysql (0.0.2) fluent-plugin-mysqlslowquery (0.0.2) fluent-plugin-notifier (0.0.1) fluent-plugin-numeric-monitor (0.0.1) fluent-plugin-parser (0.1.2) fluent-plugin-pghstore (0.1.2) fluent-plugin-redis (0.2.0) fluent-plugin-redis-counter (0.1.1) fluent-plugin-resque (0.2.1) fluent-plugin-rewrite-tag-filter (0.0.1) fluent-plugin-s3 (0.2.2) fluent-plugin-sampling-filter (0.1.1) fluent-plugin-say (0.1.1) fluent-plugin-scribe (0.10.9) fluent-plugin-sns (0.2.1) fluent-plugin-solr (0.1.1) fluent-plugin-splunk (0.0.1.1) fluent-plugin-sqs (0.2.1) fluent-plugin-tagfile (0.0.1) fluent-plugin-td (0.10.7) fluent-plugin-udp (0.0.1) fluent-plugin-webhdfs (0.0.2) fluent-plugin-zabbix (0.0.1) Community Awesomeness
8. STATSD FLUME SYSLOGD SCRIBE KAFKA Other tools in same family
9. THANK YOU