Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Internet of Me

Internet of Me

Presentation for Elastic LA Meetup on Oct 18, 2017. Demo on Importing Data from Pocket API into Elastic Stack (Elasticsearch, Logstash, Kibana) with Docker.

Avatar for Rich Horace

Rich Horace

October 18, 2017
Tweet

More Decks by Rich Horace

Other Decks in Technology

Transcript

  1. ABOUT ME • Director of DevOps at Nativo • Last

    10+ years in online advertising space and early-stage startups • Working with Log Aggregation Systems since ‘08 • Elastic LA Meetup Organizer since 2015
  2. INTERNET OF ME • Challenge Keep with Technology • Alternate

    Titles: • Buried: Keeping up with Technology • I’m a Data Hoarder, Here’s My Enablers • Internet of Me Part 1
  3. INTERNET OF ME • Challenge Keep with Technology • Alternate

    Titles: • Buried: Keeping up with Technology • I’m a Data Hoarder, Here’s My Enablers • Internet of Me Part 1
  4. INTERNET OF ME • Challenge Keep with Technology • Alternate

    Titles: • Buried: Keeping up with Technology • I’m a Data Hoarder, Here’s My Enablers • Internet of Me Part 1
  5. INTERNET OF ME • Challenge Keep with Technology • Alternate

    Titles: • Buried: Keeping up with Technology • I’m a Data Hoarder, Here’s My Enablers • Internet of Me Part 1
  6. INTERNET OF ME • Challenge Keep with Technology • Alternate

    Titles: • Buried: Keeping up with Technology • I’m a Data Hoarder, Here’s My Enablers • Internet of Me Part 1
  7. INTERNET OF ME • Challenge Keep with Technology • Alternate

    Titles: • Buried: Keeping up with Technology • I’m a Data Hoarder, Here’s My Enablers • Internet of Me Part 1
  8. TALK GOALS • Introduction to My Favorite Apps • Pocket

    API • Demo Pull Pocket Data in Elastic Stack • Deep Dive into Elastic Stack • Tips and Tricks • Next Projects
  9. POCKET • getpocket.com • Review API Docs • Example JSON

    Retrieval • Limited Search Capabilities for Relevant Results
  10. DEMO • Open Sourced with Sample Data: • https://github.com/richhorace/docker-getpocket- elastic

    • Persistent Data with Docker Named Volume • Docker Launch Minimal
  11. TIPS • View Index Mapping to Build Template http://localhost:9200/pocket/_mapping?pretty {

    "pocket" : { "mappings" : { "logs" : { "properties" : { "@timestamp" : { "type" : "date" }, "@version" : { "type" : "text", "fields" : { "keyword" : { "type" : "keyword", "ignore_above" : 256 } } }, .......
  12. ELASTIC STACK WEEKLY • Next Issue: #7 – Become a

    Pioneer www.elasticstackweekly.com