Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Powering Customer Experiences with Elastic

Elastic Co
November 29, 2016

Powering Customer Experiences with Elastic

For more than a decade Jeremy has been fascinated with the use of search-based technologies as the primary driver of customer experiences. In this talk, he will reflect on his experience with two live projects for major publishers taking this approach with the Elastic Stack. Lead Developer Matt Frater will then demonstrate the concepts being used at Fairfax Media in new applications such as the well-known GoodFood app and site.

Jeremy Kelaher l Head of Architecture, Product Technology l Fairfax Media
Matt Frater l Lead Developer l Fairfax Media

Elastic Co

November 29, 2016
Tweet

More Decks by Elastic Co

Other Decks in Technology

Transcript

  1. Powering Customer Experiences with Elastic, Storytelling with Search Jeremy Kelaher,

    Head of Architecture, Fairfax Media Matt Frater, Lead Developer, API team, Fairfax Media Sydney | November 29 2016
  2. Fairfax Media Limited [ASX:FXJ] is an innovative and digitally progressive

    media company in Australia and New Zealand - the trusted voice informing, engaging and entertaining audiences and communities via newspapers, websites, radio stations, events and dynamic digital ventures.
  3. • Fairfax operates several broadly-based services businesses spanning marketing, property,

    entertainment and beyond. Fairfax’s independent journalism and quality content has been keeping people informed and connected for more than 180 years. Business divisions include Australian Publishing Media, Domain Group, Digital Ventures, Fairfax New Zealand and Life Media & Events. • Fairfax has a portfolio of leading websites, tablet and smartphone apps, including the online news sites smh.com.au and theage.com.au in Australia and stuff.co.nz in New Zealand. The group also has leading classified and transaction websites in Australia.
  4. The Problem Authoring Many Authoring systems ✦ “Big Iron” (digital/print)

    ✦ Bloggers ✦ Special Purpose ✦ Partners ✦ Syndication Reuse Curation at scale ✦ Lists, Listicles, Galleries ✦ Reuse of venues, events, pictures ✦ Format sub-edit ✦ Derivative Articles Delivery OffNet ✦ Facebook IA ✦ AMP ✦ Apple OnNet ✦ Sites ✦ Apps ✦ Widgets
  5. Solution Pipeline Architecture Authoring Authoring Authoring Ingest Tools API UX

    UX UX Source systems (CQ, Django, WordPress, XML files) Ingest (node.js lambda) Elastic Stack Core storing • JSON-LD Schema.org Ruby Front End/Admin + Swagger Destination systems – direct to page js, node, WordPress, Django, CQ
  6. DR Elastic Alerts Elastic (Percolate) AWS Kinesis (Inbound) End State

    Goals ~1000 qps origin (>10,000 CDN) Bounded complexity on custom queries Multi Region DR PubSub Source Source Source Primary Elastic Cloud AWS Kinesis (Outbound) API Gateway Shield Akami Apps, Sites, Widgets PubSub Signed Queries Logstash /Kibana
  7. The Future Retire Legacy • Move Legacy usage of Elasticsearch

    and JCR to Fairfax API • Migrate Alerts to Publish/Subscribe (60k+ active alerts today) • Replace legacy syndication (RSS etc) with layer of API Publish/ Subscribe • Deploy Percolate/Kinesis based delivery • Extend signed queries to Publish Subscribe Robustness • Upgrade to v5 J • Explore automation for DR and environment spin up • USA based DR • API gateway with DR failover
  8. Except where otherwise noted, this work is licensed under http://creativecommons.org/licenses/by-nd/4.0/

    Creative Commons and the double C in a circle are registered trademarks of Creative Commons in the United States and other countries. Third party marks and brands are the property of their respective holders.