How Adopting Elastic at Bankwest was a Catalyst for Cultural Change (Elastic{ON} Sydney 2016)

Join Rob as he walks through the BankWest journey with Elastic, highlighting the major use cases they have as well as sharing how an innovative grass roots experiment led to the creation a real-time search solution across over 4 million customer records with Elastic as it's backbone.

Video available here: https://www.elastic.co/elasticon/tour/2016/sydney/how-adopting-elastic-at-bankwest-was-a-catalyst-for-cultural-change

Transcript

1. Rob Crowley, Technical Product Owner - APIs How Adopting Elastic at Bankwest was a Catalyst for Cultural Change Bankwest 29th Nov 2016
2. Digital disruption is driving change across established industries and finance is no exception.
3. Our customers’ adoption of technology is defining our agenda Number of interactions Revenue per interaction Experience Economy Product Economy Store Monthly decreasing Internet Monthly decreasing Mobile Daily increasing Wearables Several times a day increasing Interconnected Always on increasing
4. the species that survives is the one that is able to adapt to and adjust best to the changing environment - Charles Darwin
5. AD Producer Logstash nginx FRONT END Rabbit MQ BACK END Consumer Logstash HA Proxy (Canonical) Use Case: Centralised Logging Push to Rabbit MQ cluster at opposite site via Shovel <auth> Shield Watcher ELASTIC Kibana
6. Surprise #1 – Analytics from Kibana dashboards transformed data into information.
7. “The only way to win is to learn faster than anyone else.” - Eric Ries
8. Surprise #2 - Watcher precipitated a shift from reactive to proactive support models.
9. Encryption at rest for PII data was a challenge.
10. How you tackle it depends on your company’s risk appetite. - Elastic Search Plugin (3rd Party Vendor Options Available) - Lucene Plugin (Introduced ~25% overhead) - Disk Level (dm-crypt) - Lightweight governance (& Watcher to keep us honest)
11. Surprise #3 – Elastic use cases expanded from supporting product delivery to powering end user experiences.
12. Idea + Team + Elastic = Business Value
13. (Emergent) Use Case: Customer Search Search API F5 OpenStack Elastic Data Tenant Cloud 2 OpenStack Elastic Data Tenant Cloud 1 Bulk Agent Customer Data Extract
14. (Emergent) Use Case: Customer Search Search API F5 MQ Web API Layer System of Record OpenStack Elastic Data Tenant Cloud 2 OpenStack Elastic Data Tenant Cloud 1 Sync Agent Customer Domain GET /customers/{id} HTTP/1.1 <push>
15. Cloud computing enabled a low cost iterative approach to optimising Elastic cluster design.
16. Optimizing full text queries can be non trivial. A robust automated testing process is table stakes.
17. Takeaways