How Adopting Elastic at Bankwest was a Catalyst for Cultural Change (Elastic{ON} Sydney 2016)

Join Rob as he walks through the BankWest journey with Elastic, highlighting the major use cases they have as well as sharing how an innovative grass roots experiment led to the creation a real-time search solution across over 4 million customer records with Elastic as it's backbone.

Video available here: https://www.elastic.co/elasticon/tour/2016/sydney/how-adopting-elastic-at-bankwest-was-a-catalyst-for-cultural-change

Transcript

1. Rob Crowley, Technical Product Owner - APIs
   How Adopting Elastic at
   Bankwest was a Catalyst for
   Cultural Change
   Bankwest
   29th Nov 2016
   

   View Slide

2. Digital disruption is driving change across established
   industries and finance is no exception.
   

   View Slide

3. Our customers’ adoption of technology is
   defining our agenda
   Number of interactions
   Revenue per interaction
   Experience Economy
   Product Economy
   Store
   Monthly decreasing
   Internet
   Monthly decreasing
   Mobile
   Daily increasing
   Wearables
   Several times a day increasing
   Interconnected
   Always on increasing
   

   View Slide

4. the species that survives is
   the one that is able to adapt to and adjust best to the
   changing environment
   - Charles Darwin
   

   View Slide

5. AD
   Producer
   Logstash
   nginx
   FRONT END
   Rabbit
   MQ
   BACK END
   Consumer
   Logstash
   HA Proxy
   (Canonical) Use Case: Centralised Logging
   Push to Rabbit MQ
   cluster at opposite site
   via Shovel
   
   Shield
   Watcher
   ELASTIC
   Kibana
   

   View Slide

6. Surprise #1 – Analytics from Kibana dashboards
   transformed data into information.
   

   View Slide

7. “The only way to win is to learn faster
   than anyone else.”
   - Eric Ries
   

   View Slide

8. Surprise #2 - Watcher precipitated a shift from reactive
   to proactive support models.
   

   View Slide

9. Encryption at rest for PII data was a challenge.
   

   View Slide

10. How you tackle it depends on your company’s risk appetite.
    - Elastic Search Plugin (3rd Party Vendor Options Available)
    - Lucene Plugin (Introduced ~25% overhead)
    - Disk Level (dm-crypt)
    - Lightweight governance (& Watcher to keep us honest)
    

    View Slide

11. Surprise #3 – Elastic use cases expanded from supporting
    product delivery to powering end user experiences.
    

    View Slide

12. Idea + Team + Elastic = Business Value
    

    View Slide

13. (Emergent) Use Case: Customer Search
    Search API
    F5
    OpenStack
    Elastic Data
    Tenant Cloud 2
    OpenStack
    Elastic Data
    Tenant Cloud 1
    Bulk Agent
    Customer
    Data
    Extract
    

    View Slide

14. (Emergent) Use Case: Customer Search
    Search API
    F5
    MQ
    Web API Layer
    System of Record
    OpenStack
    Elastic Data
    Tenant Cloud 2
    OpenStack
    Elastic Data
    Tenant Cloud 1
    Sync Agent
    Customer
    Domain
    GET /customers/{id} HTTP/1.1
    
    

    View Slide

15. Cloud computing enabled a low cost iterative approach to
    optimising Elastic cluster design.
    

    View Slide

16. Optimizing full text queries can be non trivial.
    A robust automated testing process is table stakes.
    

    View Slide

17. Takeaways
    

    View Slide