Elastic{ON} Tour 2018 Paris : Intégration de la Suite Elastic à la plateforme interne d’Amadeus

Amadeus figure parmi les 10 premiers leaders mondiaux en programmation et développement logiciels de solutions pour l’industrie du tourisme. Dans le cadre de la plateforme interne utilisée pour livrer ses produits à ses clients, Amadeus a intégré la Suite Elastic comme composant standard et industrialisée – cela a nécessité deux tentatives ! Ils ont d'abord essayé sans l’aide du Support Elastic et n’ont pas réussi à répondre à leur critère de déploiement opérationnel. Puis, ils ont recommencé en collaboration étroite avec Elastic et ce composant fait désormais partie de leur catalogue interne. Aymeric Gerardin et Luca Belluccini partagent leur expérience au sein d’Amadeus: « Retour sur les défis relevés et les leçons retenues pour finalement aboutir au succès de leur projet Elastic.

Aymeric Gerardin | Manager SRE for Data Management & Monitoring Division | Amadeus
Luca Belluccini | Elastic Stack Lead Developer for Queueing & Data Store Department | Amadeus

Transcript

1. Aymeric Gerardin, Manager SRE for Data Management & Monitoring Division, Amadeus Luca Belluccini, Elastic Stack Lead Developer for Queueing & Data Store Department, Amadeus Intégration de la Suite Elastic à la plateforme interne d’Amadeus
2. The image part with relationship ID rId3 was not found in the file. © Amadeus IT Group and its affiliates and subsidiaries The image part with relationship ID rId3 was not found in the file. Elastic Suite integration in Amadeus platform Paris, 30 Jan 2018 Aymeric Gerardin, Manager SRE for Data Management & Monitoring Division @Amadeus Luca Belluccini, Elastic Stack Lead Developer for Queueing & Data Store Department @Amadeus
3. The image part with relationship ID rId3 was not found in the file. Solutions we offer © Amadeus IT Group and its affiliates and subsidiaries Distribution Provision of indirect distribution services IT Solutions Including direct distribution technology _ Data Centre _ Platforms & applications _ Sales & marketing infrastructure _ Customers business management to serve travelers _Business intelligence _Merchandising _User-generated content _e-Commerce _Social media _Search _Advertising _Mid- & back-office _Expense management _Payments _Ticketing _Self-booking tool _Point of sale _Mobile _Offer management _Business Intelligence _Flight sequence optimisation _Resource optimisation _Passenger verification _Contract and billing _Weight and balance _Flight management _Revenue management _Revenue accounting _Content management _Trip management _Customer management _Point of sale _Distribution _Baggage reconciliation _Self-service bag drop _Self-service check-in _Loyalty _e-Commerce _Mobile _Reservation _Property management _Payments 3
4. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. Our customers © Amadeus IT Group and its affiliates and subsidiaries The image part with relationship ID rId3 was not found in the file. tour operators car rental companies cruise and ferry lines rail operators insurance provider groups airport operators ground handlers The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. 43 hospitality properties 580,000 travel agencies and corporations, online and worldwide 90 233 16 110 100 50 The image part with relationship ID rId3 was not found in the file. airlines The image part with relationship ID rId3 was not found in the file. 709 The image part with relationship ID rId3 was not found in the file. 4
5. The image part with relationship ID rId3 was not found in the file. Inspire Shop Book On-trip Pre-trip Post-trip Enriching every step of the traveler’s journey © Amadeus IT Group and its affiliates and subsidiaries 5 mage part with relationship ID rId3 was not found in the file. The power shifts to end-users and drives our technology agenda. Customization and Openness End-user centric travel Personalization
6. The image part with relationship ID rId3 was not found in the file. © Amadeus IT Group and its affiliates and subsidiaries Behind the scene
7. 7 © Amadeus IT Group and its affiliates and subsidiaries Data High Volumes The image part with relationship ID rId3 was not found in the file. 145K Tps in avg. 300K Tps at peak 1.3 Petabytes of Data produced by day Applications & Infrastructure
8. d3 was not found in the file. 8 © Amadeus IT Group and its affiliates and subsidiaries Amadeus Technology Platform
9. 9 © Amadeus IT Group and its affiliates and subsidiaries Deploy world-wide! Madrid Munich Nice We operate in 190+ markets Datacenter #1 Cluster #1 vDatacenter Cluster #2 vDatacenter Endpoints Endpoints Datacenter #m-1 Cluster #p vDatacenter Endpoints Datacenter #m Cluster #n vDatacenter Endpoints … Data exchange VPN
10. The image part with relationship ID rId3 was not found in the file. 10 © Amadeus IT Group and its affiliates and subsidiaries 2013…
11. 11 © Amadeus IT Group and its affiliates and subsidiaries Functional Monitoring First Elastic implementation json Application(s) The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file.
12. The image part with relationship ID rId3 was not found in the file. © Amadeus IT Group and its affiliates and subsidiaries Data platform Hadoop 2014 Kafka 2015 Elastic 2016 Object store 2017 Couchbase 2014 Qlik 2018 ? ? MongoDB 2015
13. _Skeptic • User Behavior Analytics _Arcane • Human/Robotic activity analysis _New SOC based on SIEMonster 13 © Amadeus IT Group and its affiliates and subsidiaries Use cases The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in The image part with relationship ID rId3 was not found in The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. LambdaBox The image part with relationship ID rId3 was not found in the file.
14. The image part with relationship ID rId3 was not found in the file. 14 © Amadeus IT Group and its affiliates and subsidiaries Let’s deep dive
15. The image part with relationship ID rId3 was not found in the file. 15 © Amadeus IT Group and its affiliates and subsidiaries Elastic Industrialization Filling the gap Architecture Sizing and Infrastructure Configuration & Deploy Monitoring Security Backups Operability Client libraries Trainings … The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file.
16. _Reliability & redundancy _Flexible in scale up/down (horizontal & vertical) _Best practices from Elasticsearch documentation _ support with Workshops on site 16 © Amadeus IT Group and its affiliates and subsidiaries Architecture The image part with relationship ID rId3 was not found in the file. mnode#1 Master only The image part with relationship ID rId3 was not found in the file. The imag e mnode#2 Master only The image part with relationship ID rId3 was not found in the file. The imag e mnode#3 Master only The image part with relationship ID rId3 was not found in the file. The imag e cnode#1 Coordinating The image part with relationship ID rId3 was not found in the file. The imag e cnode#2 Coordinating The image part with relationship ID rId3 was not found in the file. The imag e dnode#1 Data only The image part with relationship ID rId3 was not found in the file. The imag e dnode#2 Data only The image part with relationship ID rId3 was not found in the file. The imag e dnode#n Data only The image part with relationship ID rId3 was not found in the file. The imag e … … node#1 The imag e node#2 The imag e The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. Kibana Kibana Load Balancer The image part with relationship ID rId3 was not found in the file.
17. _Depends on… • Use case • Type of data • Near real time constraints • Document size, fields • Indexing, updates & delete requests • Search requests, aggregation requests • Availability level _Elastic support with Questionnaire 17 © Amadeus IT Group and its affiliates and subsidiaries Sizing & Infrastructure The image part with relationship ID rId3 was not found in the file. VMs on ESXi hosts 1 VM per node instance SSDs for production systems Firecell and host awareness The image part with relationship ID rId3 was not found in the file.
18. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. _ & community support for • Puppet • Ansible _Operating System configuration tweaks _Documentation by elastic 18 © Amadeus IT Group and its affiliates and subsidiaries Configuration & deployment The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file.
19. The image part with relationship ID rId3 was not found in the file. _Integration with our internal monitoring system thanks to REST APIs • Platform metrics • Elasticsearch and Kibana metrics _Alerting • Incident triggers • On-call loops 19 © Amadeus IT Group and its affiliates and subsidiaries Monitoring & Alerting The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file.
20. _X-Pack security key features • Network encryption • System keys • Authentication layer • Authorization layer • Access auditing logs 20 © Amadeus IT Group and its affiliates and subsidiaries Security The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file.
21. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. 21 © Amadeus IT Group and its affiliates and subsidiaries Operability & Backups _Administration & configuration APIs _Backups via internal solution using S3 interface _Continuous service via rolling restarts _Compatibility across all the Elastic stack products
22. _Multiple technologies to support _Improving client metrics, adding probes in client libraries _Elastic supports several programming languages 22 © Amadeus IT Group and its affiliates and subsidiaries Applications Client libraries The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file.
23. 23 Future _Proof of concept for Openshift integration © 2016 Amadeus IT Group and its affiliates and subsidiaries _Improvements on change tracking & auditing _Improvements on client libraries _New usecases The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file.
24. mage part with relationship ID rId3 was not found in the file. _The industrialization process lead to reusable components within • plays an important role _People • Service Reliability Engineering _Processes • Change management, change awareness _Growing • Iterative evolution of features & requirements • Plan for change 24 © Amadeus IT Group and its affiliates and subsidiaries Takeaways The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file. The image part with relationship ID rId3 was not found in the file.
25. t with relationship ID rId3 was not found in the file. 25 © Amadeus IT Group and its affiliates and subsidiaries Questions?
26. Thank you! © Amadeus IT Group and its affiliates and subsidiaries You can follow us on: AmadeusITgroup amadeus.com amadeus.com/blog