Slide 1

Slide 1 text

qaware.de A Hitchhikers Guide to the Cloud Friendly Migration of Apache Solr Mario-Leander Reimer [email protected] Managing Director | CTO QAware GmbH Wolfgang Klimt [email protected] IT Troubleshooter ConSol Software GmbH

Slide 2

Slide 2 text

QAware | 2

Slide 3

Slide 3 text

3 QAware

Slide 4

Slide 4 text

4 QAware

Slide 5

Slide 5 text

Old Architecture QAware | 5 28x 28x 28x 8 Apache Instances Search Load 28x Loader

Slide 6

Slide 6 text

New Architecture, Step one QAware | 6 28 x 3(+) 28x 8 Apache Instances Search 28x Loader Load

Slide 7

Slide 7 text

New Architecture, Step one QAware | 7 28 x 3(+) 28x 8 Apache Instances Search 28x Loader Load Staging 28 x

Slide 8

Slide 8 text

Search Solr Go Live QAware | 8 8 Apache Instances 28x 28x

Slide 9

Slide 9 text

New Architecture, Step two QAware | 9 28 x 3(+) Search 8 Apache Instances 28 x Staging 28 x Load Loader Loader Loader Loader ? x Loader

Slide 10

Slide 10 text

Go Live of Step two QAware | 10 28 x 3(+) Search 8 Apache Instances 28 x Staging Loader Loader Loader Loader 28x 28x Loader

Slide 11

Slide 11 text

Go Live of Step two QAware | 11 28 x 3(+) Search 8 Apache Instances 28 x Staging Loader Loader Loader Loader 28x 28x Loader

Slide 12

Slide 12 text

Technologies QAware | 12 ■ Mainly AWS EC2 machines and ALBs ■ Terraform and Terragrunt used as Infrastructure as Code solution ■ Hashicorp Packer used to create custom AMIs with Apache Solr distribution and AWS Corretto JDK pre-installed ■ AWS Aurora but also Apache Ignite as staging databases ■ Envoy Proxies to access on-premise datacenter from VPC, mainly to save IP addresses on direct connect ■ EBS snapshots for faster startup of Solr instance on scale-up

Slide 13

Slide 13 text

Learnings and Tips QAware | 13 ■ Plan a gradually Go Live ■ Have a fallback plan ■ Many small instances behave different to few big instances ■ Reserve time for improvements after go live ■ Test thoroughly, but don’t expect to have tested everything

Slide 14

Slide 14 text

Q&A

Slide 15

Slide 15 text

qaware.de QAware GmbH Aschauer Straße 32 81549 München Tel. +49 89 232315-0 [email protected] twitter.com/qaware linkedin.com/company/qaware-gmbh xing.com/companies/qawaregmbh slideshare.net/qaware github.com/qaware