Microservices in Gett

A talk given at RailsClub'15 by Andrey Deryabin from Evil Martians

Transcript

1. RAILSCLUB 2015 Microservices in Gett Andrey Deryabin
2. Team Lead @brainopia @razum2um @nebolsin @ssdany Andrey Deryabin
3. Taxi Beauty Home Services Food Delivery 10 million users 32 cities
4. — James Hughes “Microservice Architecture is an architectural concept that aims to decouple a solution by decomposing functionality into discrete services”
5. — Sam Newman “Microservices are small, autonomous services that work together”
6. Teamwork Communication Shared Code Fault Tolerance Authentication/Authorization Logging/Auditing Testing Configuring
7. Communication HTTP REST JSON
8. Shared code
9. Don’t Repeat Yourself vs Service Isolation
10. git ‘https://link_to_repo.git' do gem 'gett-config' gem 'gett-env' end
11. Authentication
12. Single sign-on Integration with OKTA (authorization) Two-Factor authentication Requirements
13. Auth Service
14. redirect 302 with SAML request JWT Auth Service Client Service SAML response
15. Versioning/Auditing
16. A B C D
17. Distributed Transaction
18. Flat transaction Nested Transaction
19. One Phase Commit Two Phase Commit
20. Two phase commit 1. Voting Phase • Coordinator sends a can_commit? request to all participants • Each participant votes YES/NO to coordinator 2. Completion Phase • Coordinator collects votes and makes the decision • YES Participants wait for a commit! or abort! request.
21. A B C D
22. A B C D check check check
23. A B C D check check check
24. A B C D check check check
25. A B C D check check check confirmation confirmation confirmation
26. A B C D check check check confirmation confirmation confirmation
27. A B C D check check check confirmation confirmation confirmation
28. A B C D check check check confirmation confirmation confirmation
29. Copy On Write
30. Fault Tolerance
31. Millions of API requests per day
32. Lots of servers
33. Hundreds of dependencies
34. — Mia Hamm “Failure happens all the time. It happens every day in practice. What makes you better is how you react to it”
35. Release it!
36. Resilience patterns Use Timeouts Bulkheads Fail Fast Circuit Breaker
37. Circuit Breaker
38. Closed Closed Half open Timeout reset Success Failure Threshold reached Success
39. Circuit Breaker require 'stoplight' stoplight = Stoplight('ping') { ping 'railsclub.ru' } stoplight.run # => true stoplight.color # => “green" ############## stoplight.run # => false stoplight.color # => "red"
40. Testing
41. Manual tests Automated Tests
42. Testing workflow Local Server Staging Server QA Server Production
43. RSpec Lurker Capybara
44. Lurker https://github.com/razum2um/lurker
45. Validating JSON Schema Documentation UI for live testing (Swagger integration)
46. # spec/requests/users_spec.rb it "lists users", :lurker do get "/api/v1/users.json" end
47. // lurker/api/v1/users-GET.json.yml --- description: user listing prefix: users management requestParameters: description: '' type: object responseCodes: - status: 200 successful: true description: '' responseParameters: type: array items: description: '' type: object additionalProperties: false required: [] properties: id: description: '' type: integer example: 1 name: description: '' type: string example: razum2um extensions: method: GET path_info: "/api/v1/users.json" path_params: action: index controller: api/v1/users query_params: limit: '1'
48. Failure/Error: post :create [...] Lurker::ValidationError: Request - The property '#/' contains additional properties ["social_network"] outside of the schema when none are allowed in schema file:///.../lurker/api/v1/users- POST.json.yml# Response - The property '#/user/last_sign_in_at' of type String did not match the following type: null in schema file:///.../lurker/api/v1/users-POST.json.yml#
49. Configuring when provisioning
50. Configuring on the fly (without restart/redeploy) Distributed configuring No syncronization lack
51. — zookeeper.apache.org “ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services”
52. http://bit.ly/Lurker http://bit.ly/ReleaseIt http://bit.ly/BuildingMicroservices http://jwt.io/ http://gett.com http://zookeeper.org
53. Thanks! aderyabin @aderyabin @evilmartians evilmartians.com ad@evl.ms