The Starship Fleet: From Point to Multipoint

Initially conceived in the early 2000s, the enterprise service bus (ESB) has become a ubiquitous part of enterprise application and systems integration. This introductory talk explores the potential pitfalls of point-to-point integration, introduces the concept of an enterprise service bus and how it can help to implement a service-oriented architecture (SOA) within a large enterprise environment.

Transcript

1. THE STARSHIP FLEET FROM POINT TO MULTIPOINT Mike Nowakowski @mike_nowakowski JUNE 2015
3. THE STARSHIP FLEET A long time ago… In a galaxy far away… There was an elite fleet of starships…
4. THE STARSHIP FLEET Point-to-Point C = 3
5. THE STARSHIP FLEET Point-to-Point M2 T Ship B M1 Ship A
6. THE STARSHIP FLEET Point-to-Point C = 10
7. THE STARSHIP FLEET Point-to-Point C = 45
8. THE STARSHIP FLEET Point-to-Point N(N-1) 2 3 ships, C = 3 5 ships, C = 10 10 ships, C = 45 25 ships, C = 300 Maximum Connections
9. THE STARSHIP FLEET Point-to-Point ➔ Highly coupled! ➔ Communication ◆ Ships
10. THE STARSHIP FLEET Deep out in space… There was a beacon of hope… A ship so powerful and mighty… Hub and Spoke
11. THE STARSHIP FLEET Hub and Spoke
12. THE STARSHIP FLEET Hub and Spoke Maximum Connections N
13. THE STARSHIP FLEET Hub and Spoke
14. THE STARSHIP FLEET Hub and Spoke ➔ Loose Coupling! ➔ Communication ◆ Enterprise
15. ENTERPRISE SERVICE BUS Components Service Endpoint M2
16. ENTERPRISE SERVICE BUS Components HUB T M1
17. ENTERPRISE SERVICE BUS Components HUB T M1 M2 Service Endpoint Channel
18. ENTERPRISE SERVICE BUS Components Event / Message Header Attributes Body Channel TCP / UDP HTTP FTP ... Endpoint Database Web Service IoT Device ...
19. THE STARSHIP FLEET What’s wrong with this picture?
20. THE STARSHIP FLEET What’s wrong with this picture? ➔ Dependency ➔ Single-point of Failure ➔ Scalability and Performance
21. THE STARSHIP FLEET Enterprise Service Bus S1 S2 S3 Services =
22. THE STARSHIP FLEET Enterprise Service Bus = S1 S2 S3
23. ENTERPRISE SERVICE BUS An enterprise service bus (ESB) is a software architecture model used for designing and implementing communication between mutually interacting software applications in a service-oriented architecture (SOA). - Wikipedia What is it?
24. ENTERPRISE SERVICE BUS What is it? SOA enables ESB
25. ENTERPRISE SERVICE BUS Systems View App 2 App 1 API 1 API 2 App 3 MySQL CSV XML JSON XML JSON JDBC ESB
26. ENTERPRISE SERVICE BUS Business View Create Invoice Process Order Create Order ESB Update Inventory
27. ENTERPRISE SERVICE BUS Multiple Create Invoice Process Order Create Order ESB 1 Update Inventory Toronto ESB 2
28. ENTERPRISE SERVICE BUS ➔ Connectivity ➔ Routing ➔ Reliability ➔ Data Transformation ➔ Administration ➔ Standards ➔ Security Characteristics
29. ENTERPRISE SERVICE BUS ➔ Priority ◆ How important is the message? ◆ Levels (Low, High, etc.) ➔ Types ◆ Content-Based ◆ Conditional ◆ Policy-Based Routing
30. ENTERPRISE SERVICE BUS ➔ Types ◆ Content-Based (CBR) Routing App 1 998-456-1234 App 2 1-997-678-1234 App 3 M M T ESB
31. ESB ENTERPRISE SERVICE BUS ➔ Types ◆ Conditional Routing M App 1 98 125 T App 2 500 App 3 M < 100 App 4
32. ENTERPRISE SERVICE BUS ➔ Types ◆ Policy-Based Routing M Store 1 Return T-shirt T Store 2 Return T-shirt Return Hat Department 1 M Department 2 ESB
33. ENTERPRISE SERVICE BUS ➔ QoS (Quality of Service) ◆ Bandwidth ◆ Latency ◆ Throughput ➔ Monitoring and Logging ➔ Scalability ➔ Performance Reliability
34. ENTERPRISE SERVICE BUS ➔ Message Exchange Patterns (MEPs) ◆ One-Way Reliability App 1 App 2 ESB Request Request
35. ENTERPRISE SERVICE BUS ➔ Message Exchange Patterns (MEPs) ◆ Request/Response Reliability App 1 Request App 2 Response ESB
36. ENTERPRISE SERVICE BUS ➔ Message Exchange Patterns (MEPs) ◆ Request/Callback ◆ Publish/Subscribe Reliability
37. ENTERPRISE SERVICE BUS ➔ Formats ➔ Data Mapping ◆ Look-up tables, Subsets, Custom Functions Data Transformation App 1 Order ID Country Code CA T App2 Order ID Country Canada ESB
38. ENTERPRISE SERVICE BUS ➔ Accounts & Users ➔ Configuration ➔ Change Management ➔ Capacity Management ➔ Governance Administration
39. ENTERPRISE SERVICE BUS ➔ Audits ➔ Attack Surface / Vectors ➔ Access Control ➔ Confidentiality ➔ Compliance ➔ Data Retention ➔ Data Ownership Security
40. ENTERPRISE SERVICE BUS ➔ XML Standards <order> <id>10000</id> <quantity>1</quantity> <amount>$1000.00</amount> <product>Laptop</product> </order>
41. ENTERPRISE SERVICE BUS ➔ XML ◆ XPath and XQuery Standards Input <orders> <order>1</order> <order>2</order> </orders> T Query /orders/order[2] Output <order>2</order>
42. ENTERPRISE SERVICE BUS ➔ XML ◆ WSDL ◆ SOAP Standards
43. ENTERPRISE SERVICE BUS ➔ JSON ◆ RAML • RESTful API Modeling Language • YAML and JSON Standards
44. ENTERPRISE SERVICE BUS ➔ Technical ◆ Maintainability ◆ Scalability ◆ Performance ◆ Security Benefits
45. ENTERPRISE SERVICE BUS ➔ Business ◆ Agility ◆ Value ◆ Solutions ◆ Lower Costs Benefits
46. ENTERPRISE SERVICE BUS What’s out there? 2000 2010 2015 2005 Microsoft BizTalk Red Hat JBoss Fuse Microsoft Azure Bus Oracle Service Bus MuleSoft
47. ENTERPRISE SERVICE BUS ➔ Red Hat JBoss Fuse ➔ MuleSoft ➔ Oracle Service Bus ➔ Microsoft BizTalk ➔ Microsoft Azure Service Bus What’s out there?
48. THANKS! Questions? m5nowako@uwaterloo.ca @mike_nowakowski
49. REFERENCES Chappell, David. 2004. Enterprise Service Bus. Sebastopol, California. O’Reilly Media. Enterprise Service Bus. In Wikipedia. Retrieved March 13, 2015, from http://en.wikipedia.org/wiki/Enterprise_service_bus. Josuttis, Nicolai. 2007. SOA in Practice: The Art of Distributed System Design. Sebastopol, California. O’Reilly Media.