Enterprise Integration Patterns Revisited for the Era of Big Data, Internet of Things, Cloud and Microservices
In 2015, I had two talks about Enterprise Integration Patterns at OOP 2015 in Munich, Germany and at JavaDay 2015 in Kiev, Ukraine. I reused a talk from 2013 and updated it with current trends to show how important Enterprise Integration Patterns (EIP) are everywhere today and in the upcoming years.
Great to see that Gregor Hohpe - founder and author of the EIP book, and currently Head of IT at Allianz - was attending one of the sessions, too:
Introduction to Enterprise Integration Patterns
Data exchanges between companies increase a lot. Hence, the number of applications, which must be integrated increases, too. The realization of these integration scenarios is a complex and time-consuming task because different applications and services do not use the same concepts, interfaces, data formats and technologies.
Originated and published over ten years ago by Gregor Hohpe and Bobby Woolf, Enterprise Integration Patterns (EIP) became the world wide de facto standard for describing integration problems. These patterns offer a standardized way to split huge, complex integration scenarios into smaller recurring problems. The following slide deck revisits EIPs and gives an overview about the status quo and its relevance regarding modern concepts such as Big Data, Internet of Things, Cloud or Microservices. The following shows a simple, but powerful diagram using several different EIPs such as an Splitter or Router (source: http://www.enterpriseintegrationpatterns.com/):
Fortunately, EIPs offer more possibilities than just being used for modeling integration problems in a standardized way. Frameworks and tools implement these patterns, already. The developer does not have to implement EIPs on his own.
Trends: Hybrid Integration and the Citizen Integrator
The behavior of end users changes these days. Mission critical systems still need to be integrated on enterprise level. However, business users also want (and need) to be more practical without having to ask IT departments for help (taking a long time usually). Technical people (no developer, but some technical knowledge) want to realize simple integrations with partners by themselves.
While Forrester talks a about “Hybrid Integration”, Gartner names it “Citizen Developers” or “Citizen Integrators”. No matter how you name these new trends – they are on the way to the IT world of most enterprises, already.
TIBCO is following this trend. Take a look at TIBCO NOW Tour in Paris and London in 2015: TIBCO announced different tools for different end users. The future integration portfolio will contain offerings for business users, citizen developers and classical enterprise integration scenarios:
• TIBCO ActiveMatrix BusinessWorks Enterprise Edition keeps TIBCO’s flagship integration product for enterprise integration scenarios. It can be deployed on-premise on physical hardware, virtual machines or in IaaS cloud infrastructures such as Amazon EC2)
• TIBCO ActiveMatrix BusinessWorks Container Edition is similar to BusinessWorks Enterprise Edition, but optimized for cloud deployment (e.g. automatic port configuration, some activities have been changed / removed to be cloud-ready, for example File and FTP activities). The Container Edition is deployed as PaaS in the cloud or on premise, based on Pivotal’s CloudFoundry. It uses CloudFoundry’s flexible container concepts under the hood. Docker support is also planned for next year.
• TIBCO Cloud Integration offers intuitive web-based integration for the “Citizen Integrator”, e.g. to create and deploy REST services or to configure connections and policies of Open APIs. It can be used as “Micro Gateway” in the cloud.
• TIBCO Simplr also offers an intuitive web-based user interface for the Business User, e.g. to synchronize data via self-service from SaaS offerings such as Salesforce and Marketo without technical knowledge.
EIPs for Streaming Analytics, IoT and Microservices
EIPs are important not only for „classical integration“ using an Enterprise Service Bus such as TIBCO ActiveMatrix BusinessWorks or new integration cloud services such as TIBCO Cloud Integration or TIBCO Simplr.
You also (have to) use EIPs with frameworks and tools for Stream Processing (e.g. TIBCO StreamBase), API Management / Application Services Governance (e.g. TIBCO API Exchange or TIBCO Mashery), and any other tool which uses some kind of integration logic, e.g. for Internet of things (IoT) or building business logic via Microservices.
EIPs for Log Analytics and Operational Intelligence
Log Analytics and Operational Intelligence (e.g. TIBCO LogLogic and TIBCO Unity is another hot topic in the market these days, where you use EIPs for processing log data and other events. Take a look at the typical workflow, which translates to several different EIPs:
Figure 1: Workflow for Log Analytics and Operational Intelligence
Slide Deck “Enterprise Integration Patterns Revisited”
Here is the slide deck, which discusses the above content in more detail:
TODO UPLOAD NEW VERSION TO SLIDESHARE
Integration is Key to a Successful Future
The number of different data sources and technologies increases even more than in the past:
• Legacy systems such as CRM, ERP, Mainframe or B2B via EDIFACT, will not disappear
• Big Data clusters such as Data Warehouse, Apache Hadoop or NoSQL databases will store exponentially more data year by year
• Streaming server and In-Memory Data Grids will process more and more data in real time in the future
• Cloud, Mobile, APIs, Big Data, Fast Data, Internet of Things are no option, but everybody’s future!
Therefore: EVERYTHING HAS TO BE INTEGRATED! Enterprise Integration Patterns are a key piece in this puzzle!
Keywords:
Enterprise Integration Patterns, EIP, Big Data, Fast Data, Internet of Things, IoT, Cloud, Streaming Analytics, Integration, Microservices, Enterprise Service Bus, ESB, Open API, Streaming Analytics, Stream Processing, TIBCO, BusinessWorks, StreamBase, LogLogic, Unity, open api, API Management, Cloud Integration, Citizen Developer, Hybrid Integration, iSaaS, iPaaS, Oracle, IBM, Software AG, MuleSoft, Talend, JBoss, Fuse, Spring, Java
megachucky
fullkaiten
shumei_ito
grimoh
iwamot
imamura_ko_0314
shigashiyama
sakaik
panda_program
hinono
oracle4engineer
ogiwarat
hakubishin3
gr2m
erikaheidi
stephaniewalter
kevinliebholz
maltzj
paigeccino
bluesmoon
michaelherold
addyosmani
nonsquared
aarron
![Questions? Kai Wähner [email protected] @KaiWaehner www.kai-waehner.de LinkedIn / Xing à](https://files.speakerdeck.com/presentations/bd325bcfe4d14167a669358b4650d644/slide_62.jpg){kind=link}