Share
Embed
InterSystems Ensemble As A Service in the AWS Cloud
A Transactional Health Information Exchange deployed on Amazon Web Services powered by InterSystems Technology.
Ron Sweeney
March 16, 2015
Transcript
35 slides
-
Ron Sweeney, Integra/on Required Ensemble As A
Service, Part 1 InterSystems Global Summit 2015 1 -
Ensemble Cloud Deployment Our Show Today 2 InterSystems
Global Summit 2015 Ron Sweeney, Integration Required Hi. I helped Great Lakes Health Connect implement HealthShare for their use case and provided support the Engineering, Architecture, and Development efforts for this solution. The GS14 to GS15 Journey This session today is about a journey, which fittingly started out around Global Summit of last year. Its meant to provide some transparent insight to others investigating deploying Ensemble in the Cloud for similar purposes and highlight their use case. Episode 1 and Episode 2 This is a two part presentation, and both parts are highly technical. The first episode will mainly be focused on implementation, and the second episode will focus on the gotchas and drill down with a little bit more detail. -
3 InterSystems Global Summit 2015 Great Lakes Health Connect
Michigan Based Health Informa/on Exchange Great Lakes Health Connect An individual’s appropriate healthcare data is available wherever it is needed across the state (and beyond). • 126 hospitals • 82% of Michigan’s acute beds • >3,000 connected participants • Over 6 million unique patients in master person index • 95%+ of data flowing to State • Refused Federal Upstart Money • Pricing Model Leads to Adoption -
4 InterSystems Global Summit 2015 Business Goal Intermediate Integra/on
Architecture Infrastructure Hosted solution that provides services to HIE participants. Hybrid Infrastructure Provide a platform for delivering custom solutions. IHE Glasses Document Consumer + Document Registry -
Implementa/on Team and Target Support Team 5 CONFIDENTIAL:
Integration Required Doug, Leadership Julie, Leadership Barry, Architect Heidi, PM Mike, Engineer Mitch, Developer Gerry, AWS SE Ron, HS SE INFRASTRUCTURE (AWS) HOST (RED HAT) DB (CACHE) DEV (HEALTHSHARE) Implementation INFRASTRUCTURE (AWS) HOST (RED HAT) DB (CACHE) DEV (HEALTHSHARE) Target Support Mike, Engineer Mitch, Developer WRC AS A SERVICE -
6 InterSystems Global Summit 2015 Guiding Principles Business Requirements
Innovation Doing the Right Work Cost Containment Monthly Burn Rate Built to Scale United States HIE Security Built In, Not Bolted On Performance Don’t be a Bottleneck -
7 InterSystems Global Summit 2015 To The Cloud? The
Decision Process sk FTP Server Cloud witch Back Up Server P Server LDAP Server UPS Battery Cloud Compute As Utility vCloud Block of Compute Appliance Datacenter In a Box Cloud Disk FTP Server Cloud Switch Back Up Server LDAP Server LDAP Server UPS Battery Firewall Backup Tape Library LDAP Repository LDAP Repository Brick and Mortar Co-Location Cloud Disk FTP Server Cloud Switch Back Up Server LDAP Server LDAP Server UPS Battery Cloud Compute As Utility vCloud Block of Compute Appliance Datacenter In a Box Cloud Disk FTP Server Cloud Switch Back Up Server LDAP Server LDAP Server UPS Battery Firewall Backup Tape Library LDAP Repository LDAP Repository -
Prove It Nutanix vs. AWS 8 Scaling Prove
It Performance Prove It Approval of 30 Day Development Sprint InterSystems Global Summit 2015 -
Prove It Auto-‐Scaling 9 More Minions! When the
going gets tough, scale out the processing to meet the demand. Less Minions! Follow the demand of the participating Health Systems, scale back processing on weekends and at night. No Minions At All Turn off Certification and Development environments when not in use. InterSystems Global Summit 2015 -
Prove It Performance 10 Benchmarks Rules • Encrypted
Volumes • Spindle Optimized Volumes • Equal Config (SPEC Score) InterSystems Global Summit 2015 Minimum 280 msg/sec. (any run) The Benchmark Tool • Traffic Generator • Equal Driver and Sink • Reports Messages a Second • ^pButtons for bonus points Workloads • T1 – Simple pass-through • T2 – 1-1-2 with Transform • T4 – 1-4-5 with Transform • T4 – Same As Above No Ack HL7 Messaging Flow DRIVER SUT SINK -
To The Cloud The Deployment 11 InterSystems
Global Summit 2015 0 2.15 10.15 1.15 6.15 0 + 12-‐24mo PROD DATA FLOW Deliverable Infrastructure HealthShare Capabili/es 9mo PROVE IT AWS vs. NUTANIX | HL7 Pass-‐through | Intermediate Integra/on BUILD IT Perimeter Security VPC/VPN | Ensemble Minion Engineering| Intermediate Intermediate Integra/on EVOLVE IT Web: Enterprise Service Bus and CSP BUILD IT New Relic and Trend Micro| Pipeline Migra/ons BUILD IT : Mirror Set| Cache Mirroring| HA HIATUS Refactor| Back Log| Integra/on HARDEN IT S3 Glacier Backups| DB Restore Tes/ng | DR Con/nuous Capability Enhancements PROVE IT Auto-‐Scaling | Ensemble/Cache Auto-‐Provisioning 5.15 -
12 InterSystems Global Summit 2015 Build It Amazon Web
Services Infrastructure -
13 InterSystems Global Summit 2015 Build It InterSystems Enabling
Technologies Enterprise Manager Cache Mirroring Message Bank ENS Default Secngs CSP Gateway JAVA Gateway -
14 InterSystems Global Summit 2015 Build It Suppor/ng Technologies
NFS Cluster Github SCM New Relic Trend Micro Red Hat -
Innova/on Plaeorm for Health Informa/on Exchange Brain Storm Capable
and SAAS-‐y 16 InterSystems Global Summit 2015 Registry Hosted IIA Cloud Infra Cloud Security/ Monitoring Cloud Software Subscription OS Subscription Software Subscription Service Subscription -
Ron Sweeney, Integra/on Required Ensemble As A
Service, Part 2 InterSystems Global Summit 2015 18 -
Ensemble Cloud Deployment Our Show Today 19 InterSystems
Global Summit 2015 Ron Sweeney, Integration Required Hi. I helped Great Lakes Health Connect implement HealthShare for their use case and provided support the Engineering, Architecture, and Development efforts for this solution. The GS14 to GS15 Journey This session today is about a journey, which fittingly started out around Global Summit of last year. Its meant to provide some transparent insight to others investigating deploying Ensemble in the Cloud for similar purposes and highlight the GLHC use case. Episode 1 and Episode 2 This is a two part presentation, and both parts are highly technical. The first episode will mainly be focused on implementation, and the second episode will focus on the gotchas and drill down with a little bit more detail. -
20 InterSystems Global Summit 2015 Great Lakes Health Connect
Michigan Based Health Informa/on Exchange Great Lakes Health Connect An individual’s appropriate healthcare data is available wherever it is needed across the state (and beyond). • 126 hospitals • 82% of Michigan’s acute beds • >3,000 connected participants • Over 6 million unique patients in master person index • 95%+ of data flowing to State • Refused Federal Upstart Money • Pricing Model Leads to Adoption -
21 InterSystems Global Summit 2015 Business Goal Intermediate Integra/on
Architecture Infrastructure Hosted solution that provides services to HIE participants. Hybrid Infrastructure Provide a platform for delivering custom solutions. -
23 InterSystems Global Summit 2015 Meet the Cast Ensemble
As A Service Actors MINION Ephemeral Ensemble Instance. CONTROLLER Persistent Ensemble Cluster. Houses Message Bank, and “Non-Scaling Compliant” Production. FLOAT File I/O Shared NFS Mount -
Auto-‐Scaling Engineering Connect 24 Birth of a MINION
InterSystems Global Summit 2015 # Instance User Data Steps # Mount Tarball ############### mkdir /home/ec2-user/software mount -t ext3 /dev/xvdc /home/ec2-user/software # Mikes Huge Security Hole ########################## service iptables stop chkconfig iptables off USER-DATA # Go get "the intersystems deployment package" ############################################## cd /home/ec2-user git clone https://support%40michiganhealthconnect%2Eorg: [email protected]/greatlakeshealth/ intersys_deployment # Install HS mkdir /hs/data mkdir /hs/data/mgr cp /home/ec2-user/intersys_deployment/lic/cache.key /hs/data/mgr/ mkdir /home/ec2-user/software/package/install_confirmation/ cp /home/ec2-user/intersys_deployment/conf/preinstall /home/ec2-user/ software/package/install_confirmation/ cd /home/ec2-user/software/package/ ./installFromParametersFile /home/ec2-user/intersys_deployment/conf/ parameters.isc # Load Packages echo -e "root\nGlobalSummit1\nW \$system.OBJ.Load(\"/home/ec2-user/ intersys_deployment/update/HIE.xml\",\"ckf\")" | csession HIEMINION -U ENSEMBLE SCM CLONE HS CONFIGURATION -
Auto-‐Scaling Engineering 25 “Casters Up” MINION InterSystems Global
Summit 2015 A MINIONS DEATH WISH Before I die, please remove me from the load balancer. -
Cache Mirroring and Backup Connect 26 Successful oauth
grant of fitbit resources via a configured application configured through Abriiz Dev App Account by the logged in Abriiz user. HA/DR InterSystems Global Summit 2015 S3 and Glacier Immediate Backup and Cold Storage. Mirroring Across Availability Zones -
Security Synchroniza/on Connect 27 Successful oauth grant of
fitbit resources via a configured application configured through Abriiz Dev App Account by the logged in Abriiz user. Enterprise Manager InterSystems Global Summit 2015 Users Distributed User Sync -
Central Message Reten/on Connect 28 Successful oauth grant
of fitbit resources via a configured application configured through Abriiz Dev App Account by the logged in Abriiz user. Message Bank InterSystems Global Summit 2015 Operational Message Retention Policy 30 Days Continuity Message Retention Policy 90 Days -
Web Architecture Connect 29 Successful oauth grant of
fitbit resources via a configured application configured through Abriiz Dev App Account by the logged in Abriiz user. Service Bus InterSystems Global Summit 2015 Service Bus IHE Service Pass-through and Ensemble Business Services -
It’s not all Chocolate Rivers and Candy Flowers The
Chocolate Factory 30 Gotchas Things to consider when moving your Chocolate Factory to the Cloud… InterSystems Global Summit 2015 -
Understanding the BAA 31 InterSystems Global Summit 2015
Dedicated Tenancy • Different Resource Pool within Amazon • Limited to Minimum Instance Types Service Offering • Put on your AWS BAA Glasses Become An Encrypto-Saurus • All intercommunication encrypted Bad Things Happen to Bad Kids • You are held to their interpretation of Risk Security and Compliance -
Responsible Man in the Middle 32 InterSystems Global
Summit 2015 Visibility • Reporting • Queuing • Suspended Messages Bad Things Happen to Bad Kids • So Watch your children Monitoring and ACK/Nack Ci/zenship -
Gotchas 33 InterSystems Global Summit 2015 A Field Guide
to Avoiding Bad Kids SSL Termination Host Based Termination IP’s are Non-Existent DNS Heavy and Dependent Pay for What You Use Myth Storage and VPN VPC Configuration Up Front Engineering Crucial Swapless Hosts Instance Engineering Required Do NOT Backup to NFS S3 Move Requires Some Space Mirroring Floating IP Not Possible w/o extensive Engineering Dedicated Tenancy It’s a Different Amazon Mirroring Private Network Not Possible w/o extensive Engineering Local Hostname Change this in User Data VPN Connections Limit 10 Service Platform Amazon’s Blend and Lock-In