Upgrade to Pro — share decks privately, control downloads, hide ads and more …

InterSystems Ensemble As A Service in the AWS Cloud

InterSystems Ensemble As A Service in the AWS Cloud

A Transactional Health Information Exchange deployed on Amazon Web Services powered by InterSystems Technology.

80c0cfaa40462f99fcf0686c074c12e7?s=128

Ron Sweeney

March 16, 2015
Tweet

More Decks by Ron Sweeney

Other Decks in Technology

Transcript

  1.   Ron  Sweeney,  Integra/on  Required      Ensemble  As  A

     Service,  Part  1   InterSystems Global Summit 2015 1
  2. Ensemble  Cloud  Deployment   Our  Show  Today   2 InterSystems

    Global Summit 2015 Ron Sweeney, Integration Required Hi. I helped Great Lakes Health Connect implement HealthShare for their use case and provided support the Engineering, Architecture, and Development efforts for this solution. The GS14 to GS15 Journey This session today is about a journey, which fittingly started out around Global Summit of last year. Its meant to provide some transparent insight to others investigating deploying Ensemble in the Cloud for similar purposes and highlight their use case. Episode 1 and Episode 2 This is a two part presentation, and both parts are highly technical. The first episode will mainly be focused on implementation, and the second episode will focus on the gotchas and drill down with a little bit more detail.
  3. 3 InterSystems Global Summit 2015 Great  Lakes  Health  Connect  

    Michigan  Based  Health  Informa/on  Exchange   Great Lakes Health Connect An individual’s appropriate healthcare data is available wherever it is needed across the state (and beyond). •  126 hospitals •  82% of Michigan’s acute beds •  >3,000 connected participants •  Over 6 million unique patients in master person index •  95%+ of data flowing to State •  Refused Federal Upstart Money •  Pricing Model Leads to Adoption
  4. 4 InterSystems Global Summit 2015 Business  Goal   Intermediate  Integra/on

     Architecture   Infrastructure Hosted solution that provides services to HIE participants. Hybrid Infrastructure Provide a platform for delivering custom solutions. IHE Glasses Document Consumer + Document Registry
  5. Implementa/on  Team  and  Target  Support   Team   5 CONFIDENTIAL:

    Integration Required Doug, Leadership Julie, Leadership Barry, Architect Heidi, PM Mike, Engineer Mitch, Developer Gerry, AWS SE Ron, HS SE INFRASTRUCTURE (AWS) HOST (RED HAT) DB (CACHE) DEV (HEALTHSHARE) Implementation INFRASTRUCTURE (AWS) HOST (RED HAT) DB (CACHE) DEV (HEALTHSHARE) Target Support Mike, Engineer Mitch, Developer WRC AS A SERVICE
  6. 6 InterSystems Global Summit 2015 Guiding  Principles   Business  Requirements

      Innovation Doing the Right Work Cost Containment Monthly Burn Rate Built to Scale United States HIE Security Built In, Not Bolted On Performance Don’t be a Bottleneck
  7. 7 InterSystems Global Summit 2015 To  The  Cloud?   The

     Decision  Process   sk FTP Server Cloud witch Back Up Server P Server LDAP Server UPS Battery Cloud Compute As Utility vCloud Block of Compute Appliance Datacenter In a Box Cloud Disk FTP Server Cloud Switch Back Up Server LDAP Server LDAP Server UPS Battery Firewall Backup Tape Library LDAP Repository LDAP Repository Brick and Mortar Co-Location Cloud Disk FTP Server Cloud Switch Back Up Server LDAP Server LDAP Server UPS Battery Cloud Compute As Utility vCloud Block of Compute Appliance Datacenter In a Box Cloud Disk FTP Server Cloud Switch Back Up Server LDAP Server LDAP Server UPS Battery Firewall Backup Tape Library LDAP Repository LDAP Repository
  8. Prove  It   Nutanix  vs.  AWS   8 Scaling Prove

    It Performance Prove It Approval of 30 Day Development Sprint InterSystems Global Summit 2015
  9. Prove  It   Auto-­‐Scaling   9 More Minions! When the

    going gets tough, scale out the processing to meet the demand. Less Minions! Follow the demand of the participating Health Systems, scale back processing on weekends and at night. No Minions At All Turn off Certification and Development environments when not in use. InterSystems Global Summit 2015
  10. Prove  It   Performance   10 Benchmarks Rules •  Encrypted

    Volumes •  Spindle Optimized Volumes •  Equal Config (SPEC Score) InterSystems Global Summit 2015 Minimum 280 msg/sec. (any run) The Benchmark Tool •  Traffic Generator •  Equal Driver and Sink •  Reports Messages a Second •  ^pButtons for bonus points Workloads •  T1 – Simple pass-through •  T2 – 1-1-2 with Transform •  T4 – 1-4-5 with Transform •  T4 – Same As Above No Ack HL7 Messaging Flow DRIVER   SUT   SINK  
  11. To  The  Cloud   The  Deployment   11   InterSystems

     Global  Summit  2015   0   2.15   10.15   1.15   6.15   0  +  12-­‐24mo   PROD   DATA  FLOW   Deliverable    Infrastructure            HealthShare  Capabili/es   9mo   PROVE  IT   AWS  vs.  NUTANIX  |    HL7  Pass-­‐through  |  Intermediate  Integra/on   BUILD  IT   Perimeter  Security  VPC/VPN    |  Ensemble  Minion  Engineering|  Intermediate  Intermediate  Integra/on   EVOLVE  IT   Web:    Enterprise  Service  Bus  and  CSP   BUILD  IT   New  Relic  and  Trend  Micro|  Pipeline  Migra/ons   BUILD  IT   :  Mirror  Set|    Cache  Mirroring|  HA   HIATUS   Refactor|    Back  Log|  Integra/on     HARDEN  IT   S3  Glacier  Backups|    DB  Restore  Tes/ng  |  DR     Con/nuous  Capability     Enhancements   PROVE  IT   Auto-­‐Scaling  |  Ensemble/Cache  Auto-­‐Provisioning     5.15  
  12. 12 InterSystems Global Summit 2015 Build  It   Amazon  Web

     Services  Infrastructure  
  13. 13 InterSystems Global Summit 2015 Build  It   InterSystems  Enabling

     Technologies     Enterprise     Manager   Cache   Mirroring   Message   Bank   ENS   Default     Secngs   CSP   Gateway   JAVA   Gateway  
  14. 14 InterSystems Global Summit 2015 Build  It   Suppor/ng  Technologies

      NFS   Cluster   Github   SCM   New   Relic   Trend   Micro   Red   Hat  
  15. 15 InterSystems Global Summit 2015 As  Built   Resul/ng  Architecture

     
  16. Innova/on  Plaeorm  for  Health  Informa/on  Exchange   Brain  Storm  Capable

     and  SAAS-­‐y   16 InterSystems Global Summit 2015 Registry Hosted IIA Cloud Infra Cloud Security/ Monitoring Cloud Software Subscription OS Subscription Software Subscription Service Subscription
  17. Ques/ons?   Intermission   InterSystems Global Summit 2015 17

  18.   Ron  Sweeney,  Integra/on  Required      Ensemble  As  A

     Service,  Part  2   InterSystems Global Summit 2015 18
  19. Ensemble  Cloud  Deployment   Our  Show  Today   19 InterSystems

    Global Summit 2015 Ron Sweeney, Integration Required Hi. I helped Great Lakes Health Connect implement HealthShare for their use case and provided support the Engineering, Architecture, and Development efforts for this solution. The GS14 to GS15 Journey This session today is about a journey, which fittingly started out around Global Summit of last year. Its meant to provide some transparent insight to others investigating deploying Ensemble in the Cloud for similar purposes and highlight the GLHC use case. Episode 1 and Episode 2 This is a two part presentation, and both parts are highly technical. The first episode will mainly be focused on implementation, and the second episode will focus on the gotchas and drill down with a little bit more detail.
  20. 20 InterSystems Global Summit 2015 Great  Lakes  Health  Connect  

    Michigan  Based  Health  Informa/on  Exchange   Great Lakes Health Connect An individual’s appropriate healthcare data is available wherever it is needed across the state (and beyond). •  126 hospitals •  82% of Michigan’s acute beds •  >3,000 connected participants •  Over 6 million unique patients in master person index •  95%+ of data flowing to State •  Refused Federal Upstart Money •  Pricing Model Leads to Adoption
  21. 21 InterSystems Global Summit 2015 Business  Goal   Intermediate  Integra/on

     Architecture   Infrastructure Hosted solution that provides services to HIE participants. Hybrid Infrastructure Provide a platform for delivering custom solutions.
  22. 22 InterSystems Global Summit 2015 As  Built  Express   Resul/ng

     Architecture  
  23. 23 InterSystems Global Summit 2015 Meet  the  Cast   Ensemble

     As  A  Service  Actors   MINION Ephemeral Ensemble Instance. CONTROLLER Persistent Ensemble Cluster. Houses Message Bank, and “Non-Scaling Compliant” Production. FLOAT File I/O Shared NFS Mount
  24. Auto-­‐Scaling  Engineering   Connect   24 Birth  of  a  MINION

      InterSystems Global Summit 2015 # Instance User Data Steps # Mount Tarball ############### mkdir /home/ec2-user/software mount -t ext3 /dev/xvdc /home/ec2-user/software # Mikes Huge Security Hole ########################## service iptables stop chkconfig iptables off USER-DATA # Go get "the intersystems deployment package" ############################################## cd /home/ec2-user git clone https://support%40michiganhealthconnect%2Eorg: 61d53b508SUPERSECRETfc67921586b173477@github.com/greatlakeshealth/ intersys_deployment # Install HS mkdir /hs/data mkdir /hs/data/mgr cp /home/ec2-user/intersys_deployment/lic/cache.key /hs/data/mgr/ mkdir /home/ec2-user/software/package/install_confirmation/ cp /home/ec2-user/intersys_deployment/conf/preinstall /home/ec2-user/ software/package/install_confirmation/ cd /home/ec2-user/software/package/ ./installFromParametersFile /home/ec2-user/intersys_deployment/conf/ parameters.isc # Load Packages echo -e "root\nGlobalSummit1\nW \$system.OBJ.Load(\"/home/ec2-user/ intersys_deployment/update/HIE.xml\",\"ckf\")" | csession HIEMINION -U ENSEMBLE SCM CLONE HS CONFIGURATION
  25. Auto-­‐Scaling  Engineering   25 “Casters  Up”  MINION   InterSystems Global

    Summit 2015 A MINIONS DEATH WISH Before I die, please remove me from the load balancer.
  26. Cache  Mirroring  and  Backup   Connect   26 Successful oauth

    grant of fitbit resources via a configured application configured through Abriiz Dev App Account by the logged in Abriiz user. HA/DR   InterSystems Global Summit 2015 S3 and Glacier Immediate Backup and Cold Storage. Mirroring Across Availability Zones
  27. Security  Synchroniza/on   Connect   27 Successful oauth grant of

    fitbit resources via a configured application configured through Abriiz Dev App Account by the logged in Abriiz user. Enterprise  Manager   InterSystems Global Summit 2015 Users Distributed User Sync
  28. Central  Message  Reten/on   Connect   28 Successful oauth grant

    of fitbit resources via a configured application configured through Abriiz Dev App Account by the logged in Abriiz user. Message  Bank   InterSystems Global Summit 2015 Operational Message Retention Policy 30 Days Continuity Message Retention Policy 90 Days
  29. Web  Architecture   Connect   29 Successful oauth grant of

    fitbit resources via a configured application configured through Abriiz Dev App Account by the logged in Abriiz user. Service  Bus   InterSystems Global Summit 2015 Service Bus IHE Service Pass-through and Ensemble Business Services
  30. It’s  not  all  Chocolate  Rivers  and  Candy  Flowers   The

     Chocolate  Factory   30 Gotchas Things to consider when moving your Chocolate Factory to the Cloud… InterSystems Global Summit 2015
  31. Understanding  the  BAA     31 InterSystems Global Summit 2015

    Dedicated Tenancy •  Different Resource Pool within Amazon •  Limited to Minimum Instance Types Service Offering •  Put on your AWS BAA Glasses Become An Encrypto-Saurus •  All intercommunication encrypted Bad Things Happen to Bad Kids •  You are held to their interpretation of Risk Security  and  Compliance  
  32. Responsible  Man  in  the  Middle     32 InterSystems Global

    Summit 2015 Visibility •  Reporting •  Queuing •  Suspended Messages Bad Things Happen to Bad Kids •  So Watch your children Monitoring  and  ACK/Nack  Ci/zenship  
  33. Gotchas   33 InterSystems Global Summit 2015 A  Field  Guide

     to  Avoiding  Bad  Kids   SSL Termination Host Based Termination IP’s are Non-Existent DNS Heavy and Dependent Pay for What You Use Myth Storage and VPN VPC Configuration Up Front Engineering Crucial Swapless Hosts Instance Engineering Required Do NOT Backup to NFS S3 Move Requires Some Space Mirroring Floating IP Not Possible w/o extensive Engineering Dedicated Tenancy It’s a Different Amazon Mirroring Private Network Not Possible w/o extensive Engineering Local Hostname Change this in User Data VPN Connections Limit 10 Service Platform Amazon’s Blend and Lock-In
  34. 34 InterSystems Global Summit 2015 Ques/ons?   Concluded  

  35. Concluded   35 InterSystems Global Summit 2015