Introducing our new NSF funded project (@slateci) to develop a services layer to advance construction of a national research platform for collaborative science
Joe Breen University of Chicago University of Michigan University of Utah First Meeting of the National Research Platform Montana State University August 7-8, 2017
the Mobility of Capability" • Equip the SciDMZ with a service orchestration platform, potentially federated to create scalable, multi-campus science platforms • Underlayment-as-a-service (UaaS) for platform builders & science gateway developers 2
globus software for gatekeepers and storage interfaces, condor for job submission and routing Since 2003 we've led deployments of integration testbeds and supported production services across ~100 institutions 5
centers led by UMich and UChicago • Multi-site grid federations of distributed storage, job routing, software and data caches in production > 10 years • Each supports workflows from >1k users from the international collaboration 6
- Latency in updates across sites make it extremely difficult to rapidly innovate platform services VO (domain & application) centric - Requires distributed expertise in specialized software stacks across many institutions - Resource providers need to become experts in a range of VO software services 8
the missing shim ◦ A generic CI substrate optimized for hosting edge services ◦ Programmable ◦ Easy & natural for HPC and IT professionals ◦ Tool for creating "hybrid" platforms • Potentially federate ◦ Centralized deployment & operations possible • DevOps friendly (for platform and science gateway developers) ◦ quick patches, release iterations, fast track new capabilities 11
Standalone or federated • Federated clusters support multi-site platform systems • Widely used open source technologies for growth and sustainability 12
premise services, potentially managed by third parties, present additional risks that need to be understood ◦ Engagements with CISO from our campuses ◦ Engagement with Center for Trustworthy Scientific Cyberinfrastructure Scientific outreach • Underlayment to Science ◦ Embedded with science collaborations with multi-institution cyberinfrastructure - distributed data services, software, job routing ◦ Developers associated with the Science Gateways Community Institute 15
builders ◦ Easily compatible with FIONA box and current PRP setups • We need partners & volunteers: ◦ to help inform technology choices ◦ to confront and solve policy & cybersecurity issues ◦ focus on usability & integration in HPC environments ◦ usability for science gateway developers & distributed service deployment teams ◦ align with emergent national SciDMZ patterns 16
science platform developers a ubiquitous "CI substrate" • Change distributed cyberinfrastructure opertional practice by mobilizing capabilities in the edge • Achieve scale through multi-site service meshes: ensembles of federated, orchestrated services 18 SLIDES: http://bit.ly/slateci-nrp