Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ambassadors of Code: Open Source in Service to National Security

Ambassadors of Code: Open Source in Service to National Security

Ian Lee

May 30, 2018

More Decks by Ian Lee

Other Decks in Technology


  1. LLNL-PRES-752119 This work was performed under the auspices of the

    U.S. Department of Energy by Lawrence Livermore National Laboratory under contract DE-AC52-07NA27344. Lawrence Livermore National Security, LLC Ambassadors of Code: Open Source in Service to National Security Code.gov Meetup, hosted by CircleCI Ian Lee Lawrence Livermore National Laboratory May 30, 2018
  2. LLNL-PRES-752119 2 software.llnl.gov

  3. LLNL-PRES-752119 3 software.llnl.gov

  4. LLNL-PRES-752119 4 software.llnl.gov https://upload.wikimedia.org/wikipedia/commons/a/a8/U.S._National_labs_map.jpg

  5. LLNL-PRES-752119 5 software.llnl.gov http://www.ex-astris-scientia.org/articles/new_enterprise/enterprise-warpcore.jpg

  6. LLNL-PRES-752119 6 software.llnl.gov 1960s 1970s 1980s 1990s 2000s 2010s Pioneering

    simulations of particle tracking CDC 3600 CDC 7600 Ozone mixing models CRAY 1 ASCI Blue- Pacific Helping the medical community plan radiation treatment Unprecedented dislocation dynamics simulations BlueGene Breakthrough visualizations of mixing fluids Dynamics in three dimensions Global climate modeling Detailed predictions of ecosystems Petascale and exascale computing
  7. LLNL-PRES-752119 7 software.llnl.gov § 3 out of 16 #1 systems

    over last 20 years Top500.org ASCI White Nov 2000 – Nov 2001 BlueGene/L Nov 2004 – Nov 2007 Sequoia June 2012 https://www.top500.org/resources/top-systems/
  8. LLNL-PRES-752119 8 software.llnl.gov Sierra

  9. LLNL-PRES-752119 9 software.llnl.gov TOSS – Tri-Lab Operating System Software §

    Built on Red Hat Enterprise Linux — Not an HPC distribution § Adds LLNL developed additions and patches to support HPC — Low Latency Interconnect: Infiniband — Parallel File System: Lustre — Resource Manager: SLURM § Work closely with open communities Components not in TOSS Supported Linux Commodity Hardware Platform Kernel, Infiniband, Message Passing Interface Batch Scheduler (MOAB) User Environment Lustre File Systems Compiler & Development Tools Resource Manager (SLURM) TOSS Components HPSS Hopper LLNL-PRES-550311 TOSS is a software stack for HPC – large, interconnected clusters!
  10. LLNL-PRES-752119 10 software.llnl.gov § Began as simple resource manager —

    Now scalable to 1.6M+ cores (sequoia) § Launch and manage parallel jobs — Large, parallel jobs, often MPI § Queuing and scheduling of jobs — Much more work than resources http://slurm.schedmd.com http://www.ibm.com/developerworks/library/l-slurm-utility/figure3.gif
  11. LLNL-PRES-752119 11 software.llnl.gov http://flux-framework.github.io § Family of projects used to

    build site-customized resource management systems § flux-core — Implements the communication layer and lowest level services and interfaces § flux-sched — Consists of an engine that handles all the functionality common to scheduling § capacitor — A bulk execution manager using flux-core, handles running and monitoring 1000’s of jobs
  12. LLNL-PRES-752119 12 software.llnl.gov ZFS on Linux http://zfsonlinux.org § ZFS is

    an open source filesystem and volume manager designed to address the limitations of existing storage solutions § 2011: Available for Linux § Ten LLNL filesystems, totaling ~ 100PB § Ships in Ubuntu 16.04
  13. LLNL-PRES-752119 13 software.llnl.gov § Handles combinatorial explosion of ABI-incompatible packages

    § All versions coexist, binaries work regardless of user’s environment § Familiar syntax, reminiscent of brew, yum, etc $ spack install mpileaks unconstrained $ spack install [email protected] @ custom version $ spack install [email protected] %[email protected] % custom compiler $ spack install [email protected] %[email protected] +threads +/- build option $ spack install [email protected] os=SuSE11 os=<frontend OS> $ spack install [email protected] os=CNL10 os=<backend OS> $ spack install [email protected] os=CNL10 target=haswell target=<cpu target> SPACK http://software.llnl.gov/spack
  14. LLNL-PRES-752119 14 software.llnl.gov § Manages the first-ever decentralized database for

    handling climate science data § Multiple petabytes of data at dozens of federated sites worldwide § International collaboration for the software that powers most global climate change research https://github.com/ESGF http://esgf.llnl.gov
  15. LLNL-PRES-752119 15 software.llnl.gov VisIt § Originally developed to visualize and

    analyze the results of terascale simulations § Interactive, scalable, visualization, animation and analysis tool § Powerful, easy to use GUI § Distributed and parallel architecture allows handling extremely large data sets interactively http://visit.llnl.gov
  16. LLNL-PRES-752119 16 software.llnl.gov http://computation.llnl.gov/casc

  17. LLNL-PRES-752119 17 software.llnl.gov https://software.llnl.gov

  18. LLNL-PRES-752119 18 software.llnl.gov LLNL Open Source Presence https://software.llnl.gov/explore

  19. LLNL-PRES-752119 19 software.llnl.gov LLNL Open Source Engagement https://software.llnl.gov/explore

  20. LLNL-PRES-752119 20 software.llnl.gov

  21. LLNL-PRES-752119 21 software.llnl.gov Science & Technology Review “Our large collection

    of software is a precious Laboratory asset, one that benefits both Lawrence Livermore, and in many cases, the public at large.” - Bruce Hendrickson Associate Director, Computation https://str.llnl.gov/2018-01/comjan18
  22. LLNL-PRES-752119 22 software.llnl.gov https://www.exascaleproject.org/more-on-the-software-that-underpins-the-exascale-computing-project/

  23. LLNL-PRES-752119 23 software.llnl.gov § “Federal Source Code Policy: Achieving Efficiency,

    Transparency, and Innovation through Reuseable and Open Source Software” — “Agencies shall make custom-developed code available for Government-wide reuse and make their code inventories discoverable at https://www.code.gov (“Code.gov”) […]” — “[…] establishes a pilot program that requires agencies, when commissioning new custom software, to release at least 20 percent of new custom-developed code as Open Source Software (OSS) […]” Federal Source Code Policy https://sourcecode.cio.gov https://code.gov & https://sourcecode.cio.gov
  24. LLNL-PRES-752119 24 software.llnl.gov https://code.gov

  25. LLNL-PRES-752119 25 software.llnl.gov https://code.gov/#/explore-code/agencies/DOE

  26. LLNL-PRES-752119 26 software.llnl.gov https://osti.gov/doecode

  27. LLNL-PRES-752119 27 software.llnl.gov Public US Government GitHub Data Scrape §

    252 US Government Orgs — U.S. Federal (137) — U.S. Military and Intelligence (12) — U.S. Research Labs (103) § 8716 Open Source Repositories https://github.com/LLNL/scraper/pull/3 LLNL 5% Other US Governm ent 95%
  28. LLNL-PRES-752119 28 software.llnl.gov US Government Organizations on GitHub https://government.github.com/community/

  29. Thank You! [email protected] @IanLee1521 // @LLNL_OpenSource

  30. This document was prepared as an account of work sponsored

    by an agency of the United States government. Neither the United States government nor Lawrence Livermore National Security, LLC, nor any of their employees makes any warranty, expressed or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately owned rights. Rference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States government or Lawrence Livermore National Security, LLC. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States government or Lawrence Livermore National Security, LLC, and shall not be used for advertising or product endorsement purposes.