Upgrade to Pro — share decks privately, control downloads, hide ads and more …

State of the Galaxy Community Update 2018

State of the Galaxy Community Update 2018

Anton and James thoughts on Galaxy present and future presented at #GCCBOSC2018.

James Taylor

June 28, 2018
Tweet

More Decks by James Taylor

Other Decks in Science

Transcript

  1. Dataset size and complexity Number of users Clinical High propensity

    for standardization Non clinical Low propensity for standardization
  2. Technical Dataset size Number of datasets Data and tool heterogeneity

    Level of privacy/security required Social Community size Global Reach
  3. XSEDE, Indiana University XSEDE & CyVerse, TACC, Austin EU JRC,

    Ispra Penn State cvmfs0-tacc0 • test.galaxyproject.org • main.galaxyproject.org cvmfs1-tacc0 cvmfs1-iu0 • Stratum 0 servers • Stratum 1 servers galaxy.jrc.ec.europa.eu de.NBI, RZ Freiburg cvmfs0-psu0 • singularity.galaxyproject.org • data.galaxyproject.org cvmfs1-psu0 cvmfs1-ufr0.usegalaxy.eu CVMFS server distribution Galaxy Australia, Melbourne cvmfs1-mel0.gvl.org.au
  4. Galaxy UI is unique advantage—let’s make it better! Dataset collections—first

    size, now heterogeneity Single-page application with histories, workflows, visualizations all in one place Multiple, connected windows (ala JupyterHub) Drag and drop all the things Extensible and generalizable like the rest of Galaxy Different levels of detail: Galaksio/Activities, current UI, command line/notebook
  5. Federated storage as a first step Galaxy Main Private Servers

    Public Servers Servers Cloud Galaxy Appliance User ∞ ∞ ∞ ∞ ∞ Azure BLOB AWS S3 OpenStack Swift
  6. Ways this helps us all Deploy Galaxy anywhere (and everywhere)

    more easily Allow users to bring whatever resources they have, use resources more efficiently Move compute to data, and compute over data that is never co-located Integrate with existing and emerging authn/authz systems enabling the analysis of large and protected datasets in place Bring the wealth of tools and analysis approaches developed in Galaxy to new datasets, and open up new datasets and resources to the research community
  7. Want to work on any of these things with us?

    Next generation Galaxy UI Global Data/Compute Federation Interoperability with other platforms Creating and running training Talk to James, Anton, Dan, or Jeremy!