Upgrade to Pro — share decks privately, control downloads, hide ads and more …

W&B Tables and Ray (Chris Van Pelt, Weights & Biases)

W&B Tables and Ray (Chris Van Pelt, Weights & Biases)

Data is at the core of every ML workflow. In this talk, Chris discusses our powerful latest tool Tables and new features in W&B Artifacts to let you visualize and query datasets and model evaluations at the example level. You can use this new tool together with Ray to analyze and understand your datasets, and to measure and debug model performance.

Our goal is to give you highly scalable, flexible and configurable tools, with rich out-of-the-box visualizations available for common tasks. The system is constructed out of:

The ability to save large wandb.Table objects, optionally containing rich media (like images with bounding boxes), inside of W&B Artifacts.
Support for cross-artifact file references, and the ability to join tables together in the UI. This is used, for example, to log a set of bounding box predictions against a ground-truth dataset artifact, without duplicating the source images and labels.

An all new “typed, run-time-swappable UI-panel architecture”. This is what powers the rich visualizations and charts you see as you compare and group your data tables. Eventually we’ll open this up, so users can add completely custom visualizers that work everywhere in the W&B UI.
Use W&B Tables to log and visualize data and model predictions. Interactively explore your data by comparing changes precisely across models, epochs, or individual examples & understanding higher-level patterns in your data & capturing and communicating your insights with visual samples.

Anyscale

July 15, 2021
Tweet

More Decks by Anyscale

Other Decks in Technology

Transcript

  1. Weights & Biases
    Developer tools for Machine Learning
    W&B Tables with Ray

    View full-size slide

  2. Our Leadership Team
    Chris Van Pelt
    Co-Founder, CVP
    Powerset, Figure Eight
    Lukas Biewald
    Co-Founder, CEO
    Powerset, Figure Eight, OpenAI
    Shawn Lewis
    Co-Founder, CTO
    Google, Beep
    Customers Investors Team Background
    Richard Socher
    Chief Scientist,
    Salesforce
    Nat Friedman
    CEO, GitHub
    Greg Brockman
    CTO, OpenAI
    OpenAI
    Google
    Waymo
    Microsoft
    Stanford
    Harvard
    Berkeley
    Figure Eight (acquired by Appen)
    Segment
    Yahoo
    Domino
    JP Morgan

    View full-size slide

  3. Our Solution

    View full-size slide

  4. Ray Demo
    https://wandb.me/ray-dsviz

    View full-size slide

  5. Nature Dataset
    https://wandb.me/dsviz-nature-colab

    View full-size slide

  6. Self driving car dataset
    https://wandb.me/dsviz-cars-demo

    View full-size slide

  7. NLP Dataset
    https://wandb.me/wb-spacy

    View full-size slide

  8. Fully Connected
    https://wandb.ai/fc

    View full-size slide