Notebooks: Tools for LLMs

Slide 1

Slide 1 text

Kyle Kelley at AI Dev Day, July 25th, 2023 Notebooks: Tools for LLMs ⚡ Talk at AI Dev Day

Slide 2

Slide 2 text

I'm Kyle Kelley • Chief Architect at Noteable • IPython & Jupyter Developer • Previously Notebooks Platform at Net fl ix • Containers, DevOps, and UX Hi!

Slide 3

Slide 3 text

What are Notebooks Play Build Share

Slide 4

Slide 4 text

No content

Slide 5

Slide 5 text

In[1] : import openai   import noteable

Slide 6

Slide 6 text

https://www.youtube.com/watch?v=Xd-VPCC_WKI&t=584s Choose your own adventure Video from I versus AI Live Demo!

Slide 7

Slide 7 text

Make literate computational documents Data Driven Documents

Slide 8

Slide 8 text

How?

Slide 9

Slide 9 text

Headless Execution From Scheduled Jobs to Realtime Notebooks • Original scheduled notebook jobs: • Interactive compute with realtime updates • Both interactive and batched

Slide 10

Slide 10 text

Headless Execution Close your tabs

Slide 11

Slide 11 text

No content

Slide 12

Slide 12 text

Comparisons Noteable Plugin, OpenAI Code Interpreter, and Jupyter Extensions • Ephemeral compute: Fast to spin up • Durable Compute: access to data fi les, environment variables/secrets, and databases • In all cases, ability to debug, reason about outputs, and run code

Slide 13

Slide 13 text

From: Please use the IMDb Data Source with the `imdb` schema to determine which years had the most horror fi lms. To: Which years had the most horror fi lms?

Slide 14

Slide 14 text

Conclusion Untapped Potential of LLMs and Notebooks for Data Analysis • Longer form blog post of this talk:    platform.noteable.io/blog/notebook-tools-for-llms • Augment Notebooks with app.noteable.io • Try the Plugin with ChatGPT Plus!