Agile Lean Tuscany 16/10/2024 - PLEASE, STOP LOGGING YOUR EXPERIMENTS IN A .TXT FILE

A quick Intro to Weights & Biases

Transcript

1. Luca Corbucci PLEASE, STOP LOGGING YOUR EXPERIMENTS IN A .TXT FILE A quick Intro to Weights & Biases https://lucacorbucci.me/
4. WHAT IS WANDB? A platform for ML practitioners that can help simplify the development, monitoring and debugging of Machine Learning Models.
5. WHAT IS WANDB? A platform for developers and researchers that can help simplify the development, monitoring and debugging of your experiments
6. WHAT IS WANDB? These tools are open source and you can self-host WANDB on your machine A platform for developers and researcher that can help simplify the development, monitor and debugging of your experiments
7. “Yeah, I know this platform but I’ve already started my project and I cannot waste time implementing this logging mechanism” Cit. Just a random person to whom I suggest using Wandb
8. HOW WANDB CAN BE USEFUL IN MY WORKFLOW?
9. HOW WANDB CAN BE USEFUL IN MY WORKFLOW? Track your experiments: log all the metrics you need to analyse and keep track of
10. Track your experiments: log all the metrics you need to analyse and keep track of Visualisation of the results: It automatically creates plots to visualise the results of your experiments HOW WANDB CAN BE USEFUL IN MY WORKFLOW?
11. Track your experiments: log all the metrics you need to analyse and keep track of Visualisation of the results: It automatically creates plots to visualise the results of your experiments Tune your hyperparameters: the best hyper- parameters for your model are just a yaml file away HOW WANDB CAN BE USEFUL IN MY WORKFLOW?
12. Track your experiments: log all the metrics you need to analyse and keep track of. Visualisation of the results: It automatically creates plots to visualise the results of your experiments. Tune your hyperparameters: the best hyper- parameters for your model are just a yaml file away. Results Reporting: easily create dashboard to report your results. HOW WANDB CAN BE USEFUL IN MY WORKFLOW?
13. OTHER INTERESTING FEATURES Wandb Launch: automation of ML Workflow. Launch your experiment from WANDB on your machine LLMs Monitoring: monitor how users interact with your LLMs LLM Debugging: verify how your LLM changes during the training and identify errors Weave: Tracking and evaluation of LLM Applications (That I haven’t used yet)
14. Demo! 👨💻
15. Thanks 🙏
16. Questions! Luca Corbucci https://lucacorbucci.me/
17. Slides Repo https://github.com/lucacorbucci/wandb-quick-intro https://speakerdeck.com/lcorbucci/wandb