pyvanot

Transcript

1. pyvanot
2. who
3. what pyvanot • python package and app that creates • a 12.7 billion row, 448 column, open dataset updated in real time addressing the question of our age: is there a difference between Paul Ivanov and David Nicholson?
4. why Paul David
5. why Paul David background in neuro / AI background in neuro / AI industry gig industry gig Python-based blog Python-based blog can ride a bike can ride a bike makes terrible puns makes terrible puns
6. why
7. how pyvanot project and package that leverages the power and flexibility of the Python data science stack to provide insight into this question that has troubled humanity since time immemorial
8. how pyvanot built on cookiecutter-pyopensci follows best practices established in PyOpenSci dev guide https://www.pyopensci.org/contributing-guide
9. how • scrape the web for the latest Paul Ivanov and David Nicholson data ◦ using requests beautiful_soup and luigi
10. how • build and serve the `pyvanot` open dataset as a table with billions of rows ◦ using Dask and datasette ▪ inspired by this blog post from Sergio Sanchez: https://towardsdatascience.com/making-open-data-more-ac cessible-with-datasette-480a1de5e919
11. when upon
12. where • https://github.com/NickleDave/pyvanot