Simple PyPI

Lightning talk on PyPI for dotPy 2020

dotpy.io/
https://aka.ms/simple-pypi or https://github.com/kimadeline/pypi-simple-scraping

Transcript

1. @kimadeline_m dotPy 2020 Simple Hint: it’s not “tarte détective privé·e”
2. @kimadeline_m PyPA PyPI (Warehouse) Python Packaging Authority pypy pip, Pipfile, packaging, … Python Package Index
3. @kimadeline_m https://pypi.org/simple/
4. @kimadeline_m … <a href="https://pypi.org/simple/blablacar-api/">BlaBlaCar-API</a> <a href="https://pypi.org/simple/b-labs-models/">b-labs-models</a> <a href="https://pypi.org/simple/black/">black</a> <a href="https://pypi.org/simple/blackarrow/">blackarrow</a> <a href="https://pypi.org/simple/blackbeard/">blackbeard</a> …
5. @kimadeline_m : PEP 503
6. @kimadeline_m • Longest package name: Aaaaaaaaaaaaaaaaaaa- aaaaaaaaa-aaaaaaasa-aaaaaaasa-aaaaasaa-aaaaaaasa- bbbbbbbbbbb (80 characters) • Average package name length: 12.43 characters • ‘*python*’: 5694 packages (2.59%) • ‘*py*’: 28663 packages (13.03%)
7. @kimadeline_m … <a href="https://pypi.org/simple/blablacar-api/">BlaBlaCar-API</a> <a href="https://pypi.org/simple/b-labs-models/">b-labs-models</a> <a href="https://pypi.org/simple/black/">black</a> <a href="https://pypi.org/simple/blackarrow/">blackarrow</a> <a href="https://pypi.org/simple/blackbeard/">blackbeard</a> …
8. @kimadeline_m • .tar.gz: jupyterlab-1.2.6.tar.gz • .zip: numpy-1.18.1.zip • .whl: matplotlib-3.1.3-cp38-cp38-win_amd64.whl
9. @kimadeline_m • .tar.gz: jupyterlab-1.2.6.tar.gz • .zip: numpy-1.18.1.zip • .whl: matplotlib-3.1.3-cp38-cp38-win_amd64.whl
10. @kimadeline_m • .tar.gz: jupyterlab-1.2.6.tar.gz • .zip: numpy-1.18.1.zip • .whl: matplotlib-3.1.3-cp38-cp38-win_amd64.whl
11. @kimadeline_m matplotlib-3.1.3-cp38-cp38-win_amd64.whl
12. @kimadeline_m matplotlib-3.1.3-cp38-cp38-win_amd64.whl interpreter
13. @kimadeline_m matplotlib-3.1.3-cp38-cp38-win_amd64.whl ABI
14. @kimadeline_m matplotlib-3.1.3-cp38-cp38-win_amd64.whl platform
15. @kimadeline_m : PEP 566
16. @kimadeline_m https://pypi.org/pypi/<package>/json
17. @kimadeline_m { info: { } releases: { 1.0.0: [ { }, { }, … ], … } urls: [ { }, { }, … ] } https://pypi.org/pypi/<package>/json
18. @kimadeline_m { info: { } releases: { 1.0.0: [ { }, { }, … ], … } urls: [ { }, { }, … ] } https://pypi.org/pypi/<package>/json
19. @kimadeline_m { info: { } releases: { 1.0.0: [ { }, { }, … ], … } urls: [ { }, { }, … ] } https://pypi.org/pypi/<package>/json
20. @kimadeline_m { info: { } releases: { 1.0.0: [ { }, { }, … ], … } urls: [ { }, { }, … ] } https://pypi.org/pypi/<package>/json
21. @kimadeline_m { info: { } releases: { 1.0.0: [ { }, { }, … ], … } urls: [ { }, { }, … ] } https://pypi.org/pypi/<package>/<version>/json
22. @kimadeline_m • PyPA projects: https://packaging.python.org/key_projects/#pypa- projects • Add API endpoint to get latest version of all projects: https://github.com/pypa/warehouse/issues/347 • Regular dump of the PyPI database: https://github.com/pypa/warehouse/issues/1478 • Would people be interested in a daily download of PyPI metadata until #1478 is implemented: https://twitter.com/brettsky/status/1200536491388100608 • PyPI keyword stats: https://github.com/uranusjr/packaging- metadata-comparisons/blob/master/topics/keywords.md • Core metadata specifications: https://packaging.python.org/specifications/core-metadata/ • JSON API documentation: https://warehouse.readthedocs.io/api- reference/json/
23. @kimadeline_m kimadeline/pypi-simple-scraping