apidays Paris 2024 - Creating APIs That Data Scientists Will Love - Ryan Day, Conference of State Bank Supervisors API Management and AI

Data Scientists Will Love
Ryan Day, Advanced Data Scientist at Conference of State Bank Supervisors (CSBS)

apidays Paris 2024 - The Future API Stack for Mass Innovation
December 3 - 5, 2024

------

Check out our conferences at https://www.apidays.global/

Do you want to sponsor or talk at one of our conferences?
https://apidays.typeform.com/to/ILJeAaV8

Learn more on APIscene, the global media made by the community for the community:
https://www.apiscene.io

Explore the API ecosystem with the API Landscape:
https://apilandscape.apiscene.io/

Transcript

1. Creating APIs That Data Scientists Will Love Email newsletter -------->
2. “ To succeed in AI, first master APIs. — Ryan Day
3. Go deeper on today’s topic with my book Coming From O'Reilly Publishing in March 2025
4. https://tips.handsonapibook.com To get today’s slides Tip Sheet: APIs for AI & Data Science - sign up today
5. Walking in the shoes of a data scientist
6. Marianna Diamos, Los Angeles Times, CC BY 4.0 via Wikimedia Commons Marianna Diamos, Los Angeles Times, CC BY 4.0 via Wikimedia Commons Before you criticize a man, walk a mile in his shoes. That way, when you do criticize him, you'll be a mile away and have his shoes – Steve Martin
7. Source: Anaconda State of Data Science Report Jobs Data Scientists Do
8. (Python) Tools Data Scientists Use
9. Creating APIs that data scientists will love
10. Our demonstration project
11. 1 - Provide an SDK for your API. 2 - Add standard external identifiers. 3 - Enforce data type definitions. 4 - Provide a method for bulk downloads. 5 - Support querying by last changed date. Tips to Make APIs for Data Scientists
12. SDKs: just give me the data Tip 1 - Provide a Software Development Kit
13. Solid Baseline - REST API, API keys, SDKs
15. SDK: the user’s perspective
16. Extra reference data to join other datasets. Tip 2 - Add standard external identifiers
18. Swagger UI documentation
19. Get Player endpoint in Swagger UI documentation Internal Identifier
20. Standard external identifier: GSIS_ID External Identifier
21. Streamlit app - enriched with third-party data
22. Joining to Industry Data - nfldatapy
23. Give structures your users can count on Tip 3 - Enforce data type definitions in your API.
24. OpenAPI specification file
25. OpenAPI specification file - paths
26. OpenAPI specification file - schemas
27. Pydantic - enforcing definitions
28. The data, the whole data, and nothing but the data. Tip 4 - Provide a method for bulk downloads.
29. 3 Reasons Data Scientists want Bulk Data 1. Exploratory data analysis (EDA) 2. Training data for an ML Model 3. Initial load of a data pipeline
30. Initial Load - Airflow
31. Just give me the deltas. Tip 5 - Support querying by last changed date.
32. Last Changed Date - User’s perspective
33. Incremental load- Airflow
34. Airflow code
35. 1 - Provide an SDK for your API 2 - Add standard external identifiers. 3 - Enforce data type definitions. 4 - Provide a method for bulk downloads. 5 - Support querying by last changed date. Tips to Make APIs for Data Scientists
36. https://tips.handsonapibook.com Get more tips and tricks Tip Sheet: APIs for AI & Data Science - sign up today
37. Extra Slides
38. Source: Microsoft Team Data Science Process
39. A common format that is easy to consume Extra Tip - Return data in JSON format
40. Players endpoint in Swagger UI documentation
41. JSON data returned
42. This presentation template is free for everyone to use thanks to the following: Happy designing! for the presentation template for the photos Credits Pexels, Pixabay