Unlocking SQL with Kotlin Data Analytics: A Practical Exploration

Demo: https://github.com/zaleslaw/Unlocking-SQL-KotlinConf-2024/blob/master/notebooks/db/1-actors.ipynb

Transcript

1. Unlocking SQL with Kotlin Data Analytics: A Practical Exploration Aleksei Zinovev @zaleslaw
2. Bio • Project Lead, Kotlin for Data Science • Distributed ML enthusiast • Apache Ignite PMC • TensorFlow Contributor • Happy father and husband • https://github.com/zaleslaw • https://twitter.com/zaleslaw
3. Motivation Kotlin Community Python, Pandas, Matplotlib Kotlin Dev who just need to visualize some data from CSV
4. DataFrame as a Data Structure
5. File Data Exploration
6. DataFrame as a Hierarchical Data Structure
9. Okay, wait, what about databases?
10. Okay, wait, what about databases?
11. Okay, wait, what about databases?
12. Okay, wait, what about databases?
13. Main issues for Backend Kotlin Devs • Fragmented Reporting Tools • Context Switching Between IDE and Database Tools • Inconsistent SQL Dialects and JDBC Implementations • Difficulty in Integrating Multiple Data Sources (Files and Databases) • Export and Usability Challenges • Limited Presentation and Sharing Among Kotlin Developers
14. Our Solution for Backend Kotlin Devs • Utilize Kotlin Notebooks in IntelliJ IDEA for all data analysis tasks. • Conduct database tasks directly in Kotlin Notebooks, avoiding frequent switching between tools. • Standardize database access API across different systems using the Kotlin DataFrame library. • Simplify data integration by merging data from various sources with the Kotlin DataFrame library. • Easily share and present results via export options for reports and charts.
15. SQL database analysis
16. Data Source in Demo: IMDB SQL Database
17. KDA useful links (replace with QR code) 1. Kotlin DataFrame documentation 2. Kotlin DataFrame examples 3. Kandy documentation 4. Kandy Quick Start Guide 5. Kandy examples
18. Thank you, and don’t forget to vote @zaleslaw