Roles Required for Providing Operation Indicators to 500 People

Koya Harayama (LINE Fukuoka / Data Engineering & Solution Team / Solution Architect )

https://tech-verse.me/ja/sessions/103
https://tech-verse.me/en/sessions/103
https://tech-verse.me/ko/sessions/103

Transcript

2. Self Introduction Role ⎯ LINE Fukuoka / Development Center / Data Labs ⎯ Support data utilization in LINE Fukuoka Company Name ⎯ Harayama Koya
3. There are 9 roles required for data utilization project Today’s take away Project scaling issues can be solved by the team based on roles
4. Agenda - About LINE Fukuoka - Data utilization project in LINE Fukuoka - Roles required for data utilization project - How to solve project scaling issues by roles - Current issue and future planning
5. About LINE Fukuoka
6. Technology Corporate Activities Planning / Marketing Design Operations Second domestic base of LINE
7. Monitoring Operation Direction Localization Reviews Customer Care Operations etc.
8. Data utilization project in LINE Fukuoka
9. No data platform Issues about KPI Management No comprehensiveness No data utilization culture
10. VIIM Project Since Feb. 2020 Visualize / analyze operation data Support KPI management Cross-department project
11. Cross-department project Data Labs Global Operation IT Promotion Value Management
12. Volume Quality Productivity Dashboards
13. Project scaling Since 2020/02 Number of dashboards 300 Number of dashboard users 20 10 25x 30x 500
14. Defined 9 roles for data utilization project Success factors of project scaling Organized project team based on roles Utilized roles to solve issues of project scaling
15. No Roles Value Management IT Promotion Global Operation Data Labs 1 Data Strategy ̋ 2 Data Governance ̋ ̋ 3 Data Architecture ̋ 4 Data Infrastructure ̋ 5 Data Planning ̋ ̋ 6 Data Ingestion ̋ ̋ 7 Data Warehouse / Data Mart ̋ 8 Data Visualization ̋ 9 Data Analysis ̋ ̋ Roles and assignment
16. Roles required for data utilization project
17. Data Collection Data Manipulation Data Visualization / Data Analysis Project Setup Steps of data utilization project Before collecting data After collecting data
18. No1 : Data Strategy Roles: - Set the project goals - Make plans to utilize data to achieve project goals Related job type: - Data strategist As-Is To-Be (Goal) data
19. No2 : Data Governance Roles: - Make rules and policies of data governance - Communicate with info sec & legal depts. Related job type: - Data manager Rules and policies Data governance Info sec / Legal Communication
20. No2 : Data Governance Roles: - Make rules and policies of data governance - Communicate with info sec & legal depts. Related job type: - Data manager Rules and policies Data users Data governance Infosec / Legal Data source Data Communication
21. No3 : Data Architecture Role: - Make a system design of data platform Related job type: - Solution architect
22. System Architecture of VIIM Project Data Lake Data Warehouse tableau VIIM Project DBs airflow workflow tool
23. No4 : Data Infrastructure Role: - Prepare DBs and other tools based on system architecture Related job type: - Data platform engineer
24. No5 : Data Planning Roles: - Make plans of each data utilization - Manage sub-project of each data utilization Related job Type: - Data planner Data What data? How to store? How to visualize/analyze? Data users
25. No6 : Data Ingestion Roles: - Collect and ingest data into Data Lake based on data planning Related job type: - Data Engineer - Analytics Engineer
26. No7 : Data Warehouse / Data Mart Role: - Build data warehouse / data mart following data planning Related Job Type: - Analytics engineer
27. No8 : Data Visualization Role: - Visualize data based on data planning - Support KPI management of users Related job Type: - Data analyst
28. No9 : Data Analysis Role: - Ad-hoc data analysis based on data planning - Support decision making Related job type: - Data analyst - Data scientist Data Analysis
29. Data Collection Data Manipulation Data Visualization / Data Analysis Project Setup 9 roles for data utilization project Before collecting data After collecting data 1 Data Strategy 2 Data Governance 3 Data Architecture 4 Data Infrastructure 5 Data Planning 6 Data Ingestion 7 Data Warehouse / Mart 8 Data Visualization 9 Data Analysis
30. How to solve project scaling issues by roles
31. Issue : how to build the project team X Dept. Y Dept. x1 Team x2 Team y1 Team y2 Team Whom to ask? What to ask? ?
32. No Roles Value Management IT Promotion Global Operation Data Labs 1 Data Strategy ̋ 2 Data Governance ̋ ̋ 3 Data Architecture ̋ 4 Data Infrastructure ̋ 5 Data Planning ̋ ̋ 6 Data Ingestion ̋ ̋ 7 Data Warehouse / Data Mart ̋ 8 Data Visualization ̋ 9 Data Analysis ̋ ̋ Role assignments by mission and skill-set
33. Issue : Scope of data collection Need to check these points - Scope of data collection - Personal information - Permission of data owner ? Data Lake Scope? Personal information? Permission?
34. Check each point by each role 5 Data Planning Current / future usage Scope of data collection
35. Check each point by each role ２ Data governance Information Security Answer Question 5 Data Planning Current / future usage Personal Information Scope of data collection
36. Check each point by each role Personal Information ２ Data governance Information Security Data Owner Permission of data owner 5 Data Planning ２ Data governance Approve Explain 5 Data Planning Scope of data collection Current / future usage Answer Question
37. Issue : Accountability of data Need to answer the questions from internal audit etc. - What data are stored in DBs - Prove there is no high-risk personal information in DBs ? Data Lake Data Warehouse Which table? Which column? Internal audit etc. Question
38. Prepare data catalog 4 Data Infrastructure Data Catalog Request Prepare All roles
39. 4 Data Infrastructure Data Catalog Request Prepare All roles 2 Data Governance Internal audit etc. Answer Prepare data catalog
40. Issue : Permission control of dashboard users Need to manage many users - Prepare permission policy - Monitor account usage Users Dashboards OK NG NG OK
41. Make a manual of permission control ２ Data governance Infosec / Legal Permission control manual Communication
42. Delegate permission control to user side ２ Data governance User side manager Dashboard Users delegate permission control
43. Monitor dashboard usage ２ Data governance User side manager Dashboard Users delegate permission control monitor 8 Data Visualization Monitoring dashboard
44. Number of dashboards 300 Number of dashboard users 20 10 25x 30x 500 Issue : Task increase following project scaling
45. Each member’s growth and efficient hiring 10 Number of project members 16 Value Management Data Labs IT Promotion Global Operation
46. Data Collection Data Manipulation Data Visualization / Data Analysis Project Setup Project scaling issues Before collecting data After collecting data Task increase following project scaling How to build project team Scope of data collection Permission control of dashboard users Accountability of data
47. Current issue and future planning
48. Issue : More complicated data governance tasks - Stricter personal information management rules - More complicated discussion required with infosec & legal dept. Rules and policies Data users Data governance Data source Data Communication Infosec & Legal
49. No Roles Value Management IT Promotion Global Operation Data Labs 1 Data Strategy ̋ 2 Data Governance ̋ ̋ 3 Data Architecture ̋ 4 Data Infrastructure ̋ 5 Data Planning ̋ ̋ 6 Data Ingestion ̋ ̋ 7 Data Warehouse / Data Mart ̋ 8 Data Visualization ̋ 9 Data Analysis ̋ ̋ Other roles in each dept.
50. Launch a new dept. for data governance (in LINE Fukuoka) Data Labs Global Operation Value Management IT Promotion Data Governance
51. More data driven company VIIM Project LINE Fukuoka
52. There are 9 roles required for data utilization project Today’s take away Project scaling issues can be solved by the team based on roles
53. Thank you