GrimoireCon North America 2017. Session 1: Introduction to Bitergia Analytics Dashboard and Platform.

GrimoireCon North America 2017. Session 1: Introduction to Bitergia Analytics Dashboard and Platform.

Transcript

1. Introduction to Bitergia Analytics Dashboard & Platform dizquierdo@bitergia.com jgb@bitergia.com jsmanrique@bitergia.com http://bitergia.com
2. Outline Overview of Bitergia Analytics Dashboard New features of the platform
3. Outline: use cases Eclipse: https://eclipse.biterg.io GlusterFS: https://glusterfs.biterg.io OPNFV: https://opnfv.bitergi.io PatternFly: https://patternfly.biterg.io CNCF: https://cncf.biterg.io Atomic: https://aotmic.biterg.io CoreOS: https://coreos.biterg.io OpenShift: https://openshift.biterg.io Ovirt: https://ovirt.biterg.io Xen: https://xen.biterg.io Puppet: https://puppet.biterg.io Ceph: https://ceph.biterg.io RDO: https://rdo.biterg.io Wikimedia: https://wikimedia.biterg.io
4. Overview of Bitergia Analytics Dashboard
5. Overview
6. Git
7. Review of the rest of panels
8. Some Features Architecture Some Features
9. Architecture Original Data Sources Mining Tools Perceval @ GrimoireLab Info Enrich. GrimoireELK @ GrimoireLab Viz ElasticSearch + Kibana Others
10. Some Features Drill down Time frame selection Sharing / embedding Data export (CSV…) API access (ElasticSearch API) Allowed users can create widgets and panels Easier validation Search box
11. Drill Down Any widget is interactive When clicked, the panel is updated and all widgets are filtered
12. Drill Down (Filters) When drilling down, a filter appears (field:value) Mouse over: Enable/disable, pin/unpin, invert, remove, edit
13. Timeframe Selection Special filter: timeframe (top right corner) Any timeframe of activity can be selected
14. Sharing / Embedding We can share / embed panels at any moment Eg: share with a team the data for a given repository during the last year
15. Sharing / Embedding Embedding example: - http://grimoirelab.github.io/use_cases/#sharing
16. Data Export Data in tables can be exported For any timeframe With any filter
17. API Access ElasticSearch documentation: https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-get.html Example: curl -XGET 'https:/elasticsearch_instance:443/project/git/_search/' Other tools can be used for viz instead of Kibana
18. Creation of Widgets and Panels When allowed: - Edit widgets - Create new ones - Build own panels
19. Easier Validation Since we can filter activity: - We can work at the level of developer or repository - This helps to find inconsistencies in the data - List of commits, changesets, repositories by a developer - Affiliations, unique identities - Checking of oddities in the data, such as peaks
20. Search Box General search box for filtering purposes: - Look for specific field matches: - author_name:”Juan Hernandez” - Look for keywords: - Juan Hernandez => Either Juan or Hernandez across all fields
21. Aggregation of Data Since Kibana allows for new features - drill down, timeframe filter, creation of own widgets and others We can aggregate all information in a single dashboard - So we can later share or filter per project of interest
22. Indexes - Indexes are the magic under Kibana - Those are enriched - Think of them as big matrixes of information - Each column represents a entity - You can keep adding entities to your analysis - Gender, Organization, Domain, others
23. Final remarks
24. Final remarks We’re still shaping the product: you can take advantage of that The system is quite flexible Feedback is welcome!