Slide 1

Slide 1 text

chaoss.community Meet GrimoireLab Making your life easier ICSME 2018, Madrid (Spain), Sep 25 2018 Jesus M. Gonzalez-Barahona

Slide 2

Slide 2 text

chaoss.community /me Like six years ago I was having coffees with the gang of Bitergia founders Involved in the company since then bitergia.com I work at Universidad Rey Juan Carlos... ...researching about software development gsyc.es/~jgb My two hats:

Slide 3

Slide 3 text

/Bitergia Software Development Analytics for your peace of mind bitergia.com

Slide 4

Slide 4 text

chaoss.community ... Produce integrated, open source software for analyzing software development …. chaoss.community

Slide 5

Slide 5 text

chaoss.community When you’re collecting, preparing data for your next paper...

Slide 6

Slide 6 text

chaoss.community When you’re collecting, preparing data for your next paper… use some help!

Slide 7

Slide 7 text

chaoss.community GrimoireLab Software development analytics with free, open source software (a CHAOSS project) chaoss.github.io/grimoirelab chaoss.github.io/grimoirelab-tutorial

Slide 8

Slide 8 text

chaoss.community Software development analytics opnfv.biterg.io chaoss.biterg.io

Slide 9

Slide 9 text

chaoss.community GrimoireLab architecture

Slide 10

Slide 10 text

chaoss.community Installing from pip $ python3 -m venv /tmp/gl $ source /tmp/gl/bin/activate (gl) $ pip install --upgrade pip setuptools wheel (gl) $ pip install grimoirelab (gl) $ grimoirelab -v chaoss.github.io/grimoirelab-tutorial/basics/install.html

Slide 11

Slide 11 text

chaoss.community Running from Docker images docker run -p 5601:5601 -p 9200:9200 -v $(pwd)/credentials.cfg:/override.cfg -t grimoirelab/full credentials.cfg: [github] api-token = XXX

Slide 12

Slide 12 text

chaoss.community Architecture: extraction

Slide 13

Slide 13 text

chaoss.community Example: Perceval (gl) $ pip install perceval (gl) $ perceval git https://github.com/grimoirelab/perceval (gl) $ perceval github grimoirelab perceval --sleep-for-rate -t XXXXX ...

Slide 14

Slide 14 text

chaoss.community Example: Perceval from perceval.backends.core.git import Git repo_url = 'http://github.com/grimoirelab/perceval' repo_dir = '/tmp/perceval' repo = Git(uri=repo_url, gitpath=repo_dir) for commit in repo.fetch(): print(commit['data']['commit'])

Slide 15

Slide 15 text

chaoss.community Producing a dashboard (assumes Elasticsearch at http://localhost:9200, Kibiter at http://localhost:5601 ) Prepare: mordred.cfg Prepare: projects.json Maybe: identities.yaml Maybe: menu.yaml (es) mordred -c mordred.cfg chaoss.github.io/grimoirelab-tutorial/sirmordred/dashboard.html

Slide 16

Slide 16 text

chaoss.community Using Perceval to compute metrics • Get items from the data source • Store them in a data structure • Compute metrics • You can also use Pandas, of course github.com/chaoss/wg-gmd/blob/master/examples/Code_ Commits.ipynb

Slide 17

Slide 17 text

chaoss.community Architecture: enrichment

Slide 18

Slide 18 text

chaoss.community Example: item in enriched index

Slide 19

Slide 19 text

chaoss.community Computing metrics from enriched indexes • Connect to Elasticsearch indexes (produced with p2o, mordred) • Query them to get items of interest • Compute metrics • You can also use Pandas, of course chaoss.github.io/grimoirelab-tutorial/python/indexes.html

Slide 20

Slide 20 text

chaoss.community Architecture: exploitation

Slide 21

Slide 21 text

chaoss.community Example: producing a dashboard (es) $ pip install grimoire-mordred (es) $ mordred -c mordred.cfg (assumes Elasticsearch at http://localhost:9200, Kibiter at http://localhost:5601 ) Needs: mordred.cfg, projects.json, identities.yaml, menu.yaml chaoss.github.io/grimoirelab-tutorial/sirmordred/dashboard.html

Slide 22

Slide 22 text

chaoss.community GrimoireLab Software development analytics with free, open source software (a CHAOSS project) chaoss.github.io/grimoirelab chaoss.github.io/grimoirelab-tutorial

Slide 23

Slide 23 text

chaoss.community License & Attributions “Pain Relief”, by Nick Youngson, Alpha Stock Images, CC by-sa 3.0 “Broken Glass Sadness Disappointment Can't Sad”, from Max Pixel, CC0 Slides licensed under Creative Commons ShareAlike 4.0 (CC by-sa 4.0) Copyright CHAOSS & Jesus M. Gonzalez-Barahona 2018