Keeping hundreds of code repositories consistent.. and staying sane !

In a micro-services environment, code repositories tend to multiply very quickly. Getting an accurate view of their config can be a challenge, so here are 2 tools that cqn help a lot : GitHub crawler and CI-droid

Transcript

1. Vincent FUCHS KEEPING HUNDREDS OF CODE REPOSITORIES CONSISTENT.. .. AND STAYING SANE !
2. WHO AM I ? @big_Vinz vincent.fuchs@sgcib.com 15 YEARS EXPERIENCE TOTAL, 13 IN SOCIÉTÉ GÉNÉRALE Paris, New-York, Bangalore SUPPORT, DEV JAVA, TECH LEAD, TECH COACH, TECH ARCHITECT OPENSOURCE CONSUMER SINCE I STARTED .. Producer for past 2 years FOCUS Microservices, monitoring, « dev efficiency »
3. “SOME MORE TOOLS ??”
4. MICROSERVICES – ONE TOOL PER PROBLEM We already have tools for :  API gateway (Zuul)  Service discovery (Consul)  Monitoring (ELK)  Tracing (Zipkin)  deploying (Containers)  Documenting (Open API)  ….
5. WHAT ABOUT THE CODE REPOSITORIES ?
6. WHAT ABOUT THE CODE REPOSITORIES ? 430 REPOSITORIES TO MANAGE!
7. TOOLS TO HELP MANAGING REPOSITORIES Accurate reporting on all repositories Github crawler Automate low value maintenance tasks Ci-droid
8. GITHUB CRAWLER
9. “GITHUB CRAWLER” Demo
10. SCREENSHOTS FROM DEMO Accurate reporting by repository / branch Dashboarding, thanks to Kibana. Breakdown of Spring Boot versions used on the platform
11. GITHUB CRAWLER – HOW DOES IT WORK ? Basic config : Organization Which files Which indicators Which reporting using Github API Indicator reporting by repo/branch - Organization - repositories - files - indicators
12. GITHUB CRAWLER – TYPICAL CONFIG
13. CI-DROID
14. CI-DROID – WHICH TASKS CAN IT TAKE CARE OF ? Automatic rebase on mergeable PR Notification on non- mergeable PR PR analysis
15. CI-DROID – HOW DOES IT WORK ? RabbitMq CI-droid GitHub CI-droid Webhook PullRequest events GitHub events CI-droid-tasks- consumer Instance 1 Push on default branch events Instance 2 Instance 3
16. WHAT IF… … WE CONNECTED BOTH ? Github crawler collects data.. ..CI-droid performs actions on repositories
17. CI-DROID – HOW DOES IT WORK ? RabbitMq CI-droid GitHub CI-droid Webhook PullRequest events GitHub events CI-droid-tasks- consumer Instance 1 Push on default branch events Instance 2 Instance 3
18. CI-DROID – HOW DOES IT WORK ? RabbitMq CI-droid GitHub CI-droid Webhook PullRequest events GitHub events CI-droid-tasks- consumer Instance 1 Push on default branch events Instance 2 Instance 3 Action to perform Instance n CI-droid actions Swagger / postman / UI
19. CI-DROID « BULK ACTIONS ».. IN ACTION ! OrgName/ OrgName/ OrgName/ OrgName/ OrgName/ OrgName/ OrgName/ OrgName/ OrgName/ OrgName/ OrgName/ OrgName/ OrgName/
20. ACTIONS CURRENTLY IN STOCK Out of the box, these actions are already available :  Overwrite/create a static file  Overwrite/create a file, based on a template  Simple replace in file  Replace an existing Maven profile  Add some XML content under a given Xpath  Remove an XML element (identified by its Xpath)  Remove a dependency or plugin in a pom.xml
21. Implement it ! Share it ! AND IF YOU’RE NOT FINDING WHAT YOU’RE LOOKING FOR..
22. WHERE TO CONTRIBUTE ?
23. WHERE TO CONTRIBUTE ? https://github.com/societe-generale/
24. QUESTIONS ? KEEPING HUNDREDS OF CODE REPOSITORIES CONSISTENT.. AND STAYING SANE ! Vincent FUCHS, SOCIÉTÉ GÉNÉRALE @big_Vinz vincent.fuchs@sgcib.com Github : https://github.com/societe-generale/