tb3 -- using tinderboxes efficiently

There is ongoing work in making our tinderboxes less archaic and more useful. This talk gives an overview of progress to far and a prospect on what is to come.
tb3 is a new implementation for tinderbox coordination. A blog entry[1] already explained the basic idea.

tb3 can:

coordinate multiple tinderboxes working on the same build scenario or branch
coordinate one tinderbox working on multiple build scenarios or multiple branches
make tinderboxes bisect without loosing sight of the head of a branch
especially help tests and builds that are painfully slow

It should also enable:

better bibisect repo generation
covers the scope of simple "does it build"-tinderboxing and unittesting up to "blackbox" integration and system testing (we need your tests now!)
in the long run, should be integrated with all our communication channels (IRC, mailing list, RSS feeds etc. -- each with messages appropriate for that medium)

[1] http://http//skyfromme.wordpress.com/2013/08/03/tb3-more-efficient-tinderboxing/

Transcript

1. 1 tb3: using tinderboxes efficiently Bjoern Michaelsen bjoern.michaelsen@canonical.com bjoern.michaelsen@documentfoundation.org
2. 2 tb3: using tinderboxes efficiently Agenda Status quo Scoring Trusting the client or not? Keeping owners in control Django Web UI Missing Bits
3. 3 Crowdsourcing code review http://upload.wikimedia.org/wikipedia/commons/1/18/US_Navy_091212-N-3404S-106_Navy_defensive_end_Jabaree_Tuani_%28%5E98%29_and_nose_guard_Chase_Burge_%28%5E93%29_stop_Army_slot_back_Patrick_Mealy_%28%5E5%29_during_the_first_quar
4. 4 tb3: using tinderboxes efficiently Status Quo: no coordination bazillion mails “Are we there yet?”/”Is it fixed yet?” three linux tinderboxes might all test the same build … … while other commits remain completely untested.
5. 5 tb3: using tinderboxes efficiently Stop right now! Stop right there I gotta know right now before we go any further … Let me sleep on it and I’ll give you an answer in the morning – Paradise by the Dashboard Light, Bat out of Hell, Meat Loaf We would love to bisect a breaker ASAP! esp. on very slow platforms But: We dont want to stop watching the head of the branch.
6. 6 tb3: using tinderboxes efficiently Why scoring? Generic: a build scenario Adaptable: By weighting Comparable: describes relative urgency thereby allows assigning and distributing resources: to multiple platforms to multiple strategies: bisecting/building head/gerrit verification to multiple branches: release branch and master
7. 7 tb3: using tinderboxes efficiently Coordination: building head
8. 8 tb3: using tinderboxes efficiently Coordination: bisecting
9. 9 tb3: using tinderboxes efficiently Coordination: never trust the client (mostly)
10. 10 tb3: using tinderboxes efficiently Coordination: never trust the client (mostly)
11. 11 tb3: using tinderboxes efficiently Coordination: never trust the client (mostly) (mostly) comparable results the strictness of this might differ by platform (mostly) reliable reporting (mostly) reliable turnaround times
12. 12 tb3: using tinderboxes efficiently Keeping the choice with the tinderbox owner Scores are just proposals Picking up the scores is no obligation to build a proposal Thus: tinderbox owners can do fancy reweighting voodoo of scores tinderbox owners can track multiple scenarios and build what is most urgent tinderbox owners can report one result to multiple platforms
13. 13 tb3: using tinderboxes efficiently Django Web-UI: repository overview
14. 14 tb3: using tinderboxes efficiently Django Web-UI: Branch overview
15. 15 tb3: using tinderboxes efficiently Django Web-UI: Repository builds
16. 16 tb3: using tinderboxes efficiently Django Web-UI: Branch builds
17. 17 tb3: using tinderboxes efficiently Django: Missing bits RSS feeds IRC bots/twitter feeds log uploads Web UI de-uglification gitweb/cgit integration gerrit builder integration client side plumbing/production machine setup
18. 18 tb3: using tinderboxes efficiently Conclusion tb3 allows to: Coordinate multiple builders working on the same scenario/branch Coordinate one tinderbox to work on multiple branches and scenarios as needed Make tinderboxes bisect without loosing track of the head of a branch Esp. helps with tests and builds that are painfully slow
19. 19 tb3: using tinderboxes efficiently Contact me Sweetshark on #libreoffice-dev/#libreoffice-qa on freenode Sweetshark1 on twitter