Reliable, Repeatable builds with Koji

http://speakerdeck.com/u/herlo/p/goose-linux-rebuilding-enterprise-linux

Transcript

1. Building RPMS Reliably and Repeatably using Koji
2. Hello. My name is Clint Savage People online call me herlo I participate online at the following places I don't always blog, but when I do, I use http://sexysexypenguins.com
3. Comic Relief
4. What is Koji? • Task scheduler • Result tracker • A build system used by many – Fedora/EPEL – RHEL – Scientific Linux – GoOSe
5. What Koji is not! • Software release lifecycle management • Deployment tool • Repository management tool • Continuous integration tool
6. Design • Reliable environment • Repeatable builds
7. Existing components • rpmbuild • mock • yum • createrepo
8. ENVRA • epoch – used rarely • name – upstream name • version – upstream version • release – rpm package version • architecture – i686, x86_64, noarch
9. RPM Build Process
10. rpmbuild Demo
11. Mock Creates a chroot for every build: yum configuration - a list of repo’s. yum command e.g install meta-package. Lots of caching options. Example Use: mock -r goose-6-x86_64 –init mock -r goose-6-x86_64--shell <cmd> mock -r goose-6-x86_64 --rebuild salt-0.9.9.1-1.src.rpm
12. Mock Demo
13. Koji Architecture
14. • kojihub – Python based xml-rpc server • Interacts with database , the brain. • koji – xml-rpc command line client • Add users, submitting builds, watch logs, regen repo, etc. • kojiweb - a client to koji-hub • Web interface with status • Cancel and resubmit tasks • kojid – builder • Polls koijhub for new tasks • Runs mock to build SRPMs and RPMs • Runs createrepo to generate new repositories • kojira – Repository Administrator • Requests new repositories as needed. • Manages buildroots and repositories. Koji Components
15. Koji Tags / Targets • A tag in koji is a repository of built packages • Tags can be inherited • Maintained by kojira • A build tag defines buildroot • A target defines the tag applied to a successful build • RPMs from external repos can be imported Let's look at a tag and target now.
16. Koji Build Process
17. make sources • git contains .spec file and 'sources' file • sources file contains the tarball and sha256sum verification • downloads .tarball release files • calls curl to local .tar.gz repository • verifies with 'sources' file using sha256
18. Koji Build Demo
19. • mash – repository configuration • sigul – package signing • bodhi – package lifecycle management • packagedb – manages package lists and owners Tools that use Koji
20. Thank you for your attention! web: http://gooseproject.org email: herlo@gooseproject.org project url: http://github.com/gooseproject irc.freendode.net: #gooseproject Slides available @ http://speakerdeck.com/u/herlo/p/koij-reliable-repeatable-builds