Bundling Bundler 2.0

Given at RubyConf BR 2017

Transcript

1. Bundling Bundler 2.0 Samuel Giddins Samuel Giddins, RubyConf BR 2017 1
2. @segiddins Samuel Giddins, RubyConf BR 2017 2
3. @segiddins • Bundler's primary committer • RubyGem's primary committer • RubyGems.org occasional contributor • RubyGems security • Mostly finished writing Bundler 2 • Released CocoaPods 1.0 Samuel Giddins, RubyConf BR 2017 3
4. Why Bundler 2? Samuel Giddins, RubyConf BR 2017 4
5. The Forever Plan Samuel Giddins, RubyConf BR 2017 5
6. The Forever Plan • Fix every known bug • Deprecate everything we wanted to get rid of by 1.0.0.0.0.0.0.1 • Don't make promises we can't deliver • Ship in ~2012 Samuel Giddins, RubyConf BR 2017 6
7. The Tools We Built Samuel Giddins, RubyConf BR 2017 7
8. The Tools We Built • bundler-changelog • FeatureFlag • documentation tests • changing Bundler versions on CI Samuel Giddins, RubyConf BR 2017 8
9. bundler-changelog https://github.com/bundler/bundler-changelog Samuel Giddins, RubyConf BR 2017 9
10. bundler-changelog bundler-changelog !"" CHANGELOG.md !"" changes !"" changes.csv !"" from_changelog !"" lib # $"" changelog.rb !"" open_prs_since $"" releases.csv Samuel Giddins, RubyConf BR 2017 10
11. Bundler::FeatureFlag Samuel Giddins, RubyConf BR 2017 11
12. Bundler::FeatureFlag module Bundler class FeatureFlag def self.settings_flag(flag, &default) settings_method("#{flag}?", flag, &default) end def self.settings_option(key, &default); end def self.settings_method(name, key, &default); end (1..10).each {|v| define_method("bundler_#{v}_mode?") { major_version >= v } } def initialize(bundler_version); end def major_version; end settings_flag(:allow_bundler_dependency_conflicts) { bundler_2_mode? } settings_option(:default_cli_command) { bundler_2_mode? ? :cli_help : :install } end end Samuel Giddins, RubyConf BR 2017 12
13. Bundler::FeatureFlag - if Bundler::Version.split(".").first.to_i >= 2 - if Gem::Version.new(Bundler::VERSION) >= Gem::Version.new("2.0") + if Bundler.feature_flag.enable_cool_new_feature? new_behavior end Samuel Giddins, RubyConf BR 2017 13
14. Documentation Tests • Every setting documented • Bundler can't use arbitrary config settings any more • Keep language friendly & welcoming • All commands have a custom man page Samuel Giddins, RubyConf BR 2017 14
15. Changing Bundler versions on CI language: ruby script: rake spec:travis before_script: - travis_retry rake spec:travis:deps - travis_retry rake override_version - travis_retry rake man:build - travis_retry rake spec:rubygems:clone_rubygems_$RGV branches: only: - master - auto - /.+-dev$/ - /.+-stable$/ notifications: slack: on_success: change on_failure: always rooms: - secure: JxBi7DDJGkIF/7f/FSN/HUHpvV4EKfQccZHTPd1b2pNJn3GXo6u+tNVbAw2WjxYzPyPQI3ZcYBCU9SEXp/i7VmG8uMzh8Kyildw+miSKYKVb90uYqcsXWzbxwyNBgJLvyDkzST45H5lgnyAicee3WkFes/WDZikIajbH7ztdb04= addons: code_climate: repo_token: secure: "TrzIv116JLGUxm6PAUskCYrv8KTDguncKROVwbnjVPKTGDAgoDderd8JUdDEXrKoZ9qGLD2TPYKExt9/QDl71E+qHdWnVqWv4HKCUk2P9z/VLKzHuggOUBkCXiJUhjywUieCJhI3N92bfq2EjSBbu2/OFHqWOjLQ+QCooTEBjv8=" rvm: - 2.4.1 - 2.3.4 - 2.2.7 - 2.1.10 - 2.0.0 - 1.9.3 - 1.8.7 # Rubygems versions MUST be available as rake tasks # see Rakefile:125 for the list of possible RGV values env: # We need to know if changes to rubygems will break bundler on release - RGV=master # Test the latest rubygems release with all of our supported rubies - RGV=v2.6.8 matrix: include: - rvm: 2.4.1 env: RGV=v2.6.8 BUNDLER_SPEC_SUB_VERSION=2.0.0 # Ruby 2.4, Rubygems 2.6.8 and up # Ruby 2.3, Rubygems 2.5.1 and up - rvm: 2.2.6 env: RGV=v2.5.2 # Ruby 2.2, Rubygems 2.4.5 and up - rvm: 2.2.6 env: RGV=v2.4.8 # Ruby 2.1, Rubygems 2.2.2 and up - rvm: 2.1.10 env: RGV=v2.2.5 # Ruby 2.0.0, Rubygems 2.0.0 and up - rvm: 2.0.0 env: RGV=v2.2.5 - rvm: 2.0.0 env: RGV=v2.1.11 - rvm: 2.0.0 env: RGV=v2.0.14 # Ruby 1.9.3, Rubygems 1.5.3 and up - rvm: 1.9.3 env: RGV=v2.2.5 - rvm: 1.9.3 env: RGV=v2.1.11 - rvm: 1.9.3 env: RGV=v2.0.14 - rvm: 1.9.3 env: RGV=v1.8.29 - rvm: 1.9.3 env: RGV=v1.7.2 - rvm: 1.9.3 env: RGV=v1.6.2 - rvm: 1.9.3 env: RGV=v1.5.3 # Ruby 1.8.7, Rubygems 1.3.6 and up - rvm: 1.8.7 env: RGV=v2.2.5 # ALLOWED FAILURES # since the great Travis image outage, frequent random segfaults :'( - rvm: 1.8.7 env: RGV=v2.0.14 - rvm: 1.8.7 env: RGV=v1.8.29 - rvm: 1.8.7 env: RGV=v1.7.2 - rvm: 1.8.7 env: RGV=v1.6.2 - rvm: 1.8.7 env: RGV=v1.5.3 - rvm: 1.8.7 env: RGV=v1.4.2 - rvm: 1.8.7 env: RGV=v1.3.7 - rvm: 1.8.7 env: RGV=v1.3.6 # Ruby-head (we want to know how we're doing, but not fail the build) - rvm: ruby-head env: RGV=master allow_failures: - rvm: 1.8.7 env: RGV=v2.0.14 - rvm: 1.8.7 env: RGV=v1.8.29 - rvm: 1.8.7 env: RGV=v1.7.2 - rvm: 1.8.7 env: RGV=v1.6.2 - rvm: 1.8.7 env: RGV=v1.5.3 - rvm: 1.8.7 env: RGV=v1.4.2 - rvm: 1.8.7 env: RGV=v1.3.7 - rvm: 1.8.7 env: RGV=v1.3.6 - rvm: ruby-head env: RGV=master Samuel Giddins, RubyConf BR 2017 15
16. Changing Bundler versions on CI Rspec.describe "the lockfile format", bundler: "< 1" do end Rspec.describe "the lockfile format", bundler: 2 do end Samuel Giddins, RubyConf BR 2017 16
17. Intermission The Other Forever Plan Samuel Giddins, RubyConf BR 2017 17
18. The Other Forever Plan The rumors of Bundler's death have been greatly exaggerated http://bundler.io/blog/2013/12/07/the-rumors-of- bundlers-death-have-been-greatly-exaggerated.html Samuel Giddins, RubyConf BR 2017 18
19. The Other Forever Plan • Shipping Bundler in Ruby ✔ • Merging RubyGems and Bundler ✔✘ • Making everything forward and backward compatible ✘ Samuel Giddins, RubyConf BR 2017 19
20. Top 10 Changes Samuel Giddins, RubyConf BR 2017 20
21. Dropping old Ruby / RubyGems Support Samuel Giddins, RubyConf BR 2017 21
22. Dropping old Ruby / RubyGems Support spec.required_ruby_version = ">= 2.3" spec.required_rubygems_version = ">= 2.5" Samuel Giddins, RubyConf BR 2017 22
23. Command-Line Flags Aren't Remembered Samuel Giddins, RubyConf BR 2017 23
24. New bundle config Interface Samuel Giddins, RubyConf BR 2017 24
25. New bundle config Interface Old: $ bundle config # list all settings $ bundle config "path" # print the current `path` setting $ bundle config "path" "vendor" # set the path to "vendor" $ bundle config --delete "path" # delete the current setting for `path` Samuel Giddins, RubyConf BR 2017 25
26. New bundle config Interface New: $ bundle config list # list all settings $ bundle config get "path" # print the current `path` setting $ bundle config set "path" "vendor" # set the path to "vendor" $ bundle config unset "path" # delete the current setting for `path` Samuel Giddins, RubyConf BR 2017 26
27. Isolated Installs Samuel Giddins, RubyConf BR 2017 27
28. Isolated Installs The new default: $ bundle install --path ".bundle" Samuel Giddins, RubyConf BR 2017 28
29. Isolated Installs The old default: $ bundle config set path.system true Samuel Giddins, RubyConf BR 2017 29
30. Aggressive Caching Samuel Giddins, RubyConf BR 2017 30
31. Aggressive Caching • Caching built extensions • Global gem download cache • Global git cache Samuel Giddins, RubyConf BR 2017 31
32. Aggressive Caching /Users/segiddins/.bundle/cache !"" compact_index # !"" rubygems.org.443.29b0360b937aa4d161703e6160654e47 !"" extensions # $"" x86_64-darwin-16 !"" gems # $"" rubygems.org.443.29b0360b937aa4d161703e6160654e47 $"" git !"" CLAide-1f7c26f0e18404ea56d6204dab591f5ec71ac1b9 !"" Molinillo-9d794a0756ad56a3e90d93c578f55158b9102520 Samuel Giddins, RubyConf BR 2017 32
33. Multi-Source Safety Samuel Giddins, RubyConf BR 2017 33
34. Multi-Source Safety Addressing Bundler's First CVE Samuel Giddins, RubyConf BR 2017 34
35. Multi-Source Safety source "https://rubygems.org" source "https://not-rubygems.org" gem "rails" Samuel Giddins, RubyConf BR 2017 35
36. Errors Are Now Called Errors Samuel Giddins, RubyConf BR 2017 36
37. Local Platforms are Respected Samuel Giddins, RubyConf BR 2017 37
38. Local Platforms are Respected gem "ffi" ffi-1.9.1 ffi-java-1.9.1 ffi-universal-darwin-1.9.1 ffi-x86_64-darwin-16-1.9.1 Samuel Giddins, RubyConf BR 2017 38
39. Bundler Is More Fun To Develop Samuel Giddins, RubyConf BR 2017 39
40. Counting is Hard, Maybe Fewer Than 10 Exciting Things Samuel Giddins, RubyConf BR 2017 40
41. Back To The Top Why Bundler 2? Samuel Giddins, RubyConf BR 2017 41
42. Why Bundler 2? • Why do we need a new major release? • Why talk about it? • Why pour so much effort into it? Samuel Giddins, RubyConf BR 2017 42
43. Why Bundler 2? A brief history of Bundler usage1 Version Release Date Downloads 0.3.0 July 29, 2009 3,308 1.0.0 August 29, 2010 297,889 1.15.4 August 19, 2017 12,493,974 All Time 205,973,132 1 Current as of November 10, 2017 Samuel Giddins, RubyConf BR 2017 43
44. Why Bundler 2? A brief history of Bundler: http://andre.arko.net/2015/04/28/how-does-bundler- work-anyway/ • André Arko, Bundler Project Lead Samuel Giddins, RubyConf BR 2017 44
45. Why Bundler 2? Bundler 1 is Old Samuel Giddins, RubyConf BR 2017 45
46. Why Bundler 2? The Ruby Community Has Grown Up Samuel Giddins, RubyConf BR 2017 46
47. Why Bundler 2? We've Gotten 7 Years of Experience Samuel Giddins, RubyConf BR 2017 47
48. Why Bundler 2? We Want Bundler To Last Samuel Giddins, RubyConf BR 2017 48
49. Why Bundler 2? Our Users Deserve the Best Bundler We Can Build Them Samuel Giddins, RubyConf BR 2017 49
50. When Bundler 2? Soon Samuel Giddins, RubyConf BR 2017 50
51. gem install bundler --version ">= 2.0.0.pre.1" Samuel Giddins, RubyConf BR 2017 51
52. @segiddins Samuel Giddins, RubyConf BR 2017 52