Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Kiba ETL: feedback on OSS / open-core sustainability for a Ruby gem

Kiba ETL: feedback on OSS / open-core sustainability for a Ruby gem

It’s pretty easy to get burned out in OSS, as we all know! Since starting working on Kiba ETL (a ruby data processing framework) in 2015, I made a number of decisions to avoid this at all cost, and make sure my research on this would be funded sustainably, in a way or another.

In this talk, I give feedback on which conscious design decisions & trade-offs I made over time and I will explain where I stand at the moment.

Thibaut Barrère

February 19, 2020
Tweet

More Decks by Thibaut Barrère

Other Decks in Programming

Transcript

  1. ᇌ KIBA ETL Feedback on OSS / open-core sustainability for

    a Ruby gem — Thibaut Barrère, LoGeek SARL (https://www.logeek.fr)
  2. job = Kiba.parse do source MyCSVSource, filename: "files/input.csv" transform MyTransform,

    some_config transform MyOtherTransform, some_config transform { |row| ... } destination MyDatabaseDestination, database: db, table: :products end Kiba.run(job)
  3. Funding! Support! ❤ thank you Mum & Dad Also VC

    Dad: "3D is nice, but will this earn money at some point?"
  4. source :in, { :file => 'extracted/crm-changes.csv', :parser => :delimited, :skip_lines

    => 1 }, [:first_name, :last_name] after_read :ensure_fields_presence, { :fields => fields } transform(:id_partenaire) { |n,v,r| some_computation } destination :out, { :file => output_file, :include_headers => true, :separator => ";" }