Reducing ActiveRecord memory consumption using Apache Arrow

Reducing ActiveRecord memory consumption using Apache Arrow

Using Apache Arrow as the internal data structure of ActiveRecord, the execution time of the pluck method was reduced, and this method could be more parallelizable.

And I suggested that we should let DBMSs support the data format of Apache Arrow as their query result so that the memory consumption of Active Record is also reduced.

7cca11c5257fda526eeb4b1ada28f904?s=128

Kenta Murata

April 20, 2019
Tweet