Upgrade to Pro — share decks privately, control downloads, hide ads and more …

InfluxDB IOx Project Update - 2021-02-10

Paul Dix
February 10, 2021

InfluxDB IOx Project Update - 2021-02-10

February, 2021 project update for InfluxDB IOx, a new in-memory columnar database written in Rust, backed by Apache Arrow, using object storage for persistence. The replication document on slide 2 is here.

Paul Dix

February 10, 2021
Tweet

More Decks by Paul Dix

Other Decks in Technology

Transcript

  1. Paul Dix
    InfluxData – CTO & co-founder
    [email protected]
    @pauldix
    InfluxDB IOx - a new columnar
    time series database (update)

    View full-size slide

  2. Progress
    • New Team Members!
    • Read Buffer progress
    • Mutable Buffer & Read Buffer connections
    • Arrow Flight API
    • Replication, multiple IOx servers doc

    View full-size slide

  3. API Decisions
    • Management API will be gRPC
    – CLI for common tasks
    • Write
    – InfluxDB 2.0 Line Protocol
    – JSON objects (events!)
    – Protobuf?
    • Query
    – HTTP (csv, json, display)
    – Arrow Flight
    – Postgres?

    View full-size slide

  4. What’s Next?
    • Management API
    • Parquet Persistence to Object Store
    • Recovery from Object Store
    • Replication
    • Subscriptions
    • Official Builds & Documentation (now late March)

    View full-size slide