What does HackerNews think of pipelinedb?
High-performance time-series aggregation for PostgreSQL
Language:
C
#22
in
PostgreSQL
#18
in
SQL
PipelineDB might be of interest. https://github.com/pipelinedb/pipelinedb
Looks useful, but it depends on PipelineDB, a PostgreSQL extension for streaming data. Unfortunately PipelineDB hasn't been updated since May 2019 [0] when they were acquired by Confluent [1]. The former PipelineDB team appears to be focused on Confluent's KSQL product [2]. There's an open source "ksqlDB" but it appears to depend on Kafka, so it's not a 1:1 replacement for PipelineDB[3].
[0] https://github.com/pipelinedb/pipelinedb
[1] https://www.confluent.io/blog/pipelinedb-team-joins-confluen...
[2] https://www.confluent.io/blog/confluent-cloud-ksql-as-a-serv...
There are a lot of products that either fork or directly extend PostgreSQL for OLAP workloads. Greenplum[0], Materialize[1], Citus[2], PipelineDB[3] etc etc.
[2] https://www.citusdata.com/ (edit: I said TimescaleDB, I was thinking of Citus)
[3] https://github.com/pipelinedb/pipelinedb
Disclosure: I work for VMware, which sponsors Greenplum development and sells commercial offerings.
PipelineDB (YC W14) has a lot of similarities to the technology described in this paper, and is open-source: https://github.com/pipelinedb/pipelinedb
Disclaimer: I worked at Truviso; I know the PipelineDB guys but I'm not affiliated with the company.
Very cool that it is open sourced - seems like there would be a lot to learn from the code. Link: https://github.com/pipelinedb/pipelinedb