What does HackerNews think of duckdb?
DuckDB is an in-process SQL OLAP Database Management System
I've chalked duckdb up as a python tool, which made me less interested. A little searching however revealed JavaScript & rust bindings, & a wasm implementation. The wasm implentatiom in particular I find exceedingly exciting.
https://duckdb.org/2021/10/29/duckdb-wasm.html
the existence of DuckDB?
https://github.com/duckdb/duckdb
you've got an already popular open source tool being extended and built by the guy who helped make BigQuery and people from Snowflake. VCs are going to be willing to throw money at that
duckdb -c "SELECT passenger_count, COUNT(*), AVG(total_amount) FROM taxi.csv GROUP BY ALL"
DuckDB will automatically infer you are reading a CSV file from the extension, then automatically infer column names from the header, together with various CSV properties (data types, delimiter, quote type, etc). You don't even need to quote the table name as long as the file is in your current directory and the file name contains no special characters.DuckDB uses the SQLite shell, so all of the commands that are mentioned in the article with SQLite will also work for DuckDB.
[1] https://github.com/duckdb/duckdb
Disclaimer: Developer of DuckDB
It's so fast/good that I've actually been using it for a lot of data cleaning and transformation that previously I'd have done in Pandas.