What does HackerNews think of better-sqlite3?
The fastest and simplest library for SQLite3 in Node.js.
Language:
C++
If I were charged with this task I'd probably take an actual SQLite DB and write methods to parse data from text files, then process it within SQLite, and serialize it back to the text file when an API method is called or after each processing step. A fresh DB engine, fully re-implemented to match SQLite's API is insane unless you're a prodigy or have a sizable team and will come with numerous downsides. I can recommend https://github.com/WiseLibs/better-sqlite3 and https://github.com/loveencounterflow/dbay
Why do you have async reads and writes? There's no client-server setup here, using async / await just introduces pointless waiting.
The frontend is in Vue. Both the FE and BE are in TypeScript.
Parallelism is provided by https://github.com/photostructure/batch-cluster.js/
Metadata reads and writes are via https://github.com/photostructure/exiftool-vendored.js/
Persistence is via SQLite: https://github.com/WiseLibs/better-sqlite3
Image transforms are via Sharp: https://sharp.pixelplumbing.com/
My more nerdier blog posts are tagged here: https://photostructure.com/tags/coding/
It would be great to have some benchmarks against better-sqlite and the regular sqlite libraries, like in https://github.com/WiseLibs/better-sqlite3