I'm with you there. It seems like an extension to existing DBs would be better. I would like something like this for a file based DB like sqlite.

txtai combines SQLite and Faiss to enable vector search. It also does a lot more than that.

https://github.com/neuml/txtai