As much as I like pg_vector, I think right now what we need the most is a pre-packaged version of sqlite-vss and a Pythonic wrapper for bootstrapping projects. This would lower barriers to entry even more for those using LLMs solely via APIs, and save people the trouble of setting up a database server or risking getting locked in to yet another prickly SaaS while iterating on a concept.

Scaling can come later, after the solution has proven its worth.