If you are doing LLM, of course you do. But an amazing OSS vector DB has yet to arrived. The number of vectors it could handle needs to be in the billions, at least.

What’s wrong with Faiss? https://github.com/facebookresearch/faiss