What does HackerNews think of llama_index?

LlamaIndex (GPT Index) is a project that provides a central interface to connect your LLM's with external data.

Language: Python

Patterns for building LLM-based systems and products | Aug 2023
I'm sorry but from a _practical_ standpoint, it feels like mostly fluff. Someone was advertising today on a HN hiring post that they would create a basic chatbot for a specific set of documents for $15,000. This feels like the type of web page that person would use to confuse a client into thinking that was a fair price.

Practically speaking the starting point should be things like the APIs such as OpenAI or open source frameworks and software. For example, llama_index https://github.com/jerryjliu/llama_index. You can use something like that or another GitHub repo built with it to create a customized chatbot application in a few minutes or a few days. (It should not take two weeks and $15,000).

It would be good to see something detailed that demonstrates an actual use case for fine tuning. Also, I don't believe that the academic tests are appropriate in that case. If you really were dead set on avoiding a leading edge closed LLM, and doing actual fine-tuning, you would want a person to look at the outputs and judge them in their specific context such as handling customer support requests for that system.

LlamaIndex raises $8.5M seed round, led by Greylock Partners | Jun 2023
Github link https://github.com/jerryjliu/llama_index
Train own custom dataset on GPT-4 | May 2023
There are a bunch of them now

https://github.com/jerryjliu/llama_index is one

Ask HN: Bypassing GPT-4 8k tokens limit | May 2023
Check out llama_index at https://github.com/jerryjliu/llama_index. What it does: it creates an index over your data using OpenAI embeddings vectors, using the OpenAI Ada model. When querying, it compiles as much context out of this index as fits into GPT, based on similarity to your prompt. Be cautious however: when I experimented with this, GPT-4 support with it‘s larger context size was not there yet. I have landed https://github.com/hwchase17/langchain/pull/1778, but I never wound up submitting another, yet similar patch (to llama_index? Don‘t remember). Make sure that the GPT-4 context is really fully used, and not some smaller size is assumed. Also, ensure that GPT-4 is used as the LLM in the first place: the defaults used to be the older models.
LangChain Announces 10M Seed Round | Apr 2023
Can someone explain how LangChain compares to Llama Index [1]?

[1] https://github.com/jerryjliu/llama_index

GPT4 is up to 6 times more expensive than GPT3.5 | Mar 2023
Expand Context ↕
There are already some cool projects that help LLM go beyond the context window limitation and work with even larger codebases like https://github.com/jerryjliu/llama_index and https://github.com/hwchase17/langchain.
GPT-4 | Mar 2023
Expand Context ↕
There’s already project that help with going beyond the context window limitation like https://github.com/jerryjliu/llama_index

They also just tweeted this to showcase how it can work with multimodal data too: https://twitter.com/gpt_index/status/1635668512822956032?s=4...