What does HackerNews think of haystack?

:mag: Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex question answering, semantic search, text generation applications, and more.

Language: Python

#8 in R
#26 in Machine learning
#6 in Natural language processing
#9 in Natural language processing
#124 in Python
Llama2 + Haystack on Colab | Jul 2023
I recently conducted some experiments with Llama2 and Haystack (https://github.com/deepset-ai/haystack), the NLP/LLM framework.

The notebook can be helpful for those trying to load Llama2 on Colab.

1) Installed Transformers from the main branch (and other libraries)

2) Loaded Llama-2-13b-chat-hf on Colab using 4-bit quantizazion, thanks to the material shared by Younes Belkada

3) Disabled Tensor Parallelism, which caused some issues

4) Installed a minimal version of Haystack

5) Found a hacky way to load the model in Haystack's PromptNode

6) Had a fun chat session with the model, discussing everything from David Guetta to Don Matteo (an Italian TV series)!

Re-implementing LangChain in 100 lines of code | May 2023
Expand Context ↕
Yes! https://github.com/deepset-ai/haystack
Introducing Agents in Haystack: Make LLMs resolve complex tasks | Apr 2023
Expand Context ↕
Looks like the same general idea:

https://github.com/deepset-ai/haystack
Show HN: Hello – A conversational search engine powered by transformers | Jan 2022
Slightly related, but could I make something similar using Haystack[0] and feeding it with a large index?

[0]https://github.com/deepset-ai/haystack