What does HackerNews think of chatbot-ui?

An open source ChatGPT UI.

Language: TypeScript

It depends what you mean by "viable alternatives" and how much money you are prepared to spend on hardware to self-host. As others have mentioned, you can try llama.cpp and LocalAI, but for most ChatGPT-like applications, you won't get anything like as good results. I've found that using GPT-4 via the OpenAI API is somewhat more reliable than ChatGPT, either via the Playground or via a local chat interface like https://github.com/mckaywrigley/chatbot-ui
I use ChatBot-UI to achieve something like 1 and 2 together. It runs locally and uses the OpenAI API to provide a ChatGPT-like experience, but the chat history is saved locally in the browser. It also has a useful prompt management sidebar.

Of course, OpenAI saves the data regardless, but they say they don't use API requests for training data and they claim it's deleted after 30 days.

https://github.com/mckaywrigley/chatbot-ui

https://openai.com/policies/api-data-usage-policies

OpenAI have a good business model here, though possibly a bit unethical.

Shopify (who recently laid me off but I still speak highly of) locked down the public access to ChatGPT's website. But you could use Shopify's internal tool (built using https://github.com/mckaywrigley/chatbot-ui) to access the APIs, with access to GPT4. And it was great!

So look at this from OpenAI's perspective. They could put up a big banner saying "Hey everyone, we use everything you tell ChatGPT to train it to be smarter. Please don't tell it anything confidential!". And then also say "By the way, we have private API access that doesn't use anything you say as training inputs- maybe your company would prefer that?"

The louder they shout those two things, the more businesses will line up to pay them.

And the reason they can do this: they've built a brilliant product that everyone wants to use, everyone is going to use.

For quick and easy, I like https://www.chatbotui.com

Plug in your API key and start chatting. Chats are stored in your browser. You can also run it locally, if you wish. https://github.com/mckaywrigley/chatbot-ui