Hey! Thanks for this tool. I was testing and paying copilot, including the new chat integrated tool, but I feel your work flow proposal is more compelling.

That said, I'm not sure what's the difference between providing my own openapi key or not. The "Customization" doc is not entirely clear on what using my own key enables me to do.

For instance, is this required for gpt4? What are the limits of the free trial key?

I don't want to evaluate this not knowing which model is really using, and it's not clear what difference the key makes.

Edit: Also when I asked the Continue chat how to change my key and the model being used, it said that this is not possible since the key is yours, instead of pointing me to the "Extension Settings" inside the extension tab using the cog wheel.

We wanted to make it as easy as possible for people to try Continue, so we allow 250 free requests. These use gpt4. If you plug in your own API key in VS Code settings, it will also use gpt4 by default.

We'll update the /help messaging so it knows this, and you can read more about choosing a model here: https://continue.dev/docs/customization

LocalAI seems like a interesting project that allows self-hosted can be easily called over the network. Open AI compatible interface https://github.com/go-skynet/LocalAI