To copy a reddit meme: text-generation-webui plugin when? But seriously, this seems like an incredible upgrade.

Better yet, text-generation-webui-docker when?

Is Serge what you are looking for? I've been using it to play around with prompting a few large language models.