Very Interesting. One of the big challenges with LLMs is getting well formed JSON output. GPT4 is much better at this. But is very expensive. So anything that can help is good. Looking forward to trying this out locally with LLAMA.
What is LLAMA ?
Taks a look at: https://github.com/ggerganov/llama.cpp