It’s not possible currently but there’s another story on the HN front page with an open source alternative which I haven’t tried

Which one?

Possibly this "PaLM + RLHF - Pytorch" project:

https://github.com/lucidrains/PaLM-rlhf-pytorch