andai

I read about something a few weeks ago which does just this! Does anyone know what it's called?

lucidrains
you are probably thinking of https://arxiv.org/abs/2207.03481

for inference, there is https://github.com/bigscience-workshop/petals

however, both are only in the research phase. start tinkering!