In terms of pickled files, we may ask them to release the models in safetensors. That would be a big improvement.
There's not much we can do about dependencies on pytorch or other python libraries. Perhaps people can make more independent implementations. The redundancy in implementations would help.
I'm surprised that some of the cutting edge AI work is not being done in pure Rust. Why even have a binding layer?