Imagine if it was possible to combine this with homomorphic encryption into something like AirDrop for LLMs!
("Sorry, I don't know how to answer that – but you can try getting closer to a bunch of other people running the app on their device and ask again!")
Sounds like a literal hive mind!
The library they're using is literally called Hivemind [0]. I'm interested to see how the approach they're using differs from what we use in federated learning or gossip learning.
> Hivemind is a PyTorch library for decentralized deep learning across the Internet.