Can anyone comment on whether this will be useful for training neural networks?

There is a project working for this: https://github.com/plaidml/plaidml