New restriction in their License suggests the software can't be modified.
"2. All persons obtaining a copy or substantial portion of the Software, a modified version of the Software (or substantial portion thereof), or a derivative work based upon this Software (or substantial portion thereof) must not delete, remove, disable, diminish, or circumvent any inference filters or inference filter mechanisms in the Software, or any portion of the Software that implements any such filters or filter mechanisms."
You can't remove the filters per the license, but the weights will be available soon and so anyone can just reimplement this code using the weights
That's already been done: https://github.com/lucidrains/imagen-pytorch