is this the first GPT-like models which is fully opensource ? none of the others are right ?
Aren't eleutherai's model so?
doesnt seem the code is there - pretrained models are there. https://github.com/kingoflolz/mesh-transformer-jax/#gpt-j-6b
https://huggingface.co/EleutherAI/gpt-j-6B
isnt that so ?
The code is there: https://github.com/EleutherAI/gpt-neox