I loved the idea (git everything!) until I read this:

"How do I remove a package and all of its dependencies? [...] The package manager does not do recursive dependency removal on removal of a package. This error-prone automation will not be added to the package manager. "

All of Gentoo's packages are in git and it does support recursive removal: https://github.com/gentoo/gentoo