It will be nice when Cargo dependencies can use pre-built binaries instead of having to compile the whole dep chain. One crate I contribute to has a 4 GiB target folder and takes 20 mins to compile from scratch...
In the meantime, you can use sccache to at least save the time spent to compile the same version of a crate more than once.