I have this dream of being able to live my entire computer life in a Unix command line without need for X or GUIs. Just boot straight to command line and go. Does anyone here do that?

Might be closer than you think... Check out Notcurses.

https://github.com/dankamongmen/notcurses

Here's a demo:

https://www.youtube.com/watch?v=dcjkezf1ARY