I've used winRAR for a long time because of the "self-extracting executable" feature. You can set it up to create an exe (instead of a rar) that extracts files to a particular location and then runs arbitrary commands. It's like a super simple ghetto-fabulous installer and it just works.
Now I wonder what else can do that as easily in a windows environment? I haven't looked around because I haven't needed to but now I am curious. And yes, the winRAR UI is getting a bit long in the tooth.
You can have that with updates using Squirrel; https://github.com/Squirrel/Squirrel.Windows.