Been looking for something like this for my windows computer. Little Snitch has been invaluable over the years but never found anything that covers it’s features for windows
If you are looking for a simple and light firewall (but still better than Windows Firewall), I recommend using Simplewall. It does not require a kernel extension and works with the API provided by Windows to do network filtering.