If you're using Firefox there is a tweak you can make to not give sites access to your password.[1]
Aside from that, try to avoid using auto fill, just copy the username/email and password from your manager directly.
[1] https://www.ghacks.net/2014/01/08/block-websites-reading-mod...
I am currently also using the passff extension (https://github.com/passff/passff). So, you are saying I should better not do that?