And is there a way to tell GitHub _not_ to analyse repos that I own?

Yes, there is an account setting checkbox labeled "Allow GitHub to use my code snippets for product improvements" - https://github.com/settings/copilot

I'm a bit confused how this will work in practice, because I don't see how they can retrain their entire model every time someone toggles that setting.