This is slightly unrelated/related to the author's problem, but I've been working on creating something that can continually scrape websites for updates for me - and tell me when something has changed. Still a WIP, but if anyone's interested: https://fetcher.page