"The RSS feed for websites missing it"
I am able to get a lot of generally unavailable feeds using https://github.com/RSS-Bridge/rss-bridge running on my server. Perhaps this code could be someday brought in as a catch-all last resort.
KilltheNewsletter[0] is a great email-to-RSS generator, for instance. And RSSBridge[1] has all sorts of x-to-RSS bridges available. There’s even a website[2] that allows you to turn public Telegram channels into RSS feeds.
[0] - https://kill-the-newsletter.com/
[1] - https://github.com/RSS-Bridge/rss-bridge
[2] - https://tg.i-c-a.su/
Tiny Tiny RSS[0] is an addictive RSS reader with tons of options to sort, manipulate, filter in/out, etc. RSS entries. Feed Preview[1] is a must-have Firefox add-on for finding available feeds on websites (and previewing them).
All alternative front-ends to YouTube, Twitter, Instagram, etc. provide feeds to subscribe to people like Invidious[2], nitter[3], Bibliogram[4], etc. (large list of alternative front-ends here [5]).
Fortunately, Github and Reddit, still natively support RSS feeds.
As others have mentioned, WordPress-based websites natively include RSS feeds for the whole website, by category, for comments of a particular post, etc. This is much better than crappy newsletters.
Regarding newsletters, when it's the only option, I use Mailnesia[6] to turn an inbox into an RSS feed.
Speaking of bridges, RSS-Bridge[7] makes feeds available to hundreds of websites through community plugins.
Feed43 [8] is also a great tool to force an ordinary page to be available as an RSS feed.
SearX [9], a metasearch engine, turns into a very powerful tool to watch for something on the whole web with advanced search functions and results available as RSS feeds. This is better than many dedicated tools, imo.
Anyway, I don't think RSS feeds are missing or even dying. But they are definitely a relic of the good old days, when Aaron Swartz was around, and unfortunately reserved for people who are looking for them or are curious enough to dive into that world.
One thing is for sure though: if they disappear, I'm out.
[1] https://code.guido-berhoerster.org/addons/firefox-addons/fee...
[3] https://github.com/zedeus/nitter
[4] https://sr.ht/~cadence/bibliogram/
[5] https://github.com/mendel5/alternative-front-ends
It is a feed generator for sites that don't have it.
I think in the future RSS will be a community driven effort, not something that the website themselves care to implement.
[1] - https://politepol.com/en/ [2] - https://github.com/DIYgod/RSSHub [3] - https://github.com/RSS-Bridge/rss-bridge
If any of you are looking into RSS, check out FreshRSS[2] (an RSS aggregator). A mobile client I especially like is NetNewsWire[3] (for Apple products only, but is imo amazing)
Not possible as long as the pages are not walled behind a login.
https://github.com/RSS-Bridge/rss-bridge
Just saw, it works also with other websites like youtube. But I have never tried this.
https://feed2exec.readthedocs.io/ https://github.com/feed2imap/feed2imap
Also some tools for converting non-RSS websites to RSS:
https://github.com/RSS-Bridge/rss-bridge https://git.ao2.it/tweeper.git
Two things I am using:
Twitter to RSS: https://github.com/RSS-Bridge/rss-bridge
Arbitrary RSS feeds: https://feedity.com
I used to have direct feeds from my YouTube subscriptions, but they either killed or moved that feature. This runs on the same $5 vm as my RSS feed reader and works great.
Yeah, there's some sites that have killed their RSS feeds, and feeds can be tough to find (though there's browser extensions that fix that issue), but most major news organizations, blogging platforms, etc, support RSS. And for those that don't (including Twitter, Instagram, Github, etc), RSS Bridge can often fill the gap:
https://github.com/RSS-Bridge/rss-bridge
In short: RSS is my frontend to the web, and it's fantastic!
https://github.com/RSS-Bridge/rss-bridge https://github.com/feediron/ttrss_plugin-feediron https://git.tt-rss.org/fox/tt-rss
You can replace most of your social media feeds. I'm compiling a list of URLs you can use to replace existing services with RSS: https://gist.github.com/thefranke/63853a6f8c499dc97bc17838f6...
[0] https://github.com/damoeb/rss-proxy/
I would indeed prefer that facebook provides those feeds themselves as it sometimes break because Facebook changes things (the latest breakage I encountered being Facebook replying with "You must be logged in to view this page").
After that shutdown I was on Feedly for a while, and now moved to self hosting miniflux [0] which I'm quite happy with. Haven't found the perfect Android app, but the miniflux web view (minimal, but effective) is growing on me. I also self-host rss-bridge [1] to wrangle some less ideal feeds (you can grab whole content, format as you like, etc.)
[0] https://github.com/RSS-Bridge/rss-bridge [1] https://github.com/damoeb/rss-proxy
A pragmatic approach. Trying to build a generalized framework handling each and every edge case promises endless complexity.
I highly recommend it.
edit: Both rssbox in the OP, and RSS-bridge[1] are open source. I was thinking of the latter. There's also RSSHub[2].
https://github.com/RSS-Bridge/rss-bridge
(you can find multiple instances on the web)
Note there are ways to get an RSS feed from some sites without them (RSS-Bridge[0] is what I use), but the experience is much better if the site natively produces one.
In time, you'll find yourself with hundreds of feeds on a variety of topics.
[1]: https://github.com/RSS-Bridge/rss-bridge [0]: https://rss-bridge.bb8.fun/
I like your static-file approach though. Never thought of pre-generating RSS-feeds that way.
What is more, I've got bunch of scripts that do keyword search for topics that interest me on Reddit/Hackernews/GitHub/pinboard and generate private RSS feeds. That way I can quickly skim through them once in a while and stay up to date without having to do manual searches.
P.S. if the website doesn't support RSS, you can still use one of feed generators that basically scrape the website now and then and generate the feed. I've used http://fetchrss.com so far, there are also some open source/selfhosted alternatives like https://github.com/RSS-Bridge/rss-bridge
https://github.com/RSS-Bridge/rss-bridge/
For HN, you can run that very same codebase from https://hnrss.org: https://github.com/edavis/go-hnrss
1. RSS-Bridge[0] - RSS Feeds for websites that don't give you one. Supports instagram/facebook/Google Search and many more (150+) websites. Very easy to contribute, and there are open requests for lots of providers. (I added a Amazon Price Tracker Bridge in <150 loc). Yes, I get a RSS notification when there is a price change on something I follow[1].
2. MiniFlux - Golang+Postgres based self-hosted RSS feed reader. Minimal/responsive design with keyboard shortcuts https://miniflux.app
3. 3. tt-rss - A highly configurable PHP based RSS feed reader. Supports plugins and has tons of options. UI is similar to Google Reader. https://tt-rss.org
4. Winds - A Beautiful Open Source RSS & Podcast App powered by @getstream_io. I haven't tried self-hosting it yet, but it looks really great. Also, under very active development. https://github.com/GetStream/Winds
5. FreshRSS - Lightweight PHP/SQlite self-hosted feed reader. Looks great as well. https://freshrss.org
6. Kill the Newsletter - Subscribe to a newsletter with a one-time generated email address, it generates a RSS feed for you. Your inbox stays clean. https://www.kill-the-newsletter.com
7. OPML Generator - Generates OPML Files using subscriptions on other sites. Supports GitHub stars (generates a file you can import to follow releases from all your starred repos on GitHub) https://opml.bb8.fun/ (Personal project, so count this as a shameless self plug)
8. RSS never really died, so revival is a misnomer in that sense. All major news publications still support RSS. The entire Podcast ecosytem works on RSS. You should also look at WebSub and ActivityPub (both W3C recommendations) if you're interested in this.
9. And finally a cool new idea - build a Telegram Channel to RSS Feed generator. Will open up so much hidden content to the open web.
10. Bonus: https://www.youneedfeeds.com/ Info site that you should share with your friends to help them get started with RSS.
[0]: https://github.com/RSS-Bridge/rss-bridge
[1]: https://github.com/RSS-Bridge/rss-bridge/pull/741
[3]: https://twitter.com/captn3m0/status/1018850458675408902
For me, RSS is by far (still) the best way to access web content.
I've tried some self hosted RSS readers over the years but I've stayed with FreshRSS[1] for the last year. It has been a marvelous experience. Zero trouble, zero administrative burden. Self-hosted bliss. Best of all is the fact that it uses a flat file DB so it can easily be backed up, moved around and migrated. Can not recommend it enough. Also, it's PHP, so works on any cheap shared hosting. That's how I use it.
One of the best things about it is escaping the algorithmically curated feeds.
Every site and service that I wish to follow has an RSS feed, except for Twitter. I use RSS-Bridge[2] (self hosted too) to follow users. RSS-Bridge[2] will give you feeds for just about every service you can think of.
If you don't find a feed for a site, sometimes you just have to dig a little. You learn at which URIs the most commons CMSes presents their Atom/RSS feeds (hello /feed/).
https://github.com/Kickball/awesome-selfhosted
I've tried some self hosted RSS readers over the years but I've stayed with FreshRSS[1] for the last year. It has been a marvelous experience. Zero trouble, zero administrative burden. Self-hosted bliss. Best of all is the fact that it uses a flat file DB so it can easily be backed up, moved around and migrated. Can not recommend it enough. Also, it's PHP, so works on any cheap shared hosting. That's how I use it.
One of the best things about it is escaping the algorithmically curated feeds.
Every and service that I use has an RSS feed, except for Twitter. I use RSS-Bridge[2] (self hosted too) to follow users. RSS-Bridge[2] will give you feeds for just about every service you can think of.
If you don't find a feed for a site, sometimes you just have to dig a little. You learn at which URIs the most commons CMSes presents their Atom/RSS feeds (hello /feed/).
I use rss-bridge in combination with rss2email to follow instagram feeds after leaving instagram.
I went a few years without Google Analytics, and I was proud of the fact that my weblog had no tracking software. I kept thinking I would write a script to track the audience myself. But I was busy and never got around to it. So in the autumn I decided, okay, I'll use Google Analytics for a few months, till I can write my own code.
I'd written my own system for tracking my weblog, back in the era of 2005-2009, before I used WordPress (back when I only used my own code for websites).
Looking at the Google Analytics results nowadays is heartbreaking for someone like me, who remembers the independent blogosphere of 12 years ago. Because it is gone. Utterly gone.
Back then my traffic tended to come from dozens of independent bloggers who noticed when I occasionally said something smart. The blogosphere was a world of individual voices. There were big group blogs, such as Crooked Timber, but even those consisted of individuals and it was easy to figure out who had admired something I wrote. It was a world where you had some sense of who was reading you, and what they thought about you, and they could see when you read them in return.
That world died in the era 2006-2010 as Twitter and Facebook gained influence.
Nowadays, Google Analytics shows I get traffic from sites that aggregate audiences. Overwhelmingly, that's Facebook and Twitter. The traffic is very sporadic, full of big spikes of anonymous readers. A few times a year I'll write something that gets on the front page of Hacker News, and then I'll get from Hacker News anywhere from 4,000 to 40,000 visits over two or three days. Which is great, but also sporadic.
What I miss is the ability to follow those who are reading me, and more so, their awareness, in response, that I am reading them in return. The dynamic of "You read me so I read you and you see that I read you" is alive and well on specific sites, such as Twitter, but I miss it being part of the general Internet experience. I do realize I can use something like https://github.com/RSS-Bridge/rss-bridge to treat social media as a series of RSS feeds, and I am planning on doing that, but that still misses the element of them seeing that I am reading them.
I've been thinking about some way to try to balance people's preference for walled-gardens with this kind of open back and forth conversation. I might work on this more seriously later in the year.
If anyone is interested in a bit of history, way back in 2006 I wrote what was widely considered the most definitive summary of the fighting that had taken place among those interested in developing RSS. All of this was made irrelevant by the rise of Twitter, but in 2006, this still seemed like a very important topic for the Web industry:
"RSS has been damaged by in-fighting among those who advocate for it"
http://www.smashcompany.com/technology/rss-has-been-damaged-...
http://ambassadors.thehustle.co/
http://ben-evans.com/newsletter
http://fortune.com/tag/term-sheet/
http://jack-clark.net/import-ai
http://pablojuan.com/subscribe
http://pruthvishetty.com/bookmark
http://softwareleadweekly.com/
http://subscribe.machinelearnings.co/
http://weekly.monitoring.love/
http://www.craftinginterpreters.com/
http://www.hackernewsletter.com
http://www.juliezhuo.com/design/mailinglist.html
http://www.metzdowd.com/mailman/listinfo/
https://cooperpress.com/publications/
https://danielmiessler.com/podcast/
https://dbader.org/python-tricks
https://github.com/Daviey/awesome-mailinglists
https://github.com/explore/subscribe
https://github.com/kilimchoi/engineering-blogs/blob/master/e...
https://github.com/plainflow/plainflow-digested-week/
https://github.com/RSS-Bridge/rss-bridge
https://inside.com/readthisthing
https://lists.eff.org/mailman/listinfo/crypto-ops
https://lists.randombit.net/mailman/listinfo/cryptography
https://mailman.srv.cs.cmu.edu/mailman/listinfo/connectionis...
https://mattermark.com/newsletters/
https://nytimes.com/newsletters/morning-briefing
https://programmingdigest.net/
https://thebrowser.com/try-the-browser
https://tinyletter.com/getputpost
https://tinyletter.com/levthedev
https://www.androiddevdigest.com/
https://www.bloomberg.com/view/topics/money-stuff
https://www.datascienceweekly.org
https://www.feistyduck.com/bulletproof-tls-newsletter/
https://www.indiehackers.com/businesses/hacker-news-books
https://www.newyorker.com/newsletters
https://www.nngroup.com/articles/subscribe/
https://www.productmanagerhq.com
https://www.reddit.com/user/gwern/submitted/
Because that has been my experience?
> I start my day with my RSS reader and the only site I follow that doesn't really support RSS is HN.
Awesome, happy for you. I wish that was the case here. For most of my news sources (which aren't tech) no RSS feed exists. Same for a number of newsletters I'm interested in. They exist in plain HTML format but there's no RSS feed to speak of, not even of the archive.
However, I've recently ran into RSS-Bridge[1] which I'm hoping means that I'll be able to generate RSS feeds out of some stuff and get back to consuming most of my information that way.
Definitely. If it operated in a Manner similar to Mastodon then FB would be a lot more tempting to use for the limited purposes I feel I need access. All I would like to use it for is to get an RSS feed of news from various clubs and to be able to reply to such posts (e.g. to confirm that I'll attend an event they've advertised). Unfortunately, FB disabled the RSS feed some time ago and to use rss-bridge (https://github.com/RSS-Bridge/rss-bridge) requires configuring proxies or trying to solve captchas. Even browsing the public page for an event will shove login boxes or random captchas in my face, and the more it is rammed down my throat the more I wish to avoid it.