What does HackerNews think of rss-bridge?

The RSS feed for websites missing it

Language: PHP

#1 in PHP
There's also RSS-Bridge: https://github.com/RSS-Bridge/rss-bridge

"The RSS feed for websites missing it"

That is cool for a local feed. Have you tried it on a server?

I am able to get a lot of generally unavailable feeds using https://github.com/RSS-Bridge/rss-bridge running on my server. Perhaps this code could be someday brought in as a catch-all last resort.

Lots of X-to-RSS has popped up in recent years, and a good portion of websites still support it under the hood.

KilltheNewsletter[0] is a great email-to-RSS generator, for instance. And RSSBridge[1] has all sorts of x-to-RSS bridges available. There’s even a website[2] that allows you to turn public Telegram channels into RSS feeds.

[0] - https://kill-the-newsletter.com/

[1] - https://github.com/RSS-Bridge/rss-bridge

[2] - https://tg.i-c-a.su/

I am, using rss-bridge (https://github.com/RSS-Bridge/rss-bridge) to access feeds on other services (mostly twitter).
If you go the self-hosted route you can also put RSS-Bridge on the same host to locally generate RSS feeds for a lot of sources that don't have RSS like Twitter https://github.com/RSS-Bridge/rss-bridge
Looks nice! You might be interested in related tools to build off of, like rss-bridge: https://github.com/RSS-Bridge/rss-bridge/
That's something I did implement in Pipes, but the API limit and API changes made it hard and I basically can't guarantee that it works. https://github.com/RSS-Bridge/rss-bridge is an alternative you might like.
RSS feeds have become my one and only way to consume the web and subscribe to people, websites and various things on the web.

Tiny Tiny RSS[0] is an addictive RSS reader with tons of options to sort, manipulate, filter in/out, etc. RSS entries. Feed Preview[1] is a must-have Firefox add-on for finding available feeds on websites (and previewing them).

All alternative front-ends to YouTube, Twitter, Instagram, etc. provide feeds to subscribe to people like Invidious[2], nitter[3], Bibliogram[4], etc. (large list of alternative front-ends here [5]).

Fortunately, Github and Reddit, still natively support RSS feeds.

As others have mentioned, WordPress-based websites natively include RSS feeds for the whole website, by category, for comments of a particular post, etc. This is much better than crappy newsletters.

Regarding newsletters, when it's the only option, I use Mailnesia[6] to turn an inbox into an RSS feed.

Speaking of bridges, RSS-Bridge[7] makes feeds available to hundreds of websites through community plugins.

Feed43 [8] is also a great tool to force an ordinary page to be available as an RSS feed.

SearX [9], a metasearch engine, turns into a very powerful tool to watch for something on the whole web with advanced search functions and results available as RSS feeds. This is better than many dedicated tools, imo.

Anyway, I don't think RSS feeds are missing or even dying. But they are definitely a relic of the good old days, when Aaron Swartz was around, and unfortunately reserved for people who are looking for them or are curious enough to dive into that world.

One thing is for sure though: if they disappear, I'm out.

[0] https://tt-rss.org

[1] https://code.guido-berhoerster.org/addons/firefox-addons/fee...

[2] https://invidious.io

[3] https://github.com/zedeus/nitter

[4] https://sr.ht/~cadence/bibliogram/

[5] https://github.com/mendel5/alternative-front-ends

[6] https://mailnesia.com

[7] https://github.com/RSS-Bridge/rss-bridge

[8] https://feed43.com

[9] https://searx.space

I've the same issue with some local news webpages and government sites, but I've been using PolitePol[1] to generate the feeds; they're not great but get the job done. Right now I'm looking for projects like RSSHub[2] or RSS Bridge[3] to have a similar service but self-hosted and without the restrictions of the free tier of PolitePol.

I think in the future RSS will be a community driven effort, not something that the website themselves care to implement.

[1] - https://politepol.com/en/ [2] - https://github.com/DIYgod/RSSHub [3] - https://github.com/RSS-Bridge/rss-bridge

As a big fan of RSS (I read HN through hnrss[0]), this is wonderful. It seems to be a nice catch-all for whatever websites rss-bridge doesn't support.

If any of you are looking into RSS, check out FreshRSS[2] (an RSS aggregator). A mobile client I especially like is NetNewsWire[3] (for Apple products only, but is imo amazing)

[0] https://hnrss.github.io/

[1] https://github.com/RSS-Bridge/rss-bridge

[2] https://www.freshrss.org/

[3] https://netnewswire.com/

https://github.com/RSS-Bridge/rss-bridge

Not possible as long as the pages are not walled behind a login.

For Twitter I use this Bridge to get RSS

https://github.com/RSS-Bridge/rss-bridge

Just saw, it works also with other websites like youtube. But I have never tried this.

For websites without an RSS feed, you can try to generate one using self-hosting RSS Bridge[1]. There are some instances with open access, though supposedly some may work more reliably than others.

[1]: https://github.com/RSS-Bridge/rss-bridge

Thank you, will try it out.

Two things I am using:

Twitter to RSS: https://github.com/RSS-Bridge/rss-bridge

Arbitrary RSS feeds: https://feedity.com

Nice tool! A related one that is helpful for getting RSS feeds from websites (with e.g. full article content) is rss-bridge: https://github.com/RSS-Bridge/rss-bridge
Not exactly what you are looking for, but probably the core HTML-->RSS is in rss-bridge: https://github.com/RSS-Bridge/rss-bridge
Check out rss-bridge

I used to have direct feeds from my YouTube subscriptions, but they either killed or moved that feature. This runs on the same $5 vm as my RSS feed reader and works great.

https://github.com/RSS-Bridge/rss-bridge

And fortunately, RSS never really went away.

Yeah, there's some sites that have killed their RSS feeds, and feeds can be tough to find (though there's browser extensions that fix that issue), but most major news organizations, blogging platforms, etc, support RSS. And for those that don't (including Twitter, Instagram, Github, etc), RSS Bridge can often fill the gap:

https://github.com/RSS-Bridge/rss-bridge

In short: RSS is my frontend to the web, and it's fantastic!

Not just that, there is an awesome project to scrape webpages that do not feature RSS: https://github.com/RSS-Bridge/rss-bridge

You can replace most of your social media feeds. I'm compiling a list of URLs you can use to replace existing services with RSS: https://gist.github.com/thefranke/63853a6f8c499dc97bc17838f6...

There are other opensource alternatives you might be interested in too [0], [1] and [2]. For rss-proxy you do not have to deal with selectors, though the feed quality won't be as good as the one OP suggests.

[0] https://github.com/damoeb/rss-proxy/

[1] https://github.com/RSS-Bridge/rss-bridge

[2] https://github.com/DIYgod/RSSHub

Please amend the documentation and compare your software against the established participants in this field.

https://github.com/RSS-Bridge/rss-bridge

https://github.com/DIYgod/RSSHub

I don't have a facebook account myself but follow some people's publications using rssbridge (https://github.com/RSS-Bridge/rss-bridge).

I would indeed prefer that facebook provides those feeds themselves as it sometimes break because Facebook changes things (the latest breakage I encountered being Facebook replying with "You must be logged in to view this page").

Big fan of RSS since back at least to the Google Reader days. I realized I was just checking the same websites over and over and decided to streamline the process. (That ended up in building up a backlog of entries in a feed and scrambling before whatever was about to expire, but that's another story).

After that shutdown I was on Feedly for a while, and now moved to self hosting miniflux [0] which I'm quite happy with. Haven't found the perfect Android app, but the miniflux web view (minimal, but effective) is growing on me. I also self-host rss-bridge [1] to wrangle some less ideal feeds (you can grab whole content, format as you like, etc.)

[0] https://miniflux.app/

[1] https://github.com/RSS-Bridge/rss-bridge

I agree. An RSS-based social network is a network that you fully own. Unfortunately the subscription experience lacks of some aspects, e.g. engagement with other users/author is much harder. We should implement some tools to overcome this. For all the sites that lack of feed support use gap fillers [0], [1] and others.

[0] https://github.com/RSS-Bridge/rss-bridge [1] https://github.com/damoeb/rss-proxy

There is RSS-Bridge which is doing exactly that: A plugin per website, common libraries.

A pragmatic approach. Trying to build a generalized framework handling each and every edge case promises endless complexity.

https://github.com/RSS-Bridge/rss-bridge

There's an open source service that does something similar, does anyone remember its name?

edit: Both rssbox in the OP, and RSS-bridge[1] are open source. I was thinking of the latter. There's also RSSHub[2].

[1] https://github.com/RSS-Bridge/rss-bridge

[2] https://github.com/DIYgod/RSSHub

https://github.com/RSS-Bridge/rss-bridge provides this and works for me. It sometimes throws an error but recovers after that.
In the same vein : RSS-Bridge

https://github.com/RSS-Bridge/rss-bridge

(you can find multiple instances on the web)

To extend that a bit, using something like RSS-Bridge[0] you can turn a Twitter feed into an RSS feed.

[0] https://github.com/RSS-Bridge/rss-bridge

I've been using RSS Bridge[1]. Let's you funnel other things into an RSS feed. One of my use cases is in fact following comics on Instagram from creators who don't upload anywhere else

[1]https://github.com/RSS-Bridge/rss-bridge

Building a list of RSS feeds takes time. I find that when I stumble across a new site (regardless of how I got there), I poke around to see if the content is interesting. If so, I seek out an RSS feed for it.

Note there are ways to get an RSS feed from some sites without them (RSS-Bridge[0] is what I use), but the experience is much better if the site natively produces one.

In time, you'll find yourself with hundreds of feeds on a variety of topics.

[0] https://github.com/RSS-Bridge/rss-bridge

You can also use RSS-Bridge[1], which covers GitHub Feeds, and lot more sites. My instance[0] has the GitHub bridges enabled, and I subscribe to a few issues on our Slack channels this way.

[1]: https://github.com/RSS-Bridge/rss-bridge [0]: https://rss-bridge.bb8.fun/

I like your static-file approach though. Never thought of pre-generating RSS-feeds that way.

Yes. I don't understand how else I'm supposed to receive content without constantly rechecking everything and having to remember where I stopped previously.

What is more, I've got bunch of scripts that do keyword search for topics that interest me on Reddit/Hackernews/GitHub/pinboard and generate private RSS feeds. That way I can quickly skim through them once in a while and stay up to date without having to do manual searches.

P.S. if the website doesn't support RSS, you can still use one of feed generators that basically scrape the website now and then and generate the feed. I've used http://fetchrss.com so far, there are also some open source/selfhosted alternatives like https://github.com/RSS-Bridge/rss-bridge

Instead of sending your Twitter followers to a random cloud service (and getting it rate-limited), run your own RSS-Bridge to generate RSS from sites that don't have them, like Twitter, Facebook, Instagram. If you use it yourself and some friends, rate limiting is not a problem.

https://github.com/RSS-Bridge/rss-bridge/

For HN, you can run that very same codebase from https://hnrss.org: https://github.com/edavis/go-hnrss

If you are interested in RSS, I did a twitter-thread [3] recently on interesting projects in the space. Reproducing here: If you are interested in helping revive #RSS, a thread on some good FOSS projects around RSS:

1. RSS-Bridge[0] - RSS Feeds for websites that don't give you one. Supports instagram/facebook/Google Search and many more (150+) websites. Very easy to contribute, and there are open requests for lots of providers. (I added a Amazon Price Tracker Bridge in <150 loc). Yes, I get a RSS notification when there is a price change on something I follow[1].

2. MiniFlux - Golang+Postgres based self-hosted RSS feed reader. Minimal/responsive design with keyboard shortcuts https://miniflux.app

3. 3. tt-rss - A highly configurable PHP based RSS feed reader. Supports plugins and has tons of options. UI is similar to Google Reader. https://tt-rss.org

4. Winds - A Beautiful Open Source RSS & Podcast App powered by @getstream_io. I haven't tried self-hosting it yet, but it looks really great. Also, under very active development. https://github.com/GetStream/Winds

5. FreshRSS - Lightweight PHP/SQlite self-hosted feed reader. Looks great as well. https://freshrss.org

6. Kill the Newsletter - Subscribe to a newsletter with a one-time generated email address, it generates a RSS feed for you. Your inbox stays clean. https://www.kill-the-newsletter.com

7. OPML Generator - Generates OPML Files using subscriptions on other sites. Supports GitHub stars (generates a file you can import to follow releases from all your starred repos on GitHub) https://opml.bb8.fun/ (Personal project, so count this as a shameless self plug)

8. RSS never really died, so revival is a misnomer in that sense. All major news publications still support RSS. The entire Podcast ecosytem works on RSS. You should also look at WebSub and ActivityPub (both W3C recommendations) if you're interested in this.

9. And finally a cool new idea - build a Telegram Channel to RSS Feed generator. Will open up so much hidden content to the open web.

10. Bonus: https://www.youneedfeeds.com/ Info site that you should share with your friends to help them get started with RSS.

[0]: https://github.com/RSS-Bridge/rss-bridge

[1]: https://github.com/RSS-Bridge/rss-bridge/pull/741

[3]: https://twitter.com/captn3m0/status/1018850458675408902

Why not use rss-bridge[1] to make a rss feed for you twitter needs ? There are several public instances that allow you to do exactly that.

[1]:https://github.com/RSS-Bridge/rss-bridge

True dat!

For me, RSS is by far (still) the best way to access web content.

I've tried some self hosted RSS readers over the years but I've stayed with FreshRSS[1] for the last year. It has been a marvelous experience. Zero trouble, zero administrative burden. Self-hosted bliss. Best of all is the fact that it uses a flat file DB so it can easily be backed up, moved around and migrated. Can not recommend it enough. Also, it's PHP, so works on any cheap shared hosting. That's how I use it.

One of the best things about it is escaping the algorithmically curated feeds.

Every site and service that I wish to follow has an RSS feed, except for Twitter. I use RSS-Bridge[2] (self hosted too) to follow users. RSS-Bridge[2] will give you feeds for just about every service you can think of.

If you don't find a feed for a site, sometimes you just have to dig a little. You learn at which URIs the most commons CMSes presents their Atom/RSS feeds (hello /feed/).

[1] https://freshrss.org/

[2] https://github.com/RSS-Bridge/rss-bridge

For me, RSS is by far the best way to access web content.

I've tried some self hosted RSS readers over the years but I've stayed with FreshRSS[1] for the last year. It has been a marvelous experience. Zero trouble, zero administrative burden. Self-hosted bliss. Best of all is the fact that it uses a flat file DB so it can easily be backed up, moved around and migrated. Can not recommend it enough. Also, it's PHP, so works on any cheap shared hosting. That's how I use it.

One of the best things about it is escaping the algorithmically curated feeds.

Every and service that I use has an RSS feed, except for Twitter. I use RSS-Bridge[2] (self hosted too) to follow users. RSS-Bridge[2] will give you feeds for just about every service you can think of.

If you don't find a feed for a site, sometimes you just have to dig a little. You learn at which URIs the most commons CMSes presents their Atom/RSS feeds (hello /feed/).

[1] https://freshrss.org/

[2] https://github.com/RSS-Bridge/rss-bridge

Some other people had mentioned some services available but I'd like to add self-hosted options https://github.com/RSS-Bridge/rss-bridge and https://github.com/taroved/pol into the mix.

I use rss-bridge in combination with rss2email to follow instagram feeds after leaving instagram.

A personal story:

I went a few years without Google Analytics, and I was proud of the fact that my weblog had no tracking software. I kept thinking I would write a script to track the audience myself. But I was busy and never got around to it. So in the autumn I decided, okay, I'll use Google Analytics for a few months, till I can write my own code.

I'd written my own system for tracking my weblog, back in the era of 2005-2009, before I used WordPress (back when I only used my own code for websites).

Looking at the Google Analytics results nowadays is heartbreaking for someone like me, who remembers the independent blogosphere of 12 years ago. Because it is gone. Utterly gone.

Back then my traffic tended to come from dozens of independent bloggers who noticed when I occasionally said something smart. The blogosphere was a world of individual voices. There were big group blogs, such as Crooked Timber, but even those consisted of individuals and it was easy to figure out who had admired something I wrote. It was a world where you had some sense of who was reading you, and what they thought about you, and they could see when you read them in return.

That world died in the era 2006-2010 as Twitter and Facebook gained influence.

Nowadays, Google Analytics shows I get traffic from sites that aggregate audiences. Overwhelmingly, that's Facebook and Twitter. The traffic is very sporadic, full of big spikes of anonymous readers. A few times a year I'll write something that gets on the front page of Hacker News, and then I'll get from Hacker News anywhere from 4,000 to 40,000 visits over two or three days. Which is great, but also sporadic.

What I miss is the ability to follow those who are reading me, and more so, their awareness, in response, that I am reading them in return. The dynamic of "You read me so I read you and you see that I read you" is alive and well on specific sites, such as Twitter, but I miss it being part of the general Internet experience. I do realize I can use something like https://github.com/RSS-Bridge/rss-bridge to treat social media as a series of RSS feeds, and I am planning on doing that, but that still misses the element of them seeing that I am reading them.

I've been thinking about some way to try to balance people's preference for walled-gardens with this kind of open back and forth conversation. I might work on this more seriously later in the year.

If anyone is interested in a bit of history, way back in 2006 I wrote what was widely considered the most definitive summary of the fighting that had taken place among those interested in developing RSS. All of this was made irrelevant by the rise of Twitter, but in 2006, this still seemed like a very important topic for the Web industry:

"RSS has been damaged by in-fighting among those who advocate for it"

http://www.smashcompany.com/technology/rss-has-been-damaged-...

You can 'easily' generate a RSS stream out of Facebook and Twitter (and many other sources), e.g. w/RSS Bridge (https://github.com/RSS-Bridge/rss-bridge).
There's also https://github.com/RSS-Bridge/rss-bridge. It's self-hosted and has many many bridges for different sites that don't do RSS.
Just the links from comments:

http://hndigest.com/

http://ambassadors.thehustle.co/

http://androidweekly.net/

http://ben-evans.com/newsletter

http://delanceyplace.com/

http://eepurl.com/cE6e9H

http://fair.org/

http://fermatslibrary.com/

http://flowingdata.com/

http://fortune.com/tag/term-sheet/

http://freshpatents.com

http://frontendfocus.co/

http://growthhackingidea.com/

http://hackaday.com

http://hackernewsbooks.com/

http://hackerpixels.com/

http://jack-clark.net/import-ai

http://javascriptweekly.com/

http://kottke.org/

http://lererhippeau.com/

http://llvmweekly.org/

http://pablojuan.com/subscribe

http://postgresweekly.com/

http://pruthvishetty.com/bookmark

http://pycoders.com/

http://scalatimes.com/

http://softwareleadweekly.com/

http://subscribe.machinelearnings.co/

http://tedium.co

http://webopsweekly.com/

http://weekly.monitoring.love/

http://www.craftinginterpreters.com/

http://www.devopsweekly.com/

http://www.finsmes.com

http://www.hackernewsletter.com

http://www.juliezhuo.com/design/mailinglist.html

http://www.metzdowd.com/mailman/listinfo/

http://www.oppsdaily.com/

http://www.pointer.io

http://www.pythonweekly.com/

http://www.quantumweekly.com

http://www.thejournal.email/

https://2read.today

https://a16z.com/

https://beta.hndigest.com

https://blog.acolyer.org

https://californiasunday.com

https://changelog.com/weekly

https://club.macstories.net

https://cooperpress.com/publications/

https://csharpdigest.net/

https://ctomentor.network/

https://dadario.com.br

https://danielmiessler.com/podcast/

https://dbader.org/

https://dbader.org/python-tricks

https://DevOpsish.com

https://elixirdigest.net/

https://feedly.com/

https://github.com/Daviey/awesome-mailinglists

https://github.com/explore/subscribe

https://github.com/kilimchoi/engineering-blogs/blob/master/e...

https://github.com/plainflow/plainflow-digested-week/

https://github.com/RSS-Bridge/rss-bridge

https://inside.com/

https://inside.com/readthisthing

https://iosdevweekly.com/

https://labnotes.org/

https://lastweekinaws.com/

https://lists.eff.org/mailman/listinfo/crypto-ops

https://lists.randombit.net/mailman/listinfo/cryptography

https://mailman.srv.cs.cmu.edu/mailman/listinfo/connectionis...

https://mattermark.com/newsletters/

https://nytimes.com/newsletters/morning-briefing

https://porter.io/

https://programmingdigest.net/

https://react.statuscode.com/

https://reactdigest.net/

https://reddit.cool/

https://scout.wisc.edu/about

https://softwareclown.com

https://sreweekly.com/

https://staceyoniot.com/

https://startupresources.io/

https://stratechery.com

https://tedium.co

https://thebrowser.com

https://thebrowser.com/try-the-browser

https://thehackernews.com/

https://thesizzle.com.au

https://tinyletter.com/getputpost

https://tinyletter.com/levthedev

https://umaar.com/dev-tips/

https://www.androiddevdigest.com/

https://www.bloomberg.com/view/topics/money-stuff

https://www.cronweekly.com

https://www.datascienceweekly.org

https://www.feistyduck.com/bulletproof-tls-newsletter/

https://www.getrevue.co/

https://www.google.com/alerts

https://www.indiehackers.com/businesses/hacker-news-books

https://www.launchticker.com/

https://www.newyorker.com/newsletters

https://www.nngroup.com/articles/subscribe/

https://www.productmanagerhq.com

https://www.reddit.com/user/gwern/submitted/

https://www.schneier.com/crypto-gram/

https://www.vikingcodeschool.com/weekly-code-review

> Why do you say this?

Because that has been my experience?

> I start my day with my RSS reader and the only site I follow that doesn't really support RSS is HN.

Awesome, happy for you. I wish that was the case here. For most of my news sources (which aren't tech) no RSS feed exists. Same for a number of newsletters I'm interested in. They exist in plain HTML format but there's no RSS feed to speak of, not even of the archive.

However, I've recently ran into RSS-Bridge[1] which I'm hoping means that I'll be able to generate RSS feeds out of some stuff and get back to consuming most of my information that way.

[1]: https://github.com/RSS-Bridge/rss-bridge

> If it was more like email that isn't owned by any one entity I would be more understanding.

Definitely. If it operated in a Manner similar to Mastodon then FB would be a lot more tempting to use for the limited purposes I feel I need access. All I would like to use it for is to get an RSS feed of news from various clubs and to be able to reply to such posts (e.g. to confirm that I'll attend an event they've advertised). Unfortunately, FB disabled the RSS feed some time ago and to use rss-bridge (https://github.com/RSS-Bridge/rss-bridge) requires configuring proxies or trying to solve captchas. Even browsing the public page for an event will shove login boxes or random captchas in my face, and the more it is rammed down my throat the more I wish to avoid it.