What does HackerNews think of magnetissimo?
Web application that indexes all popular torrent sites, and saves it to the local database.
[1] https://github.com/sergiotapia/magnetissimo
implemented using Elixir and Phoenix. Cool little project
There are a few core contributors to the project now and a Discord server as well and everything in this article rings true to me.
It becomes an obligation of sorts and you definitely feel like you're letting people down, especially when it comes to people who have taken the time to contribute and share feedback, let alone people who actually open PRs.
What I think can help is having more core contributors with write permissions, share the load. Or be up front in your readme and say, "I only check this once a quarter".
This does not include the descriptions though.
Also check out https://github.com/sergiotapia/magnetissimo
Checkout some of the issue I have in my repo: https://github.com/sergiotapia/magnetissimo
They are valuable insight into the problems people have, and if I asked them to open a PR for every problem I would most likely have 1 or 2 at most issues open. Everybody loses.
https://github.com/sergiotapia/magnetissimo
There's something really sad when these sites die, a part of my teenage life is gone for good. I felt the same way when Demonoid shut down.
Can these sites skate the legality line by offering only magnet links? Why are their costs so high if they can just host magnet links and cache the site with Varnish or something similar?
It's easy to build a crawler, the hard part is spending time on bullshit like DMCA takedowns and such. Even if you say: "I just crawl, I don't provide download links, I don't even know what is indexed", you have to deal with legal issues.
So, host your own locally or for your community. No big deal.
Even Google has to deal with DMCA!
Elixir's OTP was a fantastic fit, I scrape stuff really quickly with minimal orchestration code. There are bugs here and there, and I haven't had time to circle back and patch a lot of the issues I noticed, but it "works".
I'm proud of it because it broke the 200 star barrier on my Github profile. With Elixir to boot! I love this language.
Elixir was paramount for this project's simplicity. I leveraged GenServer and the BEAM VM to effortlessly created different crawl queues that utilize all the cpu's cores to maximize throughput. It's really really fast.
The idea is that anyone can clone the project, run it, and get upwards of 400+ torrents indexed per second immediately. Your own personal kickasstorrents. Or host one for your friends and family.
Would love to add a logo to the project.
- Screenshot: http://i.imgur.com/B9OFxTx.png
- Github: https://github.com/sergiotapia/magnetissimo
- License: MIT