Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads
- Thread starter Jules--Winnfield
- Start date
Any idea what's coming on with coomer.party? I keep getting errors. Thanks for this useful software btw it's so appreciated
Coomer has a rate limit I haven't been able to exactly pinpoint. Give it a few hours/day then try again.
Is there a way to download Saint.to videos that are embedded on a post without having to use the script?
I don't know what wrong here but It keep saying "No Link" with gofiles.io even though I already put the link in URL.txt. Strangely, It doesn't write any download log.
P/S: Fixed it, been running it as administrator that cause problem. Don't know why that cause problem, excuse me, I'm not a "code guy", so I just double click for it to run and it work.
P/S: Fixed it, been running it as administrator that cause problem. Don't know why that cause problem, excuse me, I'm not a "code guy", so I just double click for it to run and it work.
Last edited:
You're better to ask in the support section. But just right click it. Might have to inspect element and find the link, no idea.
I have a new update coming soon. Just testing quick.
I know you are working on an update and appreciate all the work you are putting into this for everyone.
But would changing the links we have in our URL text file from their .com address to the new .to address pick up where the massdownloader left off based on the downloader history or would it start re-downloading everything.
Edit: Just attempted an address with the change to .to and it failed. Ignore my ignorance.
But would changing the links we have in our URL text file from their .com address to the new .to address pick up where the massdownloader left off based on the downloader history or would it start re-downloading everything.
Edit: Just attempted an address with the change to .to and it failed. Ignore my ignorance.
For the history, it should pick everything up fine. I need to flip the switch for the .to domain though. I've made some large changes and I don't want to push out a broken mess if I can help it.
I've pushed the update, let me know if anything is broken.
I've changed the selection for skipping certain hosts
instead of
There is a --ratelimit argument, this will throttle the scraping speed (which should be quicker now!). The throttle is in requests/s, the default is 50/s allowed.
There's a --throttle argument, this will throttle requests made during downloading, it's the delay between each request to each domain. default is 0.5s (cyberfile and bunkr remain at 1s default) between requests.
I've changed the selection for skipping certain hosts
instead of
--skip-cyberdrop --skip-jpgchurch it'd now be --skip cyberdrop jpgchurchThere is a --ratelimit argument, this will throttle the scraping speed (which should be quicker now!). The throttle is in requests/s, the default is 50/s allowed.
There's a --throttle argument, this will throttle requests made during downloading, it's the delay between each request to each domain. default is 0.5s (cyberfile and bunkr remain at 1s default) between requests.
The ssl errors are probably valid, as I'm pretty sure the certificates are now purely for .to, not .com (haven't verified, just a guess). Did you try multiple times with the .to links?
Edit: NVM, it does seem like one of those links you are using it causing it to hang. let me try and figure it out
Last edited:
neoliberal Pushing 2.30.2
I had a process limiter on scraping, active sessions = number of threads. What you ran into was having more SimpCity links than number of threads available, so the SimpCity links occupied all threads, not allowing anything else to be scraped (bunkr, cyberdrop, etc).
I've changed it and taken out the limiter and instead added a few in other places.
With this new version (2.30>) scraping should be a lot faster as I'm not limiting things to one session, so multiple links can be scraped at the same time.
I had a process limiter on scraping, active sessions = number of threads. What you ran into was having more SimpCity links than number of threads available, so the SimpCity links occupied all threads, not allowing anything else to be scraped (bunkr, cyberdrop, etc).
I've changed it and taken out the limiter and instead added a few in other places.
With this new version (2.30>) scraping should be a lot faster as I'm not limiting things to one session, so multiple links can be scraped at the same time.
Thanks for the quick update!
People who are using Linux can use the following command to 'fix' their URLs.txt file
also Jules--Winnfield you need to update your sig, it still uses the old domain :)
Thanks for all you do! Make sure to update the link in your signature to the new .to domain.
I updated to 2.30.2 and am getting the following error:
I keep forgetting that dictionary type hinting isn't valid below 3.9...
I'll fix it.