D
Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads
- Thread starter Jules--Winnfield
- Start date
If you are using the V5 start file, it doesn't install Cyberdrop-DL to the system, it installs it to a virtual environment it makes. You'll need to install it in cmd to run it in cmd.
I tried that but I don't know how to actually insert the location, I tried grabbing and dropping the folder but didn't work 😅 "input is not a file"
Tried using "pip install --upgrade cyberdrop-dl" but still cant run, is this the wrong command?
I'd need to know what happens when you do that, then try to run it. It is the correct command.
I'd like to report that I don't get the DDOS Guard now when scraping Simp City. It must've been just aggressive after the ~8-10 hour outage from the other day in North America. I tried the same 2 links before and I managed to get them to work now midday (mountain time, USA).
Also, hate to bring up a 2 weeks old topic, but did you adjust anything further besides max rate = 1 for Cyberdrop (the website), returning, Jules--Winnfield ? You said you'd look into it (I think it was right before V5 dropped).
I still have tons of 'partial downloads' from mid 2023 that I need to review and see if my current CDL config can fix this situation (its highly unique, I never did any skip history or db configs in the past - only skip_hosts in order to focus on Cyberdrop.to when it was half-obtainable still [before the .me domain was practically unusable for scraping]).
Thanks for all what you do, Jules.
In logs folder there is Download_Error_URLS.csv, Scrape_Error_URLS.csv, and Unsupported_URLs.txt. Can you also add for fail because DDOS guard?
Is it mentioned in a log, or is there a way to get more information on "Skipped By Config # files"? Being able to see what about the config caused those files to be skipped in the last run might be useful.
I haven't used this in a while and I've just updated to v5.
I'm getting a Scrape Failures (DDOS-Guard): 1
is it because I'm on vpn? Is there a way around this?
or did I not update the program properly, maybe?
Thank you for your help, mate!
EDIT: when I use bunkr in the browser it works fine. It's just the downloader that doesn't download things.
I'm getting a Scrape Failures (DDOS-Guard): 1
is it because I'm on vpn? Is there a way around this?
or did I not update the program properly, maybe?
Thank you for your help, mate!
EDIT: when I use bunkr in the browser it works fine. It's just the downloader that doesn't download things.
I rewrote the entire scraper, all of it. But the big change for Cyberdrop (website) specifically is 1 simultaneous download, and a harder limit on requests/s
It's DDOS-Guard, VPN can both help, and hurt depending on which you use, and where you're connecting.
DDOS-Guard is a browser check, and Cyberdrop-DL doesn't use a browser, so it can't pass it.