Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads

[dunkin89]

For some reason certain posts aren't able to be scraped with the "scrape single forum post" option
These 2 scrapes are from the same thread with the same settings, not sure why one didn't work

Successful scrape:

Please, Log in or Register to view codes content!

Unsuccessful scrape

Please, Log in or Register to view codes content!

 

[AMoussaGuido]

i appreciate the addition of the different types of failures to the latest update. makes it easier to figure out what to try and DL manually.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

I know exactly why, and ain't that annoying. It's due to the opening message on that page from voidream being a newer "post" than the one you have linked.

Can you open a github issue ticket for this? I will get to it, I just need to think on how to approach this, and the github issue will make me remember not to forget about it.

 

[dunkin89]

Please, Log in or Register to view quotes

Done, thanks man

 

[Jules--Winnfield]

In order to fix some things that were broken, I've had to implement a requirement for Python 3.11 for CDL 5.1.2

5.1.2 will bring back the ability to gracefully exit the program with Ctlr + C, and should fix the program pre-emptively finishing, as well as tasks getting "lost"

 

[Systaltic]

btw pip install -U cyberdrop-dl doesn't update to 5.1 for me, just 5.0.123

 

[EightyThree]

Please, Log in or Register to view quotes

Are you running Python 3.11?
python --version

 

[Systaltic]

Please, Log in or Register to view quotes

3.11.6

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

you likely have multiple versions of python installed. I'd double check that if I were you

 

[xoeh]

As jules said, DDOS Guard is out of his control. I find DDoS Guard gets triggered when A) the bunkr link is newly generated (you can test this yourself) and B) when the link has received high volume of requests in the past 48 hours (so if its a popular thread here, that link is now 'hot' and will not 'cool off' for about a week. Also can be combination of A & B.)

So either be patient and run said URLs in a week or manually download unfortunately. Its just the name of the game.

 

[nakednews]

When finishing a queue in v5, i get he following set of (SSL?) errors that cause the script to hang.

Please, Log in or Register to view codes content!

 

[Systaltic]

Please, Log in or Register to view quotes

well it was just the one. but I tried uninstalling and reinstalling python and after that it did work. weird

 

[xoeh]

Please, Log in or Register to view quotes

see quote below

Please, Log in or Register to view quotes

 

[SasukeUchiha49]

Please, Log in or Register to view quotes

What exactly even is DDOS Guard like some kind of fire wall or something from bunkr's end? I'm no programmer so this the first time I've heard of this

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

Essentially? You can think of DDOS-Guard as a bouncer at a club. Do too many things wrong, don't have ID, etc, you get kicked out, or not let through the door at all.

The more people trying to get into the club, the stricter the bouncer will be.

 

[biggusdickus425]

Please, Log in or Register to see links and images

This happens when i try to open the mac file does anyone know how to fix this?

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

open a new terminal window then type:

chmod 755 <drag in the file from finder> then press enter, then try again.

 

[omegarao]

Getting this error message when after uninstalling python 3.10 and installing 3.11.4. Any ideas what could be the issue?

Please, Log in or Register to see links and images

 

[DrArchive04]

Delete the cyberdrop folder and download it again.

Please, Log in or Register to view quotes

 

[omegarao]

Please, Log in or Register to view quotes

That fixed the issue thanks