Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads

z777

Lurker
Apr 18, 2023
2
4
78
0fya082315al84db03fa9bf467e3.png
Might wanna fix the --max-concurrent-downloads-per-domain (max_* actually) cli argument(s):

When applied as mentioned in the docs (--max-concurrent-downloads-per-domain), it's not recognized as a valid argument:

cyberdrop-dl: error: unrecognized arguments: --max-concurrent-downloads-per-domain

Running cyberdrop-dl -h lists --max_concurrent-downloads-per-domain (with underscore between max and concurrent) which works fine.
 

ramos77

Casual
Sep 18, 2022
8
30
135
0fya082315al84db03fa9bf467e3.png
i have a problem now, the program doesnt even start, i open the bat file and then it does its thing and just stops at the

F:\Cyberdrop_DL.V4>cyberdrop-dl

F:\Cyberdrop_DL.V4>pause
Press any key to continue . . .

i press enter and nothing.
 

ramos77

Casual
Sep 18, 2022
8
30
135
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
F:\Cyberdrop_DL.V4>pip install --upgrade cyberdrop-dl
Requirement already satisfied: cyberdrop-dl in c:\users\user\appdata\local\programs\python\python37\lib\site-packages (4.2.52)
Collecting cyberdrop-dl
Downloading cyberdrop_dl-4.2.53-py3-none-any.whl (88 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.8/88.8 kB 5.2 MB/s eta 0:00:00
Requirement already satisfied: aiofiles>=23.1.0 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from cyberdrop-dl) (23.1.0)
Requirement already satisfied: aiohttp>=3.8.4 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from cyberdrop-dl) (3.8.4)
Requirement already satisfied: aiolimiter>=1.1.0 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from cyberdrop-dl) (1.1.0)
Requirement already satisfied: beautifulsoup4>=4.12.2 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from cyberdrop-dl) (4.12.2)
Requirement already satisfied: certifi>=2023.5.7 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from cyberdrop-dl) (2023.5.7)
Requirement already satisfied: myjdapi>=1.1.6 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from cyberdrop-dl) (1.1.6)
Requirement already satisfied: PyYAML>=6.0 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from cyberdrop-dl) (6.0)
Requirement already satisfied: rich>=13.3.5 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from cyberdrop-dl) (13.3.5)
Requirement already satisfied: setuptools>=67.8.0 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from cyberdrop-dl) (67.8.0)
Requirement already satisfied: tqdm>=4.65.0 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from cyberdrop-dl) (4.65.0)
Requirement already satisfied: yarl>=1.9.2 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from cyberdrop-dl) (1.9.2)
Requirement already satisfied: attrs>=17.3.0 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from aiohttp>=3.8.4->cyberdrop-dl) (23.1.0)
Requirement already satisfied: charset-normalizer<4.0,>=2.0 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from aiohttp>=3.8.4->cyberdrop-dl) (3.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from aiohttp>=3.8.4->cyberdrop-dl) (6.0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from aiohttp>=3.8.4->cyberdrop-dl) (4.0.2)
Requirement already satisfied: frozenlist>=1.1.1 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from aiohttp>=3.8.4->cyberdrop-dl) (1.3.3)
Requirement already satisfied: aiosignal>=1.1.2 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from aiohttp>=3.8.4->cyberdrop-dl) (1.3.1)
Requirement already satisfied: asynctest==0.13.0 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from aiohttp>=3.8.4->cyberdrop-dl) (0.13.0)
Requirement already satisfied: typing-extensions>=3.7.4 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from aiohttp>=3.8.4->cyberdrop-dl) (4.6.2)
Requirement already satisfied: importlib_metadata<5.0,>=1.3 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from aiolimiter>=1.1.0->cyberdrop-dl) (4.13.0)
Requirement already satisfied: soupsieve>1.2 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from beautifulsoup4>=4.12.2->cyberdrop-dl) (2.4.1)
Requirement already satisfied: requests in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from myjdapi>=1.1.6->cyberdrop-dl) (2.31.0)
Requirement already satisfied: pycryptodome in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from myjdapi>=1.1.6->cyberdrop-dl) (3.18.0)
Requirement already satisfied: markdown-it-py<3.0.0,>=2.2.0 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from rich>=13.3.5->cyberdrop-dl) (2.2.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from rich>=13.3.5->cyberdrop-dl) (2.15.1)
Requirement already satisfied: colorama in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from tqdm>=4.65.0->cyberdrop-dl) (0.4.6)
Requirement already satisfied: idna>=2.0 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from yarl>=1.9.2->cyberdrop-dl) (3.4)
Requirement already satisfied: zipp>=0.5 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from importlib_metadata<5.0,>=1.3->aiolimiter>=1.1.0->cyberdrop-dl) (3.15.0)
Requirement already satisfied: mdurl~=0.1 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from markdown-it-py<3.0.0,>=2.2.0->rich>=13.3.5->cyberdrop-dl) (0.1.2)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\andre\appdata\local\programs\python\python37\lib\site-packages (from requests->myjdapi>=1.1.6->cyberdrop-dl) (2.0.2)
Installing collected packages: cyberdrop-dl
Attempting uninstall: cyberdrop-dl
Found existing installation: cyberdrop-dl 4.2.52
Uninstalling cyberdrop-dl-4.2.52:
Successfully uninstalled cyberdrop-dl-4.2.52
Successfully installed cyberdrop-dl-4.2.53

F:\Cyberdrop_DL.V4>cyberdrop-dl

F:\Cyberdrop_DL.V4>pause
Press any key to continue . . .


thats all!
 

shimonx

Lurker
Feb 22, 2023
6
13
78
0fya082315al84db03fa9bf467e3.png
to com problema, o meu de um tempo pra ca só fica nisso

C:\Users\Desktop\ados>pip install --upgrade cyberdrop-dl
'pip' não é reconhecido como um comando interno
ou externo, um programa operável ou um arquivo em lotes.

C:\Users\Desktop\ados>cyberdrop-dl
'cyberdrop-dl' não é reconhecido como um comando interno
ou externo, um programa operável ou um arquivo em lotes.

C:\Users\Desktop\ados>pause
Pressione qualquer tecla para continuar. . .
 

Jules--Winnfield

Cyberdrop-DL Creator
Mar 11, 2022
2,152
5,062
1,127
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
Due to ratelimiting, coomer takes a long time to scrape. After you have scraped a profile from coomer though, CDL caches all the results it gets, and is a *lot* faster on subsequent runs for that profile. Either to get new posts or because it's part of a forum link you are scraping. Just let it work is my advice.
 

Jules--Winnfield

Cyberdrop-DL Creator
Mar 11, 2022
2,152
5,062
1,127
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
I'll have to look into the SC error. As for the *Blacklisted site* error, only way I'd be able to fix that is by having a screen grab of the inspect element for the title when you open the link.

As a reminder, if either site is blocked in your country and you aren't able to regularly access it, CDL won't work for them without a computer wide vpn (some may not work).
 

Overt_Ninja

Bathwater Drinker
Mar 13, 2022
23
1,410
1,234
0fya082315al84db03fa9bf467e3.png
For some reason when I use the start windows.bat I keep getting an invalid links error as if it can't read the URLs text file, but if I do cyberdrop-dl in command prompt with the link manually it works.