Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads

yishouhaoshi3dm

Fan
Mar 16, 2022
43
50
85
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
2022-12-02 21:41:44,987:DEBUG:proactor_events:proactor_events.py:626:Using proactor: IocpProactor
2022-12-02 21:41:45,009:DEBUG:base_functions:base_functions.py:60:We are running version 3.6.14 of Cyberdrop Downloader
2022-12-02 21:41:45,009:DEBUG:main:main.py:70:Creating Config
2022-12-02 21:41:45,009:DEBUG:base_functions:base_functions.py:130:Validating Config
2022-12-02 21:41:45,013:DEBUG:base_functions:base_functions.py:60:Getting Run Args
2022-12-02 21:41:45,013:DEBUG:base_functions:base_functions.py:193:Gathering Args
2022-12-02 21:41:45,013:DEBUG:main:main.py:93:Starting Cyberdrop-DL
2022-12-02 21:41:45,013:DEBUG:main:main.py:94:Using authorization arguments: {'simpcity_username': None, 'simpcity_password': '!REDACTED!', '*Blacklisted site*_username': None, '*Blacklisted site*_password': '!REDACTED!', 'xbunker_username': None, 'xbunker_password': '!REDACTED!'}
2022-12-02 21:41:45,013:DEBUG:main:main.py:95:Using file arguments: {'input_file': WindowsPath('URLs.txt'), 'output_folder': WindowsPath('Downloads'), 'output_last_forum_post_file': WindowsPath('URLs_last_post.txt'), 'db_file': WindowsPath('download_history.sqlite')}
2022-12-02 21:41:45,013:DEBUG:main:main.py:96:Using jdownloader arguments: {'jdownloader_enable': False, 'jdownloader_username': None, 'jdownloader_password': '!REDACTED!', 'jdownloader_device': None}
2022-12-02 21:41:45,013:DEBUG:main:main.py:97:Using runtime arguments: {'threads': 0, 'attempts': 10, 'disable_attempt_limit': False, 'connection_timeout': 15, 'ratelimit': 50, 'throttle': 0.5, 'include_id': False, 'exclude_videos': False, 'exclude_images': False, 'exclude_audio': False, 'exclude_other': False, 'ignore_history': False, 'output_last_forum_post': False, 'separate_posts': False, 'mark_downloaded': False, 'proxy': None, 'skip_hosts': []}
2022-12-02 21:41:45,023:DEBUG:base_functions:base_functions.py:60:Starting Scrape
2022-12-02 21:41:45,023:DEBUG:base_functions:base_functions.py:60:Starting scrape of
Please, Log in or Register to see links and images

2022-12-02 21:42:06,097:DEBUG:Erome_Spider:Erome_Spider.py:36:Error encountered while handling
Please, Log in or Register to see links and images

Traceback (most recent call last):
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\site-packages\aiohttp\connector.py", line 980, in _wrap_create_connection
return await self._loop.create_connection(*args, **kwargs) # type: ignore[return-value] # noqa
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\asyncio\base_events.py", line 1064, in create_connection
raise exceptions[0]
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\asyncio\base_events.py", line 1049, in create_connection
sock = await self._connect_sock(
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\asyncio\base_events.py", line 960, in _connect_sock
await self.sock_connect(sock, address)
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\asyncio\proactor_events.py", line 705, in sock_connect
return await self._proactor.connect(sock, address)
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\asyncio\windows_events.py", line 817, in _poll
value = callback(transferred, key, ov)
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\asyncio\windows_events.py", line 604, in finish_connect
ov.getresult()
OSError: [WinError 121] 信号灯超时时间已到

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\site-packages\cyberdrop_dl\crawlers\Erome_Spider.py", line 19, in fetch
soup = await session.get_BS4(url)
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\site-packages\cyberdrop_dl\client\client.py", line 42, in get_BS4
async with self.client_session.get(url, ssl=self.client.ssl_context) as response:
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\site-packages\aiohttp\client.py", line 1141, in __aenter__
self._resp = await self._coro
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\site-packages\aiohttp\client.py", line 536, in _request
conn = await self._connector.connect(
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\site-packages\aiohttp\connector.py", line 540, in connect
proto = await self._create_connection(req, traces, timeout)
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\site-packages\aiohttp\connector.py", line 901, in _create_connection
_, proto = await self._create_direct_connection(req, traces, timeout)
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\site-packages\aiohttp\connector.py", line 1206, in _create_direct_connection
raise last_exc
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\site-packages\aiohttp\connector.py", line 1175, in _create_direct_connection
transp, proto = await self._wrap_create_connection(
File "C:\Users\yishouhaoshi3DM\AppData\Local\Programs\Python\Python310\lib\site-packages\aiohttp\connector.py", line 988, in _wrap_create_connection
raise client_error(req.connection_key, exc) from exc
aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host
Please, Log in or Register to see links and images
ssl:<ssl.SSLContext object at 0x000001A88F717740> [信号灯超时时间已到]
2022-12-02 21:42:06,100:DEBUG:base_functions:base_functions.py:60:Error scraping
Please, Log in or Register to see links and images

2022-12-02 21:42:06,100:DEBUG:Erome_Spider:Erome_Spider.py:38:Cannot connect to host
Please, Log in or Register to see links and images
ssl:<ssl.SSLContext object at 0x000001A88F717740> [信号灯超时时间已到]
2022-12-02 21:42:06,100:DEBUG:base_functions:base_functions.py:60:Finished scrape of
Please, Log in or Register to see links and images

2022-12-02 21:42:06,100:ERROR:main:main.py:119:ValueError No links
2022-12-02 21:42:06,100:DEBUG:base_functions:base_functions.py:60:No links found duing scraping, check passwords or that the urls are accessible
2022-12-02 21:42:06,100:DEBUG:base_functions:base_functions.py:60:This program does not currently support password protected albums.
2022-12-02 21:42:06,101:DEBUG:sql_helper:sql_helper.py:120:Successfully closed sqlite database connection
 

solbadguyvr

Diamond Tier
Mar 11, 2022
14
791
927
0fya082315al84db03fa9bf467e3.png
Having trouble running this for a thread. I think I think I added the right credentials:

2022-12-04 12:31:31,998:DEBUG:selector_events:selector_events.py:54:Using selector: KqueueSelector
2022-12-04 12:31:32,015:DEBUG:base_functions:base_functions.py:60:We are running version 3.6.15 of Cyberdrop Downloader
2022-12-04 12:31:32,016:DEBUG:main:main.py:70:Creating Config
2022-12-04 12:31:32,017:DEBUG:base_functions:base_functions.py:130:Validating Config
2022-12-04 12:31:32,027:DEBUG:base_functions:base_functions.py:60:Getting Run Args
2022-12-04 12:31:32,040:DEBUG:main:main.py:93:Starting Cyberdrop-DL
2022-12-04 12:31:32,040:DEBUG:main:main.py:94:Using authorization arguments: {'simpcity_password': '!REDACTED!', 'simpcity_username': 'MYPASSWORD', '*Blacklisted site*_password': '!REDACTED!', '*Blacklisted site*_username': None, 'xbunker_password': '!REDACTED!', 'xbunker_username': None}
2022-12-04 12:31:32,040:DEBUG:main:main.py:95:Using file arguments: {'db_file': PosixPath('download_history.sqlite'), 'input_file': PosixPath('URLs.txt'), 'output_folder': PosixPath('Downloads'), 'output_last_forum_post_file': PosixPath('URLs_last_post.txt')}
2022-12-04 12:31:32,041:DEBUG:main:main.py:96:Using jdownloader arguments: {'jdownloader_device': None, 'jdownloader_enable': False, 'jdownloader_password': '!REDACTED!', 'jdownloader_username': None}
2022-12-04 12:31:32,041:DEBUG:main:main.py:97:Using runtime arguments: {'attempts': 10, 'connection_timeout': 15, 'disable_attempt_limit': False, 'exclude_audio': False, 'exclude_images': False, 'exclude_other': False, 'exclude_videos': False, 'ignore_history': False, 'include_id': False, 'mark_downloaded': False, 'output_last_forum_post': False, 'proxy': None, 'ratelimit': 50, 'separate_posts': False, 'skip_hosts': [], 'threads': 0, 'throttle': 0.5}
2022-12-04 12:31:32,086:DEBUG:base_functions:base_functions.py:60:Starting Scrape
2022-12-04 12:31:32,088:DEBUG:base_functions:base_functions.py:60:Starting scrape of https://simpcity.su/threads/evelyn-lin.62014/page-3
2022-12-04 12:31:34,767:DEBUG:base_functions:base_functions.py:60:Finished scrape of https://simpcity.su/threads/evelyn-lin.62014/page-3
2022-12-04 12:31:34,768:ERROR:main:main.py:119:ValueError No links
2022-12-04 12:31:34,768:DEBUG:base_functions:base_functions.py:60:No links found duing scraping, check passwords or that the urls are accessible
2022-12-04 12:31:34,768:DEBUG:base_functions:base_functions.py:60:This program does not currently support password protected albums.
2022-12-04 12:31:34,773:DEBUG:sql_helper:sql_helper.py:120:Successfully closed sqlite database connection
 
  • Like
Reactions: maxine

solbadguyvr

Diamond Tier
Mar 11, 2022
14
791
927
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
G2 Esports Facepalm GIF by BLAST



Appreciate your help!
 
  • PeepoLove
Reactions: Jules--Winnfield

tyrant1988

Lurker
Mar 12, 2022
2
1
58
0fya082315al84db03fa9bf467e3.png
Hi,

I have already installed the necessary cyberdrop 3.6.15 version on Python 3.10.8 with pip 22.3.1.

Unable to user 'cyberdrop-dl' command though. not sure why. removed the roaming data as per FAQ but that didnt work either. Would appreciate any help!

Please, Log in or Register to see links and images
 

tyrant1988

Lurker
Mar 12, 2022
2
1
58
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
Yo, tried the add to path
C:\Users\Admin\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310

Didnt seem to work. My python installation was via Microsoft App store which show the usual python installation screen to enable add to path, i suspect it has something to do with it. going thru this route enabled my pip to work however. my old installation file couldnt even get pip to be installed by default.

UPDATE: OK. I ditched the windows 10 app installation, and downloaded 3.10.8. Manually added Py dir to PATH and manually downloaded get-pip.py. Ran the script and it managed to work. Sweat :KEKWlaugh:.Your comment prompted me to think harder lol.
 
Last edited:
  • Like
Reactions: Jules--Winnfield

zHipster

Superfan
Aug 9, 2021
13
521
737
0fya082315al84db03fa9bf467e3.png
I'm trying to use this Dl, but at the first download, the download folder got deleted, ok, i created another one.
RN i'm trying to download this cyberdrop link:

Please, Log in or Register to see links and images


And this cyberdrop video:

Please, Log in or Register to see links and images


When i tried the video it seams to be downloading but when it's finish it there's no video, and when trying to donwload the whole link, it keeps like this forever:

WettMelons OnlyFans Vids: 0%| | 0/309 [00:00<?, ?FILE/s]

This DL isnt working with Cyberdrop? If so, is there another way?
PS: I'm using the py, 3.10.7, do i need to be 3.10?
 
Last edited: