Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads

Sort By Date Sort By Reaction Score
J4k_The_Reaper

J4k_The_Reaper

Tier 2 Sub
Mar 12, 2022
21
208
337
0fya082315al84db03fa9bf467e3.png
2023-06-04 12:11:45,007:DEBUG:proactor_events:proactor_events.py:633:Using proactor: IocpProactor
2023-06-04 12:11:45,021:DEBUG:base_functions:base_functions.py:54:Starting Cyberdrop-DL
2023-06-04 12:11:45,026:DEBUG:base_functions:base_functions.py:54:Using authentication arguments: {'gofile_api_key': '!REDACTED!', 'gofile_website_token': '', 'pixeldrain_api_key': '!REDACTED!', '*Blacklisted site*_username': '', '*Blacklisted site*_password': '!REDACTED!', 'simpcity_username': '', 'simpcity_password': '!REDACTED!', '*Blacklisted site*_username': '', '*Blacklisted site*_password': '!REDACTED!', 'xbunker_username': '', 'xbunker_password': '!REDACTED!'}
2023-06-04 12:11:45,026:DEBUG:base_functions:base_functions.py:54:Using files arguments: {'db_file': WindowsPath('download_history.sqlite'), 'errored_download_urls_file': WindowsPath('Errored_Download_URLs.csv'), 'errored_scrape_urls_file': WindowsPath('Errored_Scrape_URLs.csv'), 'input_file': WindowsPath('URLs.txt'), 'log_file': WindowsPath('downloader.log'), 'output_folder': WindowsPath('Downloads'), 'output_last_forum_post_file': WindowsPath('URLs_last_post.txt'), 'unsupported_urls_file': WindowsPath('Unsupported_URLs.csv')}
2023-06-04 12:11:45,026:DEBUG:base_functions:base_functions.py:54:Using forum options arguments: {'output_last_forum_post': False, 'scrape_single_post': False, 'separate_posts': False}
2023-06-04 12:11:45,026:DEBUG:base_functions:base_functions.py:54:Using ignore arguments: {'exclude_videos': False, 'exclude_images': False, 'exclude_audio': False, 'exclude_other': False, 'ignore_cache': False, 'ignore_history': False, 'skip_hosts': [], 'only_hosts': []}
2023-06-04 12:11:45,026:DEBUG:base_functions:base_functions.py:54:Using jdownloader arguments: {'apply_jdownloader': False, 'jdownloader_username': '', 'jdownloader_password': '!REDACTED!', 'jdownloader_device': ''}
2023-06-04 12:11:45,026:DEBUG:base_functions:base_functions.py:54:Using progress options arguments: {'hide_new_progress': False, 'hide_overall_progress': False, 'hide_forum_progress': False, 'hide_thread_progress': False, 'hide_domain_progress': False, 'hide_album_progress': False, 'hide_file_progress': False, 'refresh_rate': 10, 'visible_rows_threads': 2, 'visible_rows_domains': 2, 'visible_rows_albums': 2, 'visible_rows_files': 10}
2023-06-04 12:11:45,026:DEBUG:base_functions:base_functions.py:54:Using ratelimiting arguments: {'connection_timeout': 15, 'ratelimit': 50, 'throttle': 0.5}
2023-06-04 12:11:45,026:DEBUG:base_functions:base_functions.py:54:Using runtime arguments: {'allow_insecure_connections': False, 'attempts': 10, 'block_sub_folders': False, 'check_for_partial_files_and_empty_dirs': True, 'disable_attempt_limit': False, 'filesize_minimum_images': 0, 'filesize_minimum_other': 0, 'filesize_minimum_videos': 0, 'filesize_maximum_images': 0, 'filesize_maximum_other': 0, 'filesize_maximum_videos': 0, 'include_id': False, 'max_concurrent_threads': 0, 'max_concurrent_domains': 0, 'max_concurrent_albums': 0, 'max_concurrent_downloads_per_domain': 4, 'output_errored_urls': False, 'output_unsupported_urls': False, 'proxy': '', 'remove_bunkr_identifier': False, 'required_free_space': 5, 'skip_download_mark_completed': False, 'user_agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/112.0'}
2023-06-04 12:11:45,026:DEBUG:base_functions:base_functions.py:54:Using sorting arguments: {'sort_downloads': False, 'sort_directory': WindowsPath('Sorted Downloads'), 'sorted_audio': '{sort_dir}/{base_dir}/Audio', 'sorted_images': '{sort_dir}/{base_dir}/Images', 'sorted_others': '{sort_dir}/{base_dir}/Other', 'sorted_videos': '{sort_dir}/{base_dir}/Videos'}
2023-06-04 12:11:45,026:DEBUG:base_functions:base_functions.py:54:We are running version 4.2.71 of Cyberdrop Downloader
2023-06-04 12:11:45,170:DEBUG:base_functions:base_functions.py:54:Starting Scrape

Traceback (most recent call last):
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\aiohttp\client.py", line 536, in _request
conn = await self._connector.connect(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\aiohttp\connector.py", line 540, in connect
proto = await self._create_connection(req, traces, timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\aiohttp\connector.py", line 901, in _create_connection
_, proto = await self._create_direct_connection(req, traces, timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\aiohttp\connector.py", line 1175, in _create_direct_connection
transp, proto = await self._wrap_create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\aiohttp\connector.py", line 980, in _wrap_create_connection
return await self._loop.create_connection(*args, **kwargs) # type: ignore[return-value] # noqa
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\asyncio\base_events.py", line 1063, in create_connection
sock = await self._connect_sock(
^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\asyncio\base_events.py", line 967, in _connect_sock
await self.sock_connect(sock, address)
File "C:\Program Files\Python311\Lib\asyncio\proactor_events.py", line 726, in sock_connect
return await self._proactor.connect(sock, address)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\aiohttp\client.py", line 534, in _request
async with ceil_timeout(real_timeout.connect):
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\async_timeout\__init__.py", line 129, in __aexit__
self._do_exit(exc_type)
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\async_timeout\__init__.py", line 212, in _do_exit
raise asyncio.TimeoutError
TimeoutError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\cyberdrop_dl\downloader\downloaders.py", line 198, in download_file
complete_file, partial_file, proceed, expected_size = await self.check_file_exists(complete_file,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\cyberdrop_dl\downloader\downloaders.py", line 302, in check_file_exists
expected_size = await self.download_session.get_filesize(media.url, str(media.referer),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\cyberdrop_dl\client\client.py", line 210, in get_filesize
async with self.client_session.get(url, headers=headers, ssl=self.client.ssl_context,
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\aiohttp\client.py", line 1141, in __aenter__
self._resp = await self._coro
^^^^^^^^^^^^^^^^
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\aiohttp\client.py", line 540, in _request
raise ServerTimeoutError(
aiohttp.client_exceptions.ServerTimeoutError: Connection timeout to host
Please, Log in or Register to see links and images


During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\cyberdrop_dl\downloader\downloader_utils.py", line 71, in wrapper
return await f(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\paulf\AppData\Roaming\Python\Python311\site-packages\cyberdrop_dl\downloader\downloaders.py", line 284, in download_file
raise DownloadFailure(code=getattr(e, "code", 1), message=repr(e))
cyberdrop_dl.base_functions.error_classes.DownloadFailure: 1
2023-06-04 12:14:57,286:DEBUG:base_functions:base_functions.py:54:| [green]Files Complete: 1[/green] - [yellow]Files Skipped: 195[/yellow] - [red]Files Failed: 1[/red] |
2023-06-04 12:14:57,287:DEBUG:base_functions:base_functions.py:54:
 
chenbo

chenbo

Bathwater Drinker
Mar 12, 2022
448
5,390
1,302
0fya082315al84db03fa9bf467e3.png
Hi Jules, I encountered some issues while downloading the bunkr file. Here is the log file. Could you please help me take a look at what the problem might be? The Python version I'm using is 3.11.


Please, Log in or Register to view spoilers
 
Z

zeroww

Lurker
Nov 6, 2022
2
0
46
0fya082315al84db03fa9bf467e3.png
mine keeps like this

Starting Cyberdrop-DL
We are running version 4.2.72 of Cyberdrop Downloader
Starting Scrape
Starting:
Please, Log in or Register to see links and images


and the Cyberdrop paste keeps popping up the file download_history.sqlitejournal forever. But nothing happens.
 
B

BootBoot

Lurker
May 17, 2022
1
0
46
0fya082315al84db03fa9bf467e3.png
I've noticed that when using Cyberdrop-DL for coomer.party it will dowload the images into separate folders that reflect the individual posts. The kenomo.party website is set up similarly, but instead of the downloader behaving the same way, it just haphazerdly downloads all the images into one massive, unsorted folder. Is there a way to keep downloads from Kenomo organized like it does for Coomer?
 
neolith

neolith

egirl shill
Mar 11, 2022
591
36,593
1,793
0fya082315al84db03fa9bf467e3.png
everyoneenjoy said:
Please, Log in or Register to view quotes
Click to expand...
your site-packages are broken (it mentions at the top), remove everything python related on your machine, and start over from the beginning. a new python install (be sure to add to your path [click the box in the installer] and dont use the windows store version). and maybe a restart to be safe.
 
S

SwornTrie43

Lurker
Mar 17, 2022
3
1
58
0fya082315al84db03fa9bf467e3.png
I am having an issue downloading albums from cyberfile as well. The link to the album is fine and the scrape process was successful and gave me a complete status saying that all files were downloaded. The only issue is that I can't find the folder anywhere in my downloads folder. I opened up the download history sqlite filed and the download path says it should be in a folder in my downloads folder. I tried downloading again, thinking it might have just been a one-off error, but the same thing happened again. Has anyone faced this issue? Or can guide me in the direction of fixing this?
 
You must log in or register to reply here.
Top Bottom