Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads

brad86

Bathwater Drinker
Mar 12, 2022
42
1,242
1,242
0fya082315al84db03fa9bf467e3.png
https://i.imgur was here once, but it's now gone/AgRJf32.png

I recently put together a new PC, and I have had this issue stopping me from downloading ever since.
I have Python, MS runtime libraries, SDKs and others pretty much exactly the same as on my previous PC.
 

Hatman9

Tier 3 Sub
Jun 29, 2022
17
353
534
0fya082315al84db03fa9bf467e3.png
im trying to do the script method and im getting this can someone help pls?
C:\Users\joshu\Downloads\Cyberdrop_DL.V3>pip install --upgrade cyberdrop-dl
Collecting cyberdrop-dl
Using cached cyberdrop_dl-3.6.13-py3-none-any.whl (64 kB)
Collecting aiofiles>=22.1.0
Using cached aiofiles-22.1.0-py3-none-any.whl (14 kB)
Collecting aiohttp>=3.8.3
Using cached aiohttp-3.8.3-cp311-cp311-win_amd64.whl (317 kB)
Collecting beautifulsoup4>=4.11.1
Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)
Collecting certifi>=2022.9.24
Using cached certifi-2022.9.24-py3-none-any.whl (161 kB)
Collecting colorama>=0.4.6
Using cached colorama-0.4.6-py2.py3-none-any.whl (25 kB)
Collecting gofile-client>=1.0.1
Using cached gofile_client-1.0.1-py3-none-any.whl (7.3 kB)
Collecting myjdapi>=1.1.6
Using cached myjdapi-1.1.6-py3-none-any.whl (13 kB)
Collecting PyYAML>=6.0
Using cached PyYAML-6.0-cp311-cp311-win_amd64.whl (143 kB)
Requirement already satisfied: setuptools>=65.5.0 in c:\users\joshu\appdata\local\programs\python\python311\lib\site-packages (from cyberdrop-dl) (65.5.0)
Collecting tqdm>=4.64.1
Using cached tqdm-4.64.1-py2.py3-none-any.whl (78 kB)
Collecting yarl>=1.8.1
Using cached yarl-1.8.1.tar.gz (172 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting attrs>=17.3.0
Using cached attrs-22.1.0-py2.py3-none-any.whl (58 kB)
Collecting charset-normalizer<3.0,>=2.0
Using cached charset_normalizer-2.1.1-py3-none-any.whl (39 kB)
Collecting multidict<7.0,>=4.5
Using cached multidict-6.0.2.tar.gz (50 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting async-timeout<5.0,>=4.0.0a3
Using cached async_timeout-4.0.2-py3-none-any.whl (5.8 kB)
Collecting frozenlist>=1.1.1
Using cached frozenlist-1.3.3-cp311-cp311-win_amd64.whl (32 kB)
Collecting aiosignal>=1.1.2
Using cached aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)
Collecting requests
Using cached requests-2.28.1-py3-none-any.whl (62 kB)
Collecting pycryptodome
Using cached pycryptodome-3.16.0-cp35-abi3-win_amd64.whl (1.7 MB)
Collecting idna>=2.0
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.13-py2.py3-none-any.whl (140 kB)
Building wheels for collected packages: yarl, multidict
Building wheel for yarl (pyproject.toml) ... error
error: subprocess-exited-with-error

Ă— Building wheel for yarl (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [43 lines of output]
C:\Users\joshu\AppData\Local\Temp\pip-build-env-ukfyu478\overlay\Lib\site-packages\setuptools\config\setupcfg.py:508: SetuptoolsDeprecationWarning: The license_file parameter is deprecated, use license_files instead.
warnings.warn(msg, warning_class)
**********************
* Accelerated build *
**********************
running bdist_wheel
running build
running build_py
creating build
creating build\lib.win-amd64-cpython-311
creating build\lib.win-amd64-cpython-311\yarl
copying yarl\_quoting.py -> build\lib.win-amd64-cpython-311\yarl
copying yarl\_quoting_py.py -> build\lib.win-amd64-cpython-311\yarl
copying yarl\_url.py -> build\lib.win-amd64-cpython-311\yarl
copying yarl\__init__.py -> build\lib.win-amd64-cpython-311\yarl
running egg_info
writing yarl.egg-info\PKG-INFO
writing dependency_links to yarl.egg-info\dependency_links.txt
writing requirements to yarl.egg-info\requires.txt
writing top-level names to yarl.egg-info\top_level.txt
reading manifest file 'yarl.egg-info\SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no previously-included files matching '*.pyc' found anywhere in distribution
warning: no previously-included files matching '*.cache' found anywhere in distribution
warning: no previously-included files found matching 'yarl\*.html'
warning: no previously-included files found matching 'yarl\*.so'
warning: no previously-included files found matching 'yarl\*.pyd'
no previously-included directories found matching 'docs\_build'
adding license file 'LICENSE'
writing manifest file 'yarl.egg-info\SOURCES.txt'
copying yarl\__init__.pyi -> build\lib.win-amd64-cpython-311\yarl
copying yarl\_quoting_c.pyi -> build\lib.win-amd64-cpython-311\yarl
copying yarl\_quoting_c.pyx -> build\lib.win-amd64-cpython-311\yarl
copying yarl\py.typed -> build\lib.win-amd64-cpython-311\yarl
running build_ext
building 'yarl._quoting_c' extension
creating build\temp.win-amd64-cpython-311
creating build\temp.win-amd64-cpython-311\Release
creating build\temp.win-amd64-cpython-311\Release\yarl
"C:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\BIN\x86_amd64\cl.exe" /c /nologo /O2 /W3 /GL /DNDEBUG /MD -IC:\Users\joshu\AppData\Local\Programs\Python\Python311\include -IC:\Users\joshu\AppData\Local\Programs\Python\Python311\Include "-IC:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\INCLUDE" "-IC:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\ATLMFC\INCLUDE" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.10240.0\ucrt" /Tcyarl/_quoting_c.c /Fobuild\temp.win-amd64-cpython-311\Release\yarl/_quoting_c.obj
_quoting_c.c
c:\users\joshu\appdata\local\programs\python\python311\include\pyconfig.h(207): fatal error C1083: Cannot open include file: 'basetsd.h': No such file or directory
error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\BIN\\x86_amd64\\cl.exe' failed with exit code 2
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for yarl
Building wheel for multidict (pyproject.toml) ... error
error: subprocess-exited-with-error

Ă— Building wheel for multidict (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [65 lines of output]
*********************
* Accelerated build *
*********************
running bdist_wheel
running build
running build_py
creating build
creating build\lib.win-amd64-cpython-311
creating build\lib.win-amd64-cpython-311\multidict
copying multidict\_abc.py -> build\lib.win-amd64-cpython-311\multidict
copying multidict\_compat.py -> build\lib.win-amd64-cpython-311\multidict
copying multidict\_multidict_base.py -> build\lib.win-amd64-cpython-311\multidict
copying multidict\_multidict_py.py -> build\lib.win-amd64-cpython-311\multidict
copying multidict\__init__.py -> build\lib.win-amd64-cpython-311\multidict
running egg_info
writing multidict.egg-info\PKG-INFO
writing dependency_links to multidict.egg-info\dependency_links.txt
writing top-level names to multidict.egg-info\top_level.txt
reading manifest file 'multidict.egg-info\SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no previously-included files matching '*.pyc' found anywhere in distribution
warning: no previously-included files found matching 'multidict\_multidict.html'
warning: no previously-included files found matching 'multidict\*.so'
warning: no previously-included files found matching 'multidict\*.pyd'
warning: no previously-included files found matching 'multidict\*.pyd'
no previously-included directories found matching 'docs\_build'
adding license file 'LICENSE'
writing manifest file 'multidict.egg-info\SOURCES.txt'
C:\Users\joshu\AppData\Local\Temp\pip-build-env-9lxf1_lt\overlay\Lib\site-packages\setuptools\command\build_py.py:202: SetuptoolsDeprecationWarning: Installing 'multidict._multilib' as data is deprecated, please list it in `packages`.
!!


############################
# Package would be ignored #
############################
Python recognizes 'multidict._multilib' as an importable package,
but it is not listed in the `packages` configuration of setuptools.

'multidict._multilib' has been automatically added to the distribution only
because it may contain data files, but this behavior is likely to change
in future versions of setuptools (and therefore is considered deprecated).

Please make sure that 'multidict._multilib' is included as a package by using
the `packages` configuration field or the proper discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).

You can read more about "package discovery" and "data files" on setuptools
documentation page.


!!

check.warn(importable)
copying multidict\__init__.pyi -> build\lib.win-amd64-cpython-311\multidict
copying multidict\py.typed -> build\lib.win-amd64-cpython-311\multidict
running build_ext
building 'multidict._multidict' extension
creating build\temp.win-amd64-cpython-311
creating build\temp.win-amd64-cpython-311\Release
creating build\temp.win-amd64-cpython-311\Release\multidict
"C:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\BIN\x86_amd64\cl.exe" /c /nologo /O2 /W3 /GL /DNDEBUG /MD -IC:\Users\joshu\AppData\Local\Programs\Python\Python311\include -IC:\Users\joshu\AppData\Local\Programs\Python\Python311\Include "-IC:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\INCLUDE" "-IC:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\ATLMFC\INCLUDE" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.10240.0\ucrt" /Tcmultidict/_multidict.c /Fobuild\temp.win-amd64-cpython-311\Release\multidict/_multidict.obj -O2
_multidict.c
c:\users\joshu\appdata\local\programs\python\python311\include\pyconfig.h(207): fatal error C1083: Cannot open include file: 'basetsd.h': No such file or directory
error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\BIN\\x86_amd64\\cl.exe' failed with exit code 2
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for multidict
Failed to build yarl multidict
ERROR: Could not build wheels for yarl, multidict, which is required to install pyproject.toml-based projects

C:\Users\joshu\Downloads\Cyberdrop_DL.V3>cyberdrop-dl
'cyberdrop-dl' is not recognized as an internal or external command,
operable program or batch file.
 
  • Like
Reactions: urgbur

amirogozhin

Fan
Mar 12, 2022
7
57
225
0fya082315al84db03fa9bf467e3.png
I'm getting the following when trying to download from bunkr and I don't understand it:
2022-12-01 10:53:20,992:DEBUG:selector_events:selector_events.py:54:Using selector: KqueueSelector
2022-12-01 10:53:20,999:DEBUG:base_functions:base_functions.py:41:We are running version 3.3.14 of Cyberdrop Downloader
2022-12-01 10:53:21,000:DEBUG:main:main.py:60:Starting downloader with args: {'input_file': PosixPath('URLs.txt'), 'output_folder': PosixPath('Downloads'), 'log_file': 'downloader.log', 'db_file': 'download_history.sqlite', 'threads': 0, 'attempts': 10, 'connection_timeout': 15, 'disable_attempt_limit': False, 'include_id': False, 'exclude_videos': False, 'exclude_images': False, 'exclude_audio': False, 'exclude_other': False, 'ignore_history': False, 'separate_posts': False, 'leakednudes_username': None, 'leakednudes_password': '!REDACTED!', '*Blacklisted site*_username': None, '*Blacklisted site*_password': '!REDACTED!', 'simpcity_username': None, 'simpcity_password': '!REDACTED!', 'skip_hosts': [], 'ratelimit': 50, 'throttle': 0.5, 'links': []}
2022-12-01 10:53:21,027:DEBUG:base_functions:base_functions.py:41:Starting Scrape
2022-12-01 10:53:21,029:DEBUG:base_functions:base_functions.py:41:Starting scrape of
Please, Log in or Register to see links and images

2022-12-01 10:53:21,560:DEBUG:base_functions:base_functions.py:41:Finished scrape of
Please, Log in or Register to see links and images


Then after each failed file:
2022-12-01 10:53:25,740:DEBUG:rate_limiting:rate_limiting.py:88:
Delaying request to bunkrr.su/v/ for 0.30 seconds.
2022-12-01 10:53:25,928:DEBUG:client:client.py:131:Server for
Please, Log in or Register to see links and images
is either down or the file no longer exists
2022-12-01 10:53:25,929:DEBUG:downloaders:downloaders.py:256:Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/cyberdrop_dl/client/downloaders.py", line 253, in download_and_store
await self.download_file(url, referral=referral, filename=filename, session=session,
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/cyberdrop_dl/client/downloaders.py", line 30, in wrapper
return await f(self, *args, **kwargs)
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/cyberdrop_dl/client/downloaders.py", line 200, in download_file
await self.rename_file(filename, url, db_path)
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/cyberdrop_dl/client/downloaders.py", line 234, in rename_file
temp_file.rename(complete_file)
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/pathlib.py", line 1232, in rename
self._accessor.rename(self, target)
FileNotFoundError: [Errno 2] No such file or directory: 'Downloads/MaxxMarie [OF Vids] [update]/MaxxMarie-[13]-[21.03.2022]-Q4be.mp4.part' -> 'Downloads/MaxxMarie [OF Vids] [update]/MaxxMarie-[13]-[21.03.2022]-Q4be.mp4'
 

darth vader 69420

Bathwater Drinker
Nov 13, 2022
75
6,116
1,239
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
this is what the downloader.log has written after i tried:
2022-12-02 19:00:03,576:DEBUG:proactor_events:proactor_events.py:626:Using proactor: IocpProactor
2022-12-02 19:00:03,627:DEBUG:base_functions:base_functions.py:41:We are running version 2.30.7 of Cyberdrop Downloader
2022-12-02 19:00:03,628:DEBUG:main:main.py:53:Starting downloader with args: {'input_file': WindowsPath('URLs.txt'), 'output_folder': WindowsPath('Downloads'), 'log_file': 'downloader.log', 'db_file': 'download_history.sqlite', 'threads': 0, 'attempts': 10, 'disable_attempt_limit': False, 'include_id': False, 'exclude_videos': False, 'exclude_images': False, 'exclude_audio': False, 'exclude_other': False, 'ignore_history': False, 'separate_posts': False, 'thotsbay_username': None, 'thotsbay_password': '!REDACTED!', 'skip_hosts': [], 'ratelimit': 50, 'throttle': 0.5, 'links': []}
2022-12-02 19:00:03,660:DEBUG:base_functions:base_functions.py:41:Starting Scrape
2022-12-02 19:00:03,665:DEBUG:base_functions:base_functions.py:41:
Please, Log in or Register to see links and images
is not supported currently.
2022-12-02 19:00:03,670:ERROR:main:main.py:81:ValueError No links
2022-12-02 19:00:03,670:DEBUG:base_functions:base_functions.py:41:No links found, check the URL.txt
If the link works in your web browser, please open an issue ticket with me.
2022-12-02 19:00:03,672:DEBUG:base_functions:base_functions.py:41:This program does not currently support password protected albums.
2022-12-02 19:00:03,673:DEBUG:sql_helper:sql_helper.py:93:Successfully closed sqlite database connection
 
Last edited: