Password protected albums are not currently supported.
Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads
- Thread starter Jules--Winnfield
- Start date
hello Jules what is the problem ?
We are running version 3.6.48 of Cyberdrop Downloader
Getting Run Args
Not enough free space to run the program.
Purging empty directories
Finished downloading. Enjoy :)
There are partial downloads in the downloads folder
It is saying that there is not enough space, but I have space on my pc, I already cleaned the cache memory, it solved it, but then this problem appeared again
We are running version 3.6.48 of Cyberdrop Downloader
Getting Run Args
Not enough free space to run the program.
Purging empty directories
Finished downloading. Enjoy :)
There are partial downloads in the downloads folder
It is saying that there is not enough space, but I have space on my pc, I already cleaned the cache memory, it solved it, but then this problem appeared again
Hello, please help are not loading links from kemono
But from coomer everything works completely
We are running version 3.6.48 of Cyberdrop Downloader
Getting Run Args
Starting Scrape
Starting scrape of
Error scraping
Finished scrape of
023-01-20 05:24:45,076:DEBUG:proactor_events:proactor_events.py:626:Using proactor: IocpProactor
2023-01-20 05:24:45,131:DEBUG:base_functions:base_functions.py:61:We are running version 3.6.48 of Cyberdrop Downloader
2023-01-20 05:24:45,131:DEBUG:main:main.py:73:Creating Config
2023-01-20 05:24:45,131:DEBUG:base_functions:base_functions.py:142:Validating Config
2023-01-20 05:24:45,139:DEBUG:base_functions:base_functions.py:61:Getting Run Args
2023-01-20 05:24:45,147:DEBUG:base_functions:base_functions.py:205:Gathering Args
2023-01-20 05:24:45,147:DEBUG:main:main.py:97:Starting Cyberdrop-DL
2023-01-20 05:24:45,147:DEBUG:main:main.py:98:Using authorization arguments: {'pixeldrain_api_key': '!REDACTED!', 'simpcity_username': None, 'simpcity_password': '!REDACTED!', '*Blacklisted site*_username': None, '*Blacklisted site*_password': '!REDACTED!', 'xbunker_username': None, 'xbunker_password': '!REDACTED!'}
2023-01-20 05:24:45,147:DEBUG:main:main.py:99:Using file arguments: {'input_file': WindowsPath('URLs.txt'), 'output_folder': WindowsPath('Downloads'), 'output_last_forum_post_file': WindowsPath('URLs_last_post.txt'), 'db_file': WindowsPath('download_history.sqlite')}
2023-01-20 05:24:45,147:DEBUG:main:main.py:100:Using jdownloader arguments: {'jdownloader_enable': False, 'jdownloader_username': None, 'jdownloader_password': '!REDACTED!', 'jdownloader_device': None}
2023-01-20 05:24:45,147:DEBUG:main:main.py:101:Using runtime arguments: {'threads': 0, 'attempts': 10, 'required_free_space': 5, 'disable_attempt_limit': False, 'connection_timeout': 15, 'ratelimit': 50, 'throttle': 0.5, 'include_id': False, 'exclude_videos': False, 'exclude_images': False, 'exclude_audio': False, 'exclude_other': False, 'ignore_history': False, 'output_last_forum_post': False, 'separate_posts': False, 'mark_downloaded': False, 'proxy': None, 'skip_hosts': []}
2023-01-20 05:24:45,220:DEBUG:base_functions:base_functions.py:61:Starting Scrape
2023-01-20 05:24:45,221:DEBUG:base_functions:base_functions.py:61:Starting scrape of
2023-01-20 05:25:04,178:DEBUG:Kemono_Spider:Kemono_Spider.py:65:Error encountered while handling
OSError: [WinError 121]
aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host kemono.party:443 ssl:<ssl.SSLContext object at 0x00000208F74D5E40> [Semaphore timeout exceeded]
2023-01-20 05:25:04,190:DEBUG:base_functions:base_functions.py:61:Error scraping
2023-01-20 05:25:04,190:DEBUG:Kemono_Spider:Kemono_Spider.py:67:Cannot connect to host kemono.party:443 ssl:<ssl.SSLContext object at 0x00000208F74D5E40> [Semaphore timeout exceeded]
2023-01-20 05:25:04,190:DEBUG:base_functions:base_functions.py:61:Finished scrape of
2023-01-20 05:25:04,190:ERROR:main:main.py:128:ValueError No links
2023-01-20 05:25:04,190:DEBUG:base_functions:base_functions.py:61:No links found during scraping, check passwords or that the urls are accessible
2023-01-20 05:25:04,191:DEBUG:base_functions:base_functions.py:61:This program does not currently support password protected albums.
2023-01-20 05:25:04,191:DEBUG:sql_helper:sql_helper.py:133:Successfully closed sqlite database connection
But from coomer everything works completely
We are running version 3.6.48 of Cyberdrop Downloader
Getting Run Args
Starting Scrape
Starting scrape of
Error scraping
Finished scrape of
023-01-20 05:24:45,076:DEBUG:proactor_events:proactor_events.py:626:Using proactor: IocpProactor
2023-01-20 05:24:45,131:DEBUG:base_functions:base_functions.py:61:We are running version 3.6.48 of Cyberdrop Downloader
2023-01-20 05:24:45,131:DEBUG:main:main.py:73:Creating Config
2023-01-20 05:24:45,131:DEBUG:base_functions:base_functions.py:142:Validating Config
2023-01-20 05:24:45,139:DEBUG:base_functions:base_functions.py:61:Getting Run Args
2023-01-20 05:24:45,147:DEBUG:base_functions:base_functions.py:205:Gathering Args
2023-01-20 05:24:45,147:DEBUG:main:main.py:97:Starting Cyberdrop-DL
2023-01-20 05:24:45,147:DEBUG:main:main.py:98:Using authorization arguments: {'pixeldrain_api_key': '!REDACTED!', 'simpcity_username': None, 'simpcity_password': '!REDACTED!', '*Blacklisted site*_username': None, '*Blacklisted site*_password': '!REDACTED!', 'xbunker_username': None, 'xbunker_password': '!REDACTED!'}
2023-01-20 05:24:45,147:DEBUG:main:main.py:99:Using file arguments: {'input_file': WindowsPath('URLs.txt'), 'output_folder': WindowsPath('Downloads'), 'output_last_forum_post_file': WindowsPath('URLs_last_post.txt'), 'db_file': WindowsPath('download_history.sqlite')}
2023-01-20 05:24:45,147:DEBUG:main:main.py:100:Using jdownloader arguments: {'jdownloader_enable': False, 'jdownloader_username': None, 'jdownloader_password': '!REDACTED!', 'jdownloader_device': None}
2023-01-20 05:24:45,147:DEBUG:main:main.py:101:Using runtime arguments: {'threads': 0, 'attempts': 10, 'required_free_space': 5, 'disable_attempt_limit': False, 'connection_timeout': 15, 'ratelimit': 50, 'throttle': 0.5, 'include_id': False, 'exclude_videos': False, 'exclude_images': False, 'exclude_audio': False, 'exclude_other': False, 'ignore_history': False, 'output_last_forum_post': False, 'separate_posts': False, 'mark_downloaded': False, 'proxy': None, 'skip_hosts': []}
2023-01-20 05:24:45,220:DEBUG:base_functions:base_functions.py:61:Starting Scrape
2023-01-20 05:24:45,221:DEBUG:base_functions:base_functions.py:61:Starting scrape of
2023-01-20 05:25:04,178:DEBUG:Kemono_Spider:Kemono_Spider.py:65:Error encountered while handling
OSError: [WinError 121]
aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host kemono.party:443 ssl:<ssl.SSLContext object at 0x00000208F74D5E40> [Semaphore timeout exceeded]
2023-01-20 05:25:04,190:DEBUG:base_functions:base_functions.py:61:Error scraping
2023-01-20 05:25:04,190:DEBUG:Kemono_Spider:Kemono_Spider.py:67:Cannot connect to host kemono.party:443 ssl:<ssl.SSLContext object at 0x00000208F74D5E40> [Semaphore timeout exceeded]
2023-01-20 05:25:04,190:DEBUG:base_functions:base_functions.py:61:Finished scrape of
2023-01-20 05:25:04,190:ERROR:main:main.py:128:ValueError No links
2023-01-20 05:25:04,190:DEBUG:base_functions:base_functions.py:61:No links found during scraping, check passwords or that the urls are accessible
2023-01-20 05:25:04,191:DEBUG:base_functions:base_functions.py:61:This program does not currently support password protected albums.
2023-01-20 05:25:04,191:DEBUG:sql_helper:sql_helper.py:133:Successfully closed sqlite database connection
Last edited:
You are hitting a timeout, as a heads up: both kemono and coomer have pretty hard ratelimits, you might have hit one if you've been downloading from them a lot.
This is surprising because I have never downloaded files from kemono in this way
Absolutely yes!
By the way, jdownloader 2 catches links to download coomer, but kemono does not see.
Both do, just checked.
Try turning jdownloader off and trying kemono again (I have no idea what the problem is for you and am just spitballing)
Thanks a lot for this great tool Jules--Winnfield. Is there any way to skip the files which are already downloaded when running the script?
Believe that's the default. It will still scrape, in order to identify if it's already in the database. As long as you don't delete that database, it'll skip them; but, you can use the '--ignore-history' flag to make it redownload things already in the database.
It skips the files downloaded by the script, but I am talking about the files which were downloaded without using the script. Is there anyway to skip them?
Not that I'm aware of. Will defer to Jules. I usually run Dupe Guru or Czkawka routinely to clear up any duplicates.
You can put the links into the URLs.txt file and use the --mark-downloaded flag. It'll tell the program you've already downloaded them.
For JDownloader you should ask for help here: https://simpcity.su/forums/help-support-suggestions.60/
This isn't the place for it.
3.6.51
- Removed Kemono support.
Kemono has implemented DDOS-Guard, which I'm not going to attempt to get around. So as of now, it's no longer supported by Cyberdrop-DL
Hey, is Python 3.11 supported coz I’m getting the errors below? pip is also updated to the latest version:
…..
error: subprocess-exited-with-error
× Preparing metadata (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [17 lines of output]
…..
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
Hey I'd need to see the output generated that was left out. But 3.11 should work at this point. Best compatibility will be 3.10 though.