Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads

heso123

Lurker
Mar 11, 2022
1
0
46
0fya082315al84db03fa9bf467e3.png
Used Cyberdrop Downloader for a long time and had no problems until I updated to version 5

Maybe this could be a newbie question but...

Installed using Start Windows.bat and after that, I tried using the command "cyberdrop-dl (link)" and got this message back ( is not recognized as an internal command)

When I open using the Start Windows.bat, the menu appears but I don't know how to put the link to an album that I want to download
 

xablau10

Tier 3 Sub
Feb 19, 2022
24
444
604
0fya082315al84db03fa9bf467e3.png
Having a problem where its not dowloading anymore, I placed the links, clicked to run, selected download but at the event everything is just 0, completed, skipped and failed all say 0
 
  • Like
Reactions: boomtime_69

TEB9605

Lurker
Apr 3, 2022
3
0
46
0fya082315al84db03fa9bf467e3.png
I'm having the same issue, I place mine in the .txt file, run the .bat, it basically scrapes through the links like usual but just doesn't download anything
 

cylindereve

Tier 1 Sub
Jul 13, 2022
5
129
383
0fya082315al84db03fa9bf467e3.png
Hi, firstly great tool thank you for making and maintaining it.

Secondly, is there a limit to how many links can be scraped in one instance? I have a very large list of urls and it appears cyberdrop has frozen with '.... And 300025 Links in Scrape Queue' being the only text in Scraping. As well, no values in Files, Scrape Failures, or Download Failures have changed in a significant amount of time. Please let me know if there is an approximate max number of scrapes so I can split up my URL list to try remain below that amount.

Thank you.
 

DrFapGood

Tier 3 Sub
Mar 23, 2023
33
259
382
0fya082315al84db03fa9bf467e3.png
Is there a limitation with PixelDrain albums? I'm not getting any errors/failures but the scrape is coming back with 0 files.
 

DrFapGood

Tier 3 Sub
Mar 23, 2023
33
259
382
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
INFO : 2024-03-08 10:10:58,392 : utilities.py:98 : Starting Async Processes...
DEBUG : 2024-03-08 10:10:58,392 : utilities.py:98 : Starting Cyberdrop-DL Process for Default Config
DEBUG : 2024-03-08 10:10:58,392 : utilities.py:98 : Running version 5.1.94
DEBUG : 2024-03-08 10:10:58,392 : utilities.py:98 : Using Config: Default
DEBUG : 2024-03-08 10:10:58,392 : utilities.py:98 : Using Config File: AppData\Configs\Default\settings.yaml
DEBUG : 2024-03-08 10:10:58,392 : utilities.py:98 : Using Input File: AppData\Configs\Default\URLs.txt
DEBUG : 2024-03-08 10:10:58,392 : utilities.py:98 : Using Download Folder: G:\Unsorted
DEBUG : 2024-03-08 10:10:58,392 : utilities.py:98 : Using History File: AppData\Cache\cyberdrop.db
DEBUG : 2024-03-08 10:10:58,393 : utilities.py:98 : Using Authentication:
{
"Forums Credentials": {
"celebforum Credentials Provided": false,
"f95zone Credentials Provided": false,
"leakedmodels Credentials Provided": false,
"*Blacklisted site* Credentials Provided": false,
"simpcity Credentials Provided": false,
"*Blacklisted site* Credentials Provided": false,
"shit forum Credentials Provided": false
},
"Forums XF Cookies": {
"celebforum XF Cookie Provided": false,
"f95zone XF Cookie Provided": false,
"leakedmodels XF Cookie Provided": false,
"*Blacklisted site* XF Cookie Provided": false,
"simpcity XF Cookie Provided": false,
"*Blacklisted site* XF Cookie Provided": false,
"shit forum XF Cookie Provided": false
},
"GoFile Provided": false,
"Imgur Provided": false,
"JDownloader Provided": false,
"PixelDrain Provided": false,
"Reddit Provided": false
}
DEBUG : 2024-03-08 10:10:58,393 : utilities.py:98 : Using Settings:
{
"Download_Options": {
"block_download_sub_folders": false,
"disable_download_attempt_limit": false,
"disable_file_timestamps": false,
"include_album_id_in_folder_name": false,
"include_thread_id_in_folder_name": false,
"remove_domains_from_folder_names": false,
"remove_generated_id_from_filenames": false,
"scrape_single_forum_post": false,
"separate_posts": false,
"skip_download_mark_completed": false
},
"File_Size_Limits": {
"maximum_image_size": 0,
"maximum_other_size": 0,
"maximum_video_size": 0,
"minimum_image_size": 0,
"minimum_other_size": 0,
"minimum_video_size": 0
},
"Files": {
"download_folder": "G:\\Unsorted",
"input_file": "AppData\\Configs\\Default\\URLs.txt"
},
"Ignore_Options": {
"exclude_audio": false,
"exclude_images": false,
"exclude_other": false,
"exclude_videos": false,
"ignore_coomer_ads": false,
"only_hosts": [],
"skip_hosts": []
},
"Logs": {
"download_error_urls_filename": "Download_Error_URLs.csv",
"last_forum_post_filename": "Last_Scraped_Forum_Posts.txt",
"log_folder": "AppData\\Configs\\Default\\Logs",
"main_log_filename": "downloader.log",
"scrape_error_urls_filename": "Scrape_Error_URLs.csv",
"unsupported_urls_filename": "Unsupported_URLs.txt"
},
"Runtime_Options": {
"delete_partial_files": false,
"ignore_history": false,
"log_level": 10,
"send_unsupported_to_jdownloader": false,
"skip_check_for_empty_folders": false,
"skip_check_for_partial_files": false
},
"Sorting": {
"sort_downloads": true,
"sort_folder": "G:\\Sorted",
"sort_incremementer_format": " ({i})",
"sorted_audio": "{sort_dir}/{base_dir}/Audio/{filename}{ext}",
"sorted_image": "{sort_dir}/{base_dir}/Images/{filename}{ext}",
"sorted_other": "{sort_dir}/{base_dir}/Other/{filename}{ext}",
"sorted_video": "{sort_dir}/{base_dir}/Videos/{filename}{ext}"
}
}
DEBUG : 2024-03-08 10:10:58,393 : utilities.py:98 : Using Global Settings:
{
"General": {
"allow_insecure_connections": false,
"flaresolverr": "",
"max_file_name_length": 95,
"max_folder_name_length": 60,
"proxy": "",
"required_free_space": 5,
"user_agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:120.0) Gecko/20100101 Firefox/120.0"
},
"Rate_Limiting_Options": {
"connection_timeout": 15,
"download_attempts": 10,
"download_delay": 0,
"max_simultaneous_downloads": 15,
"max_simultaneous_downloads_per_domain": 5,
"rate_limit": 50,
"read_timeout": 300
}
}
INFO : 2024-03-08 10:10:58,407 : utilities.py:98 : Starting UI...
INFO : 2024-03-08 10:10:58,557 : utilities.py:98 : Scrape Starting:
Please, Log in or Register to see links and images

INFO : 2024-03-08 10:10:59,174 : utilities.py:98 : Scrape Finished:
Please, Log in or Register to see links and images

INFO : 2024-03-08 10:10:59,240 : utilities.py:98 : Running Post-Download Processes...
INFO : 2024-03-08 10:10:59,240 : utilities.py:111 :
Sorting Downloads: Please Wait
INFO : 2024-03-08 10:11:04,256 : utilities.py:111 : Organized: 0 Audio Files
INFO : 2024-03-08 10:11:04,257 : utilities.py:111 : Organized: 0 Image Files
INFO : 2024-03-08 10:11:04,257 : utilities.py:111 : Organized: 0 Video Files
INFO : 2024-03-08 10:11:04,258 : utilities.py:111 : Organized: 0 Other Files
INFO : 2024-03-08 10:11:04,259 : utilities.py:111 : Checking for partial downloads...
INFO : 2024-03-08 10:11:04,260 : utilities.py:111 : Checking for empty folders...
INFO : 2024-03-08 10:11:04,262 : utilities.py:98 : Printing Stats...
INFO : 2024-03-08 10:11:04,262 : utilities.py:111 :
Download Stats:
INFO : 2024-03-08 10:11:04,262 : utilities.py:111 : Downloaded 0 files
INFO : 2024-03-08 10:11:04,263 : utilities.py:111 : Previously Downloaded 0 files
INFO : 2024-03-08 10:11:04,263 : utilities.py:111 : Skipped By Config 0 files
INFO : 2024-03-08 10:11:04,264 : utilities.py:111 : Failed 0 files
INFO : 2024-03-08 10:11:04,264 : utilities.py:111 :
Scrape Failures:
INFO : 2024-03-08 10:11:04,265 : utilities.py:111 :
Download Failures:
INFO : 2024-03-08 10:11:04,265 : utilities.py:98 : Checking for Program End...
INFO : 2024-03-08 10:11:04,265 : utilities.py:98 : Checking for Updates...
INFO : 2024-03-08 10:11:05,759 : utilities.py:98 : Closing Program...
INFO : 2024-03-08 10:11:05,760 : utilities.py:111 :
Finished downloading. Enjoy :)
 

TEB9605

Lurker
Apr 3, 2022
3
0
46
0fya082315al84db03fa9bf467e3.png
I'm having an issue like the above post, my log file is also very similar, but I'm getting the issue with both PixelDrain and *Blacklisted site*.

My CDL version wasn't up to date, so I just downloaded the latest one (5.1.94) and the issue persists.

My Python version is 3.11.7 in case that helps