Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads

[alexmason85]

Please, Log in or Register to view quotes

I have the same error

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

I'd need to see the downloader.log file

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

Yea, like I said, they take a long time to scrape. Just need to be patient.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

I'd need to see the downloader.log when you are running using the bat.

 

[Jules--Winnfield]

Hmmm. Yea, there is an issue with CDL and bunkr. It's going to take me a while to figure out.

 

[ucciee]

hers the log file.

2023-05-31 10:35:35,421:DEBUG:proactor_events:proactor_events.py:626:Using proactor: IocpProactor
2023-05-31 10:35:35,485:DEBUG:base_functions:base_functions.py:54:Starting Cyberdrop-DL
2023-05-31 10:35:35,504:DEBUG:base_functions:base_functions.py:54:Using authentication arguments: {'gofile_api_key': '!REDACTED!', 'gofile_website_token': '', 'pixeldrain_api_key': '!REDACTED!', '*Blacklisted site*_username': '', '*Blacklisted site*_password': '!REDACTED!', 'simpcity_username': 'ucciee', 'simpcity_password': '!REDACTED!', '*Blacklisted site*_username': '', '*Blacklisted site*_password': '!REDACTED!', 'xbunker_username': '', 'xbunker_password': '!REDACTED!'}
2023-05-31 10:35:35,504:DEBUG:base_functions:base_functions.py:54:Using files arguments: {'db_file': WindowsPath('download_history.sqlite'), 'errored_download_urls_file': WindowsPath('Errored_Download_URLs.csv'), 'errored_scrape_urls_file': WindowsPath('Errored_Scrape_URLs.csv'), 'input_file': WindowsPath('URLs.txt'), 'log_file': WindowsPath('downloader.log'), 'output_folder': WindowsPath('Downloads'), 'output_last_forum_post_file': WindowsPath('URLs_last_post.txt'), 'unsupported_urls_file': WindowsPath('Unsupported_URLs.csv')}
2023-05-31 10:35:35,504:DEBUG:base_functions:base_functions.py:54:Using forum options arguments: {'output_last_forum_post': False, 'scrape_single_post': False, 'separate_posts': False}
2023-05-31 10:35:35,504:DEBUG:base_functions:base_functions.py:54:Using ignore arguments: {'exclude_videos': False, 'exclude_images': False, 'exclude_audio': False, 'exclude_other': False, 'ignore_cache': False, 'ignore_history': False, 'skip_hosts': [], 'only_hosts': []}
2023-05-31 10:35:35,505:DEBUG:base_functions:base_functions.py:54:Using jdownloader arguments: {'apply_jdownloader': False, 'jdownloader_username': '', 'jdownloader_password': '!REDACTED!', 'jdownloader_device': ''}
2023-05-31 10:35:35,505:DEBUG:base_functions:base_functions.py:54:Using progress options arguments: {'hide_new_progress': False, 'hide_overall_progress': False, 'hide_forum_progress': False, 'hide_thread_progress': False, 'hide_domain_progress': False, 'hide_album_progress': False, 'hide_file_progress': False, 'refresh_rate': 10, 'visible_rows_threads': 2, 'visible_rows_domains': 2, 'visible_rows_albums': 2, 'visible_rows_files': 10}
2023-05-31 10:35:35,505:DEBUG:base_functions:base_functions.py:54:Using ratelimiting arguments: {'connection_timeout': 15, 'ratelimit': 50, 'throttle': 0.5}
2023-05-31 10:35:35,505:DEBUG:base_functions:base_functions.py:54:Using runtime arguments: {'allow_insecure_connections': False, 'attempts': 10, 'block_sub_folders': False, 'disable_attempt_limit': False, 'include_id': False, 'max_concurrent_threads': 0, 'max_concurrent_domains': 0, 'max_concurrent_albums': 0, 'max_concurrent_downloads_per_domain': 4, 'output_errored_urls': False, 'output_unsupported_urls': False, 'proxy': '', 'remove_bunkr_identifier': False, 'required_free_space': 5, 'skip_download_mark_completed': False, 'user_agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/112.0'}
2023-05-31 10:35:35,505:DEBUG:base_functions:base_functions.py:54:Using sorting arguments: {'sort_downloads': False, 'sort_directory': WindowsPath('Sorted Downloads'), 'sorted_audio': '{sort_dir}/{base_dir}/Audio', 'sorted_images': '{sort_dir}/{base_dir}/Images', 'sorted_others': '{sort_dir}/{base_dir}/Other', 'sorted_videos': '{sort_dir}/{base_dir}/Videos'}
2023-05-31 10:35:35,505:DEBUG:base_functions:base_functions.py:54:We are running version 4.2.56 of Cyberdrop Downloader
2023-05-31 10:35:35,582:DEBUG:base_functions:base_functions.py:54:Starting Scrape
2023-05-31 10:35:35,584:DEBUG:base_functions:base_functions.py:54:Starting:

Please, Log in or Register to see links and images

2023-05-31 10:35:35,845:DEBUG:base_functions:base_functions.py:54:Finished:

Please, Log in or Register to see links and images

2023-05-31 10:35:35,846:DEBUG:base_functions:base_functions.py:54:
2023-05-31 10:35:35,847:DEBUG:base_functions:base_functions.py:54:Finished Scrape
2023-05-31 10:35:41,652:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:41,653:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:41,653:DEBUG:base_functions:base_functions.py:54:Failed Download: 0hdux7kwvp5m1nl8d61xc_source-epcN4rOt.mp4
2023-05-31 10:35:42,023:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:42,023:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:42,024:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h1ttfu832du7etb2emyy_source-yydLsrRn.mp4
2023-05-31 10:35:42,625:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:42,626:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:42,626:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gwip3ykwt080emoaw6sg_source-YQUV5rns.mp4
2023-05-31 10:35:43,228:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:43,228:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:43,228:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gs355ytthzmlacme7n1d_source-HC8I5Q64.mp4
2023-05-31 10:35:43,867:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:43,868:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:43,868:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gqk459lj0voxieasahsy_source-MfgsHsom.mp4
2023-05-31 10:35:44,446:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:44,446:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:44,447:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h8umoj3cxa2zev94b0us_source-wIzhq1rV.mp4
2023-05-31 10:35:45,055:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:45,055:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:45,055:DEBUG:base_functions:base_functions.py:54:Failed Download: 5f600634b88592a0e79f3_source-1PaiemAt.mp4
2023-05-31 10:35:45,666:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:45,666:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:45,666:DEBUG:base_functions:base_functions.py:54:Failed Download: 5f13792cabee5eb6254c1_source-MMd06inW.mp4
2023-05-31 10:35:46,283:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:46,289:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:46,289:DEBUG:base_functions:base_functions.py:54:Failed Download: 5f2cbe78acc55fd8d0bfc_source-iZFljAm7.mp4
2023-05-31 10:35:46,867:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:46,867:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:46,868:DEBUG:base_functions:base_functions.py:54:Failed Download: 5f165c099112f251dc547_source-aGzssI0a.mp4
2023-05-31 10:35:47,485:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:47,485:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:47,486:DEBUG:base_functions:base_functions.py:54:Failed Download: 5f10932fb8eeeac5d91f1_source-L864pkrC.mp4
2023-05-31 10:35:48,072:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:48,072:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:48,072:DEBUG:base_functions:base_functions.py:54:Failed Download: 5f0a5144a9303a1f2c614_source-cwdrBSuT.mp4
2023-05-31 10:35:48,691:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:48,691:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:48,691:DEBUG:base_functions:base_functions.py:54:Failed Download: 5eff7abac0dae49e7ed18_source-0XVUNKaY.mp4
2023-05-31 10:35:49,298:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:49,298:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:49,298:DEBUG:base_functions:base_functions.py:54:Failed Download: 5efad9f9dcfc49b49afc5_source-IKVtWn5a.mp4
2023-05-31 10:35:49,880:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:49,880:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:49,880:DEBUG:base_functions:base_functions.py:54:Failed Download: 5ec70a6e67a35b1ec9768_source-zv7ks2kP.mp4
2023-05-31 10:35:50,498:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:50,498:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:50,498:DEBUG:base_functions:base_functions.py:54:Failed Download: 5ea956654bab574a3be60_source-doeenWfw.mp4
2023-05-31 10:35:51,101:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:51,101:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:51,101:DEBUG:base_functions:base_functions.py:54:Failed Download: 5eb13809d415050abfbfd_source-9zUkCtlB.mp4
2023-05-31 10:35:51,689:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:51,689:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:51,689:DEBUG:base_functions:base_functions.py:54:Failed Download: 5ee9e3e29d7c2a3182d42_source-ackmrtnP.mp4
2023-05-31 10:35:52,315:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:52,316:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:52,316:DEBUG:base_functions:base_functions.py:54:Failed Download: 5e7c4c9e979619341279b_source-on6us7cn.mp4
2023-05-31 10:35:52,912:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:52,912:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:52,912:DEBUG:base_functions:base_functions.py:54:Failed Download: 5e80f835aea7f06c6c031_source-H8qkdEDw.mp4
2023-05-31 10:35:53,531:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:53,531:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:53,532:DEBUG:base_functions:base_functions.py:54:Failed Download: 5e7c437b4c551f39a1e03_source-GCAFrYqW.mp4
2023-05-31 10:35:54,136:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:54,136:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:54,136:DEBUG:base_functions:base_functions.py:54:Failed Download: 5e977da06fc046facdd40_source-4JUdKmTW.mp4
2023-05-31 10:35:54,740:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-31 10:35:54,740:DEBUG:downloaders:downloaders.py:214:We ran into a 400 level error: 403
2023-05-31 10:35:54,740:DEBUG:base_functions:base_functions.py:54:Failed Download: 5e7e53d5411988736c9aa_source-R2Lt5LJV.mp4
2023-05-31 10:35:55,344:DEBUG:downloaders:downloaders.py:210:

Please, Log in or Register to see links and images

(Forbidden)

2023-05-31 10:36:00,213:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h29sd2z6xqqn5ik58y3b_source-QuWiVmvZ.mp4
2023-05-31 10:36:00,295:DEBUG:base_functions:base_functions.py:54:| [green]Files Complete: 0[/green] - [yellow]Files Skipped: 0[/yellow] - [red]Files Failed: 32[/red] |
2023-05-31 10:36:00,297:DEBUG:base_functions:base_functions.py:54:
2023-05-31 10:36:00,298:DEBUG:base_functions:base_functions.py:54:Checking for incomplete downloads
2023-05-31 10:36:00,387:DEBUG:base_functions:base_functions.py:54:Purging empty directories
2023-05-31 10:36:00,505:DEBUG:base_functions:base_functions.py:54:Finished downloading. Enjoy :)
2023-05-31 10:36:00,506:DEBUG:base_functions:base_functions.py:54:There are partial downloads in the downloads folder.
2023-05-31 10:36:00,507:DEBUG:base_functions:base_functions.py:54:
2023-05-31 10:36:00,507:DEBUG:base_functions:base_functions.py:54:If you enjoy using this program, please consider buying the developer a coffee :)

Please, Log in or Register to see links and images

2023-05-31 10:36:00,509:DEBUG:sql_helper:sql_helper.py:281:Successfully closed sqlite database connection

i am able to download the files manual

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

Yea. I don't know what the issue is currently. Waiting to hear back from Bunkr.

 

[Overt_Ninja]

Please, Log in or Register to view quotes

Uh never mind, I solved it somehow by changing which folder the cyberdrop-dl files were located and that seemed to fix all my issues. Thanks, your programmed works well.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

The reason Cyberdrop-DL has trouble with some Bunkr files currently is due to DDOS-Guard

 

[ucciee]

Please, Log in or Register to view quotes

thanks . makes sense.

 

[remizca]

for some reason the program wouldn't start downloading and only pause then asks to press any key to continue only for it to exit.

[old imgur media embed was here once, but it's now gone]

 

[Koninja]

I successfully scraped some bunkr albums, but had to keep rerunning multiple times after "failed" results. Others, just flat out failed. At this point, I'm lost as whether it's bunkr, the program, or on my end.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

I need to deal with this still. If you want a solution now, upgrade python to 3.10 or 3.11. There is an incompatibility with 3.7 I haven't sorted out yet.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

Please, Log in or Register to view quotes

See the above.

 

[Koninja]

Please, Log in or Register to view quotes

So, is there a solution? Or there's nothing to be done?

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

For the 403 Forbiddens, nothing that can be done through the program. Either you'll have to wait to see if it improves, or download the failing files manually. 503 Service unavailable failures should work after a few hours, they are due to bunkr backups iirc.

 

[remizca]

Please, Log in or Register to view quotes

i have them installed except 3.11. how do i know which version the program is using?

 

[jingle]

Is it known that nsfw.xxx not working or is it just on my end?

Spoiler: log

Please, Log in or Register to view spoilers

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

Don't have more than one installed. I'd recommend uninstalling them all and only having one.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

That's a connection issue from your computer, not an issue with the program. I don't know if nsfw.xxx does geoblocking, but as a reminder, CDL can't download from sites your computer can't connect to, you will need to use a computer wide VPN if that is the case.