Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads

[Match_stick]

I was using cyberdrop-dl but I encoutered this problem that as most of the times I scrape threads then if a video is provided with both 2160p and 1080p resolution the both videos get downloaded, this causes unnecessary bandwidth and time usage. This maybe the case both the resolution can be hosted on diffrent sites and cyberdrop-dl downloads both.
Therefore I was wondering is there any provision to skip a particular download after running the script. So that I can have only one quality of a file not having multiple different qualities of same file.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

need to see the downloader.log file

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

you can skip sites, file formats, in the config, but there is no way to do any skipping while running, no.

 

[Arclight23]

Please, Log in or Register to view quotes

2023-05-21 17:26:14,440:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gwd53si0dym2hkwzw548_source-2amzLVCl.mp4
2023-05-21 17:26:15,449:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:15,449:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:15,449:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h1nsu8s0ev1h2rqt8jiy_source-30B6RCdP.mp4
2023-05-21 17:26:16,322:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:16,322:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:16,322:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h2vunpofhon4rm93c6uh_source-XlDqjxSD.mp4
2023-05-21 17:26:18,128:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:18,128:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:18,128:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gwcp372pjesxlodcl5c9_source-17Qa7Jna.mp4
2023-05-21 17:26:21,805:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:21,805:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:21,805:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gwtxi9df6hn0s6fcjygp_source-2jHYD8bO.mp4
2023-05-21 17:26:22,191:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:22,191:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:22,191:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gxhqn386fjr0st08zbpk_source-IKzWzDvv.mp4
2023-05-21 17:26:23,868:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:23,868:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:23,868:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gwoja5mqxbt0qn7kfeaa_source-Rc1LBCLq.mp4
2023-05-21 17:26:24,240:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:24,240:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:24,240:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h6tol69z9l9hd8krvils_source-GUoGxI3h.mp4
2023-05-21 17:26:26,626:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:26,641:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:26,641:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gxxl3862rtf75qhnnvpa_source-sWZtQvJC.mp4
2023-05-21 17:26:28,285:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:28,285:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:28,285:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h44o8x45g0tqn209mplv_source-oeHnxPTa.mp4
2023-05-21 17:26:28,930:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:28,930:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:28,930:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h7q2pxpa6y6hm9s8w5ga_source-RvSbnW6e.mp4
2023-05-21 17:26:30,383:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:30,383:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:30,384:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gx0d1j0i1m6ywh244d7a_source-Zqi4Moxh.mp4
2023-05-21 17:26:30,991:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:31,006:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:31,006:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h1cd10g6qr7l9li7s3bv_source-OYMpx9BL.mp4
2023-05-21 17:26:33,208:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:33,208:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:33,208:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h1sfx73ma967o6r9hucj_source-sqUplUFZ.mp4
2023-05-21 17:26:33,780:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:33,780:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:33,780:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h8k9rqm5s2dxk3pyqpfz_source-aK2HVHkE.mp4
2023-05-21 17:26:35,820:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:35,820:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:35,820:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h4g6iz02o5mtqxhzugkd_source-oFNkG0Wb.mp4
2023-05-21 17:26:36,939:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:36,939:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:36,939:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gwayj17zjip0dikk24sj_source-d45oXrXt.mp4
2023-05-21 17:26:37,980:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:37,980:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:37,980:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h73e9gt5i0n9ospp8u16_source-t99Hcu3v.mp4
2023-05-21 17:26:39,670:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:39,670:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:39,670:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gxe4mrgwol8y7pxovagl_source-m2vfZ5tB.mp4
2023-05-21 17:26:40,126:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:40,126:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:40,126:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gwf5w59ki3fnksbev0lu_source-YkaqrBe1.mp4
2023-05-21 17:26:41,644:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:41,644:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:41,644:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h3olumrp56uivd4hlxa2_source-sJpkuyr1.mp4
2023-05-21 17:26:42,781:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:42,781:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:42,781:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gwqq96cxwpawzsmiabma_source-XIm0qQb9.mp4
2023-05-21 17:26:44,050:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:44,050:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:44,050:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h8fq6bgc44n2zloannjj_source-CCH1KwyH.mp4
2023-05-21 17:26:45,841:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:45,841:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:45,841:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gyg9jrq9ephy54o90btp_source-kkh3XPpy.mp4
2023-05-21 17:26:47,038:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:47,038:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:47,038:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h8nrdbw6zu8hha56mqqc_source-ytQ1ZGc8.mp4
2023-05-21 17:26:47,929:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:47,929:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:47,929:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h1ljw389uyf6p00h34fl_source-yoGbGCa1.mp4
2023-05-21 17:26:47,985:DEBUG:base_functions:base_functions.py:54:| [green]Files Complete: 0[/green] - [yellow]Files Skipped: 0[/yellow] - [red]Files Failed: 33[/red] |
2023-05-21 17:26:47,987:DEBUG:base_functions:base_functions.py:54:
2023-05-21 17:26:47,987:DEBUG:base_functions:base_functions.py:54:Checking for incomplete downloads
2023-05-21 17:26:47,990:DEBUG:base_functions:base_functions.py:54:Purging empty directories
2023-05-21 17:26:47,994:DEBUG:base_functions:base_functions.py:54:Finished downloading. Enjoy :)
2023-05-21 17:26:47,995:DEBUG:base_functions:base_functions.py:54:There are partial downloads in the downloads folder.
2023-05-21 17:26:47,995:DEBUG:base_functions:base_functions.py:54:
2023-05-21 17:26:47,996:DEBUG:base_functions:base_functions.py:54:If you enjoy using this program, please consider buying the developer a coffee :)

Please, Log in or Register to see links and images

2023-05-21 17:26:47,997:DEBUG:sql_helper:sql_helper.py:281:Successfully closed sqlite database connection

 

[Arclight23]

2023-05-21 17:25:51,542:DEBUG:proactor_events:proactor_events.py:626:Using proactor: IocpProactor
2023-05-21 17:25:51,587:DEBUG:base_functions:base_functions.py:54:Starting Cyberdrop-DL
2023-05-21 17:25:51,610:DEBUG:base_functions:base_functions.py:54:Using authentication arguments: {'gofile_api_key': '!REDACTED!', 'pixeldrain_api_key': '!REDACTED!', '*Blacklisted site*_username': '', '*Blacklisted site*_password': '!REDACTED!', 'simpcity_username': '', 'simpcity_password': '!REDACTED!', '*Blacklisted site*_username': '', '*Blacklisted site*_password': '!REDACTED!', 'xbunker_username': '', 'xbunker_password': '!REDACTED!'}
2023-05-21 17:25:51,610:DEBUG:base_functions:base_functions.py:54:Using file arguments: {'db_file': WindowsPath('download_history.sqlite'), 'errored_download_urls_file': WindowsPath('Errored_Download_URLs.csv'), 'errored_scrape_urls_file': WindowsPath('Errored_Scrape_URLs.csv'), 'input_file': WindowsPath('URLs.txt'), 'log_file': WindowsPath('downloader.log'), 'output_folder': WindowsPath('Downloads'), 'output_last_forum_post_file': WindowsPath('URLs_last_post.txt'), 'unsupported_urls_file': WindowsPath('Unsupported_URLs.csv')}
2023-05-21 17:25:51,610:DEBUG:base_functions:base_functions.py:54:Using forum option arguments: {'output_last_forum_post': False, 'scrape_single_post': False, 'separate_posts': False}
2023-05-21 17:25:51,611:DEBUG:base_functions:base_functions.py:54:Using ignore arguments: {'exclude_videos': False, 'exclude_images': False, 'exclude_audio': False, 'exclude_other': False, 'ignore_cache': False, 'ignore_history': False, 'skip_hosts': [], 'only_hosts': []}
2023-05-21 17:25:51,611:DEBUG:base_functions:base_functions.py:54:Using jdownloader arguments: {'apply_jdownloader': False, 'jdownloader_username': '', 'jdownloader_password': '!REDACTED!', 'jdownloader_device': ''}
2023-05-21 17:25:51,611:DEBUG:base_functions:base_functions.py:54:Using progress option arguments: {'hide_new_progress': False, 'hide_overall_progress': False, 'hide_forum_progress': False, 'hide_thread_progress': False, 'hide_domain_progress': False, 'hide_album_progress': False, 'hide_file_progress': False, 'refresh_rate': 10, 'visible_rows_threads': 2, 'visible_rows_domains': 2, 'visible_rows_albums': 2, 'visible_rows_files': 10}
2023-05-21 17:25:51,611:DEBUG:base_functions:base_functions.py:54:Using ratelimiting arguments: {'connection_timeout': 15, 'ratelimit': 50, 'throttle': 0.5}
2023-05-21 17:25:51,611:DEBUG:base_functions:base_functions.py:54:Using runtime arguments: {'allow_insecure_connections': False, 'attempts': 10, 'block_sub_folders': False, 'disable_attempt_limit': False, 'include_id': False, 'max_concurrent_threads': 0, 'max_concurrent_domains': 0, 'max_concurrent_albums': 0, 'max_concurrent_downloads_per_domain': 4, 'output_errored_urls': False, 'output_unsupported_urls': False, 'proxy': '', 'remove_bunkr_identifier': False, 'required_free_space': 5, 'skip_download_mark_completed': False, 'user_agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/112.0'}
2023-05-21 17:25:51,611:DEBUG:base_functions:base_functions.py:54:Using sorting arguments: {'sort_downloads': False, 'sort_directory': WindowsPath('Sorted Downloads'), 'sorted_audio': '{sort_dir}/{base_dir}/Audio', 'sorted_images': '{sort_dir}/{base_dir}/Images', 'sorted_others': '{sort_dir}/{base_dir}/Other', 'sorted_videos': '{sort_dir}/{base_dir}/Videos'}
2023-05-21 17:25:51,611:DEBUG:base_functions:base_functions.py:54:We are running version 4.2.39 of Cyberdrop Downloader
2023-05-21 17:25:51,776:DEBUG:base_functions:base_functions.py:54:Starting Scrape
2023-05-21 17:25:51,777:DEBUG:base_functions:base_functions.py:54:Starting:

Please, Log in or Register to see links and images

2023-05-21 17:25:58,038:DEBUG:base_functions:base_functions.py:54:Finished:

Please, Log in or Register to see links and images

2023-05-21 17:25:58,040:DEBUG:base_functions:base_functions.py:54:
2023-05-21 17:25:58,041:DEBUG:base_functions:base_functions.py:54:Finished Scrape
2023-05-21 17:26:05,669:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:05,669:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:05,670:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gwaear830skd1t9aafvr_source-2bRprNfk.mp4
2023-05-21 17:26:06,389:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:06,389:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:06,389:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h8k931pu8aubdyepqioz_source-4qFXYvsM.mp4
2023-05-21 17:26:08,338:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:08,338:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:08,338:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h0ybkoyakhjm7c9p49vg_source-mckirBtg.mp4
2023-05-21 17:26:08,758:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:08,758:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:08,758:DEBUG:base_functions:base_functions.py:54:Failed Download: 0gxwff9o5cxmkto8pw4v8_source-1mzZiBBT.mp4
2023-05-21 17:26:10,402:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:10,402:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:10,402:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h2jxj71n47avax0z40yo_source-Zie9gpA1.mp4
2023-05-21 17:26:11,829:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:11,829:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:11,829:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h6ohwk2iearz5zn7inr8_source-iVssGUVZ.mp4
2023-05-21 17:26:11,829:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:11,829:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:11,829:DEBUG:base_functions:base_functions.py:54:Failed Download: 0h7bou6ksfnrw87usajhd_source-8HtfxZYK.mp4
2023-05-21 17:26:14,440:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Bad Gateway)
2023-05-21 17:26:14,440:DEBUG:downloaders:downloaders.py:229:

Please, Log in or Register to see links and images

(Bad Gateway)

 

[Arclight23]

Please, Log in or Register to see links and images

this is th problem link

 

[Monkjew]

All my downloads are failing now... Here's my log, anyone know what's going on?

2023-05-21 07:50:39,561:DEBUG:proactor_events:proactor_events.py:625:Using proactor: IocpProactor
2023-05-21 07:50:39,582:DEBUG:base_functions:base_functions.py:54:Starting Cyberdrop-DL
2023-05-21 07:50:39,587:DEBUG:base_functions:base_functions.py:54:Using authentication arguments: {'gofile_api_key': '!REDACTED!', 'pixeldrain_api_key': '!REDACTED!', '*Blacklisted site*_username': '', '*Blacklisted site*_password': '!REDACTED!', 'simpcity_username': '', 'simpcity_password': '!REDACTED!', '*Blacklisted site*_username': '', '*Blacklisted site*_password': '!REDACTED!', 'xbunker_username': '', 'xbunker_password': '!REDACTED!'}
2023-05-21 07:50:39,587:DEBUG:base_functions:base_functions.py:54:Using file arguments: {'db_file': WindowsPath('download_history.sqlite'), 'errored_download_urls_file': WindowsPath('Errored_Download_URLs.csv'), 'errored_scrape_urls_file': WindowsPath('Errored_Scrape_URLs.csv'), 'input_file': WindowsPath('URLs.txt'), 'log_file': WindowsPath('downloader.log'), 'output_folder': WindowsPath('Downloads'), 'output_last_forum_post_file': WindowsPath('URLs_last_post.txt'), 'unsupported_urls_file': WindowsPath('Unsupported_URLs.csv')}
2023-05-21 07:50:39,587:DEBUG:base_functions:base_functions.py:54:Using forum option arguments: {'output_last_forum_post': False, 'scrape_single_post': False, 'separate_posts': False}
2023-05-21 07:50:39,587:DEBUG:base_functions:base_functions.py:54:Using ignore arguments: {'exclude_videos': False, 'exclude_images': False, 'exclude_audio': False, 'exclude_other': False, 'ignore_cache': False, 'ignore_history': False, 'skip_hosts': [], 'only_hosts': []}
2023-05-21 07:50:39,587:DEBUG:base_functions:base_functions.py:54:Using jdownloader arguments: {'apply_jdownloader': False, 'jdownloader_username': '', 'jdownloader_password': '!REDACTED!', 'jdownloader_device': ''}
2023-05-21 07:50:39,587:DEBUG:base_functions:base_functions.py:54:Using progress option arguments: {'hide_new_progress': False, 'hide_overall_progress': False, 'hide_forum_progress': False, 'hide_thread_progress': False, 'hide_domain_progress': False, 'hide_album_progress': False, 'hide_file_progress': False, 'refresh_rate': 10, 'visible_rows_threads': 2, 'visible_rows_domains': 2, 'visible_rows_albums': 2, 'visible_rows_files': 10}
2023-05-21 07:50:39,587:DEBUG:base_functions:base_functions.py:54:Using ratelimiting arguments: {'connection_timeout': 15, 'ratelimit': 50, 'throttle': 0.5}
2023-05-21 07:50:39,587:DEBUG:base_functions:base_functions.py:54:Using runtime arguments: {'allow_insecure_connections': False, 'attempts': 10, 'block_sub_folders': False, 'disable_attempt_limit': False, 'include_id': False, 'max_concurrent_threads': 0, 'max_concurrent_domains': 0, 'max_concurrent_albums': 0, 'max_concurrent_downloads_per_domain': 4, 'output_errored_urls': False, 'output_unsupported_urls': False, 'proxy': '', 'remove_bunkr_identifier': False, 'required_free_space': 5, 'skip_download_mark_completed': False, 'user_agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/112.0'}
2023-05-21 07:50:39,587:DEBUG:base_functions:base_functions.py:54:Using sorting arguments: {'sort_downloads': False, 'sort_directory': WindowsPath('Sorted Downloads'), 'sorted_audio': '{sort_dir}/{base_dir}/Audio', 'sorted_images': '{sort_dir}/{base_dir}/Images', 'sorted_others': '{sort_dir}/{base_dir}/Other', 'sorted_videos': '{sort_dir}/{base_dir}/Videos'}
2023-05-21 07:50:39,587:DEBUG:base_functions:base_functions.py:54:We are running version 4.2.39 of Cyberdrop Downloader
2023-05-21 07:50:39,610:DEBUG:base_functions:base_functions.py:54:Starting Scrape
2023-05-21 07:50:39,611:DEBUG:base_functions:base_functions.py:54:Starting:

Please, Log in or Register to see links and images

2023-05-21 07:50:40,083:DEBUG:base_functions:base_functions.py:54:Finished:

Please, Log in or Register to see links and images

2023-05-21 07:50:40,084:DEBUG:base_functions:base_functions.py:54:
2023-05-21 07:50:40,084:DEBUG:base_functions:base_functions.py:54:Finished Scrape
2023-05-21 07:50:45,481:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-21 07:50:45,481:DEBUG:downloaders:downloaders.py:217:We ran into a 400 level error: 403
2023-05-21 07:50:45,481:DEBUG:base_functions:base_functions.py:54:Failed Download: joejoex7_02022020_0716_couple_chaturbate-hl3gUTyK.mp4
2023-05-21 07:50:46,001:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-21 07:50:46,009:DEBUG:downloaders:downloaders.py:217:We ran into a 400 level error: 403
2023-05-21 07:50:46,009:DEBUG:base_functions:base_functions.py:54:Failed Download: joejoex7_02022020_0534_couple_chaturbate-E6sYpdOM.mp4
2023-05-21 07:50:46,608:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-21 07:50:46,608:DEBUG:downloaders:downloaders.py:217:We ran into a 400 level error: 403
2023-05-21 07:50:46,608:DEBUG:base_functions:base_functions.py:54:Failed Download: joejoex7_02022020_0621_couple_chaturbate-aZDC7JGE.mp4
2023-05-21 07:50:47,216:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-21 07:50:47,216:DEBUG:downloaders:downloaders.py:217:We ran into a 400 level error: 403
2023-05-21 07:50:47,216:DEBUG:base_functions:base_functions.py:54:Failed Download: joejoex7_02022020_0446_couple_chaturbate-00wSMN7s.mp4
2023-05-21 07:50:47,801:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-21 07:50:47,809:DEBUG:downloaders:downloaders.py:217:We ran into a 400 level error: 403
2023-05-21 07:50:47,809:DEBUG:base_functions:base_functions.py:54:Failed Download: joejoex7_02022020_0709_couple_chaturbate-RpHHb6GP.mp4
2023-05-21 07:50:48,423:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-21 07:50:48,423:DEBUG:downloaders:downloaders.py:217:We ran into a 400 level error: 403
2023-05-21 07:50:48,423:DEBUG:base_functions:base_functions.py:54:Failed Download: joejoex7_05022020_0644_couple_chaturbate-TWVjS4cW.mp4
2023-05-21 07:50:49,028:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-21 07:50:49,028:DEBUG:downloaders:downloaders.py:217:We ran into a 400 level error: 403
2023-05-21 07:50:49,028:DEBUG:base_functions:base_functions.py:54:Failed Download: joejoex7_09022020_0452_couple_chaturbate-8Ax8GGFh.mp4
2023-05-21 07:50:49,631:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-21 07:50:49,631:DEBUG:downloaders:downloaders.py:217:We ran into a 400 level error: 403
2023-05-21 07:50:49,631:DEBUG:base_functions:base_functions.py:54:Failed Download: joejoex7_05022020_0717_couple_chaturbate-yjKQfiIo.mp4
2023-05-21 07:50:50,245:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-21 07:50:50,245:DEBUG:downloaders:downloaders.py:217:We ran into a 400 level error: 403
2023-05-21 07:50:50,245:DEBUG:base_functions:base_functions.py:54:Failed Download: joejoex7_06022020_0506_couple_chaturbate-53Ac4aE8.mp4
2023-05-21 07:50:50,841:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-21 07:50:50,841:DEBUG:downloaders:downloaders.py:217:We ran into a 400 level error: 403
2023-05-21 07:50:50,841:DEBUG:base_functions:base_functions.py:54:Failed Download: joejoex7_12012020_0219_couple_chaturbate-LiTVV00H.mp4
2023-05-21 07:50:51,435:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-21 07:50:51,443:DEBUG:downloaders:downloaders.py:217:We ran into a 400 level error: 403
2023-05-21 07:50:51,443:DEBUG:base_functions:base_functions.py:54:Failed Download: joejoex7_08022020_0403_couple_chaturbate-nwuuMeAr.mp4
2023-05-21 07:50:52,045:DEBUG:downloaders:downloaders.py:213:

Please, Log in or Register to see links and images

(Forbidden)
2023-05-21 07:50:52,045:DEBUG:downloaders:downloaders.py:217:We ran into a 400 level error: 403
2023-05-21 07:50:52,045:DEBUG:base_functions:base_functions.py:54:Failed Download: joejoex7_08022020_0639_couple_chaturbate-SkJqiUgy.mp4
2023-05-21 07:50:52,071:DEBUG:base_functions:base_functions.py:54:| [green]Files Complete: 0[/green] - [yellow]Files Skipped: 0[/yellow] - [red]Files Failed: 12[/red] |
2023-05-21 07:50:52,072:DEBUG:base_functions:base_functions.py:54:
2023-05-21 07:50:52,072:DEBUG:base_functions:base_functions.py:54:Checking for incomplete downloads
2023-05-21 07:50:52,073:DEBUG:base_functions:base_functions.py:54:Purging empty directories
2023-05-21 07:50:52,073:DEBUG:base_functions:base_functions.py:54:Finished downloading. Enjoy :)
2023-05-21 07:50:52,073:DEBUG:base_functions:base_functions.py:54:
2023-05-21 07:50:52,074:DEBUG:base_functions:base_functions.py:54:If you enjoy using this program, please consider buying the developer a coffee :)

Please, Log in or Register to see links and images

2023-05-21 07:50:52,074:DEBUG:sql_helper:sql_helper.py:281:Successfully closed sqlite database connection

 

[fssh]

It seems like the Unsupported_URLs.csv has broken. It just says

Please, Log in or Register to view codes content!

without the actual URL or forum URL.

I'm guessing it has something to do with this commit, tho I'm not good with python:

Please, Log in or Register to see links and images

Edit: using the previous version/commit, 4.2.31, seems to fix the issue.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

that's a bunkr issue.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

also a bunkr issue

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

fixed in 4.2.41

 

[hkei]

I'm finding redgifs not appearing in Unsupported_URLs, even with 4.2.41 today. Is this a related bug?

Spoiler: Log

Please, Log in or Register to view spoilers

EDIT: I also noticed the last two updates that the config.yaml has changed 1-2 times in the last week, as my Notepadd++ lets me know I need to 'refresh/reload' certain files when they've been edited outside the app.

My current files in my folder:
Errored_URLs.csv
Unsupported_URLs.csv

But I see the configyaml has now:
errored_download_urls_file: Errored_Download_URLs.csv
errored_scrape_urls_file: Errored_Scrape_URLs.csv
input_file: URLs.txt
log_file: downloader.log
output_folder: Downloads
output_last_forum_post_file: URLs_last_post.txt
unsupported_urls_file: Unsupported_URLs.csv

after the latest update, running one rip with unsupported link such as RedGIF, I still only have those two CSVs, no "Errored_Scrape_URLs" or "Errored_Download_URLs" yet... should I create them?

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

Bug, 4.2.43 fixes unsupported file not working properly.

The other two are created with the output_errored_urls flag. Neither of these will show unsupported urls. Just errors that happen during scraping, or downloading. (these were also fixed in 4.2.43)

Configs did change twice over the last few days though. That was on purpose.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

I was wrong about this, bad gateway is a bunkr issue, the 403 was on me. It's fixed

 

[Monkjew]

Please, Log in or Register to view quotes

Awesome thank you! Confirmed working

 

[mikaelmikaelmikael]

Please, Log in or Register to view quotes

can someone download it for me? or if someone has a recommendation for a good vpn that is free, thank you!

 

[otherooo]

Simple and pretty basic question: I have shit internet that drops a lot, usually for only a minute at a time. When this happens while downloading directly from bunkr using a browser, I can restart the download and it continues from where it stopped when the network dropped. Haven't been able to figure out how to do that with this tool. It just stops and remains where it was when the network dropped. Is there a way to nudge it to restart the download? Or am I SOL till xfinity gets their shit together.

 

[Jules--Winnfield]

Please, Log in or Register to view quotes

Stop CDL and restart it, it'll resume where it left off, but will have to do the scraping process again.

 

[daduv]

how can i solve this error??

Please, Log in or Register to see links and images

 

[grabo]

It started scraping but aint goin further with script :(
THis problem i have for 2 days now.

Latest version ofc