Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads

businessskeleton

Fan
Apr 1, 2023
6
50
228
0fya082315al84db03fa9bf467e3.png
Program erroring out when it starts sorting, this has happened after upgrading to v5

Unhandled exception; stopping loop: 'Task exception was never retrieved' Traceback (most recent call last): File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\aiorun.py", line 219, in new_coro await coro File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\cyberdrop_dl\main.py", line 88, in director await sorter.sort() File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\cyberdrop_dl\utils\sorting.py", line 75, in sort await self.sort_video(file, folder.name) File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\cyberdrop_dl\utils\sorting.py", line 129, in sort_video props = get_video_properties(str(file)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\videoprops\__init__.py", line 62, in get_video_properties return get_stream_properties(movie, *P_VIDEO) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\videoprops\__init__.py", line 52, in get_stream_properties output = check_output([which_ffprobe(), *ffprobe_args, movie], encoding='utf-8') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\subprocess.py", line 465, in check_output return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\subprocess.py", line 569, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['C:\\Users\\simcity\\AppData\\Local\\Programs\\Python\\Python311\\Lib\\site-packages\\videoprops\\binary_dependencies\\ffprobe.exe', '-loglevel', 'panic', '-select_streams', 'v:0', '-show_streams', '-print_format', 'json', 'Downloads\\Shailoshana (SimpCity)\\shailo (Bunkrr)\\0hg1j7cfef5h9odoppwi5_source (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1).mp4']' returned non-zero exit status 1. Traceback (most recent call last): File "<frozen runpy>", line 198, in _run_module_as_main File "<frozen runpy>", line 88, in _run_code File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Scripts\cyberdrop-dl.exe\__main__.py", line 7, in <module> File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\cyberdrop_dl\main.py", line 111, in main aiorun.run(director(manager), stop_on_unhandled_errors=True) File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\aiorun.py", line 371, in run raise pending_exception_to_raise File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\aiorun.py", line 219, in new_coro await coro File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\cyberdrop_dl\main.py", line 88, in director await sorter.sort() File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\cyberdrop_dl\utils\sorting.py", line 75, in sort await self.sort_video(file, folder.name) File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\cyberdrop_dl\utils\sorting.py", line 129, in sort_video props = get_video_properties(str(file)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\videoprops\__init__.py", line 62, in get_video_properties return get_stream_properties(movie, *P_VIDEO) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\site-packages\videoprops\__init__.py", line 52, in get_stream_properties output = check_output([which_ffprobe(), *ffprobe_args, movie], encoding='utf-8') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\subprocess.py", line 465, in check_output return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\simcity\AppData\Local\Programs\Python\Python311\Lib\subprocess.py", line 569, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['C:\\Users\\simcity\\AppData\\Local\\Programs\\Python\\Python311\\Lib\\site-packages\\videoprops\\binary_dependencies\\ffprobe.exe', '-loglevel', 'panic', '-select_streams', 'v:0', '-show_streams', '-print_format', 'json', 'Downloads\\Shailoshana (SimpCity)\\shailo (Bunkrr)\\0hg1j7cfef5h9odoppwi5_source (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1) (1).mp4']' returned non-zero exit status 1.
 

devil5advocate

Tier 3 Sub
Oct 3, 2023
7
467
600
0fya082315al84db03fa9bf467e3.png
I was grabbing from bunkrr and it was working fine earlier today (although still seeing a lot of 429 errors). But now it's no longer finding anything and seeing a 403 HTTP status error. Version is 5.0.67. I went to the bunkrr page with the browser and the page shows up fine.
 
  • Like
Reactions: Shaggy12777

Shaggy12777

Lurker
Mar 11, 2022
21
3
52
0fya082315al84db03fa9bf467e3.png
Hey
Has anyonw been able to download from social media Forum? cuz my Ui keep on trying and it does not get a error message but it has the right user and pass so im not sure if i am doing something wrong
 

Jar of Pickles

Bathwater Drinker
Mar 29, 2023
80
2,222
1,242
0fya082315al84db03fa9bf467e3.png
i like that version 5.0.67 adds the numbers in the thread URL into the folder name. I had some folders merging because the forum thread had the same name, but they were meant to be seperate because seperate tags.
 
Last edited:

XOAnonymous

Lurker
Jul 23, 2022
9
2
58
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
2023-12-07 09:25:44,755:utilities.py:81:Starting Cyberdrop-DL Process for Imported V4 Config
2023-12-07 09:25:44,755:utilities.py:81:Running version 5.0.67
2023-12-07 09:25:44,755:utilities.py:81:Using Authentication:
{
"DDOS-Guard": {
"Bunkrr Provided": false,
"Coomer Provided": false,
"Kemono Provided": false
},
"Forums Credentials": {
"celebforum Credentials Provided": false,
"f95zone Credentials Provided": false,
"leakedmodels Credentials Provided": false,
"*Blacklisted site* Credentials Provided": false,
"simpcity Credentials Provided": false,
"*Blacklisted site* Credentials Provided": false,
"shit forum Credentials Provided": false
},
"Forums XF Cookies": {
"celebforum XF Cookie Provided": false,
"f95zone XF Cookie Provided": false,
"leakedmodels XF Cookie Provided": false,
"*Blacklisted site* XF Cookie Provided": false,
"simpcity XF Cookie Provided": false,
"*Blacklisted site* XF Cookie Provided": false,
"shit forum XF Cookie Provided": false
},
"GoFile Provided": false,
"Imgur Provided": false,
"JDownloader Provided": false,
"PixelDrain Provided": false,
"Reddit Provided": false
}
2023-12-07 09:25:44,756:utilities.py:81:Using Settings:
{
"Download_Options": {
"block_download_sub_folders": false,
"disable_download_attempt_limit": false,
"disable_file_timestamps": false,
"include_album_id_in_folder_name": false,
"include_thread_id_in_folder_name": false,
"remove_domains_from_folder_names": false,
"remove_generated_id_from_filenames": false,
"scrape_single_forum_post": false,
"separate_posts": false,
"skip_download_mark_completed": false
},
"File_Size_Limits": {
"maximum_image_size": 0,
"maximum_other_size": 0,
"maximum_video_size": 0,
"minimum_image_size": 0,
"minimum_other_size": 0,
"minimum_video_size": 0
},
"Files": {
"download_folder": "E:\\Cyberdrop\\Downloads",
"input_file": "E:\\Cyberdrop\\AppData\\Configs\\Imported V4\\URLs.txt"
},
"Ignore_Options": {
"exclude_audio": false,
"exclude_images": false,
"exclude_other": false,
"exclude_videos": false,
"ignore_coomer_ads": false,
"only_hosts": [],
"skip_hosts": []
},
"Logs": {
"download_error_urls_filename": "Download_Error_URLs.csv",
"last_forum_post_filename": "Last_Scraped_Forum_Posts.txt",
"log_folder": "AppData\\Configs\\Imported V4\\Logs",
"main_log_filename": "downloader.log",
"scrape_error_urls_filename": "Scrape_Error_URLs.csv",
"unsupported_urls_filename": "Unsupported_URLs.txt"
},
"Runtime_Options": {
"delete_partial_files": false,
"ignore_history": false,
"send_unsupported_to_jdownloader": false,
"skip_check_for_empty_folders": false,
"skip_check_for_partial_files": false
},
"Sorting": {
"sort_downloads": false,
"sort_folder": "Downloads\\Cyberdrop-DL Sorted Downloads",
"sort_incremementer_format": " ({i})",
"sorted_audio": "{sort_dir}/{base_dir}/Audio/{filename}{ext}",
"sorted_image": "{sort_dir}/{base_dir}/Images/{filename}{ext}",
"sorted_other": "{sort_dir}/{base_dir}/Other/{filename}{ext}",
"sorted_video": "{sort_dir}/{base_dir}/Videos/{filename}{ext}"
}
}
2023-12-07 09:25:44,756:utilities.py:81:Using Global Settings:
{
"General": {
"allow_insecure_connections": false,
"max_file_name_length": 95,
"max_folder_name_length": 60,
"proxy": "",
"required_free_space": 5,
"user_agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/112.0"
},
"Rate_Limiting_Options": {
"connection_timeout": 15,
"download_attempts": 10,
"download_delay": 0,
"max_simultaneous_downloads": 15,
"max_simultaneous_downloads_per_domain": 4,
"rate_limit": 50,
"read_timeout": 300
}
}
 

XOAnonymous

Lurker
Jul 23, 2022
9
2
58
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
2023-12-07 09:25:44,816:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:44,818:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:45,294:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
('NoneType' object has no attribute 'get')
2023-12-07 09:25:45,295:utilities.py:81:Traceback (most recent call last):
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\utils\utilities.py", line 56, in wrapper
return await func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\scraper\crawlers\jpgchurch_crawler.py", line 84, in image
link = URL(soup.select_one("div[id=image-viewer-container] img").get('src'))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'

2023-12-07 09:25:45,296:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:45,297:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:45,649:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
(403 - HTTP status code 403: Forbidden)
2023-12-07 09:25:45,650:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:45,650:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:45,731:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
('NoneType' object has no attribute 'get')
2023-12-07 09:25:45,731:utilities.py:81:Traceback (most recent call last):
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\utils\utilities.py", line 56, in wrapper
return await func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\scraper\crawlers\jpgchurch_crawler.py", line 84, in image
link = URL(soup.select_one("div[id=image-viewer-container] img").get('src'))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'

2023-12-07 09:25:45,733:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:45,733:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:46,170:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
('NoneType' object has no attribute 'get')
2023-12-07 09:25:46,178:utilities.py:81:Traceback (most recent call last):
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\utils\utilities.py", line 56, in wrapper
return await func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\scraper\crawlers\jpgchurch_crawler.py", line 84, in image
link = URL(soup.select_one("div[id=image-viewer-container] img").get('src'))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'

2023-12-07 09:25:46,179:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:46,179:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:46,471:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
(403 - HTTP status code 403: Forbidden)
2023-12-07 09:25:46,472:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:46,472:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:46,645:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
('NoneType' object has no attribute 'get')
2023-12-07 09:25:46,645:utilities.py:81:Traceback (most recent call last):
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\utils\utilities.py", line 56, in wrapper
return await func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\scraper\crawlers\jpgchurch_crawler.py", line 84, in image
link = URL(soup.select_one("div[id=image-viewer-container] img").get('src'))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'

2023-12-07 09:25:46,647:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:46,647:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:47,188:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
('NoneType' object has no attribute 'get')
2023-12-07 09:25:47,188:utilities.py:81:Traceback (most recent call last):
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\utils\utilities.py", line 56, in wrapper
return await func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\scraper\crawlers\jpgchurch_crawler.py", line 84, in image
link = URL(soup.select_one("div[id=image-viewer-container] img").get('src'))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'

2023-12-07 09:25:47,190:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:47,190:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:47,262:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
(403 - HTTP status code 403: Forbidden)
2023-12-07 09:25:47,263:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:47,652:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
('NoneType' object has no attribute 'get')
2023-12-07 09:25:47,652:utilities.py:81:Traceback (most recent call last):
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\utils\utilities.py", line 56, in wrapper
return await func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\scraper\crawlers\jpgchurch_crawler.py", line 84, in image
link = URL(soup.select_one("div[id=image-viewer-container] img").get('src'))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'

2023-12-07 09:25:47,654:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:47,654:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:49,689:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
('NoneType' object has no attribute 'get')
2023-12-07 09:25:49,689:utilities.py:81:Traceback (most recent call last):
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\utils\utilities.py", line 56, in wrapper
return await func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\scraper\crawlers\jpgchurch_crawler.py", line 84, in image
link = URL(soup.select_one("div[id=image-viewer-container] img").get('src'))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'

2023-12-07 09:25:49,691:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:49,691:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:50,207:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
('NoneType' object has no attribute 'get')
2023-12-07 09:25:50,207:utilities.py:81:Traceback (most recent call last):
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\utils\utilities.py", line 56, in wrapper
return await func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\scraper\crawlers\jpgchurch_crawler.py", line 84, in image
link = URL(soup.select_one("div[id=image-viewer-container] img").get('src'))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'

2023-12-07 09:25:50,209:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:50,209:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:50,652:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
('NoneType' object has no attribute 'get')
2023-12-07 09:25:50,652:utilities.py:81:Traceback (most recent call last):
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\utils\utilities.py", line 56, in wrapper
return await func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\scraper\crawlers\jpgchurch_crawler.py", line 84, in image
link = URL(soup.select_one("div[id=image-viewer-container] img").get('src'))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'

2023-12-07 09:25:50,654:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:50,654:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:51,084:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
('NoneType' object has no attribute 'get')
2023-12-07 09:25:51,084:utilities.py:81:Traceback (most recent call last):
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\utils\utilities.py", line 56, in wrapper
return await func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\scraper\crawlers\jpgchurch_crawler.py", line 84, in image
link = URL(soup.select_one("div[id=image-viewer-container] img").get('src'))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
 
  • Like
Reactions: destroyed

XOAnonymous

Lurker
Jul 23, 2022
9
2
58
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
2023-12-07 09:25:51,086:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:51,086:utilities.py:81:Scrape Starting:
Please, Log in or Register to see links and images

2023-12-07 09:25:51,540:utilities.py:81:Scrape Failed:
Please, Log in or Register to see links and images
('NoneType' object has no attribute 'get')
2023-12-07 09:25:51,540:utilities.py:81:Traceback (most recent call last):
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\utils\utilities.py", line 56, in wrapper
return await func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Cyberdrop\venv\Lib\site-packages\cyberdrop_dl\scraper\crawlers\jpgchurch_crawler.py", line 84, in image
link = URL(soup.select_one("div[id=image-viewer-container] img").get('src'))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'

2023-12-07 09:25:51,542:utilities.py:81:Scrape Finished:
Please, Log in or Register to see links and images

2023-12-07 09:25:51,922:utilities.py:86:Checking for partial downloads...
2023-12-07 09:25:52,149:utilities.py:86:Checking for empty folders...
2023-12-07 09:25:52,344:utilities.py:86:
Download Stats:
2023-12-07 09:25:52,345:utilities.py:86:Downloaded 0 files
2023-12-07 09:25:52,347:utilities.py:86:Previously Downloaded 0 files
2023-12-07 09:25:52,348:utilities.py:86:Skipped By Config 0 files
2023-12-07 09:25:52,350:utilities.py:86:Failed 0 files
2023-12-07 09:25:52,350:utilities.py:86:
Scrape Failures:
2023-12-07 09:25:52,351:utilities.py:86:Scrape Failures (Unknown): 11
2023-12-07 09:25:52,351:utilities.py:86:Scrape Failures (403 HTTP Status): 3
2023-12-07 09:25:52,352:utilities.py:86:
Download Failures:
2023-12-07 09:25:52,752:utilities.py:86:
Finished downloading. Enjoy :)

Sorry for the multiple replies, couldn't send the file
 

DrArchive04

Superfan
Sep 3, 2022
16
711
827
0fya082315al84db03fa9bf467e3.png
How to obtain the DDOS-Guard cookies called:
bunkrr_ddg1
bunkrr_ddg2
bunkrr_ddgid


I tried it with the Browser extractor in the UI but it only added the simpcity ones
 

vinnie12

Casual
Apr 11, 2022
4
31
225
0fya082315al84db03fa9bf467e3.png
hi Jules--Winnfield , just updated to v5 and enjoy the edit url and change url file directory updates.

could I make a suggestion to make a hotkey clear the url file in the editor for a future update?

it could be a lesser used key like "insert" or " ~", maybe even remappable to prevent accidental keypresses
 
  • Like
Reactions: me8372623

jadasiac25

Bathwater Drinker
Mar 12, 2022
89
3,437
1,242
0fya082315al84db03fa9bf467e3.png
Not proficient at all with this stuff but Virtual Environment won't open because my Windows User profile has a space between my first and last name, and it ends the command/etc..?

Please, Log in or Register to see links and images

Win10 / Python 3.11.4 (added to path) / updated to latest V5.0.xx / cyberdrop folder resides in my C:\Users\USER\Downloads ..
Rolling back to the latest version of V4 (diff user's issue/suggestion a few pages back) didn't present this problem with creation of the V ENV, and I could successfully scrape with CD on an er0me test. But back to V5-
I've uninstalled Python 3.10 from Win programs and have done multiple uninstalls/installs of Python 3.11.4 (through suggested link; not github) and tried to remove any lingering traces of Python 3.10 or earlier. Latest of which was removing the user variables ('edit environment variables' through adv sys properties in Windows) for Path to remove -> C:\Users\FN LN\AppData\Local\Programs\Python\Python310\ and ..\scripts\ ... After which, running the .bat file again then gave mention of 'character normalization' that I caught on to before it went to the menu.
Tried to self-diagnose but failed :( .. any help appreciated. TY from a n00b
 

olsaltee

Bathwater Drinker
Mar 16, 2022
82
2,537
1,239
0fya082315al84db03fa9bf467e3.png
I haven't fully taken the time to research it but is there a way to combine the history file from 3 separate drives into one file. I was using 3 different drives for content but with this update thinking of utilizing a central drive and just moving files from there and would hate to restart the other drives from there. Currently testing the creation of 3 separate config files in the central location until I hear back. Thanks for the work you do Jules.
 

olsaltee

Bathwater Drinker
Mar 16, 2022
82
2,537
1,239
0fya082315al84db03fa9bf467e3.png
I also wanted to ask if there has been a reported issue in regards to image file downloads. So far I believe images downloaded from PixHost has been downloaded in low res thumbnail version vs full size file. For instance 1 particular file scraped was 5.19kb while actual file size is 584kb.