Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads
- Thread starter Jules--Winnfield
- Start date
Getting the following when attempting to download from bunkr. This is on wsl v1 arch linux.
Ideas?
[zerox@ayanami ~]$ cyberdrop-dl https://bunkrr.su/a/J62oFp1W
Albums to download: 1
Overall [░░░░░░░░░░░░░░░░░░░░ 0/1]
thread 'tokio-runtime-worker' panicked at 'called `Option::unwrap()` on a `None` value', /home/zerox/.cache/yay/cyberdrop-dl-git/src/cyberdrop-dl/src/lib.rs:178:10
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
Done!
[zerox@ayanami ~]$ export RUST_BACKTRACE=1
[zerox@ayanami ~]$ cyberdrop-dl https://bunkrr.su/a/J62oFp1W
Albums to download: 1
Overall [░░░░░░░░░░░░░░░░░░░░ 0/1]
thread 'tokio-runtime-worker' panicked at 'called `Option::unwrap()` on a `None` value', /home/zerox/.cache/yay/cyberdrop-dl-git/src/cyberdrop-dl/src/lib.rs:178:10
stack backtrace:
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
thread 'tokio-runtime-worker' panicked at 'called `Result::unwrap()` on an `Err` value: JoinError::Panic(...)', /home/zerox/.cache/yay/cyberdrop-dl-git/src/cyberdrop-dl/src/lib.rs:65:17
stack backtrace:
Done!Ideas?
First off, thanks for all your hard work on this sweet tool! And also for your patience when doing 'simp support.'
I've been doing my best to learn python and web scraping over the past few months and I have a lot of experience with yt-dlp.
Is it possible maybe for you to point me in the right direction on how I might be able to contribute? I just ran into a gofile album with a password and thought maybe I might be able to help.
Thanks again for all your efforts!
No, by default the program makes a downloader.log when it runs. Also makes sense to me now why your error from above didn't make any sense, you are using a different program that is named cyberdrop-dl, which is written in rust. You aren't using mine.
The biggest issue here is there is no real good way (currently) for the user to be able to provide a password, nor is there a good way for me to scrape them when doing SimpCity threads. To make it worse, some sites use captcha protection on password protected albums.
It will be something I visit in the future, but not currently. For gofile specifically, gofile-dl supports passwords.
Ah! sorry for the trouble. I did not expect there to be two packages with the same name.
Thanks for taking a look.
Thanks for taking a look.
2022-07-20 19:45:42,525:DEBUG:selector_events:selector_events.py:54:Using selector: SelectSelector
2022-07-20 19:45:42,569:DEBUG:base_functions:base_functions.py:46:We are running version 2.27.4 of Cyberdrop Downloader
2022-07-20 19:45:42,569:DEBUG:main:main.py:63:Starting downloader with args: {'input_file': WindowsPath('URLs.txt'), 'output_folder': WindowsPath('Downloads'), 'log_file': 'downloader.log', 'db_file': 'download_history.sqlite', 'threads': 0, 'attempts': 10, 'disable_attempt_limit': False, 'include_id': False, 'exclude_videos': False, 'exclude_images': False, 'exclude_audio': False, 'exclude_other': False, 'ignore_history': False, 'separate_posts': False, 'SimpCity_username': 'jondpjones', 'SimpCity_password': '!REDACTED!', 'skip_anonfiles': False, 'skip_bunkr': False, 'skip_coomer': False, 'skip_cyberdrop': False, 'skip_cyberfile': False, 'skip_erome': False, 'skip_gfycat': False, 'skip_gofile': False, 'skip_jpgchurch': False, 'skip_kemono': False, 'skip_pixeldrain': False, 'skip_pixl': False, 'skip_putmega': False, 'skip_redgif': False, 'skip_saint': False, 'links': []}
2022-07-20 19:45:42,576:DEBUG:base_functions:base_functions.py:46:Starting Scrape
2022-07-20 19:45:42,577:DEBUG:base_functions:base_functions.py:46:Starting scrape of https://simpcity.su/threads/apex_suicide-sasha-alexandria.48803/
2022-07-20 19:45:43,725:DEBUG:base_functions:base_functions.py:46:Finished scrape of https://simpcity.su/threads/apex_suicide-sasha-alexandria.48803/
2022-07-20 19:45:43,726:ERROR:main:main.py:86:ValueError No links
2022-07-20 19:45:43,726:DEBUG:base_functions:base_functions.py:46:No links found, check the URL.txt
If the link works in your web browser, please open an issue ticket with me.
2022-07-20 19:45:43,727:DEBUG:base_functions:base_functions.py:46:This program does not currently support password protected albums.
2022-07-20 19:45:43,727:DEBUG:sql_helper:sql_helper.py:100:Successfully closed sqlite database connection
a simple method is dowmthemall
This will get buried fast I'm sure.
But I'm in the planning phase of building out a full fledged app with the same functionality as the current program. Both versions will stay in production and be updated simultaneously. Trying to decide how best to lay it out and the frameworks to use. It won't be out any time soon, but it's on the way.
But I'm in the planning phase of building out a full fledged app with the same functionality as the current program. Both versions will stay in production and be updated simultaneously. Trying to decide how best to lay it out and the frameworks to use. It won't be out any time soon, but it's on the way.
Oh, and where I can, I'll support passwords (app only unfortunately). GoFile will be the first.
That won't apply to SimpCity thread scraping though.
That won't apply to SimpCity thread scraping though.
Any clue what I did? Tried deleting and reinstalling Python and still running into this same issue. This is what populates when I run.
File "C:\Users\loma\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Users\loma\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in _run_code
exec(code, run_globals)
File "C:\Users\loma\AppData\Local\Programs\Python\Python310\Scripts\cyberdrop-dl.exe\__main__.py", line 4, in <module>
File "C:\Users\loma\AppData\Local\Programs\Python\Python310\lib\site-packages\cyberdrop_dl\main.py", line 8, in <module>
from colorama import Fore
File "C:\Users\loma\AppData\Local\Programs\Python\Python310\lib\site-packages\colorama\__init__.py", line 2, in <module>
from .initialise import init, deinit, reinit, colorama_text
File "C:\Users\loma\AppData\Local\Programs\Python\Python310\lib\site-packages\colorama\initialise.py", line 6, in <module>
from .ansitowin32 import AnsiToWin32
ModuleNotFoundError: No module named 'colorama.ansitowin32'
File "C:\Users\loma\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Users\loma\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in _run_code
exec(code, run_globals)
File "C:\Users\loma\AppData\Local\Programs\Python\Python310\Scripts\cyberdrop-dl.exe\__main__.py", line 4, in <module>
File "C:\Users\loma\AppData\Local\Programs\Python\Python310\lib\site-packages\cyberdrop_dl\main.py", line 8, in <module>
from colorama import Fore
File "C:\Users\loma\AppData\Local\Programs\Python\Python310\lib\site-packages\colorama\__init__.py", line 2, in <module>
from .initialise import init, deinit, reinit, colorama_text
File "C:\Users\loma\AppData\Local\Programs\Python\Python310\lib\site-packages\colorama\initialise.py", line 6, in <module>
from .ansitowin32 import AnsiToWin32
ModuleNotFoundError: No module named 'colorama.ansitowin32'
I had ZERO experience with console type programs before using this. The learning curve was higher and it took more time/effort to learn compared to something with a GUI but I figured it out and now this thing works amazing for all this free content.
You're not wrong than these type of programs are inherently more user unfriendly but if I can figure it out, anyone else should too.
He's provided us all a tool for free and supports the program daily with a lot of repetitive issues with no real complaints, meet the guy halfway.
Open command prompt and try this
pip install --force-reinstall --no-cache-dir coloramaThen try running it again.