Tools Cyberdrop-DL: Mass Downloader for most forum sites and SimpCity threads
- Thread starter Jules--Winnfield
- Start date
I'd assume this might have something to do with the computer going to sleep and or hibernating. When a computer hibernates, essentially all processes are offloaded and put on pause.
Dumb question but maybe I didn't have enough coffee today:
From V3->V4 did the Unsupported URL change from txt to csv? Can it be changed back to txt?
Not really a big issue, just learning some basic scripting myself so I was trying to figure out how to automate the unsupported URLs using my own script, but I might just use the JDownloader in the end (I use to program 10+ years ago but I went into another industry and lost all my knowledge, and now python/ruby/etc is the new hotness)
while I dont have Windows 11, Im feeling this is due to Energy Saving features, I recently saw Chrome do a change like this, when a session or tab isn't active, it purges tab memory to cache. I would advocate looking into Performance/Energy features on Windows 11 and disable any features that affect when the system is Locked/user session is logged out.
edit2: probably maybe also your network drivers too, I remember this being a pain in the butt back in the WinXP days for some Intel NICs, more energy saving features
From V3->V4 did the Unsupported URL change from txt to csv? Can it be changed back to txt?
Not really a big issue, just learning some basic scripting myself so I was trying to figure out how to automate the unsupported URLs using my own script, but I might just use the JDownloader in the end (I use to program 10+ years ago but I went into another industry and lost all my knowledge, and now python/ruby/etc is the new hotness)
while I dont have Windows 11, Im feeling this is due to Energy Saving features, I recently saw Chrome do a change like this, when a session or tab isn't active, it purges tab memory to cache. I would advocate looking into Performance/Energy features on Windows 11 and disable any features that affect when the system is Locked/user session is logged out.
edit2: probably maybe also your network drivers too, I remember this being a pain in the butt back in the WinXP days for some Intel NICs, more energy saving features
Last edited:
It likely won't be changed back, but as you were already trying to script something for yourself, just split the CSV based on commas and take the first value.
If you are using python you can do this really simply with pandas and it's read_csv function.
Heard, thanks for info! No worries, it'll keep me on my toes! Appreciate all the hard work and updates sir
I really hate to add another reply so soon - but last question, after researching as much as I could.
Is there any way to add the DATE of the POST to the actual POST DIR (when using
EDIT: ALSO, I am trying my best to get this:
>Main Directory (i.e. Bob)
>>Subfolders by Post (i.e. Post 1234)
>>all content then
I still seem to get the ShareX etc Loose folders as sub-dirs within the Post folders, I hope to avoid. I tried
Is there any way to add the DATE of the POST to the actual POST DIR (when using
separate_posts: true ) ? I like to organize stuff by date, typically.EDIT: ALSO, I am trying my best to get this:
>Main Directory (i.e. Bob)
>>Subfolders by Post (i.e. Post 1234)
>>all content then
I still seem to get the ShareX etc Loose folders as sub-dirs within the Post folders, I hope to avoid. I tried
block_sub_folders: true but it only works on the Main Directory, which leads to just all content pooled into the main dir. Any ideas on where I might be setting up the config incorrectly?
Last edited:
Downloads are coming in now, but I'm not getting the new graphical stuff showing the downloads. The terminal just says "Finished Scrape", I can only see what's being downloaded by looking at the log or my downloads folder. Haven't tried the --hide-new-progress command yet.
Try running it with windows terminal instead of command prompt, you'll need to download it
if you put in a feature request, I can look into adding dates. I'm less inclined to add specific handling for your folder structure though, but I could probably add a {separate-posts} variable to the sorting function, again put in a ticket for it though
Thanks for your feedback, I will suffer for it now, I will maybe put in the Date feature request on the hub, thank you again for your time!
NOTE:
The sort option is almost like a separate program/process. If you run with
It will then sort everything in the targeted folder; not necessarily just what was in the URLs.txt file
(I had sorted some stuff differently, then ran another instance to download a missed link and now I'm having to resort).
Not necessarily a 'bug', just something to keep in mind if you use the sorter.
The sort option is almost like a separate program/process. If you run with
It will then sort everything in the targeted folder; not necessarily just what was in the URLs.txt file
(I had sorted some stuff differently, then ran another instance to download a missed link and now I'm having to resort).
Not necessarily a 'bug', just something to keep in mind if you use the sorter.
doesn't seem like there is much to say here, you were either being blocked by said sites, they were having issues, or you were having internet issues. You were getting connection timeouts, and receiving text responses when you should have been getting images/videos.
Is there anyway to get the failed URLs?
I used to copy the output from the CMD window and paste into notepad to download them manually. Perusing through the downloader.log file works but is very tedious.
Maybe something similar to how the "unsupported_URLs.txt" file works could be implemented?
I used to copy the output from the CMD window and paste into notepad to download them manually. Perusing through the downloader.log file works but is very tedious.
Maybe something similar to how the "unsupported_URLs.txt" file works could be implemented?
What you linked wasn't related to gofile, but if you are asking about the bunkr links:
Error status code: 503
(Bunkr under maintenance)
It's a bunkr issue.