Guide Guide to Scrap SimpCity Threads

  • Hi all, there are some hacked accounts posting viruses within zip links on gofile.
    Please report these posts when you see them.
    DO NOT reply to them, this just makes it harder for us to clean up and may get your account banned by mistake.

mlnl

Tier 3 Sub
Mar 15, 2022
18
399
932
0fya082315al84db03fa9bf467e3.png
Hey all, I'm writing a guide with tips and tricks that I use to download from this forum.
I believe you might find them useful. Ill try to explain every step carefully.


Tools you will need
  1. Please, Log in or Register to see links and images
    (To Scrape the pages, download this via github.) (Notice you will also need Python 3 installed on your system)
  2. Please, Log in or Register to see links and images
    (Super powerful general downloader)
  3. Please, Log in or Register to see links and images
    (Tool to deduplicate and find similar images and similar videos)
  4. Please, Log in or Register to see links and images
    (Tool to move your folder anywhere)
Please, Log in or Register to see links and images


Please, Log in or Register to see links and images

This is a github project which contains a Python command line tool that is used to scrap SimpCity forum posts.
The Creator has done a fantastic job of including your log in details to make it very easy to use. It will run through every page of a girl you like and try to pull all the links that uses posted (it misses the hidden ones and password links). But it gets like 80% of the links posted.

This project must be run once to generate the `URLS.txt` file that it uses to read posts.
Lets walk through some steps:

Step 1:
Head over to your downloaded Cyberdrop repository and open up a command line. Type python start.py in the same directory as the start.py file and this should generate the `URLS.txt` file.


Please, Log in or Register to see links and images


Step 2:
Go to Simp City and find a girl/boy you like:
You might find their main OF thread or even a request thread. Go and copy that link and make sure you remove any extra fields that might cause the downloader to make a mistake:
ex:

Riley Reid

You will find some links in this format:
`https://simpcity.su/threads/riley-reid.56113/page-4#post-1007790`
and
`https://simpcity.su/threads/riley-reid.9379/page-17#post-953078`


Remove the extra slashes at the end so that your links look like this
`https://simpcity.su/threads/riley-reid.56113`
`https://simpcity.su/threads/riley-reid.9379`


Now you can paste those in your generated `URLS.txt`.

Step 3:
You can supply your credentials at the command line level so that it logs into the forum and scrapes the pages like this:

python start.py --simpcity-username "YourUsername" --simpcity-password "YourPassword"

This will start downloading the supported forum links that it can handle. It will skip over those that it cant.

TIP:
If you want to hardcode your credentials so that they are always saved,
Please, Log in or Register to see links and images
. Just fill it in where it says default. This will involve editing the code and saving the changes locally so that you do not have to type out the '--simpcity-username' or password anymore.

Thanks to
Please, Log in or Register to see links and images
, we can now connect Jdownloader to scrape the pages that the Cyberdrop downloader fails to pick up.

Please, Log in or Register to see links and images
(Note Thanks to Jules-Winnfield this is now available in Cyberdorp!)
Jdownloader is an awesome multi account downloader that has loads of plugins. It doesn't scrape simpcity and it isn't as good at downloading from Cyberdrop or Bunker.is as well as CyberDropDownloder is, but it will grab all your Megaupload links, Mediafire, Gdrive, etc. You can even connect your Debrid account to it and have it automatically downloading using that account.

This might be a little tricky step, but you need to enable the MyJdownloader server so that you can access the api programmatically and send the download links there. Go to the my.jdownloader.org and create a profile. This will allow you to use your myjdownloader and access it via web on their web GUI.

Please, Log in or Register to see links and images


#TODO write the instructions using the new cyberdrop jdownloader integration

This code connects to your running Jdownloader instance and will start submitting the not supported links to the linkgrabber service inside of jdownloader. You should see a ton of links now being populated in your jdownloader program that start scraping the links. Wait until they are good, remove any unwanted javascript, css or html (or set up a filter!) and you are now ready to download.

Do you want more? I still have yet to talk about my deduplication methods and how to move hundred of gigabytes using rclone.
 
Last edited:

Jules--Winnfield

Cyberdrop-DL Creator
Mar 11, 2022
2,161
5,070
1,127
0fya082315al84db03fa9bf467e3.png
You can find the direct support/help/discussion thread for Cyberdrop-DL (the tool mentioned in step 1) here:

The JDownloader addition will be added soon. I just haven't gotten around to playing with it yet. I'll do that today so users don't have to do it themselves.

Edit: Just implemented native support inside Cyberdrop-DL in 3.3.33
 
Last edited:

dorado

degenerate
Mar 16, 2022
502
7
4,991
1,227
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes


 

bobcatmango

Lurker
Sep 27, 2023
3
10
120
0fya082315al84db03fa9bf467e3.png
I don't think this tutorial works anymore. He no longer uses the start.py file. Could we get an update on this?
 

mlnl

Tier 3 Sub
Mar 15, 2022
18
399
932
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
This whole tutorial is now old and will not work how I posted it before. Cyberdropdl now has the ability to run Jdownloader automatically set by the config file.

Jules--Winnfield has added an option in the config file to include the link to the jdownloader service you are running locally so that it will automatically send the links that Cyberdrop cannot download to Jdownloader.​


Please look at the `config` options here


Please, Log in or Register to see links and images

There seems to be a new V5 that just released that is a larger change. I'm using V4 so I will need to figure out how to transfer my config over to V5.
 
Last edited: