Question Any reddit profile scrapper?

D

Deleted member 53968

Guest
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
here's the steps, you need to install the last phyton version
1. download the gallery-dl
Please, Log in or Register to see links and images

2. after you unzip the file, press shift+right clic in the red area to open the powershell window(yellow option)

Please, Log in or Register to see links and images

3. to "install" the script use this code line
Code:
Please, Log in or Register to view codes content!
4. to upgrade to the last version use this
Code:
Please, Log in or Register to view codes content!
5. now you have the installation complete. you can access and download using this code
Code:
Please, Log in or Register to view codes content!
. i use cmd window (windows+R)
 
D

Deleted member 53968

Guest
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes
ohhh i see, i didn't even know, thanks any way
Season 9 Reaction GIF by The Office
 

slitchampion

GoodDragon
Apr 24, 2022
311
8,589
1,338
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to view quotes

He's trying to pass multiple usernames (from a .txt file) into the bdfr download command to download several users at once.

This'll do it on Linux:
cat users.txt | xargs -L 1 echo --user | xargs -L 50 python3 -m bdfr download <ARGS>
 
D

Deleted member 53968

Guest
0fya082315al84db03fa9bf467e3.png
hi, it's me again, is there a way to set the BDFR to download a specific flair (for example the
Please, Log in or Register to see links and images
) buy just for the last day?, there's a tons of unverified posts that i don't care. I tried this:

python -m bdfr download ./Subreddits --subreddit WomenBendingOver --submitted --time 2022-07-27 --folder-scheme {FLAIR} --file-scheme {DATE}_{TITLE}_{REDDITOR}_{POSTID}

but apperently only can write words

Error: Invalid value for '-t' / '--time': '2022-07-27' is not one of 'all', 'hour', 'day', 'week', 'month', 'year'.
 

GarethFreeman

Diamond Tier
Mar 12, 2022
130
908
949
0fya082315al84db03fa9bf467e3.png
Ripme has stopped working for me for the redgifs posts. I keep getting this error does anyone know what it means or can offer assistance?

Non-retriable status code 400 while downloading
 

Ravn73

Bathwater Drinker
May 6, 2022
135
7,970
1,252
0fya082315al84db03fa9bf467e3.png
Please, Log in or Register to see links and images


RipMe works excellent for me. Just copy the Submitted (for Users) link or Channel (for whole subs) link and have fun:peepoClap:
 

GarethFreeman

Diamond Tier
Mar 12, 2022
130
908
949
0fya082315al84db03fa9bf467e3.png
So I spoke to someone on the support team there, and they said they no longer support thumbs.2 meaning the API has changed completely. I don't think the rips will work until that part of the software is resolved by the developers. Just thought I'd let everyone know.
 
  • sadKEK
Reactions: mr robot tg

ClearHoney

Bathwater Drinker
Apr 7, 2022
63
5,246
1,242
0fya082315al84db03fa9bf467e3.png
The biggest issue many users run into with these pre-packaged solutions is that they rely on Reddit's API. Apparently, this limits the user to scraping 1,000 posts. For example, in the documentation for bulk-downloader-for-reddit, they note that:
Please, Log in or Register to view quotes
In some cases (e.g., specific Redditors with <1,000 posts), this should not be an issue. However, if you are scraping the contents of an entire subreddit that is medium-popular, you will definitely be affected by this limitation.

Some quick research indicates that using
Please, Log in or Register to see links and images
might be the key to solving this problem. I have not yet researched this workaround very deeply, but it does appear to be a legitimate solution to the potential problem. Per the documentation:
Please, Log in or Register to view quotes

I have not written anything applications integrating PushShift at this time, but I plan to do so relatively soon. In the meantime, it appears that another user has tried to publish a solution (which I have not tested):
Please, Log in or Register to see links and images
 

JibZ

Bathwater Drinker
Mar 12, 2022
50
1,364
1,239
0fya082315al84db03fa9bf467e3.png
Same issue for me about redgifs, I was using RipMe that stopped working few days ago and tried BDFR as mentioned in this thread, when you install it, it doesn't work but with some research, I saw this post :
Please, Log in or Register to see links and images

Had to install "Git" and update to the version as the dev said and I'm finally able to download from redgifs again!