Tools Ways to rip entire TikTok profile?

Sort By Date Sort By Reaction Score
R

richard2480

Fan
Jun 3, 2022
20
50
97
0fya082315al84db03fa9bf467e3.png
updated my scraper. uploaded to paste.ec:
Please, Log in or Register to see links and images


decryption key (add to URL after a #) is:
dEaDmCPXW8P7bAm+qPogMq8Fs7kgpy8wdcFFi3z+tBq

inputs:
- MAX_RETRIES (for playwright)
- PRINT_OUTPUTS (obvious)
- RETRY_FAILED (retry failed downloads from previous runs)
- HOME_DIR (where to save files relative to .py file)
- USER_NAME_LIST_FILE (text file with a user name on each line)
- SORT_USER_NAME_LIST (obvious)

python packages:
Please, Log in or Register to see links and images

Please, Log in or Register to see links and images

Please, Log in or Register to see links and images

Please, Log in or Register to see links and images

Please, Log in or Register to see links and images
 
  • Like
  • Hyperz
  • HACKERMANS
Reactions: nobody5, gRe4tp2aTVoZV3, Baqlopa and 4 others
C

clbrn

Fan
Mar 13, 2022
15
55
229
0fya082315al84db03fa9bf467e3.png
SulkyAvacado said:
Please, Log in or Register to view quotes
Click to expand...

Yes, it's the most convenient (database, links to videos/profiles, can download photos, can update new content easily) but It can also easily trigger temporary IP/account blacklist/ban by TikTok if not using proxy (and using it without login makes it almost useless). But the biggest deal-breaker for me - it can't download videos in HD... in your example, 4KTiktok downloads @aixaa_ys02's videos without watermark at 138MB, but her videos in HD are 451MB... personally, I prefer the quality and will download HD manually...
 
  • Like
  • PepeHands
Reactions: nobody5, gRe4tp2aTVoZV3, SulkyAvacado and 2 others
C

clbrn

Fan
Mar 13, 2022
15
55
229
0fya082315al84db03fa9bf467e3.png
Thanks, Richard, the script is working great!

Unfortunately, HD is currently broken for many videos on all web downloaders... hopefully it can be fixed and it's not TikTok deleting older HD content to free up space or something.
 
Last edited:
yanlichuk

yanlichuk

Bathwater Drinker
Mar 15, 2022
60
2,162
1,242
0fya082315al84db03fa9bf467e3.png
I use neolith method with yt-dlp and js links grabber, but now i have an error "WARNING: [TikTok] Expecting value in '': line 1 column 1 (char 0). Retrying... (attempt 1 of 4) [TikTok] 7347215851428285701: Downloading video feed" like this several times "(attempt 2, 3 of 4)" and then tiktok downloads with watermark. Has anyone had a similar situation? Is there a solution to this problem?
 
Beakwood

Beakwood

Bathwater Drinker
Mar 11, 2022
631
5,420
1,217
0fya082315al84db03fa9bf467e3.png
yanlichuk Thighwanese
I mentioned before that you have to use plugin.
simpcity.su

Tools - Ways to rip entire TikTok profile?

Yo, I want to bring attention back to the browser extension Zogbot9001 shared in this this thread two weeks ago. I had been using this extension since around february, and it's even much more powerful than what Zogbot9001 described. First, it does get every tiktok from the account you download...
simpcity.su simpcity.su
 
  • Like
Reactions: jasonjemodah, yanlichuk and neolith
yanlichuk

yanlichuk

Bathwater Drinker
Mar 15, 2022
60
2,162
1,242
0fya082315al84db03fa9bf467e3.png
When i'm using richard2480 's scraper (#141 and #148 (fix)), only the user's photos are downloaded, not a single video was downloaded. What is the problem?
 
C

clbrn

Fan
Mar 13, 2022
15
55
229
0fya082315al84db03fa9bf467e3.png
Works fine for me on Windows (I only wish it would not overwrite already downloaded files) - maybe you are missing a dependency?
 
Last edited:
  • Like
Reactions: Obicase
Beakwood

Beakwood

Bathwater Drinker
Mar 11, 2022
631
5,420
1,217
0fya082315al84db03fa9bf467e3.png
richard2480 Have you ever ran into an issue with a user/channel with the program? I can get the majority of users, but there are a few where I would run into errors. For example, I get over a dozen "Task pending name" and "coroutine object TikTokDL.download_single_video_id at" errors. I just cut, trimed, and pasted some one of the errors here along with the following code.



Code:
Please, Log in or Register to view codes content!

Here's the error in its entirety

Please, Log in or Register to see links and images

Decryption Key
dPpFNI0OiHCafIteiyAcnf1QCeng+kPkgJgVvzsNRw5
 
Last edited:
R

richard2480

Fan
Jun 3, 2022
20
50
97
0fya082315al84db03fa9bf467e3.png
clbrn it has downloaded some videos in 1080x1920 for me. also if you set self.check_file_exists = True on line 97 it will check if a file with the video ID already exists before downloading.

yanlichuk not sure why that is happening. it is working for me. if you can provide some more information i may be able to help.

Beakwood if you increase self.timeout_per_file = 2 on line 100 to a higher integer it should fix this. it will time out if the download takes longer than 2 * (number of files). or whatever integer you choose instead of 2
 
  • Like
Reactions: Obicase, clbrn, jasonjemodah and 2 others
yanlichuk

yanlichuk

Bathwater Drinker
Mar 15, 2022
60
2,162
1,242
0fya082315al84db03fa9bf467e3.png
richard2480 said:
Please, Log in or Register to view quotes
Click to expand...
I'm using the script from post #148. All requested python packages installed including
Code:
Please, Log in or Register to view codes content!
CHECK_INPUTS = True
MAX_RETRIES = 10
PRINT_OUTPUTS = True
RETRY_FAILED = False
HOME_DIR = 'G:/tiktok'
USER_NAME_LIST_FILE = 'user_name_list.txt'
SORT_USER_NAME_LIST = True
I get this response in the terminal:
D:\python\python.exe G:\tikt\tiktok-download.py Scraping profile 1/1 Scraping caracoc0 Creating new json for caracoc0 Successfully extracted Secondary User ID. Finding video ID list for caracoc0 Found 189 new video IDs 0%| | 0/189 [00:00<?, ?it/s]Video download complete. Downloading any remaining images.
And then script downloads all images.
Downloaded 7 new files for caracoc0 Saving json for caracoc0 Completed caracoc0 Process finished with exit code 0

I hope this info helps
 
You must log in or register to reply here.
Top Bottom