Requirements:
Python 3.10+
An asynchronous file archival program
The intention of Ripandtear is to make it easy to save/update content uploaded by content creators online. What makes Ripandtear unique is that it stores all information on a user in a .rat file to help condense all the information about a content creator into one location (don't worry, a .rat is just a .json file with a different extension name). From what usernames they use across different websites, to tracking already downloaded URLs and even file names with their MD5 hash to remove duplicates, it's all stored in the .rat for easy convenience when adding and creating new information from the command line. You can store all the information about a content creator, archive their content, remove duplicates and sort the files all with one command!
By using the .rat file you eliminate the need for re-downloading the same content and creating duplicate files. All the previously downloaded url's are tracked in the .rat file. If the file has already been downloaded, it is skipped to save you time/data/bandwidth and make fewer requests to servers. This also makes it convenient if you share a folder that has a .rat file with someone else. They can pick up where you left off without having to download the same content all over again!
Anyways that is the elevator pitch from the README. I tried to write a pretty extensive instructions on how to use the program with lots of examples so feel free to if you want to learn more.
Motivation
Years ago the internet was a much simpler time. You had Reddit girls that thrived off attention, cam girls trying to make as much money as possible, tumblerinas with daddy issues trying to get revenge on their fathers that were never around by posting nudes online. It was a perfect era to fulfill my addiction. Since I am posting on this site I am sure you are all thinking I am talking about a porn addiction, but that is not the case (ok, maybe a little). My primary addiction is hoarding data and organizing said data. Content creators self segregating themselves made my life very easy and I was happy. However, in the recent years this has all changed. With the rise of Onlyfans and the vast amount of money girls realize they can now make, their inner capitalist has come out and they have embraced diversification. No longer does a Reddit user stick to Reddit. Her Reddit exists to drive users to her Onlyfans, she uses Redgifs to post videos and advertise her PPV content, updates her Twitter to stay in contact with fans and maybe even has a Pornhub. Even worse is she might use different usernames for each account, or she is forced to if one account gets banned. If you only have 100-200 users saved on your computer you might be able to remember each one of her usernames and still categorize them in main website directories (Reddit, Tumblr, Onlyfans, etc).
However when your collection surpasses 1,500 Reddit users alone this becomes harder to do. This was one of the driving factors behind Ripandtear. Instead of organizing content based on sites, I have changed to collecting content per user instead. To track all the information about a user I created this program. Ripandtear. It uses the .rat file (it's just a .json file with a different extension name) to store all information I (currently) want to track. Within the .rat I can track name(s) a creator uses on specific websites, simpcity links to quickly see if people have posted new content, track url's of media I already downloaded to prevent downloading it again and most importantly download the content itself. Since I primarily use my terminal when interacting with my computer I wanted to be able to create and update users via the command line and do it quickly. I feel that I have done a good job accomplishing these goals with this first version. With one command and a few flags I can quickly log information and download all the content a user has with entering 2 commands into my terminal. One to make the folder and the second to tell Ripandtear what I want it to do.
One of the biggest features I think Ripandtear has is the use of the .rat file to track url's and downloaded files. Instead of having to download a folder with content, take the contents of said folder and copy it into the specific content creators folder, then running a separate program to remove duplicates, then run another program to sort the files, then accidentally downloading the same content again because another user reposted the same link without you realizing it and forcing you to go through the whole process all over again, Ripandtear deals with all of this for you. It tracks the urls you have downloaded so if you try to download the same content twice it skips it. It has the ability to sort files into their respective categories (pics, vids, audio, text), it keeps track of file hashes to remove duplicate content and currently it supports the majority of websites that people post on here (and I have intentions to expand the list). Since all that information is stored in the .rat file it can easily act like a checkpoint. If people include their .rat file in uploads, whoever downloads and uses it can simply pick up where the uploader left off. They no longer have to download the same content over again. This also means going the extra mile to clean up duplicates that slip by, content that people aren't interested or just bad content in general won't just benefit you, but everyone you share your .rat file.
Anyways, I feel I am rambling a bit. I mainly made this project for myself, but I have found it to be a huge boon for me and my collection. It has helped me catalog and speed up working on my collection so much that I didn't want to keep it to myself. I will admit that it might feel rigid to some since it it how I work with and save my content, maybe it could seem a little intimidating with all the different command and it still being a work in progress, but I am currently looking to improve on it. However, If you are a power user that shares a similar philosophy to organizing content and really wants to take managing that content to the next level I hope you find some use from this project.
Here is the current template of the .rat:
Python 3.10+
An asynchronous file archival program
The intention of Ripandtear is to make it easy to save/update content uploaded by content creators online. What makes Ripandtear unique is that it stores all information on a user in a .rat file to help condense all the information about a content creator into one location (don't worry, a .rat is just a .json file with a different extension name). From what usernames they use across different websites, to tracking already downloaded URLs and even file names with their MD5 hash to remove duplicates, it's all stored in the .rat for easy convenience when adding and creating new information from the command line. You can store all the information about a content creator, archive their content, remove duplicates and sort the files all with one command!
By using the .rat file you eliminate the need for re-downloading the same content and creating duplicate files. All the previously downloaded url's are tracked in the .rat file. If the file has already been downloaded, it is skipped to save you time/data/bandwidth and make fewer requests to servers. This also makes it convenient if you share a folder that has a .rat file with someone else. They can pick up where you left off without having to download the same content all over again!
Anyways that is the elevator pitch from the README. I tried to write a pretty extensive instructions on how to use the program with lots of examples so feel free to if you want to learn more.
Motivation
Years ago the internet was a much simpler time. You had Reddit girls that thrived off attention, cam girls trying to make as much money as possible, tumblerinas with daddy issues trying to get revenge on their fathers that were never around by posting nudes online. It was a perfect era to fulfill my addiction. Since I am posting on this site I am sure you are all thinking I am talking about a porn addiction, but that is not the case (ok, maybe a little). My primary addiction is hoarding data and organizing said data. Content creators self segregating themselves made my life very easy and I was happy. However, in the recent years this has all changed. With the rise of Onlyfans and the vast amount of money girls realize they can now make, their inner capitalist has come out and they have embraced diversification. No longer does a Reddit user stick to Reddit. Her Reddit exists to drive users to her Onlyfans, she uses Redgifs to post videos and advertise her PPV content, updates her Twitter to stay in contact with fans and maybe even has a Pornhub. Even worse is she might use different usernames for each account, or she is forced to if one account gets banned. If you only have 100-200 users saved on your computer you might be able to remember each one of her usernames and still categorize them in main website directories (Reddit, Tumblr, Onlyfans, etc).
However when your collection surpasses 1,500 Reddit users alone this becomes harder to do. This was one of the driving factors behind Ripandtear. Instead of organizing content based on sites, I have changed to collecting content per user instead. To track all the information about a user I created this program. Ripandtear. It uses the .rat file (it's just a .json file with a different extension name) to store all information I (currently) want to track. Within the .rat I can track name(s) a creator uses on specific websites, simpcity links to quickly see if people have posted new content, track url's of media I already downloaded to prevent downloading it again and most importantly download the content itself. Since I primarily use my terminal when interacting with my computer I wanted to be able to create and update users via the command line and do it quickly. I feel that I have done a good job accomplishing these goals with this first version. With one command and a few flags I can quickly log information and download all the content a user has with entering 2 commands into my terminal. One to make the folder and the second to tell Ripandtear what I want it to do.
One of the biggest features I think Ripandtear has is the use of the .rat file to track url's and downloaded files. Instead of having to download a folder with content, take the contents of said folder and copy it into the specific content creators folder, then running a separate program to remove duplicates, then run another program to sort the files, then accidentally downloading the same content again because another user reposted the same link without you realizing it and forcing you to go through the whole process all over again, Ripandtear deals with all of this for you. It tracks the urls you have downloaded so if you try to download the same content twice it skips it. It has the ability to sort files into their respective categories (pics, vids, audio, text), it keeps track of file hashes to remove duplicate content and currently it supports the majority of websites that people post on here (and I have intentions to expand the list). Since all that information is stored in the .rat file it can easily act like a checkpoint. If people include their .rat file in uploads, whoever downloads and uses it can simply pick up where the uploader left off. They no longer have to download the same content over again. This also means going the extra mile to clean up duplicates that slip by, content that people aren't interested or just bad content in general won't just benefit you, but everyone you share your .rat file.
Anyways, I feel I am rambling a bit. I mainly made this project for myself, but I have found it to be a huge boon for me and my collection. It has helped me catalog and speed up working on my collection so much that I didn't want to keep it to myself. I will admit that it might feel rigid to some since it it how I work with and save my content, maybe it could seem a little intimidating with all the different command and it still being a work in progress, but I am currently looking to improve on it. However, If you are a power user that shares a similar philosophy to organizing content and really wants to take managing that content to the next level I hope you find some use from this project.
Here is the current template of the .rat:
Last edited:
