Self Promotion New Scraping Tool for NSFW Reddit Profiles

[dr.crow]

HOT DIGGITY DOG! I've been busy! and boy do i have good news for you all! so remeber when some of you asked about redgif?
doctor, can your program scrape thar redgif profile?
doctor, the videeeeeos!
well, i got you lmfao program now officially is able to scrape deleted videos from both redgif and reddit thanks to a nifty little trick i found during my sleepless nights. Now, the video recovery has gotten miles better, with verifiable more catches.
for example, with LittleMare98's profile, it managed to get thumbnails and some pictures, now it's able to retrieve both videos thumbnails. in certain cases, salvaging with audio as well which is definetly neat.
Update on project:
New features:
-You can now filter by subreddits, so for example, if user X posted in r/cats and r/dogs and you want to see one or the other, or both, you know can! this makes traversal much quicker
-Scraper now does a way better job at getting deleted videos. This is the biggest one since after rescanning certain profiles, it got a bunch of hits and saved them properly. The big problem also was that video and audio are oftentime separate, now the output shows video with their respective audio (if the audio could be scraped)
-more animations to make the traversal just a bit more enjoyable and smooth
-profiles now will have a link directly to reddit and posts to their respective original submission.
-profiles will now show any redgif and imgur accounts name that posted in that reddit account, and list their respective posts with links
-overall more reliability when working with redgif and able to fetch deleted redgif posts

here is a little demonstration and another view of what's to come, enjoy!
[Login or Register to view]
Also I know some of you want to donate to the project to host the site asap. I really appreciate the support from you all <3 however i think i'd get insta banned from here the moment i do get a donation haha also keep in mind, I have to yet see how much this is actually going to cost me going forward once it is released, and I don't want to feel like i've betrayed any of you if I do have to turn in into a subscription to just break even and keep it afloat.

anyway, if any of you have more ideas feel free to comment or DM!

 

[bonjovi35]

thank you for all your hard work. in the mean time whilst we wait for the site , is there any way to see anything that was fetched so far? thanks

 

[dr.crow]

Hey all! sorry for being quiet after the last update, been terribly busy trying to fix all of this mess.
so, a couple of good news first!

nothing has been lost per say, so you all didn't just send your requests for nothing. This was important to me because i value my time, so i wanted to make sure yours was valued as well.

secondly, I did have to write an algorithm to stop this from happening again. I am partially at fault for this, i should have thought of this sooner.

regardless, if the profile is under 18, nothing will be scrapped. if you wanted to scrap pictures of her pet, cousin's dog, or that dog's cousin that was shared by that user; shit outta luck, the scrapper will legit not even begin any of that fetching process, an automatic report will be generated with specifics (this took me a minute), and that user will be added to a blacklist (this will be important later).

as soon as the process starts, the username will be checked on the blacklist, if it's there then nothing will even be tried; this is to preserve computational power.

if the profile posted before they were 18, the algorythm will catch on the oldest date of age verification and save the timestamps. everything after that verification will be salvaged, nothing before that.

backbone of the final version of the site is done, once my funds are secured by around the beginning of september, it'll be operational pretty much instantly.

now for the somber news. this turned into a full time project for me that needs hours of daily attention, maintenance, and growing development cycles. I will keep the initial release free, but after exploring countless options and avenues, it's basically impossible to do so without the following happening:
1.potential legal expenses coming from my own pocket (i am sure you all thought of this, and the whole project will get instantly scrapped if done free)
2. potentially intrusive ads which would be potentially dangerous to you, me, and a major pain in all of our asses

I always want to be transparent with all of you, so feel free to voice your opinions about this. I was thinking 10$ a month for access, which would allow me to pay for the ongoing costs of the archive, more equipment for faster scraping, be able to at least be somewhat covered in the worst case scenarios and not just being bullied into scrapping the whole thing. i'm open to suggestions!

also, needless to say. you all will have access to the requests done from this update, regardless. I will figure out some way to host them for you all, so that you can have access to them, and if you want to input more names and help this project grow, you will all be welcomed there!

features i will be working on in the future:
-tumblr accounts: after some requests i've actually managed to get deleted images with confidence of success. I might go ahead and see if other platforms are possible like X etc...
-community: since this is a community growing project, i want you all to be able to comment and discuss

feel free to also comment on future features you'd like to see

 

[dr.crow]

Guys, I’ll have to move this thread to self promotion before I get in trouble with the mods. I’ll make a thread when I have some free time, stay safe! Also sorry mods, thank you for your patience also I’ll be uploading the latest iteration thus far on Sunday. It’s around 50 gb by now lmfao so hoping you all enjoy

 

[dr.crow]

big update:
-crawler updated, newer posts are automatically archieved and will keep building on already inputted profiles

how it works:
once a username is entered and scanned, a separate crawler is deployed to watch all profiles and download any new posts done by them. this works on deleted profiles as well, in case they are reinstated. after testing, it seems extremely efficient at what it does but i will keep doing some stress testing to be sure. that being said, i've literally optimized it to shit, the backup is extremely fast. this will start running 24/7 from this post.

so if you have one of those girls that keep on posting and deleting, this is for you. This guarantees growing value to this project and something you will hopefully appreciate.

-developed more avenues for better post tracking, this could result in even more recoveries as it adds more fallbacks for some older accounts.

about the expected upload: working on it, it's bigger than 60gb now so it's slow as hell. currently working with a user so i can give the files to you guys in an acceptable manner with browsing, if not you'd be required to download this big archieve every single time.

anyway, that's about it! stay safe <3 if you feel like you want to help the project in any way, feel free to DM

 

[dr.crow]

announcement: New ETA
7 days to 14 days, site will be up and operational. Working on augmenting the results even more with new avenues I recently found, stay tuned. By all means and purposes the project is out of beta, thank you all for participating and giving your requests.

Stay safe!

 

[Darksorcerer]

Do you think you could do something to retrieve imgur pictures? Back then there were many imgur pictures but then the site deleted all the links with nudes. Camas give a lot of imgur links back but they never work at wayback machine