Self Promotion New Scraping Tool for NSFW Reddit Profiles

[dr.crow]

HOT DIGGITY DOG! I've been busy! and boy do i have good news for you all! so remeber when some of you asked about redgif?
doctor, can your program scrape thar redgif profile?
doctor, the videeeeeos!
well, i got you lmfao program now officially is able to scrape deleted videos from both redgif and reddit thanks to a nifty little trick i found during my sleepless nights. Now, the video recovery has gotten miles better, with verifiable more catches.
for example, with LittleMare98's profile, it managed to get thumbnails and some pictures, now it's able to retrieve both videos thumbnails. in certain cases, salvaging with audio as well which is definetly neat.
Update on project:
New features:
-You can now filter by subreddits, so for example, if user X posted in r/cats and r/dogs and you want to see one or the other, or both, you know can! this makes traversal much quicker
-Scraper now does a way better job at getting deleted videos. This is the biggest one since after rescanning certain profiles, it got a bunch of hits and saved them properly. The big problem also was that video and audio are oftentime separate, now the output shows video with their respective audio (if the audio could be scraped)
-more animations to make the traversal just a bit more enjoyable and smooth
-profiles now will have a link directly to reddit and posts to their respective original submission.
-profiles will now show any redgif and imgur accounts name that posted in that reddit account, and list their respective posts with links
-overall more reliability when working with redgif and able to fetch deleted redgif posts

here is a little demonstration and another view of what's to come, enjoy!
[Login or Register to view]
Also I know some of you want to donate to the project to host the site asap. I really appreciate the support from you all <3 however i think i'd get insta banned from here the moment i do get a donation haha also keep in mind, I have to yet see how much this is actually going to cost me going forward once it is released, and I don't want to feel like i've betrayed any of you if I do have to turn in into a subscription to just break even and keep it afloat.

anyway, if any of you have more ideas feel free to comment or DM!

 

[bonjovi35]

thank you for all your hard work. in the mean time whilst we wait for the site , is there any way to see anything that was fetched so far? thanks

 

[dr.crow]

Hey all! sorry for being quiet after the last update, been terribly busy trying to fix all of this mess.
so, a couple of good news first!

nothing has been lost per say, so you all didn't just send your requests for nothing. This was important to me because i value my time, so i wanted to make sure yours was valued as well.

secondly, I did have to write an algorithm to stop this from happening again. I am partially at fault for this, i should have thought of this sooner.

regardless, if the profile is under 18, nothing will be scrapped. if you wanted to scrap pictures of her pet, cousin's dog, or that dog's cousin that was shared by that user; shit outta luck, the scrapper will legit not even begin any of that fetching process, an automatic report will be generated with specifics (this took me a minute), and that user will be added to a blacklist (this will be important later).

as soon as the process starts, the username will be checked on the blacklist, if it's there then nothing will even be tried; this is to preserve computational power.

if the profile posted before they were 18, the algorythm will catch on the oldest date of age verification and save the timestamps. everything after that verification will be salvaged, nothing before that.

backbone of the final version of the site is done, once my funds are secured by around the beginning of september, it'll be operational pretty much instantly.

now for the somber news. this turned into a full time project for me that needs hours of daily attention, maintenance, and growing development cycles. I will keep the initial release free, but after exploring countless options and avenues, it's basically impossible to do so without the following happening:
1.potential legal expenses coming from my own pocket (i am sure you all thought of this, and the whole project will get instantly scrapped if done free)
2. potentially intrusive ads which would be potentially dangerous to you, me, and a major pain in all of our asses

I always want to be transparent with all of you, so feel free to voice your opinions about this. I was thinking 10$ a month for access, which would allow me to pay for the ongoing costs of the archive, more equipment for faster scraping, be able to at least be somewhat covered in the worst case scenarios and not just being bullied into scrapping the whole thing. i'm open to suggestions!

also, needless to say. you all will have access to the requests done from this update, regardless. I will figure out some way to host them for you all, so that you can have access to them, and if you want to input more names and help this project grow, you will all be welcomed there!

features i will be working on in the future:
-tumblr accounts: after some requests i've actually managed to get deleted images with confidence of success. I might go ahead and see if other platforms are possible like X etc...
-community: since this is a community growing project, i want you all to be able to comment and discuss

feel free to also comment on future features you'd like to see

 

[dr.crow]

Guys, I’ll have to move this thread to self promotion before I get in trouble with the mods. I’ll make a thread when I have some free time, stay safe! Also sorry mods, thank you for your patience also I’ll be uploading the latest iteration thus far on Sunday. It’s around 50 gb by now lmfao so hoping you all enjoy

 

[dr.crow]

big update:
-crawler updated, newer posts are automatically archieved and will keep building on already inputted profiles

how it works:
once a username is entered and scanned, a separate crawler is deployed to watch all profiles and download any new posts done by them. this works on deleted profiles as well, in case they are reinstated. after testing, it seems extremely efficient at what it does but i will keep doing some stress testing to be sure. that being said, i've literally optimized it to shit, the backup is extremely fast. this will start running 24/7 from this post.

so if you have one of those girls that keep on posting and deleting, this is for you. This guarantees growing value to this project and something you will hopefully appreciate.

-developed more avenues for better post tracking, this could result in even more recoveries as it adds more fallbacks for some older accounts.

about the expected upload: working on it, it's bigger than 60gb now so it's slow as hell. currently working with a user so i can give the files to you guys in an acceptable manner with browsing, if not you'd be required to download this big archieve every single time.

anyway, that's about it! stay safe <3 if you feel like you want to help the project in any way, feel free to DM

 

[dr.crow]

announcement: New ETA
7 days to 14 days, site will be up and operational. Working on augmenting the results even more with new avenues I recently found, stay tuned. By all means and purposes the project is out of beta, thank you all for participating and giving your requests.

Stay safe!

 

[Darksorcerer]

Do you think you could do something to retrieve imgur pictures? Back then there were many imgur pictures but then the site deleted all the links with nudes. Camas give a lot of imgur links back but they never work at wayback machine

 

[dr.crow]

new commit before the site is up in a couple of days:
- site now links to images of some other popular sites, that way you can have a little hub of other things that are commonly found elsewhere. this is just for some ease of access
-added a redgif and erome watchers in case things are posted there and not on reddit.
why this matters: once the user is inputted, a watcher not only monitors reddit uploads, but it lists the uploaded platforms used to post on reddit, and makes a list of the accounts used to do so. sometimes they may post there but not on reddit, so these are just good finds overall. the retrieval is fast which doesn't leave it to chance for a retrieval after a deletion.
-redgif and erome deleted album retrieval added

they seem simple but this was an absolutely pain in the ass to implement, so i hope you all will love it.
stay safe <3

 

[dr.crow]

upload has started, just fixing some minor bugs and we're set. i will release the site while it's uploading so be patient for your requests to be uploaded, i am doing all of this with my bandwith after all x.x and i too want to use my connection without so many lag spikes lmfao in any case, the site is 80% done, expect the release tomorrow or the day after at worst! stay safe <3

 

[dr.crow]

site is up and reachable!
r-cover.net
regitrations are available but no payment method yet until early friday when it finishes the sync.
you all are welcome to check it out, tell me what you think, report any bugs, etc.
about the cost:
$10 for a month or $27 for 3 months
even if operation costs change as the project grows and i may be forced to up this amount, everyone that signs up at this beginning stage will have those prices for life, and i feel that's fair.
in the meantime, enjoy exploring and familiarizing yourself with it, a think that any other concern is touched there, but you are always welcome to message me as always.
in the case that i missed your requests so far, please do double check when it's all geared up that the profiles you want have been added. i will double check them tonight but i am only human.
stay safe everyone <3
on the bright note, you can all have a really nice friday! hahaha

 

[dr.crow]

All completed! subscriptions are on and available to all!
thank you all again for supporting this project! looking forward to your requests in the site!
for those who missed it, the site is r-cover.net
i will be implementing more things starting today, like bulk download, previews and much more.
Stay safe! <3

 

[Kaeguri]

Already found stuff on accs I’ve been searching for years on! This project is awesome, way to go Crowe. Happy to support!

 

[Plagueboy69]

Lads im retarded, how do I pay in bitcoin?

 

[Kgriffen555055]

Is there anyway you could sort the wins by state? Great site though!

 

[dr.crow]

After talking to several people and their suggestions, I will go ahead and apply several of those.
Also due to how busy my personal life will be until the end of year, big features will take a bit longer to be implemented but are still in the works, so be patient!
They are coming - but I need time to study, have healthy breaks and work on other projects as well.

The following changes will be applied between today and tomorrow:
-During several times a day the queue will be rearranged in a different order. One ordering by how old the request is, and how many times a specific username has been asked ; and another by no report made yet (if this has happened to you it's because the acocunt history is harder to be extracted and it needs a deeper look) to amount of posts and percentage of completion.
- In case you make a request and your subscription expires, you will be able to come back on your account and download your request once it reaches full completion. You will have 3 tries to do a full profile download in case your connection drops or for any other reason.
Why 3 tries and not indefinite: The software still fetches any new posts and is using computational power to constantly check that. Even if the account is deleted, it does check if it's reinstated, plus anything from redgif, etc...
There is also a grace period for this, if the account requested is 100% completed 1 day before expiry, this change will still apply to you.
- Previews will be added due to popular demand, similar to other sites
- Suggestions tab, where you may request things that could be added to the site.