Hmmm... 25k is roughly one day, right?
I count 55k posts in 24 hours, after downloading "recent" 18500 times. This now takes 225 MB on my ram drive. I can compress it into a 13 MB file.
Maybe this particular bot farm takes the weekends off.
Bots typically run only once in a while indeed.
So far, I've only used this data to report a few "good project" posts. To put it to good use, I'd be very happy if we can turn this into a thousand reports per day (just 2% of all posts).
Searching for duplicate entries is very easy, but checking them is a lot of work. I've reported a few only now, but if it results in a few bans, it's worth it.
I hope they didn't switch to word-spinning, that shit is nasty.
Some do, I guess at least hundreds of posts per day use text spinners.
If anyone wants to try to analyse the data, I can easily upload it somewhere. I'll change the file format a bit, then I'll compress the data every other day.
