Bitcointa.lk what is it???

[theymos]

What IP?

IPs are only banned for over-use if they request pages more frequently than once per second. Faster requests are not allowed.

[roslinpl]

So now we have two bitcointalks

Great ...
Anyway if you all think this is ok - good.
But some people might be confused while visiting bitcointa.lk.

[cedivad]

Thank you for passing by, theymos.
Have you changed the behaviour of the DoS automatic banner recently? Because it's the only rationale solution i can think off, if those bans are not manual. The crawler worked just fine for a month until yesterday.

The 5 IPs i'm using right now are 54.217.199.213, 46.137.37.197, 54.195.167.127, 54.195.152.218, 54.73.190.33.

Let me simply know if you want me to kill this project and the crawler.
Posted from Bitcointa.lk - #nicm5KCTPCqeXZOn

[theymos]

Those IPs are not blocked currently. But your other abusive IPs were blocked. Just your quotefast requests (which are only part of what your crawler does) were occurring at an average frequency of 7.6 requests per second in the most recent access logging period. Your requests constituted 3.4% of all forum requests in this period. This is entirely unacceptable and of course resulted in those IPs being banned.

The maximum allowed bot request frequency is 1 request per second. Those IPs are now accessing pages at an average of 2.5 requests per second combined. If you continue exceeding the allowed request limit, we will continue banning your IPs.

[cedivad]

The 7.6 peak was due to the backlog i had on edited content, that i implemented yesterday. If you check the traffic one week ago you should see an average way less than 1 request per second. (and i'm sort of sorry for this peak).

The maximum allowed bot request frequency is 1 request per second. Those IPs are now accessing pages at an average of 2.5 requests per second combined. If you continue exceeding the allowed request limit, we will continue banning your IPs.

This forum has less than 30k posts per day, so those numbers doesn't add up on my side, something must be wrong (especially since that i removed the sync of modified content after this problem). I will write a way to see how many requests i actually do and what % fails/etc. The problem could be peak hours, when there is more than 1 post per second... But i doubt that.
Posted from Bitcointa.lk - #yCkCrM3Xkyk4sagw