[TOOL] ⭐Bitcointalk BRDb score

[dkbit98]

As promised, I've added an emoji representing the country of the localboard in question next to the user's uid.

This is a step in a good direction, but I can't see flag or letters in userscript profiles.
Even if I click on BRDb score in same usercript nothing is shown in pop up window.
So only way for me to see something is to visit profile page on website, and that is time consuming.
I also saw mistakes about other profiles posted earlier, so maybe you should set minimum number of posts that would count someone as local member.

[DYING_S0UL]

As promised, I've added an emoji representing the country of the localboard in question next to the user's uid.

This is a step in a good direction, but I can't see flag or letters in userscript profiles.
Even if I click on BRDb score in same usercript nothing is shown in pop up window.
So only way for me to see something is to visit profile page on website, and that is time consuming.
I also saw mistakes about other profiles posted earlier, so maybe you should set minimum number of posts that would count someone as local member.

None can, because he didn't add it into the userscript's window, he only added the flags to the BRDb site.
Also, if you look carefully you'll notice some of these users aren't assigned any flags yet as they don't met the minimum requirements. Example, admin.
He needs to work hard on setting the right conditions for determining the local, otherwise it would make a big mess, like it did with mine, and many others. So he can't just add it into the userscript yet.

*Ace*, the profile loading became slower, it takes about 3-5 sec to load everything. It just feels slower.

[*Ace*]

As promised, I've added an emoji representing the country of the localboard in question next to the user's uid.

This is a step in a good direction, but I can't see flag or letters in userscript profiles.
Even if I click on BRDb score in same usercript nothing is shown in pop up window.
So only way for me to see something is to visit profile page on website, and that is time consuming.
I also saw mistakes about other profiles posted earlier, so maybe you should set minimum number of posts that would count someone as local member.

I haven't added the tags to the userscript window yet. The fixes I've made are temporary; it's very difficult to find a formula that works for the vast majority of users, so I wait a little longer to see if any more bugs appear, then I put it in the userscript
 

*Ace*, the profile loading became slower, it takes about 3-5 sec to load everything. It just feels slower.

Yes, I've seen it too, but I haven't fixed it yet. Unfortunately, every new implementation makes requests to the DB and slows it down.

[*Ace*]

Have any of you ever encountered the 403 Forbidden error? I was doing some testing but apparently I exceeded the 1 request per second by a long way. So now I'm stuck with the scraper stuck. Do you know how long this ban lasts?

LoyceV you who are more expert than me

[LoyceV]

Have any of you ever encountered the 403 Forbidden error? I was doing some testing but apparently I exceeded the 1 request per second by a long way.

Isn't this just blocking a certain request? If you're going too fast and get rate limited, you get error 429. This lasts only a second as far as I know. If you go even crazier than that (or hit a bug), Cloudflare gives you Error 1015. This one lasts an hour.
I don't remember seeing error 403 on Bitcointalk.

[*Ace*]

Have any of you ever encountered the 403 Forbidden error? I was doing some testing but apparently I exceeded the 1 request per second by a long way.

Isn't this just blocking a certain request? If you're going too fast and get rate limited, you get error 429. This lasts only a second as far as I know. If you go even crazier than that (or hit a bug), Cloudflare gives you Error 1015. This one lasts an hour.
I don't remember seeing error 403 on Bitcointalk.

The other time I got error 429, but it lasted almost a whole day. Today, however, first 503, then 403. Now it seems that this block has been removed, but it lasted almost 4 hours. I need to review the duration of the requests, possibly lengthen them, but a complete cycle already lasts 3 minutes, all this seems strange to me.

[LoyceV]

The other time I got error 429, but it lasted almost a whole day.

Does that mean you keep scraping too fast, or does it persist after you stopped?
I'll test it: if I open 50 topics within a few seconds, I get:

Too fast / overloaded (503)

Most likely, you are accessing the forum too quickly. You are only allowed to access at a rate of one pageload per second on average (somewhat higher bursts).

It is also possible that the server is overloaded or temporarily down.

503 via master1

So it's not Error 429. But it works again right after that.

[*Ace*]

The other time I got error 429, but it lasted almost a whole day.

Does that mean you keep scraping too fast, or does it persist after you stopped?
I'll test it: if I open 50 topics within a few seconds, I get:

Too fast / overloaded (503)

Most likely, you are accessing the forum too quickly. You are only allowed to access at a rate of one pageload per second on average (somewhat higher bursts).

It is also possible that the server is overloaded or temporarily down.

503 via master1

So it's not Error 429. But it works again right after that.

I don't know what's going on inside the scraper. I make a request directly from the recent posts page, and between each page it pauses for 3 seconds. The entire cycle also includes Merit scraping and lasts about 3 minutes. I'm obviously doing something wrong somewhere.

[LoyceV]

I don't know what's going on inside the scraper. I make a request directly from the recent posts page, and between each page it pauses for 3 seconds. The entire cycle also includes Merit scraping and lasts about 3 minutes. I'm obviously doing something wrong somewhere.

Time for some troubleshooting? Log all scrape-requests with it's date, see what you're scraping.

[fillippone]

I saw something strange today:
On a thread, I saw this very strange score for a well-known user:



But of course, when I went into the profile, the result was different, and probably correct.



Going back to the post, I saw the wrong score again.