Analysis – The Merit Path – Where we start off and the path we follow

[DdmrDdmr]

1. Introduction

Lately I’ve seen some comments on whether it is easier to earn the first merit on such or such forum section/subsection. This moved me to find the Merit Path for each person. The Merit Path is the set of distinct section/subsections where we get merited in, ordered by the date we get merited in them for the first time.

For example, my Merit Path is as follows: (Local) Spanish -> (Other) Beginners & Help -> (Other) Meta-> (Other) Serious discussion -> (Other) Off-topic

Therefore, in my case, the Spanish Local board was my starter. I got a few merits there before being merited in the Beginners & Help board. Got a few more merits around those two boards until I got my first merit on Meta, and so on.

This is similar (a very simplified version) to what supermarkets do when they analyse our purchasing habits, classify them by sections or product families, and give us vouchers to promote the next section they consider should be of interest to us (which often is not really), where we’ve never made a purchase before, based on the study of similar paths performed by other customers. My objective here is rather more modest though…


2. First stepping stone in the Merit Path

So far, 22.543 people have been sMerited at some point. We know that some of those sMerits have been awarded to what are now deleted posts, so I’ve taken those out of the merit path.
Out of these forum members, 1.249 have received all their sMerit on deleted posts, so I will not be taking these into account since there is no derivable merit path.
For the remaining 21.294 merited forum members, this is where they have obtained their first sMerit:



What we can see is the following:

a) Russian is the section where most people got their first sMerit (17%), followed by Ann Altcoins (16,53%), Altcoin Discussion (8,82%), Bitcoin Discussion (5,86%) and Economics (5,03%).

b) On the lower end, most local boards are very low contributing to the first merit, Serious Discussion is where 0,44% obtain their first merit, followed by Bitcoin Technical Support (0,45%), Bitcoin Project Development (0,51%) and Politics & Society (0,76%).

c) When we compare the complete history to the most recent history (first of august onwards), the ratios are rather much the same, but there is a larger spike in proportion on the Altcoin Discussion board (+5,15%) and the Russian board (4,02%).


3. First stepping stone in the Merit Path by Rank

The first stepping stone may vary by rank, being some more prone than others to receive their first sMerit in certain section/subsections. To see if this is true, I’ve crossed the above table with current rank (cannot go back to rank at the time of first awarded merit), and turned the numbers into percentages to see the distribution by rank.





Interesting finds:

a) The first table (in green) shows us how many forum members from each rank have earned at least one merit. The user base here is that of the 21.294 merited users who have received sMerit on some non-deleted post at some time. For simplicity, I’ve hidden ranks such as Administrator, Donator, Founder, Global Moderator, Staff, VIP and Brand New. In addition, copper ranks are translated to a regular rank.

Now what I had to recheck multiple times (since it startled me), is that the number of merited Newbies was so high (2.218 in this subset), along side Jr. Members (7.051 in this subset). Both amount together to 43,53% of merited users (in non-deleted posts). That is way more than I has in mind, although it is true that they tend to be merited with a very small amount of merits compared to the higher ranks.

But what is relevant is the volume of these two ranks alone in comparison: out of all the merited users on non deleted posts, 43,53% are actually newbies or Jr. Members. Astonishing!

b) Altcoin Discussion is a section where the lower ranks earned their first sMerit in a rather much higher proportion than the higher ranks, albeit the number of higher rank cases is not dismissible.

c) On the other hand, the Ann Altcoin section is way more different, being the place where 20,16% of merited Legendaries were awarded sMerit for the first time!

d) Surprisingly enough, Newbies merited for the first time in the Mining Altcoins is pretty high (5,59%), and are by comparison pretty high on Bitcoin Development and Technical Discussion (4,15%) and Bitcoin Technical Support (2,39%). Strangely though, many of the merited Newbies in these sections are barely active, so perhaps they are not very concerned with the Merit System and Ranking System at all.

e) Economics and Market Place are strong starters for the higher ranks when considering their first received sMerit, and much lower in proportion for the lower ranks.

f) The proportion of Legendries merited on Meta for the first time (6,29%) is not too large comparted to the Economy sections above mentioned, and not the best starter for Newbies and Jr. Members compared to other sections.



4. Complete Merit Path Combinations

This would normally be one of the most interesting sections to analyse. Nevertheless, since the majority of people have received whatever merit they have earned in one unique section, the merit path combinations with more than one step (like the one I used in the Introduction) are rather small in proportion, and do not bear too much statistical significance. Leaving aside those that gain their merit in a unique section/subsection (and that thus have a one step merit path that is shown above), the main combinations are:

Code:

nUsers  Merit Path
60        (Alternate cryptocurrencies) Announcements (Altcoins) , (Alternate cryptocurrencies) Marketplace (Altcoins)
60        (Local) Russian , (Alternate cryptocurrencies) Announcements (Altcoins)
58        (Bitcoin) Bitcoin Discussion , (Economy) Economics
57        (Local) Russian , (Alternate cryptocurrencies) Altcoin Discussion
54        (Economy) Economics , (Bitcoin) Bitcoin Discussion
52        (Alternate cryptocurrencies) Announcements (Altcoins) , (Alternate cryptocurrencies) Altcoin Discussion
50        (Alternate cryptocurrencies) Altcoin Discussion , (Bitcoin) Bitcoin Discussion
44        (Bitcoin) Bitcoin Discussion , (Alternate cryptocurrencies) Altcoin Discussion
42        (Alternate cryptocurrencies) Altcoin Discussion , (Alternate cryptocurrencies) Announcements (Altcoins)
41        (Alternate cryptocurrencies) Marketplace (Altcoins) , (Alternate cryptocurrencies) Announcements (Altcoins)
40        (Alternate cryptocurrencies) Altcoin Discussion , (Economy) Economics
39        (Alternate cryptocurrencies) Announcements (Altcoins) , (Local) Russian
39        (Local) Russian , (Alternate cryptocurrencies) Marketplace (Altcoins)
36        (Economy) Economics , (Alternate cryptocurrencies) Altcoin Discussion
29        (Economy) Economics , (Alternate cryptocurrencies) Announcements (Altcoins)
28        (Other) Meta , (Alternate cryptocurrencies) Altcoin Discussion
27        (Alternate cryptocurrencies) Altcoin Discussion , (Alternate cryptocurrencies) Speculation (Altcoins)
27        (Other) Meta , (Bitcoin) Bitcoin Discussion
26        (Alternate cryptocurrencies) Speculation (Altcoins) , (Alternate cryptocurrencies) Altcoin Discussion
25        (Economy) Marketplace , (Economy) Trading Discussion
24        (Alternate cryptocurrencies) Altcoin Discussion , (Local) Russian
24        (Alternate cryptocurrencies) Marketplace (Altcoins) , (Local) Russian
24        (Other) Meta , (Alternate cryptocurrencies) Announcements (Altcoins)
22        (Local) German , (Alternate cryptocurrencies) Announcements (Altcoins)
22        (Other) Beginners & Help , (Other) Meta
20        (Alternate cryptocurrencies) Altcoin Discussion , (Other) Beginners & Help
20        (Local) Indonesian , (Alternate cryptocurrencies) Altcoin Discussion
19        (Economy) Marketplace , (Bitcoin) Bitcoin Discussion
18        (Alternate cryptocurrencies) Altcoin Discussion , (Alternate cryptocurrencies) Marketplace (Altcoins)
18        (Alternate cryptocurrencies) Announcements (Altcoins) , (Alternate cryptocurrencies) Mining (Altcoins)
18        (Alternate cryptocurrencies) Mining (Altcoins) , (Alternate cryptocurrencies) Announcements (Altcoins)
18        (Alternate cryptocurrencies) Speculation (Altcoins) , (Alternate cryptocurrencies) Announcements (Altcoins)
18        (Other) Meta , (Economy) Marketplace
17        (Alternate cryptocurrencies) Announcements (Altcoins) , (Bitcoin) Bitcoin Discussion
16        (Alternate cryptocurrencies) Announcements (Altcoins) , (Economy) Marketplace
16        (Economy) Economics , (Economy) Marketplace
16        (Other) Meta , (Other) Beginners & Help
15        (Alternate cryptocurrencies) Altcoin Discussion , (Economy) Marketplace
15        (Other) Meta , (Economy) Trading Discussion
14        (Alternate cryptocurrencies) Altcoin Discussion , (Other) Meta
14        (Alternate cryptocurrencies) Announcements (Altcoins) , (Economy) Trading Discussion
14        (Alternate cryptocurrencies) Announcements (Altcoins) , (Local) German
14        (Economy) Marketplace , (Alternate cryptocurrencies) Altcoin Discussion
14        (Economy) Marketplace , (Economy) Economics
14        (Local) Russian , (Bitcoin) Bitcoin Discussion
14        (Local) Turkish , (Alternate cryptocurrencies) Altcoin Discussion
13        (Alternate cryptocurrencies) Altcoin Discussion , (Economy) Trading Discussion
13        (Alternate cryptocurrencies) Announcements (Altcoins) , (Alternate cryptocurrencies) Speculation (Altcoins)
13        (Alternate cryptocurrencies) Marketplace (Altcoins) , (Alternate cryptocurrencies) Altcoin Discussion
13        (Economy) Marketplace , (Alternate cryptocurrencies) Announcements (Altcoins)

In total, there are 1.976 distinct Merit Path combinations.

5. Conclusions
Bear in mind that this topic is about where one got merited, not how many sMerits they received.

a)  There is a fair share of merited people that have been merited exclusively on later deleted posts (1.249 out of 22.543).

b) Most merited people have been merited in one unique section/subsection.

c) The main section/subsections where people are merited for the first time are Russian, Ann Altcoins, Altcoin Discussion, Bitcoin Discussion and Economics.

d) 43,54% of merited users are currently holding one of the lower ranks (Newbie or Jr. Member).

e) Ranks have different section/subsections where they got their first sMerit. Being the higher ranks more prone to Ann Altcoins, Economics, Marketplace, Russian and Meta, and the lower ranks to Ann Altcoins, Altcoin Discussion, Bitcoin Discussion, and Altcoin Mining.

f) Ann Altcoins is the section that most people got their first merit on, regardless on the rank (Russian board aside).

[1713972422]

1713972422

[1713972422]

1713972422

[1713972422]

1713972422

[1713972422]

1713972422

[LoyceV]

d) Surprisingly enough, Newbies merited for the first time in the Mining Altcoins is pretty high (5,59%), and are by comparison pretty high on Bitcoin Development and Technical Discussion (4,15%) and Bitcoin Technical Support (2,39%). Strangely though, many of the merited Newbies in these sections are barely active, so perhaps they are not very concerned with the Merit System and Ranking System at all.

I think I can explain this: From what I've seen, new users post in those boards with either a technical question, an interesting idea or even a scientific paper. I consider them to be real users, they should not be restricted by Merit, and I love to Merit them. Once their question is answered, they often disappear again. They're not spammers, so they deserve their first Merit, but you're probably right saying they don't care about Merit and Ranks.

f) Ann Altcoins is the section that most people got their first merit on, regardless on the rank (Russian board aside).

Since these boards have the most spam, and good posts are hard to find, it would be interesting to see how many of those are deserved, and how many are just plain merit abuse. But that's a lot of work to analyze.

[vphasitha01]

But what is relevant is the volume of these two ranks alone in comparison: out of all the merited users on non deleted posts, 43,53% are actually newbies or Jr. Members. Astonishing!

I think bigger portion from this 43,53% comes after the introduction of 1 merit requirement for Jr. Members by theymos at 17^th of September 2018. So if you can devide this percentage in to two parts (after and before the new 1 merit requirement) would give rather accuracy one than this.

a)  There is a fair share of merited people that have been merited exclusively on later deleted posts (1.249 out of 22.543).

I wouldn't be surprised to see that most of the later deleted posts(after got Merited) are surely from Russian board (can you compare those two subsets?)

f) Ann Altcoins is the section that most people got their first merit on, regardless on the rank (Russian board aside).

I also doubted most of the merited posts in ANN threads are sheer abuse scenarios. If you can analize, you would be able to find out how many times large number of Merits in an one merit transaction occurred in ANN sections only. I don't have the numbers but you have them surely and my guess is highest number of transactions with more than 5,10 or even 50 merits would be from ANN sections.


I'm a member who against the awarding merits for ANN threads and the thread starters of signature campaigns.


Great analysis OP and where/how you got time to do all the analysis?

BTW is there any way to use merit dashboard with mobile? because it's still not responsive. It would be great if we can use the merit dashboard on the go with our mobile too

[shield132]

d) Surprisingly enough, Newbies merited for the first time in the Mining Altcoins is pretty high (5,59%), and are by comparison pretty high on Bitcoin Development and Technical Discussion (4,15%) and Bitcoin Technical Support (2,39%). Strangely though, many of the merited Newbies in these sections are barely active, so perhaps they are not very concerned with the Merit System and Ranking System at all.

I think I can explain this: From what I've seen, new users post in those boards with either a technical question, an interesting idea or even a scientific paper. I consider them to be real users, they should not be restricted by Merit, and I love to Merit them. Once their question is answered, they often disappear again. They're not spammers, so they deserve their first Merit, but you're probably right saying they don't care about Merit and Ranks.

f) Ann Altcoins is the section that most people got their first merit on, regardless on the rank (Russian board aside).

Since these boards have the most spam, and good posts are hard to find, it would be interesting to see how many of those are deserved, and how many are just plain merit abuse. But that's a lot of work to analyze.

Merits in those sections are logical because they are ledd abused threads, users without knowledge can't post here, also I want to mention that moderator achow101 is excellent, thanks him for the work he does in his two section.
Also posts in Marketplace and altcoins announcement sections are often merited without reason, ANN threads are meritted, that's not right use of merits.

[bitmover]

My merit analysis:

I believe Ddmrddmr is the only user with more merits than posts.

Lol great job, as always!

I wish you had created some kind of interactive tool where we could put our username and see our merit path. Interesting subject

[shield132]

My merit analysis:

I believe Ddmrddmr is the only user with more merits than posts.

Lol great job, as always!

I wish you had created some kind of interactive tool where we could put our username and see our merit path. Interesting subject

Isn't BPIP.org enough? Can't understand what you mean.

[mazdafunsun]

Great job, as always.

2. First stepping stone in the Merit Path
For the remaining 21.294 merited forum members, this is where they have obtained their first sMerit:

It would be interesting to see this distrubution with condition : exluding Jr Members who have only 1 merit.

I wish you had created some kind of interactive tool where we could put our username and see our merit path. Interesting subject

Cmon, this takes a lot of work and time and your asking for a tool ( another tool).

[DdmrDdmr]

<…> Since these boards have the most spam, and good posts are hard to find, it would be interesting to see how many of those are deserved, and how many are just plain merit abuse. But that's a lot of work to analyze.

It would be great to do, but that requires manpower to go a one by one merit review on the section and classify each awarded merit somewhat. As you say, a lot of work …
Concerning the Newbie techies, I guessed that was the reason, so it’s nice that you corroborated my thoughts with hands-on knowledge of those specific sections. They are a subset of Newbies entirely different to those on other sections.

I think bigger portion from this 43,53% comes after the introduction of 1 merit requirement for Jr. Members by theymos at 17^th of September 2018. So if you can devide this percentage in to two parts (after and before the new 1 merit requirement) would give rather accuracy one than this.
<…>

Ok, I broke down the lower ranks as you indicated, and we get:

Jr. Members -> New: 33%; Old 66%
Newbies-> New: 12,5%;  Old 87,5%

So, as expected, the proportion is large on the Jr. Members New subsegment, considering the small amount of time since the 17/09/2018 vs the Jr. Members Old subsegment, which have had 10 months to earn the same merit.
 

I wouldn't be surprised to see that most of the later deleted posts(after got Merited) are surely from Russian board (can you compare those two subsets?)   

Since these 1.249 cases had all their merited posts deleted, and I only download merit related data in general, I would need to retrieve the posts (or just some) for all these cases and see if they are in the Russian board. Unfortunately, I don’t download non-merited posts so I cannot answer rightfully this question. At some point I did focus on deleted posts (see Analysis of Deleted Posts with sMerit), but my main aim was on people that either sent or received merit in later deleted posts. I did not focus solely on those that receive all their sMerit on such kind of posts.

I also doubted most of the merited posts in ANN threads are sheer abuse scenarios. If you can analize, you would be able to find out how many times large number of Merits in an one merit transaction occurred in ANN sections only. I don't have the numbers but you have them surely and my guess is highest number of transactions with more than 5,10 or even 50 merits would be from ANN sections.

Here’s the breakdown of the Ann Altcoin TXs:

Code:

sMerits	nTxs
1	5498
2	1269
3	389
4	196
5	629
6	80
7	48
8	39
9	17
10	381
11	21
12	7
13	10
14	3
15	25
16	9
17	5
18	2
19	3
20	57
21	12
22	5
23	5
24	4
25	25
26	6
27	4
28	1
29	4
30	18
31	4
32	5
34	3
35	2
36	3
37	1
38	2
39	1
40	4
41	2
42	1
43	2
44	1
45	3
46	2
48	3
49	2
50	85

A fair share of 5,10 sMerit TXs, and 85 50 sMerit TXs.. (considering all historical data)

BTW is there any way to use merit dashboard with mobile? because it's still not responsive. It would be great if we can use the merit dashboard on the go with our mobile too

I know.. Really I find that the Dashboard has so much information, that a Mobile device falls too short anyway on visualizing capabilities, favouring therefore desktop/laptop and tables visualization. It I find the time I may look into it further. I did set it so the Dashboard adjusts to the device, but It comes out crap on a mobile so the auto-adjust feature does not render proper result on a mobile phone.

<…>
I believe Ddmrddmr is the only user with more merits than posts.
<…>
I wish you had created some kind of interactive tool where we could put our username and see our merit path. Interesting subject

Actually, there are 311 forum members with more earned merits than posts. People such as @satoshi, @theyoungmillionaire, @GameKyuubi, and @1miau also have that ratio, although many others from the 311 look weird (delete posts, Alts, etc).

I guess you are talking about an interactive path such as a video of “merit receiving evolution”. I’ve though of it in the past, but could not find the right tool at the time. For now, I added this week to the Merit Dashboard a tab called “Personal Summary”, which is a good view of when you got your merits, from what ranks , on which section/subsections, and likewise on the awarding side.

It would be interesting to see this distrubution with condition : exluding Jr Members who have only 1 merit.

I think that would have another objective really. The OP is based essentially on where the first merit is obtained. If you tell me in further detail what you mean, I could give it a go when I free up some time.

[LoyceV]

I wouldn't be surprised to see that most of the later deleted posts(after got Merited) are surely from Russian board (can you compare those two subsets?)   

Since these 1.249 cases had all their merited posts deleted, and I only download merit related data in general, I would need to retrieve the posts (or just some) for all these cases and see if they are in the Russian board. Unfortunately, I don’t download non-merited posts so I cannot answer rightfully this question.

I have downloaded all posts since September 12. Scraping failed sometimes, but still, I think I have more than 99% of all posts.
If you get me the list of all deleted posts (just the post ID (example: 46748761) is enough), I can get you the board, thread title and if needed the post itself (excluding quotes, as it was created before any edits) of the past 4 weeks.

I'm curious to see the results, and it shouldn't be that much work (for me).

[DdmrDdmr]

<...> BTW is there any way to use merit dashboard with mobile? because it's still not responsive. It would be great if we can use the merit dashboard on the go with our mobile too

Tableau has had recent updates, amongst which are better tweaks to make a Dashboard visible on multiple devices with better fitting. It you take a look now, the  Merit Dashboard should be rather usable from a generic phone device (specially in portrait mode). Not everything is perfect yet though, and since the Dashboard filters when you select a chart bar or a table row, it may get in the way with the actual page scrolling on the phone. I still favour a larger device though.

<…>
If you get me the list of all deleted posts (just the post ID (example: 46748761) is enough), I can get you the board, thread title and if needed the post itself (excluding quotes, as it was created before any edits) of the past 4 weeks.
I'm curious to see the results, and it shouldn't be that much work (for me).

Ok, I’ve created a spreadsheet with all the deleted posts, regardless of their time of creation and if they make the user an exclusively merited user on deleted posts or not. Whatever you can cross I can recap back to the implied users through the merit TXs (unless you want to do that part). Let’s see if this goes anywhere interesting … : https://docs.google.com/spreadsheets/d/16Y36CFD6wfmrEeGpA9YNcbWvsiZhxq9tKapBmAMkRIQ/edit?usp=sharing

[LoyceV]

Ok, I’ve created a spreadsheet with all the deleted posts, regardless of their time of creation and if they make the user an exclusively merited user on deleted posts or not. Whatever you can cross I can recap back to the implied users through the merit TXs (unless you want to do that part). Let’s see if this goes anywhere interesting … : https://docs.google.com/spreadsheets/d/16Y36CFD6wfmrEeGpA9YNcbWvsiZhxq9tKapBmAMkRIQ/edit?usp=sharing

Thanks! Some results: Most noticeable: there was a sharp increase of deleted merited posts right after theymos' changes. The dates are my archive dates, so only an approximation of the Merit date, but the increase is very clear:

Code:

2018-09-12_Wed_18.22h.tar.bz2
45588389
45582138
45547342
45556278
45543651
2018-09-13_Thu_19.47h.tar.bz2
45628157
45615769
45630520
45641344
2018-09-14_Fri_21.23h.tar.bz2
45654613
45667428
45652542
45685392
2018-09-15_Sat_23.03h.tar.bz2
45723998
45723541
45726663
45720031
45722812
45727844
45730090
2018-09-17_Mon_00.57h.tar.bz2
45782868
45783026
2018-09-18_Tue_02.33h.tar.bz2
45810974
45816857
45823432
45803792
45825152
45823688
45849283
45814793
45817853
45816336
45819421
45822428
45829024
45838996
45845324
45848311
45849471
45830987
45831011
45831343
45832687
45835295
45835428
45835500
45835785
45835936
45834906
45835108
45837712
45837733
45841066
45842778
45839762
45818454
45848260
45830113
45848601
45819445
45827908
45832570
45832652
2018-09-19_Wed_04.08h.tar.bz2
45865991
45876551
45893121
45893140
45851252
45870607
45856934
45859320
45864206
45864500
45886748
45872127
45873152
45888959
45881432
45885436
45886249
45889805
45885205
45867621
45879752
45869192
45884450
2018-09-20_Thu_05.41h.tar.bz2
45911974
45911881
45895128
45899883
45910018
45920141
2018-09-21_Fri_07.46h.tar.bz2
45959864
45942078
45923205
45930817
45932961
45940579
45951090
45954746
45950879
45954185
45960417
45963529
45962820
45967516
45969374
45929656
45965935
45966083
45936042
45923984
45956703
45946466
2018-09-22_Sat_09.35h.tar.bz2
45989138
45987753
45987456
46006395
45999569
45989005
45981045
45976736
45982563
45986268
45991395
45987911
45984338
46000884
2018-09-23_Sun_11.27h.tar.bz2
46055423
46019041
46020683
46028098
46029345
46056490
46017168
2018-09-24_Mon_13.15h.tar.bz2
46076717
46073676
46077839
46082552
46092804
46101053
46101392
2018-09-25_Tue_15.15h.tar.bz2
46111506
46114751
46128642
46129699
46141720
2018-09-26_Wed_16.54h.tar.bz2
46190801
46154160
46160422
46185512
46192081
46180660
46166665
2018-09-27_Thu_18.32h.tar.bz2
46197317
46197841
46225375
46225462
46225393
2018-09-28_Fri_20.18h.tar.bz2
46242959
46255172
2018-09-29_Sat_22.01h.tar.bz2
46307741
46309879
46319843
46315517
46306674
2018-09-30_Sun_23.51h.tar.bz2
46363614
2018-10-02_Tue_01.30h.tar.bz2
46373527
46375443
46377887
46384343
46375402
46406145
46407990
2018-10-03_Wed_03.09h.tar.bz2
46434036
46435794
2018-10-04_Thu_04.47h.tar.bz2
46457125
2018-10-05_Fri_06.27h.tar.bz2
2018-10-06_Sat_08.22h.tar.bz2
2018-10-07_Sun_10.07h.tar.bz2
2018-10-08_Mon_11.55h.tar.bz2
2018-10-09_Tue_13.39h.tar.bz2
2018-10-10_Wed_15.21h.tar.bz2

(the last few days lack Merit data)

I count 177 deleted posts with Merit in the past month, I would have expected it to be much more.
This is the list, sorted by board: http://loycevsbasement.privatedns.org/meritdeletedposts.html

[DdmrDdmr]

<...>
I count 177 deleted posts with Merit in the past month, I would have expected it to be much more.
This is the list, sorted by board: http://loycevsbasement.privatedns.org/meritdeletedposts.html

My count seem a bit higher, but the amount is still small for the last 30 days. I was going to add to the google spreadsheet I created today, the full deleted info I have (All the TXs, aggregates per person, etc.), when I saw some false positives that I’d not encountered before. They are cases where the scraper tell me the page is deleted but, if I check the link manually, there is a valid post behind (i.e. https://bitcointalk.org/index.php?topic=3174975.msg32944571#msg32944571).

There don’t seem to be too many cases, but it’s been entertaining me for some hours now to try to find the reason, which I have now found and was not aware of:

It turns out that the Economy > Trading Discussion > Scam Accusations -> Investigations childboard requires you to be logged-in in order to access its content. I’ve only encountered this on the Investigations childboard, but I’m not 100% positive that there isn’t another locked childboard (I’ve compared a logged-in session to a non-logged-in session and have not found any other cases though).

Since the scrapper does not log-in to Bitcointalk (and I’d prefer it doesn’t, unless I create an Alt account for the task if it is doable at all), the merits assigned to Investigations are marked as assigned to a deleted posts, and the posts themselves as deleted.

Anyhow, the proportion is very small, so the number of false positives does not alter the overall picture, but I’d rather it not happen on 1-to-1 lists (I may try to create an Alt and see in the scraper can bypass this issue somehow next week).