Bitcointalk Merit Dashboard

[DdmrDdmr]

Thanks. So it's not possible to check if the personal legendary activity limit for a Hero has already been reached, if the Hero don't have 1000 Merits. (If the Hero's current activity is somewhere between 775 and 1030.)

Actually if I understood your question properly, you can on the BitcoinTalk Merit Dashboard:   



- The 108 are heroes that have activity >=100% and merit >= 100% of their goal. This means that they are just waiting to be "knighted" as Legendary.
Most of those 108 being considered for legendary, seemed to have got their merit in the airdrop, being greater than what corresponds to their rank (500 would have been the normal amount). I guess they were airdropped as if they were legendary although the formally aren't.

- The 247 have enough activity (lower limit of 775 or above), but not enough merit (less than 1.000).
You come out on the list belonging to this segment (click on the dashboard segment number 1 (could have ranked up to Legendary, lacking Merit).
Out of these, 2 are nearly there (segment of merit in the range of [80%..100%), 3 are more than halfway there (segment of merit [60%..80%) from the goal, and 242 have only between [40%..60%) of merit.
- 3 more may soon rank up, being above 80% of their goal met both in terms of activity and merit.

- 667 are below 80% of their goal both on merit and activity.

<...>

The dashboard takes the broadest approach possible, since I rather not leave any member out due to the ability to search for a specific user’s data of the dashboard. Besides, the list of exclusions could be long (theymos, nullius, satoshi, first few weeks of merit fiesta, merit sources (unknown officially), etc.). Data is available to all, so other approaches are always welcome.

[DdmrDdmr]

Edit 22/06/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 175.732    
Total Txs:       79.335
From Users:  14.981
To Users:      16.795
minDate:      2018-01-24 22:12:21   
maxDate:     2018-06-22 02:26:58

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Added this week: De-ranked Users and Potential Merit Sources.
Added Recently: User Summary, Section/Subsection, Rankings and WordCloud.


I can't yet figure out how to easily detect movements from Hero to Legendary (ranking-up) or vice-versa (de-ranking) for those Heroes that started off with an initial airdrop of 1000 Merits, instead of 500 Merits.
For example, I’ve detected comparing last weeks DB to this weeks DB that AmoreJaz has gone from Hero to Legendary this week. Nevertheless, he started off with a 1000 Merit airdrop (not 500) , so his initial rank, while being Hero last week, is not detectable through backtracking the data (unless I start to compare DBs every week and detect cases alike in this manner, but that does seem a bit of an added strain to all the calculations I perform to update the Dashboard).

[DdmrDdmr]

Edit 29/06/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 180.742    
Total Txs:       81.487
From Users:  15.159
To Users:      17.048
minDate:      2018-01-24 22:12:21   
maxDate:     2018-06-29 02:48:45

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Added this week: Post summary (distribution of sMerit per TX and TXs per post).
Added Recently: De-ranked Users, Potential Merit Sources, User Summary, Section/Subsection, Rankings and WordCloud.


The good news sMerit awarded on the last entire week (18..24 June 2018) went up nearly 16% from the previous week (11..17 June 2018), although that was a particular low week.

[DdmrDdmr]

I’ve updated the Merit Dashboard to include a Tab called Reciprocal sMerit. The idea behind this Tab is controversial to myself, since I do understand merit abuse tracking down, but rather despise the false positives that come as a side effect of it all. Even so, in favour of transparency I decided to go ahead and add this Tab on to the Dashboard.

1. Objective:
The objective of this Tab is to allow you to see the Total amount of sMerit sent from user A to User B, and how much user B has awarded User A (reciprocal sMerit).
 
This has multiple uses:
-   See one’s own reciprocal sMerit (out of curiosity at least).
-   Search for Injective Merit Abusers (A send to B x amount over time, getting 0 in return).
-   Search for Bijective Merit Abusers (A send to B x amount over time, and gets y amount in return).
 
It is very important not to jump to conclusions of Merit Abuse. Numbers are only an indicator at best, but for those who report Merit Abuse, the actual merited Messages should be studied before bringing forward a case.
 
 
2. Use:
The good thing is that this is all dynamic, meaning we can filter the data by diverse criteria, being the most important one a TX interval.

As an example, I narrowed down the TX Dates to the month of July 2018 (you can either use the slider to adjust the interval, or click on the dates on the extremes to either type them in manually or chose them from a calendar). Having narrowed down the TXs to last month, I then went on to glimpsing through the top cases listed.

The data shows the total amount of sMerit that User A has sent to User B in the timeframe, and how much User B has Sent to User A (I refrain from using the term “back” here, since that suggests a prejudgment which should not take place).

The top cases are all injective (A sends to B 50 sMerits, and is not awarded sMerit from B to A). Going case by case (click on the A->B record, then on the Sent TX to access a shortcut to the original merited Post on a pop-up menu), we can encounter cases that are:

-   Clear merit abuse (have been in the past, tagged on February, and still keeps on at it regardless) – even meriting backtracked one-liner posts with the full 50 sMerit award.

-   Multiple cases of already deleted posts to cover their tracks.

-   Posts what belonging to some of the best posters that are merited for their work (or compensated for their troubles Id say).

-   Etc.

[DdmrDdmr]

Edit 06/07/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 185.332    
Total Txs:       83.409
From Users:  15.343
To Users:      17.335
minDate:      2018-01-24 22:12:21   
maxDate:     2018-07-06 02:41:02

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.

The sMerit awarded on the last entire week (25/06/2018 ..01/07/2018) went up slightly (2,4%) from the previous week. That's an increase running now for two weeks in a row.

[DdmrDdmr]

Edit 13/07/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 189.052  
Total Txs:       85.276
From Users:  15.485
To Users:      17.588
minDate:      2018-01-24 22:12:21  
maxDate:     2018-07-13 02:41:58

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.

The sMerit awarded on the last entire week (02/07/2018 ..08/07/2018) went down nearly 7% from the previous week! Let's hope it doesn't become a new descending trend.

[DdmrDdmr]

Edit 20/07/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 193.706
Total Txs:       87.304
From Users:  15.670
To Users:      17.835
minDate:      2018-01-24 22:12:21   
maxDate:     2018-07-20 02:38:45

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.

The sMerit awarded on the last entire week (09/07/2018 ..15/07/2018) went down 5,91% from the previous week (that's 12,28% in two weeks).

[DdmrDdmr]

Edit 27/07/2018:

Updated Dashboard to reflect the most recent sMerit available data:
Total sMerit: 197.420
Total Txs:       89.116
From Users:  15.829
To Users:      18.078
minDate:      2018-01-24 22:12:21   
maxDate:     2018-07-27 02:51:03

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.

The sMerit awarded on the last entire week (16/07/2018 ..22/07/2018) went up 4,09% from the previous week.

Note: Next week's update will be done around the 7th or 8th of August.

[DdmrDdmr]

Edit 06/08/2018:

Updated Dashboard to reflect the most recent sMerit available data:

Total sMerit: 201.035
Total Txs:      90.737
From Users:  15.980
To Users:      18.292
minDate:      2018-01-24 22:12:21  
maxDate:     2018-08-03 02:41:17

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Link:  BitcoinTalk Merit Dashboard.  

The sMerit awarded on the last entire week (23/07/2018 ..29/07/2018) went down 10,94% from the previous week with a new minimum established of 3.809 sMerits awarded that week. It’s likely that the holidays take their toll, but there are nearly 19% less merit TXs, almost 18% less users awarding sMerit and nearly 16% less merited users for the referenced week …

[asdnguyenthanhtin]

How do you find these figures?

[DdmrDdmr]

How do you find these figures?

To sum it up, the centerpiece is the Merit file which is public and updated every Friday . It can be found at here: https://bitcointalk.org/merit.txt.xz. The file is limited to the last 120 days of data, so all previous records come from my cumulative set of such files.
Any other information not present in the file will need to be pulled down from the Bitcointalk website itself by scrapping data from user profiles and user posts.
Lastly, apply a bit of gray matter to give different information views derived from the raw data obtained. The Dashboard sums it all up and gives us filtering capabilities.

The figures referenced in my previous post on this thread come from the Global Summary tab, by comparing data shown there for the most recent complete weeks.

That’s about it...

[vphasitha01]

Hey...I'm really big fan of your work. I just wanted to know how can get the details of members having 9, 99, 249, 499 Merits?

When I checked my Merit data with your dashboard, it shows that I got 2 initial merits, which actually incorrect. So is there any incorrect details in the raw data or bug in the dashboard? Because LoyceV's Merit data analysis also has the same issue but with a different way.

[DdmrDdmr]

Hey...I'm really big fan of your work. I just wanted to know how can get the details of members having 9, 99, 249, 499 Merits?

When I checked my Merit data with your dashboard, it shows that I got 2 initial merits, which actually incorrect. So is there any incorrect details in the raw data or bug in the dashboard? Because LoyceV's Merit data analysis also has the same issue but with a different way.

Yes, the Initial Merits comes off slightly is some cases due to the time-lapse  between the generation of the official Merit.txt file and the process of scraping the user profile data from the Bitcointalk website.
The merit.txt file is generated around 2 am (in my time zone). I download the file at least six hours later, process it, and start to download all the profiles (posts is another issue that I start before). At best, there is something around a 12 hour difference between the merit.txt file and the end of data scarping (roughly 1 profile per 1 or 2 seconds + process data). This means that any merit TXs in that period will create a discrepancy.
For example, if on Friday 2am I have 400 merits, but receive 2 more between then and Friday 2pm, then my merit profile from Bitcointalk will likely state 402 merits (no initial airdrop in my case), but the union of the Merit.txt files will state 400 merits. Those 2 merits are a “tolerable bug” really, and are due to the above.

It’s like taking a photograph with two different cameras placed in the same position but one being instant and the other one a slow one: If you move between the two shots the image will differ a bit between the two cameras.
Of course it could be improved by not recalculating the initial merit every time (week) and only looking for the initial merit in those cases that are either new or are non-consistant (i.e. initial merit distinct to 0,10,100,250,500,1000), but I’ve taken the weekly recalculation path which is aligned with other many calculations I do.


Concerning the odd merit numbers you want to search for (9,99,249,499), you could use the User Summary Tab on the Merit Dashboard to find them. Simply adjust the Merit Received slider (or Merit slider, depending on what you are searching for) to one of those values and the data will adjust to listing the users with that amount of merits. Since the numbers on your list are not correlative, you’ll have to go one by one in this case.
You can adjust the sliders manually by dragging the handles, or type the numbers over the extremes by clicking on the numbers and typing to overwrite with yours.
I figure you are trying to see who is about to rank-up with just 1 sMerit to go. You can also use the "Ranking-up pipeline" Tab to see this, but with a broader view: If you click on a segment on the "Ranking-up pipeline Summary" that starts with a 3 (Soon may rank-up to ...), you will get the list of members that are within 20% of reaching the required Activity and Merit to reach the next rank. Click again to deselect. 


P.D. The initial Merit may be a bit "buggier" this week since I was away for a few days and scraped profiles on Monday (yesterday) instead of last Friday.

[DdmrDdmr]

Edit 10/08/2018:

Updated Dashboard to reflect the most recent sMerit available data:

Total sMerit: 205.244
Total Txs:      92.636
From Users:  16.104
To Users:      18.533
minDate:      2018-01-24 22:12:21   
maxDate:     2018-08-10 02:48:47

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Link:  BitcoinTalk Merit Dashboard. 

The sMerit awarded on the last entire week (30/07/2018 ..05/08/2018) went down 8,4% from the previous week with a new minimum established of 3.489 sMerits awarded that week. That's a 19,34% decrease in just two weeks!

[TheBeardedBaby]

Just one question here, the dashboard is not very responsive, right?? Or it's just me :



Thanks for answering, yes I'm on a mobile. Not do much time to sit behind a pc

[coinlocket$]

@DdmrDdmr is possible to see the DT reputation of users with mouseover or coloring with red/green to avoid boring clicks to open profiles here on forum?

[DdmrDdmr]

<...>

I think you're on a phone device. The Dashboard is really designed for a larger screen, due to the amount of information shown simultaneously. I actually never use it on my phone. Although the platform allows a possible development to be done specifically for phones, I have discarded doing multiple versions of the Dashboard.
I’ve just checked from a laptop with various browsers, and an Ipad with Safari and it’s as responsive as usual.

Just two additional annotation:
-   Dashboard session times out every 4 minutes or so of inactivity. This is something specific to the platform being used in Public mode and cannot be altered.

-   Every now and then, a major problem does happen with the platform which is based on AWS. There’s a link down on the bottom on the page that shows the state of the platform and it’s been OK for quite a while now: https://trust.tableau.com/status/tableau-public

@DdmrDdmr is possible to see the DT reputation of users with mouseover or coloring with red/green to avoid boring clicks to open profiles here on forum?

Actually, I don’t download DT data so I haven’t got it merged in the underlying database. I only looked into DT once, and created a DT network similar to the merit network, but never continued that line of work. The trust.txt file really has only a subset of the information that is visible on the profile (i.e. no comments), so I’m not sure that the regular info in the file is all that clarifying baring this in mind.
What I did back in April was this: A picture of what our Trust/Distrust Network looks like. This is derived from the info in the file which really is limited as you can see with basic relations indicating who trusts whom in the file such as :

theymosmos->zvs   theymos   zvs   2
theymos->malevolent   theymos   malevolent   2
theymos-/>Matthew N. Wright   theymos   Matthew N. Wright   1
theymos->Korbman   theymos   Korbman   2
-> 2 is "trusts" and 1 is "does not trust".

I don't think we can build anything near what is shown on the user profile with this file alone.

[DdmrDdmr]

Edit 17/08/2018:

Updated Dashboard to reflect the most recent sMerit available data:

Total sMerit: 209.060
Total Txs:       94.624
From Users:  16.229
To Users:      18.738
minDate:      2018-01-24 22:12:21   
maxDate:     2018-08-17 01:56:59

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Link:  BitcoinTalk Merit Dashboard. 

The sMerit awarded on the last entire week (06/08/2018 ..12/08/2018) went up 20,34% from the previous week, recovering from the two consecutive drop, and back to the weekly lower 4K zone.

It's also mandatory mentioning that hilariousetc han now joined the Legendary Olympus, and is the second Hero to reach Legendary needing Merits in the process, after Jet Cash. Congrats !

[DdmrDdmr]

Edit 24/08/2018:

Updated Dashboard to reflect the most recent sMerit available data:

Total sMerit: 212.937
Total Txs:      96.592
From Users:  16.337
To Users:      18.915
minDate:      2018-01-24 22:12:21   
maxDate:     2018-08-24 02:46:57

The dashboard gives you access to anyone’s complete merit history in the TX tab, surpassing the 120 day limit.
Link:  BitcoinTalk Merit Dashboard. 

The sMerit awarded on the last entire week (13/08/2018 ..19/08/2018) went down 10,29% from the previous week, basically due to merit/tx ratio being lower, since the number of TXs is nearly constant comparing the last two weeks.

[TeQuiero]

<...>

I came across this thread and find this surprising piece of statistics:

August 16, 2018, 05:05:34 AM: 1 from vphasitha01 for Re: Disable delete option from merited post.
July 02, 2018, 04:54:20 AM: 1 from Silent26 for Re: Done with this forum
June 25, 2018, 10:10:00 AM: 1 from xIIImaL for Re: [FANCHAIN] by SportsCastr 🔥Signature campaign🔥Earn up to $115/week for posting
May 17, 2018, 02:43:56 PM: 1 from zentdex for Re: Merit & new rank requirements
May 17, 2018, 11:57:54 AM: 1 from zentdex for Re: 100 Days of Merit
May 14, 2018, 03:39:54 AM: 1 from Foxpup for Re: Merit & new rank requirements
May 13, 2018, 05:10:46 AM: 1 from vendy86 for Lets Break The QuestionAuthority NOW !!!
May 11, 2018, 06:01:13 PM: 1 from DdmrDdmr for Re: All About Merit.
May 09, 2018, 05:18:06 PM: 1 from TMAN for (Deleted/Off-limits/Ignored)
May 07, 2018, 06:31:23 PM: 1 from Lazada for Another "Thanks Merit For This Rank Up" Thread
May 05, 2018, 02:31:35 AM: 1 from Nellayar for Another "Thanks Merit For This Rank Up" Thread
May 04, 2018, 12:52:19 PM: 2 from TMAN for Another "Thanks Merit For This Rank Up" Thread
April 28, 2018, 06:00:43 PM: 2 from suchmoon for Another "Thanks Merit For This Rank Up" Thread
April 27, 2018, 04:44:56 PM: 1 from Indohunter for Another "Thanks Merit For This Rank Up" Thread
April 27, 2018, 04:27:37 PM: 1 from Husna QA for Another "Thanks Merit For This Rank Up" Thread
April 27, 2018, 10:24:32 AM: 1 from numanoid for Another "Thanks Merit For This Rank Up" Thread
April 26, 2018, 07:44:12 PM: 3 from DdmrDdmr for Another "Thanks Merit For This Rank Up" Thread
April 26, 2018, 06:29:46 PM: 1 from JayJuanGee for Re: Merit & new rank requirements

I have bolded every merit that was awarded for a post that was somehow related to the
merit system or its ramifications.

Does anyone notice a pattern here?!

To sum up, you have earned exactly a single merit for a post that was not somehow related to the
merit system in the last 4 months.

I know that it's a bit difficult but I can see you're a master of statistics: can you make an analysis on how merits are awarded among various topics: merit related topics, technical issues or bitcoin related... It'd be very interesting.