Bitcoin Forum

Other => Meta => Topic started by: bitmover on July 29, 2020, 03:26:58 AM



Title: Super Merit Table - Where did you spend/received all of your merits
Post by: bitmover on July 29, 2020, 03:26:58 AM
I used DdmrDdmr data  (https://bitcointalk.org/index.php?topic=5256463.msg54875042#msg54875042) once again and created this cool table.

Here you can see where any user spent or received all of his merits, by boards.

Just use the search box to find your username. Then scroll around all of boards and see how many merits you have sent/received in each board.



https://i.imgur.com/awQLvmx.png
https://bitcoindata.science/supertable.html (https://bitcoindata.science/supertable.html)

I find that table pretty useful. It might take a while to load, just be patient (all merit database will be loaded)



Translations:
  • Portuguese -  Super Tabela de Méritos (https://bitcointalk.org/index.php?topic=5268317.msg54980755#msg54980755) by bitmover
  • Polish - Super Merit Table - Gdzie otrzymano i rozdzielono Merits (https://bitcointalk.org/index.php?topic=5265489.0) by cygan
  • Deutsch -  Super Merit Table - Wo erhaltene und verteilete Merits gemacht wurden (https://bitcointalk.org/index.php?topic=5265300.msg54891796#msg54891796) by Lafu
  • Russian -  Cyпep Taблицa Mepитa (https://bitcointalk.org/index.php?topic=5266736) by Ratimov
  • Turkish -    Merit Tablonuz / Merit Kazandığınız ve Harcadığınız Bölümler (https://bitcointalk.org/index.php?topic=5268292.msg54980271#msg54980271) by TomBombadil
  • Croatian - Super Merit Table - Gdje ste potrosili/dobili sav svoj merit by bitmover (https://bitcointalk.org/index.php?topic=5268699.new#new) by -CryptoViking-
    • Filipino - Super Merit Table - Kung saan inilaan ang mga binigay at nakuhang merito (https://bitcointalk.org/index.php?topic=5268984.msg54998933#msg54998933) by Peanutswar


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: cabalism13 on July 29, 2020, 03:29:32 AM
fancy 🥰
A table Version of LoyceV's Stats 😁
https://bitcointalk.org/index.php?topic=5108209.0

Edit:

I tried using it, though I only have one suggestion:
Only View where it has been Sent/Received, automatically hide Boards with 0 value.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: Lafu on July 29, 2020, 03:38:49 AM
Nice Job and work buddy , awesome and realy great to watch and for sure simple to use !
Will get it to the German Board translated if you dont mind .
Guess there are a few that will love to use it and stick around with it .


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: Yogee on July 29, 2020, 03:46:31 AM
Please add column for total sent and received.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: bitmover on July 29, 2020, 03:52:47 AM
Only View where it has been Sent/Received, automatically hide Boards with 0 value.

That would be amazing and I tried, but this flourish website doesn't allow.

I would have to host something myself to do so... maybe in the future ;)

Please add column for total sent and received.
This I can do. I will do in a few minutes

Edit: Done!


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: SFR10 on July 29, 2020, 05:22:23 AM
Excellent tool/table for viewing our Merit data but I would like to suggest separating each sub-board from its parent board [have each one of them in a different column].
- Or a drop-down of some sort [if it's possible].


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: LoyceV on July 29, 2020, 06:49:48 AM
A table Version of LoyceV's Stats 😁
Very nice indeed! Mine was just a very quick job, where I just sorted the board URLs from the forum and posted that. This looks much better, please keep it updated!
There is one flaw though: all child boards are included under the main sub board. "Trading Discussion" for instance doesn't really cover it when most of the Merit transactions on that board happened in "Reputation".

Quote
Only View where it has been Sent/Received, automatically hide Boards with 0 value.
Just Merit someone on all boards :D
I'm only missing Chinese, Greek, Hebrew, Japanese, Korean and Skandinavisk.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: cryptoaddictchie on July 29, 2020, 07:04:36 AM
Tried it.
https://i.imgur.com/uJ0JRPV.jpg

Very helpful and excellent merit data summary. I remember requesting to LoyceV few days ago on this thread https://bitcointalk.org/index.php?topic=5108209.0 and now this come out. (Maybe your client on that thread will decrease LoyceV  :D)

Only View where it has been Sent/Received, automatically hide Boards with 0 value.
That would be amazing and I tried, but this flourish website doesn't allow.

I would have to host something myself to do so... maybe in the future ;)
Were looking forward to this mate where none merited board should not be displayed. Too sad that website doesnt allow to remove it. I could possibly screenshot all if werent for those 0 vacant sent/received. Anyway this is really a great tool. 10/10!


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: bitmover on July 29, 2020, 10:29:01 AM
A table Version of LoyceV's Stats 😁
Very nice indeed! Mine was just a very quick job, where I just sorted the board URLs from the forum and posted that. This looks much better, please keep it updated!

Thanks, I will try to keep it updated.


There is one flaw though: all child boards are included under the main sub board. "Trading Discussion" for instance doesn't really cover it when most of the Merit transactions on that board happened in "Reputation".

That's a limitation of DdmrDdmr data. I can't do much, as I don't know how he was able to link each topic ID to its current section/subsection. Maybe he scraped? Painful job lol
I will stick to this limitation. I was able to generate WO observer data (https://bitcointalk.org/index.php?topic=178336.msg54878345#msg54878345), as just finding one topic is pretty easy.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: McniColl on July 29, 2020, 11:19:54 AM
Really everyone would love to see the Super Merit table, a very neatly arranged table.  Thank you so much for showing such a table. You can update this table to make it look easier and more beautiful.

I want to ask you a question. If you search by typing my name on the Superman Merit table nothing shows.  If you did that, it would be better if the names of those who did not get merit or donate could be seen on the table.

Not show my name: https://imgur.com/4nB5Thv

Thank you @bitmover


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: bitmover on July 29, 2020, 11:31:20 AM
Really everyone would love to see the Super Merit table, a very neatly arranged table.  Thank you so much for showing such a table. You can update this table to make it look easier and more beautiful.

I want to ask you a question. If you search by typing my name on the Superman Merit table nothing shows.  If you did that, it would be better if the names of those who did not get merit or donate could be seen on the table.

Not show my name: https://imgur.com/4nB5Thv

Thank you @bitmover

Hello Mcnicoll.

I excluded members who never earned any merit from the database, as all their data is zero anyway...


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: tranthidung on July 29, 2020, 11:47:35 AM
It looks like now you are more proficient to do such things. Congratulations for your achievement, bitmover!

By the way, if it is possible (on that platform and at your current skills), please add a column for percentages statistics. You can add a new column or simply integrate percentages in () blocks after the frequency statistics.

It is easier to imagine distributions based on percentages rather than frequencies.


I can do percentage statistics, but I am not sure if I understood your suggestion correctly.

Something like this?
That's it!


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: bitmover on July 29, 2020, 11:56:27 AM
It looks like now you are more proficient to do such things. Congratulations for your achievement, bitmover!

By the way, if it is possible (on that platform and at your current skills), please add a column for percentages statistics. You can add a new column or simply integrate percentages in () blocks after the frequency statistics.

It is easier to imagine distributions based on percentages rather than frequencies.

Thank you for your suggestion.

I can do percentage statistics, but I am not sure if I understood your suggestion correctly.

Something like this?

I just invented that % for our discussion, didn't calculate it.
https://i.imgur.com/rOKRrmT.png


Edit: The problem is that I already have 43 columns. This idea would double it... certainly it is interesting, but it might decrease user experience.
I think I will not be able to use the same column. I will try to figure out something


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: -CryptoViking- on July 29, 2020, 01:54:53 PM
Thank you for this tool, it is lightning fast and to be honest quite useful. I'm gonna go happily check my stats now and see where I'm frequenting the most, to be honest I probably haven't explored 30% of the forum yet.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: tranthidung on July 29, 2020, 01:55:42 PM
Edit: The problem is that I already have 43 columns. This idea would double it... certainly it is interesting, but it might decrease user experience.
I think I will not be able to use the same column. I will try to figure out something
Why not consider to move the username on the first row.

Then, the second and third rows will be:
  • Received (frequency)
  • Received (%)

The fourth and fifth rows will be:
  • Sent (frequency)
  • Sent (%)

Cheers!  :D


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: McniColl on July 29, 2020, 03:00:54 PM
Really everyone would love to see the Super Merit table, a very neatly arranged table.  Thank you so much for showing such a table. You can update this table to make it look easier and more beautiful.

I want to ask you a question. If you search by typing my name on the Superman Merit table nothing shows.  If you did that, it would be better if the names of those who did not get merit or donate could be seen on the table.

Not show my name: https://imgur.com/4nB5Thv

Thank you @bitmover

Hello Mcnicoll.

I excluded members who never earned any merit from the database, as all their data is zero anyway...


I really like your invention.  I want more simple and beautiful inventions you will give us more gifts.

I wish you a long life.  And thank you so much for explaining it to me in such a beautiful way.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: bitmover on July 29, 2020, 03:20:10 PM
Edit: The problem is that I already have 43 columns. This idea would double it... certainly it is interesting, but it might decrease user experience.
I think I will not be able to use the same column. I will try to figure out something
Why not consider to move the username on the first row.

Then, the second and third rows will be:
  • Received (frequency)
  • Received (%)

The fourth and fifth rows will be:
  • Sent (frequency)
  • Sent (%)

Cheers!  :D

You are genius. Done!


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: DdmrDdmr on July 29, 2020, 03:57:23 PM
<…> That's a limitation of DdmrDdmr data. I can't do much, as I don't know how he was able to link each topic ID to its current section/subsection. Maybe he scraped? <…>
I can add more path depth levels to the data I provided. What I do is obtain for each post the complete path that figures at the top of the page (i.e. "Bitcoin Forum > Other > Meta > Super Merit Table - Where did you spend/received all of your merits"), and then parse each item as a different level ("Bitcoin Forum" is Level 1, "Other" is level 2 and so on). 6 Levels covers everything, so it would be a question of adding levels 4, 5 and 6 (which could be blank). For example, there are 10543 TXs with level_4 = "Reputation (Moderator: Cyrus)".

Notes:
1) I cleanse levels 1,2 and 3, but not all the remaining other levels.

By that I mean that historical data may contain a reference to a certain moderator, that is not the current moderator, and I may not want the moderator to show at all. When cleansing, I delete the moderator information, and make sure I have homogeneous values.

In the above example, Reputation contains "Reputation (Moderator: Cyrus)" as it’s unique value on level 4, so filtering by this value should retrieve all Reputation TXs, but other childboards of interest may have more than one entry (i.e. moderator changes at some point, so historical data has one description, and recent records another).

2) If you want to give it a go, I can add the remaining levels 4,5 and 6 to the file. It will make it much larger though, and a bit more complex to manage due to the above.

3) I actually tried to give you the data along with this post, but cannot complete the procedure right now (I’d have to give it a go later on, when I get hands on my proper environment).


Edit:
- level 4 is rather more cleansed than I thought for local boards, since I use it on the Merit Dashboard.
- Files with the added fields:
    https://drive.google.com/file/d/1cdne4UO8vs25eoPHGjIAUxIefU_pPJOc/view?usp=sharing (rar - 15 Mb).
    https://drive.google.com/file/d/1txraHpX-ctAEr7Tb-GGx2I0aBAsEeF4D/view?usp=sharing (nor rar - 259 Mb).


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: cygan on July 29, 2020, 07:47:40 PM
bitmover, you created a very useful tool which is also very successful - respect!
i translated it into polish and published it there (https://bitcointalk.org/index.php?topic=5265489.0)


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: The Sceptical Chymist on July 29, 2020, 08:03:46 PM
Very cool little table you created there, OP.  I'm not really all that interested in merit statistics (mine or anyone else's), but it was interesting to look at which sections I'd gotten most of mine in and where I've given them out the most.  Meta topped the list for both, just as I would have guessed but I was surprised to see Trading Discussion was a section where I'd earned and given out a lot of merits--I guess I don't frequent that section much anymore, or it could be that some threads got moved there.

Excellent tool/table for viewing our Merit data but I would like to suggest separating each sub-board from its parent board [have each one of them in a different column].
- Or a drop-down of some sort [if it's possible].
Definitely a good idea.

Edit:
Trading discussing is basically Reputation board.
Lol, I just realized that when I went there a minute ago and saw that Reputation and Scam Accusations are child boards of Trading Discussion.  I forgot about that.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: bitmover on July 29, 2020, 08:06:43 PM
Very cool little table you created there, OP.  I'm not really all that interested in merit statistics (mine or anyone else's), but it was interesting to look at which sections I'd gotten most of mine in and where I've given them out the most.  Meta topped the list for both, just as I would have guessed but I was surprised to see Trading Discussion was a section where I'd earned and given out a lot of merits--I guess I don't frequent that section much anymore, or it could be that some threads got moved there.


Thank you.

Trading discussing is basically Reputation board.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: notblox1 on July 29, 2020, 08:24:15 PM
@bitmover this is amazing work and I bookmarked it in my browser.
With few improvements that previous members proposed it can be even better.

My suggestion would be to allow members to filter and hide some fields and to resize the table if possible.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: bitmover on July 29, 2020, 08:47:21 PM
Thank you all for the suggestions.

Most of those customizations will only be able if I host my table in my domain, moving away from flourish.

I am studying about using namecheao to create a website for this kind of data. I am studying a lot of python so i think i will do a lot of work

I already figured out a searchable table using bootstrap, that will work much better than this one.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: Tom Bombadil on August 12, 2020, 10:43:03 AM
Turkish translate: https://bitcointalk.org/index.php?topic=5268292.msg54980271#msg54980271


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: -CryptoViking- on August 12, 2020, 10:07:56 PM
I will translate it to Croatian too in next few days as that covers almost all users from Balkans as they visit our board regularly. This tool is so useful it's a shame if people don't know about it.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: bitmover on August 13, 2020, 05:16:36 AM
UPDATE:

I moved the merit table to my personal domain. The new link is now:
https://bitcoindata.science/supertable.html

I will soon remove flourish and generate a new table using only Javascript/Bootstrap. I hope I will have time to do it next week. Still struggling with JS to read CSV files....


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: jademaxsuy on August 13, 2020, 01:43:00 PM
Wow another statistics has been presented. I had so much love you guys for making so many statistics in this forum. It somehow could be use in the future for references. As we can see the statistics do not lie and we can interpret whether were the point we need to improve or the part that are already working and done better. Even in research as I have remember during college days, the statistics plays important role in the study. I just needed how to learn this as it is one of my hated part where I really do not like the Math subject.

Anyway, I wanted also to test this out to see where did i spend/receive my merits in this forum. Thanks for this idea surely I can manage now to see the details of the merits being spent and received.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: -CryptoViking- on August 13, 2020, 11:08:47 PM
UPDATE:

I moved the merit table to my personal domain. The new link is now:
https://bitcoindata.science/supertable.html

I will soon remove flourish and generate a new table using only Javascript/Bootstrap. I hope I will have time to do it next week. Still struggling with JS to read CSV files....

I would just like to add that it is not updating correctly or at all.Other option could be that it does not include certain boards too. It says I received 67 merit for a while now and I am at 128 already as you can see.

Not a rant btw., just pointing it out so you can add stuff if you plan to improve it.

Added Croatian translation: 

https://bitcointalk.org/index.php?topic=5268699.new#new (https://bitcointalk.org/index.php?topic=5268699.new#new)


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: bitmover on August 14, 2020, 08:38:44 PM
I would just like to add that it is not updating correctly or at all.

The table is manually updated, and I am updating it twice a month for now. I ask DdmrDdmr for the file with his scraped data.

Quote
Other option could be that it does not include certain boards too.

I am not able to do it.

I tried to use bootstrap + datatable.net to create the table, so I would have more customization options. However, I do not know how to efficiently parse the data, and my HTML file had 30mb and consumed a lot of processing power.

Flourish is very efficient in parsing the data, so I will keep the table in this format and move on to other projects. At least for now. Maybe in the future as I learn more about JS and SQL...

Quote
It says I received 67 merit for a while now and I am at 128 already as you can see.

It now shows 130 merits for you and 47 sent ;)


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: -CryptoViking- on August 14, 2020, 11:00:50 PM
I would just like to add that it is not updating correctly or at all.

The table is manually updated, and I am updating it twice a month for now. I ask DdmrDdmr for the file with his scraped data.

Quote
Other option could be that it does not include certain boards too.

I am not able to do it.

I tried to use bootstrap + datatable.net to create the table, so I would have more customization options. However, I do not know how to efficiently parse the data, and my HTML file had 30mb and consumed a lot of processing power.

Flourish is very efficient in parsing the data, so I will keep the table in this format and move on to other projects. At least for now. Maybe in the future as I learn more about JS and SQL...

Quote
It says I received 67 merit for a while now and I am at 128 already as you can see.

It now shows 130 merits for you and 47 sent ;)

Cool, I'm happy enough to have it at the disposal as it is :D  I don't know how to do that stuff either so I can't help, but hopefully someone will come along with knowledge, time, will and help you out.

Thanks for doing the manual update.


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: Peanutswar on August 15, 2020, 07:46:45 AM
Filipino translation - https://bitcointalk.org/index.php?topic=5268984.0


Title: Re: Super Merit Table - Where did you spend/received all of your merits
Post by: bitmover on September 25, 2020, 03:17:42 PM
bump
table was just updated.