[Abandoned] I created the Bitcointalk Stats Live Counter

[BlackHatCoiner]

Wow what a great work. How is it possible to track down online users and their posts?

Hi, thank you. If you go here you can see that the forum has some unique stats. I'm taking these stats from that link and I'm putting them on btctalk.live by refreshing them every 5 seconds.

The technical stuff behind:
When you load btctalk.live, I'm loading "https://bitcointalk.org/index.php?action=stats" on your browser. Once it is successfully load, the btctalk.live's server views the page source of stats and it converts it in plain text. Then, I've programmed it to find the numbers after the following phrases:

Total Members:
Total Posts:
Total Topics:
Users Online:

Once it's done, the server returns the proper values for those phrases and it starts all over again. Voila! PHP magic.

So low that it did not even reach 1% of the total registered number of users here in the forum. Is this really the effect of rank and merit system?

I would say that no, it's not. Although, thousands of these accounts have been created for earning purposes only. If you start searching some topics you can see newbies shitposting their (probably) scamming sites. They get quickly banned, but they register again with new usernames. I don't know why you mentioned the merit system. It is just a number that shows that some people found posts of a member useful. I don't think that you can abuse the merit system. It was created for this very purpose.

[1715302436]

1715302436

[SFR10]

I was going over some of the links and it looks like the following page is no longer functioning properly.

Hi guys, I introduce you the Today's Stats!

I added to count the statistics (posts, topics, registrations) everyday. After some days I will add to choose a specific day to see what happened then.

I added to insert a specific date to see it's statistics. Statistics start from 2020-07-17 and later.

Also: Statistics of all dates (list)

Not sure if that is an abandoned feature or there's an error for fetching the data since 2020-09-09.
^{- If it's just a bug of some sort, I would suggest adding its link to the homepage as well.}

So low that it did not even reach 1% of the total registered number of users here in the forum. Is this really the effect of rank and merit system?

It might have a small impact but a lot of registered members are either bots or no longer active ^{[life happens]}.

I don't know why you mentioned the merit system.

I believe he/she meant the connection it has with added difficulty in ranking up.

[BlackHatCoiner]

@SFR10, to be honest, I don't know why it stopped in 9th of September, I checked the scripts, database, cron jobs. Everything was working normally (For example daily online activity still works). That's why I decided to turn today's stats down.

If you think it is important, I can put it again. The information of the range (9th until today) will remain unknown, though.

[SFR10]

If you think it is important, I can put it again. The information of the range (9th until today) will remain unknown, though.

If it's going to somehow conflict with other things, please forget it ^{[there are still a few alternative ways]} but if it doesn't affect anything, then it would always be nicer to have access to more information in a single place

[BlackHatCoiner]

https://btctalk.live/rankcalculator/

^ I made this quick rank calculator. I haven't styled anything yet, because I want to be sure that it calculates the date properly. Can any mods/legendaries confirm it?

[hosseinimr93]

^ I made this quick rank calculator. I haven't styled anything yet, because I want to be sure that it calculates the date properly. Can any mods/legendaries confirm it?

I am neither moderator nor legendary. But I tested this.

For reaching junior member, excluding merit, you need 30 activity. If you make 1 post per day, it takes 30 days to get 30 activity and become a junior member.
I entered today's date. It says that I will become a junior member 44 days later.

I also think that it would be better to remove the word "average".
Assume that I make 30 posts on day 1 and make no post on days 2-30. In the first 30 days, I have made 1 post per day on average. In this case, I cannot become a junior member.

[TryNinja]

For reaching junior member, excluding merit, you need 30 activity. If you make 1 post per day, it takes 30 days to get 30 activity and become a junior member.
I entered today's date. It says that I will become a junior member 44 days later.

It actually requires you to post 30 times between 3 periods of activity (which are each 14 day long), at least once on each one of them. So, the answer is more complex than that. I already gave a better explanation here.

If you post at the beginning of an activity period, it will actually take you 42 days (3 periods of 14 days). While, if you post at the last day, it will take you 29 days (explained in my other post). The right answer is: it will take you from 29 to 42 days if you make exactly 1 post per day. 29 if you start the first day of a period, 30 if you start at the second day, etc...

Here is a spreadsheet with the forum activity periods: https://docs.google.com/spreadsheets/d/12saLhlUoqIdairxzuSPu6EYGrt7FN2lOstO1yDjCEbA/edit#gid=1324892580

edit: the calcuations above are wrong, see the following post.

[hosseinimr93]

---------

A = min (p , 14*n)

in which

A = Activity
p = post count,
n = number of two-week activity periods in which the user has made at least 1 post.

Case A: someone makes exactly 1 post per day and the first post is made in the first day of the activity period.

Day 1: p=1, n=1 ---> A=1   (The first day of the first period)
Day 2: p=2, n=1 ---> A=2
...
...
...

Day 14: p=14, n=1 ---> A=14
Day 15: p=15, n=2 ---> A=15   (The first day of the second period)  
Day 16: p=16, n=2 ---> A=16
...
...
...
Day 28: p=28, n=2 ---> A=28
Day 29: p=29, n=3 ---> A=29  (The first day of the third period)  
Day 30: p=30, n=3 ---> A=30

It took 30 days to become a junior member


Case B: someone makes exactly 1 post per day and the first post is made in the last day of the activity period.

Day 1: p=1, n=1 ---> A=1  (The last day of the first period)
Day 2: p=2, n=2 ---> A=2  (The first day of the second period)
Day 3: p=3, n=2 ---> A=3
...
...
...
Day 14: p=14, n=2 ---> A=14
Day 15: p=15, n=2 ---> A=15
Day 16: p=16, n=3 ---> A=16  (The first day of the third period)
Day 17: p=17, n=3 ---> A=17
...
...
...
Day 28: p=28, n=3 ---> A=28
Day 29: p=29, n=3 ---> A=29
Day 30: p=30, n=4 ---> A=30  (The first day of the fourth period)

It took 30 days to become a junior member

In both cases, it took 30 days to become a junior member.



Since I don't want to bump the other topic, I reply to your post in that topic here.

"If a brand new member posts everyday, after how many days will he get the Jr Member rank?"

- Answer: At least 29 days. Posting at least once in the last day of one of the 14 days period (+14 potential activity) and posting at least once in the next 2 periods (+14 x 2 potential activity) = total of 42 potential activity. Then, making at least 30 posts and getting 1 merit.

No, At least 16 days.

Below is what needed to do.

1. Register to the forum at last day of a two-week activity period and make at least 1 post in that day.
2. Make at least 1 post in the period 2.
3. Make 28 posts at first day of period 3. (Because 2 posts have been already made)

[TryNinja]

~

You are actually correct. I hate dealing with dates.

That's a very specific situation, though. Most people won't wait til the last day of a period to do that, so it will probably take longer for them (since registration date). In the worst case, it will indeed take 29 days so he can get enough activity (starting at the first day of a period, + 28 days til the 3rd period = 29 days).

[icopress]

Hi BlackHatCoiner, I liked your tool and I almost bookmarked it (to keep track of 3m acc). But I noticed that there is a certain gap between displayed and real.
For example giuongxep is displayed as the last registered, i.e. 2846318 but in reality its ID is 2862323

[BlackHatCoiner]

~snip~

The total registered users aren't equal with the last member's id. There are users that have been deleted completely since the forum began. Example, user with id=2: https://bitcointalk.org/index.php?action=profile;u=2

[icopress]

The total registered users aren't equal with the last member's id. There are users that have been deleted completely since the forum began. Example, user with id=2: https://bitcointalk.org/index.php?action=profile;u=2

Yes, this is clear and this missing data can be seen at bpip.org

But we're talking about a statistics resource that keeps track of recent registrations. Therefore, is it possible to include data on deleted accounts to eliminate this discrepancy?

[Smartvirus]

I'll really like to know how you did this @OP as I hope to try out stuffs like this someday in a way that it add value to the forum and an increase to the already existing tools.

The tool shows how volatile the forum is and to what extent contents are been created and comments been made on existing posts. It's amazing to see that the available posts count on the forum is over 55M and counting, wow! It's pretty exciting to watch the online member count and how active the users come off and on, the traffic is quite a thing.

What I find inappropriate is the the guessing of private key package. Why would any one need that. If it could be used in finding lost private keys, it could also be used in hacking wallets. Perhaps it's works in a different way, I don't know.

[pankowri]

I thought to share your created Bitcointalk Stats Live Counter with my native people and finally, I have done it today. This is very interesting to me to check and know the immediate result within a few seconds. I am Bangladesh and I highlighted this thread from my language (Bangla) and tried to specify all the features in a very short way to describe. Keep creating new things for us continuously.

Thread link where I tried to represent this thread in Bangla in local board---  https://bitcointalk.org/index.php?topic=631891.msg55402533#msg55402533

Thanks for your contribution to creating such amazing things.

[BlackHatCoiner]

A bump isn't bad once in a while.

[BlackHatCoiner]

I updated the OP. Also, I changed it a little bit. I always wanted to put a nice header like that. 

Today and Alldates are back again after a break (some issues).
Stats from 09/09/2020 until 11/14/2020 are not available.

Speaking of issues, I would find it nice to create a livecount for recent merit transactions. Recent merit stats can be found here, but the problem is that guests cannot see them, in which btctalk.live is based on. So I can't get those stats from there. On the other hand we have the LoyceV's database. The issue here is that these are enormous files that cannot be refreshed every 5 seconds. So I'm ran out of ideas.

[LoyceV]

Speaking of issues, I would find it nice to create a livecount for recent merit transactions. Recent merit stats can be found here, but the problem is that guests cannot see them, in which btctalk.live is based on. So I can't get those stats from there.

You'll need to scrape the data as a user. Or try Ninjastic.space - BitcoinTalk Post/Address archive + API, it currently doesn't have what you're looking for, but TryNinja might be able to add it.

On the other hand we have the LoyceV's database. The issue here is that these are enormous files that cannot be refreshed every 5 seconds.

It's also updated only once a week

[BlackHatCoiner]

I don't know, maybe something like that has already been offered here, I haven't read the whole topic, but it was possible to add 2 lines in this calculator:

Code:

 Minimum Legendary Data
Maximum Legendary Data 

I would do that it ain't anything special, but as you mentioned I've also noticed that the rank calculator isn't working properly and I don't understand why. I've set to count 14 activity for every 2 weeks.

[LoyceV]

the rank calculator isn't working properly and I don't understand why. I've set to count 14 activity for every 2 weeks.

Those 14 Activity are adjusted on a fixed time (somewhere on Tuesday), did you account for that?
That means a Newbie can reach 28 Activity within a day if he creates his account at the right moment (and creates 28 posts).

[dzungmobile]

the rank calculator isn't working properly and I don't understand why. I've set to count 14 activity for every 2 weeks.

Those 14 Activity are adjusted on a fixed time (somewhere on Tuesday), did you account for that?

Somewhere from 5 AM to not more than 9 AM forum time. I guess so.