Title: [Request] Stats Post by: cabalism13 on August 05, 2020, 04:46:31 AM I'm just curious on how lively the forum is?
Request for this Stats / or maybe someone can give me a link where I can see a real-time update of Stats: Ex: Real-Time Users Online: https://bitcointalk.org/index.php?action=stats Number of Users Online within 24 Hours: Number of Users Online within the past Week: Number of Users Online within the past Month: Number of Users Online on 2018: Number of Users Online on 2019: Current Unique Number of Users Online on 2020: Also I am curious about the traffic being get/generated by the Forum. Are we still on the Top Ranks on The Most Visited Websites in the World? Searched from the Past and these are the things I get: https://bitcointalk.org/index.php?topic=4948780.0 https://bitcointalk.org/index.php?topic=5263950.0 And as I've tried the SimilarWeb with comparison to other crypto websites, I was given this ( I don't know if this was accurate - So I'm asking for someone who can give me an accurate statistics on this or where can I found one ) https://i.ibb.co/GssVX4w/comparison2.png https://i.ibb.co/2FSQwbH/comparison3.png https://i.ibb.co/rMR30St/comparison4.png Also would like to request (I think this is a hard one) the total logs per Country (listed on our Local Sections) - SimilarWeb doesn't allow me for I don't have Premium Account Title: Re: [Request] Stats Post by: tranthidung on August 05, 2020, 05:04:48 AM Statistics Bitcointalk.org (https://bitcointalk.org/index.php?topic=5206041.0) [1] which used the statistics on BPIP.org.
With support from LoyceV and data on loyce.club, I observed following daily statistics:
Of course, all of statistics do not satisfy your request completely. :D According to [1], there is a 3.6% drop in total active profiles between two months (July compares to June). Code: . di (92373-95788)/95788*100 Title: Re: [Request] Stats Post by: LoyceV on August 05, 2020, 07:05:21 AM Number of Users Online within 24 Hours: I don't keep track of online users, only users who posted. See Active users, top posters and most active topics in the past 1h, 24h and 7d (https://bitcointalk.org/index.php?topic=5178726.0). It's not real-time though.Number of Users Online within the past Week: Title: Re: [Request] Stats Post by: tranthidung on August 05, 2020, 10:55:29 AM Here you go:
All average statistics have been on declining trends. Forum statistics (on daily basis)
Time series plots Code: +--------------------------------------------------------------------+ With multipliers (figures at the end are multipliers) Title: Re: [Request] Stats Post by: Harlot on August 05, 2020, 11:36:17 AM I remembered a topic I had read before about the "user stats" being disabled due to the forum having performance issues with it so I think the same case will happen to the forum if they bring out this real-time data as it will bring more load to the website. Maybe having an external site like what LoyceV have is the solution here if you are interested in pulling out this data from Bitcointalk.
Title: Re: [Request] Stats Post by: NeuroticFish on August 05, 2020, 11:50:02 AM Number of Users Online within 24 Hours: Number of Users Online within the past Week: Number of Users Online within the past Month: I don't know how good/updated this is, since I've only noticed it not long ago in @BlackHatCoiner personal text and I didn't actually need it, however it may worth a look: https://btctalk.live and https://btctalk.live/chartonline/ Title: Re: [Request] Stats Post by: Casdinyard on August 06, 2020, 05:33:32 AM Also would like to request (I think this is a hard one) the total logs per Country (listed on our Local Sections) - SimilarWeb doesn't allow me for I don't have Premium Account I've been working on this for almost a month but first I'm trying to scrape users based from different countries by their local board posts, by simply going to a local board and scrape every comments in every thread and in every page (this is really hard). I hope I could patent this idea so my work and time spent studying scraping wouldn't be wasted. After that, I think it would be easy if I had stats with the links of local users and simply scrape when they are active (but would take me another month studying another prog language I guess). I've also planning to make a thread saying I'm working on it but some might steal the idea. Title: Re: [Request] Stats Post by: cabalism13 on August 06, 2020, 05:54:00 AM Here you go: New Members? or is it just the name? Been looking for the Online User Stats, total Logins if you may. 😁Title: Re: [Request] Stats Post by: tranthidung on August 06, 2020, 05:57:40 AM I've been working on this for almost a month but first I'm trying to scrape users based from different countries by their local board posts, by simply going to a local board and scrape every comments in every thread and in every page (this is really hard). I hope I could patent this idea so my work and time spent studying scraping wouldn't be wasted. After that, I think it would be easy if I had stats with the links of local users and simply scrape when they are active (but would take me another month studying another prog language I guess). I appreciated your time to learn and your plan to build up a project. Honestly, I don't know how to scrape website's data.Quality is better than quantity. Figures on active or inactive members do not reflect the real situation on the forum, such as the average quality of posts or threads created by members recently. Imagine that an active local board can be detected by higher number of posts in latest few weeks compare to the other local boards. But such figures can not make sure the quality of that active local board that is probably a spam place. More active more spam endemic inside. A wider view, the forum used to be more actively in the past, late of 2017 and early of 2018, but now we have a very better forum (less spam, higher quality). Title: Re: [Request] Stats Post by: LoyceV on August 06, 2020, 06:52:43 AM by simply going to a local board and scrape every comments in every thread and in every page (this is really hard). I hope I could patent this idea Actually, it's quite easy :D Getting all topics on a board is something I did in January last year (https://bitcointalk.org/index.php?topic=5095631.0), and once you have all topicIDs, you can scrape all topics (which takes some time (https://bitcointalk.org/index.php?topic=5167469.msg53759604#msg53759604)).Title: Re: [Request] Stats Post by: Casdinyard on August 06, 2020, 07:58:25 AM A wider view, the forum used to be more actively in the past, late of 2017 and early of 2018, but now we have a very better forum (less spam, higher quality). I think the merit implementation causes that. Back then the forum was bombarded with a lot of newbie like there's no day nor an hour that there wasn't an account made in the forum. But then now, making a lot of accounts would be useless as spam posters could easily be detected by other active members, and as merits are required to gain reputation as well as it shows a proof that you're a good member of the community. by simply going to a local board and scrape every comments in every thread and in every page (this is really hard). I hope I could patent this idea Actually, it's quite easy :D Getting all topics on a board is something I did in January last year (https://bitcointalk.org/index.php?topic=5095631.0), and once you have all topicIDs, you can scrape all topics (which takes some time (https://bitcointalk.org/index.php?topic=5167469.msg53759604#msg53759604)).Would you help me? I've been coding and trying to figure out ways to scrape all comments in all threads yet I keep encountering bugs with my code (python). I hope to make a thread with such data soon and might use the code to of course scrap all local boards. But I'm also trying some other apps such as octoparse but had issues with the chronological order of tasks I want to gain.. Title: Re: [Request] Stats Post by: LoyceV on August 06, 2020, 08:45:42 AM Would you help me? I've been coding and trying to figure out ways to scrape all comments in all threads yet I keep encountering bugs with my code (python). I did scrape all posts already (but didn't keep track of the board), so it would be a waste of forum bandwidth to do it again. I know nothing about Python though.What are you trying to accomplish? Title: Re: [Request] Stats Post by: Casdinyard on August 06, 2020, 08:57:19 AM Would you help me? I've been coding and trying to figure out ways to scrape all comments in all threads yet I keep encountering bugs with my code (python). I did scrape all posts already (but didn't keep track of the board), so it would be a waste of forum bandwidth to do it again. I know nothing about Python though.What are you trying to accomplish? Imagine all threads in Pilipinas section (which I'll try to test as I am from PH), I'll try to scrape each and every comments in each threads posted into it, but all I will extract is all the usernames and their links, meaning that I could enlist all users that are filipino here in the forum as they posted once in a thread located in our local board. Then Ill try to do the same on other local boards and compare the stats to how many users are from this and that country and which country has the most users here. Though it wouldn't be a 100% accurate, but it would still be a data to consider. Title: Re: [Request] Stats Post by: LoyceV on August 06, 2020, 09:21:44 AM Though it wouldn't be a 100% accurate You'll find me in many local boards ;)Title: Re: [Request] Stats Post by: The Sceptical Chymist on August 06, 2020, 04:27:13 PM I'd like to see this graph overlaid with a bitcoin price chart--I'm not a statistics geek and am not really interested in member activity, posts, registration, and so on, but it's interesting to me that it looks like activity and registration of new accounts booms and busts along with how bitcoin is performing. That's probably obvious to a lot of members, but I don't think I've ever seen any statistical correlation between btc price and bitcointalk variables.
Title: Re: [Request] Stats Post by: tranthidung on August 06, 2020, 04:53:19 PM I'd like to see this graph overlaid with a bitcoin price chart--I'm not a statistics geek and am not really interested in member activity, posts, registration, and so on, but it's interesting to me that it looks like activity and registration of new accounts booms and busts along with how bitcoin is performing. That's probably obvious to a lot of members, but I don't think I've ever seen any statistical correlation between btc price and bitcointalk variables. You can see more details at my another thread: Assumed monthly statistics on registered accounts of bitcointalk.org (2009-2019) (https://bitcointalk.org/index.php?topic=5168990.0)Plots are not overlaid because I don't remember where I stored data for those plots hence I can not re-draw them now. From two plots, you can see unconfirmed correlation between forum members' activities and BTC price. Remember there are bias factors: merit system's kick-off (https://bitcointalk.org/index.php?topic=2818350.0) and the demotion on Jr. member (https://bitcointalk.org/index.php?topic=5030366.0) -- they are likely random shocks but effects are systematic. To support this assumption, you can see plots for forum ads' statistics (at end of this post), there are visual correlations sure. That one is an overlaid plot but for 2019 only. Regarding to forum members' activities, there is Time Series on monthly statistics of forum (new users, new topics, new posts) (https://bitcointalk.org/index.php?topic=5071903.0) Next few weeks, I will spend a little time each day to see how I can do with all collective data, to have such same plots in Impression counts for ads over years (https://bitcointalk.org/index.php?topic=5213807.msg54755449#msg54755449) Title: Re: [Request] Stats Post by: Halab on August 09, 2020, 05:50:16 PM Request for this Stats / or maybe someone can give me a link where I can see a real-time update of Stats: I'm a bit late and I'm not really going to answer your request, but I just remembered that there is this page that lists online members : https://bitcointalk.org/SSI.php?ssi_function=whosOnline From this page, a "statistician" can generate the stats you want (but he won't be able to go back in time). The only drawback : you can't see the members who have hidden their status. |