[BPIP] Bitcointalk Public Information Project [Back in Action]

[LoyceV]

I also just recently updated the OP to include a notable change I forgot, which is that profile.aspx can now handle ID's, so this could be a way to access this particular profile directly, by using: https://bpip.org/profile.aspx?id=2347750

There's a bug with unbanned accounts, it looks like the account status doesn't change from Autobanned to Active, and it remains Archived.
That resulted in many Meta Log entries instead of just one:

Code:

12/31/2019 9:38:44 PM 	Profile unbanned 	New post
12/31/2019 9:38:31 PM 	Profile unbanned 	New post
12/31/2019 9:38:19 PM 	Profile unbanned 	New post
12/31/2019 9:38:06 PM 	Profile unbanned 	New post
12/31/2019 9:37:55 PM 	Profile unbanned 	New post
12/31/2019 9:37:42 PM 	Profile unbanned 	New post
12/31/2019 9:37:29 PM 	Profile unbanned 	New post
12/31/2019 9:37:17 PM 	Profile unbanned 	New post
12/31/2019 9:37:04 PM 	Profile unbanned 	New post
12/31/2019 9:36:50 PM 	Profile unbanned 	New post
12/31/2019 9:36:38 PM 	Profile unbanned 	New post
12/31/2019 9:36:26 PM 	Profile unbanned 	New post
12/31/2019 9:36:13 PM 	Profile unbanned 	New post
12/31/2019 9:36:00 PM 	Profile unbanned 	New post
12/31/2019 9:35:47 PM 	Profile unbanned 	New post
12/31/2019 9:35:35 PM 	Profile unbanned 	New post
12/31/2019 9:35:22 PM 	Profile unbanned 	New post
12/31/2019 9:35:11 PM 	Profile unbanned 	New post
12/31/2019 9:34:01 PM 	Profile unbanned 	New post
12/31/2019 9:33:49 PM 	Profile unbanned 	New post
12/31/2019 9:33:36 PM 	Profile unbanned 	New post
12/31/2019 9:33:23 PM 	Profile unbanned 	New post
12/31/2019 9:33:11 PM 	Profile unbanned 	New post
12/31/2019 9:32:59 PM 	Profile unbanned 	New post
12/31/2019 9:32:47 PM 	Profile unbanned 	New post
12/31/2019 9:32:29 PM 	Profile unbanned 	New post
12/31/2019 9:32:16 PM 	Profile unbanned 	New post
12/31/2019 9:32:03 PM 	Profile unbanned 	New post
12/31/2019 9:31:50 PM 	Profile unbanned 	New post
12/31/2019 9:31:37 PM 	Profile unbanned 	New post
12/31/2019 9:31:25 PM 	Profile unbanned 	New post
12/31/2019 9:31:12 PM 	Profile unbanned 	New post
12/31/2019 9:31:00 PM 	Profile unbanned 	New post
12/31/2019 9:30:48 PM 	Profile unbanned 	New post
12/31/2019 9:30:35 PM 	Profile unbanned 	New post
12/31/2019 9:30:23 PM 	Profile unbanned 	New post
12/31/2019 9:30:10 PM 	Profile unbanned 	New post
12/31/2019 9:29:57 PM 	Profile unbanned 	New post
12/31/2019 9:29:45 PM 	Profile unbanned 	New post
12/31/2019 9:29:32 PM 	Profile unbanned 	New post
12/31/2019 9:29:19 PM 	Profile unbanned 	New post
12/31/2019 9:29:06 PM 	Profile unbanned 	New post
12/31/2019 9:28:55 PM 	Profile unbanned 	New post
12/31/2019 9:28:42 PM 	Profile unbanned 	New post
12/31/2019 9:28:30 PM 	Profile unbanned 	New post
12/31/2019 9:28:17 PM 	Profile unbanned 	New post
12/31/2019 9:27:50 PM 	Profile unbanned 	New post
12/31/2019 9:27:38 PM 	Profile unbanned 	New post
12/31/2019 9:27:25 PM 	Profile unbanned 	New post
12/31/2019 9:27:13 PM 	Profile unbanned 	New post
12/31/2019 9:27:00 PM 	Profile unbanned 	New post
12/31/2019 9:26:48 PM 	Profile unbanned 	New post
12/31/2019 9:26:35 PM 	Profile unbanned 	New post
12/31/2019 9:26:23 PM 	Profile unbanned 	New post
12/31/2019 9:26:10 PM 	Profile unbanned 	New post
12/31/2019 9:25:58 PM 	Profile unbanned 	New post
12/31/2019 9:25:46 PM 	Profile unbanned 	New post
12/31/2019 9:25:34 PM 	Profile unbanned 	New post
12/31/2019 9:25:21 PM 	Profile unbanned 	New post
12/31/2019 9:25:08 PM 	Profile unbanned 	New post
12/31/2019 9:24:55 PM 	Profile unbanned 	New post
12/31/2019 9:24:42 PM 	Profile unbanned 	New post
12/31/2019 9:24:30 PM 	Profile unbanned 	New post
12/31/2019 9:24:17 PM 	Profile unbanned 	New post
12/31/2019 9:24:03 PM 	Profile unbanned 	New post
12/31/2019 9:23:50 PM 	Profile unbanned 	New post
12/31/2019 9:23:38 PM 	Profile unbanned 	New post
12/31/2019 9:23:25 PM 	Profile unbanned 	New post
12/31/2019 9:23:13 PM 	Profile unbanned 	New post

[1714839249]

1714839249

[dkbit98]

There's a bug with unbanned accounts, it looks like the account status doesn't change from Autobanned to Active, and it remains Archived.

Bug Confirmed.

I wonder why is this member unbanned again?!
https://bpip.org/profile.aspx?p=pirate%20hunter

Multiple Ban Evasion, plagiarism and cheating...

[ibminer]

There's a bug with unbanned accounts, it looks like the account status doesn't change from Autobanned to Active, and it remains Archived.
That resulted in many Meta Log entries instead of just one:

This should be corrected now (as of ~2 days ago), prior profile records that didn't get their account status updated upon waking up or being unbanned should self-correct on their next parsed post (otherwise, they would need to be manually updated - which I can't do at the moment)

A small bug report in case you were unaware: Looks like some of the Reports are still broken, namely https://bpip.org/report.aspx?r=mostmerit which doesn't load at all, and https://bpip.org/report.aspx?r=dt2strength which lists everyone as joint 1st place.

I cleared the error on mostmerit shortly after your post, but strength calculations for dt1/2 took a bit more time.. and still may need some work. The duplication isn't happening anymore but I'm not quite sure yet why the rank skips numbers (on both reports). I believe the values should be accurate though, but let us know if something seems off.

Also, is it helpful or confusing to include DT1 members in the DT2 strength report?

[LoyceV]

Also, is it helpful or confusing to include DT1 members in the DT2 strength report?

It currently shows:

https://bpip.org/report.aspx?r=dtstrength ---> Strongest DT1 Position
https://bpip.org/report.aspx?r=dt2strength ---> Strongest DT2 Position

I'm confused already: where's dt1strength?

As for your question: it might be useful to show DT1 and DT2 strengths for DT1 users together. That shows how DT1-blacklisting would influence their DT-strength.

[ibminer]

I'm confused already: where's dt1strength?

 Well, why not just "Strongest DT1 Eligibility" (r=dt1eligibility?).  

That shows how DT1-blacklisting would influence their DT-strength.

DT1 strength or DT2 strength? .. Now I'm confused lol ..  

My first attempt at showing the DT2 strength for DT1 failed, but I now know why, I just need to look into this a bit more to make sure it won't hurt other procedures before implementing.. need to devote some time to a few other things first.. but if suchmoon doesn't have any animosity towards the idea, it'll be on the todo list.

[LoyceV]

That shows how DT1-blacklisting would influence their DT-strength.

DT1 strength or DT2 strength? .. Now I'm confused lol ..  

Both
I'm thinking about this scenario, in which a "downvoted" DT1 member would end up on DT2 if he gets excluded from DT1.
To quote my Mobile:

This means it is possible that a DT1-exclusion leads to a member being on DT2 which wouldn't happen without blacklisting. This is probably caused by the fact that excluded DT1-members can vote against other DT1-members, but they can't vote against DT2-members.

[bitmover]

Hello,

This is an amazing project, I really like it. I am glad the website is back. Congrats.

I noticed a few small glitches. I don't know if anyone noticed them yet, but I am pointing them out...

Even though I have a green trust, it still shows as 0-0-0 in BPIP.

516. 1554927: bitmover (Trust: +1 / =0 / -0) (1173 Merit earned) (Trust list) (BPIP)

I noticed that in this page my total activity is also different from the profile in bpip (518 against 714).

Those problems may be affecting more users.

I can't see DT2 in my profile as well, but I saw in some other users.

[ibminer]

This is an amazing project, I really like it. I am glad the website is back. Congrats.

Thank you.

I noticed a few small glitches. I don't know if anyone noticed them yet, but I am pointing them out...

Looks like the search procedure needs some updating... the profile procedure had been updated in the past to work with numerous back-end changes which have happened to the DB structure, so we just need to get that search procedure updated to reflect those changes. The most accurate numbers are going to be on the profile page itself at the moment.

I can't see DT2 in my profile as well, but I saw in some other users.

I don't believe you are on DT2 at the moment
... maybe the recent DT1 selections knocked you off?


UPDATE: Search procedure has been updated, these numbers should now match the profile page.

[Vod]

I am showing as DT2, but I am on DT1.  :/

[ibminer]

I am showing as DT2, but I am on DT1.  :/

Yes, I thought I had this corrected the other day but it came back.    I have a feeling the DT2 procedure is somehow overriding DT1 when it runs, not really sure yet.
(this is what I was referring to when I said my first attempt at including the DT2 strength under the DT1 procedure failed... I thought it had created this bug. I undid the changes made and corrected the DB entries, and it seemed to be fine after it re-ran the DT1/2 procedures, but yes, it seems to have come back.)


UPDATE: OK! DT1/2 displays should be better now.. 

[tranthidung]

I am showing as DT2, but I am on DT1.  :/

Could you consider to add a raw results in the format loyce.club use, please.

Like that one, for username: loyce.club/usernames/usernames.txt

Code:

userid: username

But this time, it is for ranks

Code:

userid: userrank

[LoyceV]

But this time, it is for ranks

Code:

userid: userrank

Do you mean for only DT1 and DT2 users, or for all users? The former is easy to do, the latter will have outdated information because 2.7 million profiles aren't instantly updated on BPIP.

[tranthidung]

But this time, it is for ranks

Code:

userid: userrank

Do you mean for only DT1 and DT2 users, or for all users? The former is easy to do, the latter will have outdated information because 2.7 million profiles aren't instantly updated on BPIP.

Initially, I thought of ranks for all users because I thought BPIP has such data despite of the fact BPIP does not instantly update it, especially recent months.

From your comments, it raises one thing that you can dump such data easily. I have the idea like that:
"What if we can observe data on DT 1/2 members over months and see how long as well as how consistent they maintain their positions as DT1/2 members. I know with the algorithm to automatically include and exclude DT members each month from theymos, it seems to be difficult that someone can maintain DT member positions for many months.

theymos updates his trust list each month so if you can, please dump that data monthly. 

[PrimeNumber7]

But this time, it is for ranks

Code:

userid: userrank

Do you mean for only DT1 and DT2 users, or for all users? The former is easy to do, the latter will have outdated information because 2.7 million profiles aren't instantly updated on BPIP.

This should not be difficult to implement. There could be a column in their database with the forum reported activity, a column with the date the information was pulled and a column when the last post posted was. They would monitor recent posts and add a row for each new post. They could periodically run a query on their database to get an estimated activity level for each account that returns accounts that have estimated activity that exceeds the next threshold required to rank up (also filtering for those with the necessary merit to rank to the next rank) and only scrape those profile pages.

[LoyceV]

"What if we can observe data on DT 1/2 members over months and see how long as well as how consistent they maintain their positions as DT1/2 members. I know with the algorithm to automatically include and exclude DT members each month from theymos, it seems to be difficult that someone can maintain DT member positions for many months.

theymos updates his trust list each month so if you can, please dump that data monthly. 

I more or less kept track of this since May 2019 in Complete overview of users on DT1 and DT2 and their ratings. For DT1, I'm still planning to make my dtview-viewer, but I ran into some dificulties and never got to finish it.

This should not be difficult to implement.

It's doable indeed, but I don't really want to add more "categories" to my data collecting. And I can't think of a use for a list of usernames and ranks. Piggy made something like it in Open scraped data of all the users - SQL Lite DB - 2.481.270 users, but it's not being updated.

[tranthidung]

Something like that (for real use cases of data on ranks): Where receivers received merits from, and meriters sents merits to. I moved further and complicated things from your data and DdmrDdmr's Merit Dashboard. From the results, I think we have interesting overview, but such things should be played around yearly (if we do).

But for userrank, DdmrDdmr has it already so if it costs your time, and some the other things, it is not worth to pay some kinda of resources on it. I agree.

[dkbit98]

There are some issues with showing merits at the moment.
I am not sure if it is a bug, or something else, but I am getting 'Server Error in '/' Application...'

[ibminer]

There are some issues with showing merits at the moment.
I am not sure if it is a bug, or something else, but I am getting 'Server Error in '/' Application...'

Thanks, corrected. (and the sum should now be appearing correctly at the bottom as well.)

[bitmover]

Hello,

I noticed one more small bug in my profile, which may be happening in other profiles as well.

Trust Feedback Information
   Pos   Neu   Neg
Received   1   0   0
Trust color:   Black

Shouldn't this color be marked as green? As I have 1 pos and 0 of the others?

[LoyceV]

I noticed one more small bug in my profile, which may be happening in other profiles as well.

My profile bug is different:

Code:

Trust Feedback Information
 	 	Pos 	Neu 	Neg
Received 	0 	0 	0
Trust color: 	Dark Green