Announcing BPIP - The Bitcointalk Public Information Project!

[LoyceV]

I did fix my merit issue, with help from LoyceV.  

Something got messed up, see https://bpip.org/smerit.aspx?to=LoyceV and search for "(history" (without quotes). It doesn't show the topic title, and links to http://loyce.club/Merit/history/557989.html instead of the post. Merit transactions from different users still link to BTCforJoe's Merit history on loyce.club.
Sample:

[1713862555]

1713862555

[Vod]

Something got messed up, see https://bpip.org/smerit.aspx?to=LoyceV and search for "(history" (without quotes). It doesn't show the topic title, and links to http://loyce.club/Merit/history/557989.html instead of the post.

That's odd!

Did you mess with theymos' data (human readable format, including usernames and post titles) (currently 35 MB)?
https://bitcointalk.org/index.php?topic=4444830.0

I pulled the titles I was missing directly from that file!  Took me five hours to parse it.  :/

Edit:  I also remember you posting something about duplicate records at the same time but on different days - can't find it now.    I have found that bug being due to the couple min difference between my sql server time and bitcointalk time when "Today at" is parsed.

[LoyceV]

Did you mess with theymos' data (human readable format, including usernames and post titles) (currently 35 MB)?

I create a new list weekly, based on the full Merit data dump (it's 89 MB by now). It shouldn't be messed up.

I pulled the titles I was missing directly from that file!  Took me five hours to parse it.  :/

That explaines how you ended up with links to loyce.club

Edit:  I also remember you posting something about duplicate records at the same time but on different days - can't find it now.  

Do you mean Occasions where the same user merited the same post twice at the exact same time? That was caused by double clicking (someone holds the record by clicking 3 times!) and can't happen anymore (theymos patched it). I have a list though:

Code:

      3 1521021718	3	3118032.msg32237391	1056258	1206548
      2 1546044870	1	5089672.msg48891178	194811	133423
      2 1545668981	1	5070641.msg47972229	334783	1085174
      2 1544634973	1	5081010.msg48626049	194811	163641
      2 1544126912	1	5081092.msg48497803	507856	2186070
      2 1542918081	1	5067090.msg47790947	1291828	392646
      2 1541855299	3	5064025.msg47764377	24140	222146
      2 1541812644	2	4781246.msg47669936	1168318	1241521
      2 1541529651	1	4938387.msg47644916	1120609	377987
      2 1541342052	1	5063178.msg47580960	198837	2020599
      2 1541019852	2	5058157.msg47319479	1192397	1582324
      2 1540286883	1	5046789.msg47148034	1120609	975910
      2 1539073895	1	4855259.msg43764251	1555320	1135631
      2 1538912350	1	1006631.msg46606297	485285	1202061
      2 1538701642	1	5043497.msg46501563	2015835	787736
      2 1538638078	1	5041370.msg46378101	1446224	359716
      2 1538072871	1	5036625.msg46108226	1878246	1275282
      2 1537891393	1	4838520.msg46143577	1120609	2161898
      2 1537827196	1	5036691.msg46128729	1192397	79608
      2 1537725094	1	5034480.msg46078932	1878246	1574226
      2 1537531585	1	5034467.msg45982563	1065523	1264860
      2 1535864602	1	178336.msg45055522	1257516	120694
      2 1534661551	1	4913218.msg44319283	1370330	1319199
      2 1534579661	1	4906420.msg44268731	1099535	906410
      2 1534310991	1	178336.msg44102258	1067333	452769
      2 1533992268	1	4811517.msg43592165	888099	1143164
      2 1533836898	1	313900.msg43779755	1695463	932931
      2 1533654427	2	4815494.msg43434718	1555374	1100290
      2 1533409469	1	2243703.msg43393217	17501	854988
      2 1532205571	1	92.msg826	194811	13
      2 1530978475	1	4468516.msg40072272	1560793	1892084
      2 1530394778	1	20301.msg26530910	552813	1131623
      2 1530351497	1	4567553.msg41202703	1073276	1799602
      2 1530122151	1	4417645.msg39367034	1555320	1160932
      2 1529566639	1	4499953.msg40495445	770687	1662872
      2 1529373802	3	4486762.msg40335682	158960	1267993
      2 1528320078	10	900132.msg10122830	330540	264128
      2 1528145331	1	4393868.msg39136043	888099	188198
      2 1527676203	1	3365068.msg37092446	888099	349097
      2 1526942384	10	2683530.msg27411367	816073	1038794
      2 1526862717	1	1006631.msg37915526	855468	1018820
      2 1526586668	2	3918293.msg37603540	107794	1430862
      2 1525812779	1	178336.msg36717803	124876	543547
      2 1525774925	1	3549524.msg36351920	1560793	2014997
      2 1525701790	1	3307997.msg34520392	1113049	1311641
      2 1525701165	1	1674772.msg36394671	173703	1381008
      2 1525611445	1	3550414.msg36467750	1819966	1180530
      2 1525320241	2	3177136.msg35356098	969327	1173856
      2 1525159637	1	3457930.msg35988786	364070	1073478
      2 1524311478	1	3345841.msg35118461	1192397	1176794
      2 1522874953	1	3254663.msg33904974	88912	388031
      2 1522692210	5	1006631.msg33778346	291810	1218011
      2 1522251550	1	178336.msg33375658	155345	1096470
      2 1522164770	10	1161170.msg12233132	373994	369212
      2 1522081161	1	789369.msg33224146	149433	1082985
      2 1521771546	1	2720235.msg32894511	1560793	1646007
      2 1521421569	1	2945878.msg32633703	1188543	976210
      2 1521104363	1	2965641.msg30461671	1245858	1410806
      2 1520686932	1	3082289.msg31895098	1331637	1341921
      2 1520686826	1	3082289.msg31860010	1331637	1261366
      2 1520666512	1	3078328.msg31738645	557989	459836
      2 1520471015	1	2158989.msg31542513	1025252	882964
      2 1520242470	10	3053008.msg31435070	291810	1753519
      2 1519990410	2	2931476.msg30109731	98986	346731
      2 1519444919	1	3009408.msg30941866	135920	147040
      2 1518999623	1	2970226.msg30532767	513960	787736
      2 1518976006	1	2770113.msg29460268	870185	1268116
      2 1518816245	5	178336.msg30439376	393354	387921
      2 1518800044	2	2239458.msg30329191	124041	2439
      2 1518719120	5	2873190.msg29505423	374823	1756786
      2 1518718980	5	2808477.msg28740279	374823	1059082
      2 1518718755	5	2891680.msg29727954	374823	1268116
      2 1518412592	1	2255748.msg30112467	1034862	735497
      2 1518250022	6	2674919.msg29093646	864139	864125
      2 1518148199	1	2202817.msg29758214	999197	1687608
      2 1518126759	1	2846459.msg29198113	984782	1245858
      2 1517884578	1	2313254.msg29604257	73590	1224889
      2 1517656597	1	1394689.msg29508785	954280	289619
      2 1517550804	1	2865759.msg29421551	205050	971594
      2 1517431482	1	2270173.msg28927901	1179987	1238657
      2 1517380438	1	2576723.msg26430918	1170710	1250976
      2 1517336553	1	384821.msg29121875	1220613	1256377
      2 1517225599	1	2833083.msg29161886	916474	308793
      2 1517164543	1	86804.msg953593	898664	31288
      2 1517086563	1	2827555.msg28999372	98986	101872
      2 1516957366	1	2818398.msg28950289	623643	381304
      2 1516921795	4	2823221.msg28920985	135920	408367
      2 1516866797	1	2169122.msg28864339	255511	249147
      2 1516866765	4	2699379.msg28859651	882756	1144425
      2 1516834582	1	2308384.msg23419008	1175060	1160144

I have found that bug being due to the couple min difference between my sql server time and bitcointalk time when "Today at" is parsed.

Wasn't the list with just postID and title easier to parse?

[Vod]

I have found that bug being due to the couple min difference between my sql server time and bitcointalk time when "Today at" is parsed.

Wasn't the list with just postID and title easier to parse?

No, I'm talking my real time parser, not rebuilding lists.  Your list was a CSV, but it had commas in the title, so i couldn't use it.  Try tab delimited.

And no, I wasn't talking about duplicate merits.  I think it was you pointed out there were two records of something same exact time, but different days.

I create a new list weekly, based on the full Merit data dump (it's 89 MB (http://loyce.club/Merit/merit.html) by now). It shouldn't be messed up.

I'll try my new "emergency recovery" script on that data, to see if the error was in your data, or (most probably) my parsing.

I did write all my parsers from scratch you know -- only recently have I started using xPath.  

[LoyceV]

Your list was a CSV, but it had commas in the title, so i couldn't use it.  Try tab delimited.

If you still need it, I can change that. I just read it as "everything before" or "everything after" the first ":".

I did write all my parsers from scratch you know

Me too, and I'm still not using anything else

[Bitcoin_Arena]

When checking some information about some account with some suspicious activity yesterday on BPIP, I did notice that all i could see in the Security/modlog section was a "woke up" note
But when Alanst then came in and said that the account had changed an email some time in July 2017.

Which brings me to the question, Is there some missing info on accounts that had modlog changes before BPIP came into existence or it's just a small glitch?


I think we have another problem.
Home page loads very well but when one tries to check a profile, they get this error. i believe it's not only me experiencing this.

[asche]

When checking some information about some account with some suspicious activity yesterday on BPIP, I did notice that all i could see in the Security/modlog section was a "woke up" note
But when Alanst then came in and said that the account had changed an email some time in July 2017.

Which brings me to the question, Is there some missing info on accounts that had modlog changes before BPIP came into existence or it's just a small glitch?

BPIP wasn't saving seclogs back then. And since there is no "full extract" of seclogs available, they go back only as long as bpip or LoyceV or whoever is actually tracking these seclog events.

[Vod]

I think we have another problem.
Home page loads very well but when one tries to check a profile, they get this error. i believe it's not only me experiencing this.

For no reason, other than annoying me when I am entertaining guests, the SQL server just stopped responding to requests! 

No changes, no CPU or memory usage... just refused to work. 

Once I got the alarm from a third party monitoring service, a reboot fixed the problem.  Sorry.

[Vod]

I did fix my merit issue, with help from LoyceV.  

Something got messed up, see https://bpip.org/smerit.aspx?to=LoyceV and search for "(history" (without quotes).

All fixed now.  It was my parsing issue...

For some reason I have to remove all \n and \t from the file before parsing, even though I can't see them in the file.  :/

[tyz]

I ran into an exception on BPIP today. Not sure if it is an exploitable bug. I pm'ed you the details.

[ibminer]

Banned indication is coming, data is being captured (and would also show up in the sec/mog log table), but I need to finish an icon somewhat related to this before it is fully displayed the way it should be.

--snip--Any indications that someone is banned--snip--

Banned icon is visible in lists - if you hadn't noticed yet.

Can you please make the search input mouse friendly? Currently it is keyboard friendly.
As you kept the autocomplete on, I use my name or others I used previously from the list with the mouse but can't confirm the search with mouse instead it needed a hit on the enter button on keyboard.

The new icon on the search should help with this. Keyboard can still be used as well.

(small bug exists with the neutral theme where you may see a flash of the techtro theme before it switches the theme to neutral - this is being worked on.)

This shouldn't be noticeable anymore, and I hope to have more theme options in the future.

^^ My 1337th post. I'm officially elite - lol!  
John Parr - St. Elmo's Fire

Next stop... 8008 posts, and I fully expect to see "boob" instead of "leet" when I make it there.  

Thanks mate! It works perfectly!  

Btw, how long will you remain leet? Haha, boobs at 8008? Let's see, I'm on my way. Probably it will take 1yr+ but I'm on my way.

Well, if you're referring to the "leet" text in my posts count, that will go away on my next post... thus why I am answering your question via an edit - I have to leave it there for at least a day.

[akamit]

Can you please make the search input mouse friendly? Currently it is keyboard friendly.
As you kept the autocomplete on, I use my name or others I used previously from the list with the mouse but can't confirm the search with mouse instead it needed a hit on the enter button on keyboard.

The new icon on the search should help with this. Keyboard can still be used as well.

Thanks mate! It works perfectly! 


Btw, how long will you remain leet? Haha, boobs at 8008? Let's see, I'm on my way. Probably it will take 1yr+ but I'm on my way.

[Zemomtum]

This is a very good initiative and i says kudos. Is there any way that Avatar cab be shown immediately it is uploaded. I had an experience that the avatar I used does not updated for over 12hrs. It is normal or something can be done to improve the refreshing state?

[LTU_btc]

This is a very good initiative and i says kudos. Is there any way that Avatar cab be shown immediately it is uploaded. I had an experience that the avatar I used does not updated for over 12hrs. It is normal or something can be done to improve the refreshing state?

How BPIP website nad your Bitcointalk avatar are related? You probably have to clean your browser cache if you don't see avatar for so long time after you change it.

[Bitcoin_Arena]

Hey Vod, it's me again
First of all I appreciate your efforts on keeping this site afloat.

This morning when I tried to search for a username, I got the compilation error again. Not sure how long it has been going on but i thought that I could alert you here.

[Baofeng]

Hey Vod, it's me again
First of all I appreciate your efforts on keeping this site afloat.

This morning when I tried to search for a username, I got the compilation error again. Not sure how long it has been going on but i thought that I could alert you here.

Let me confirmed that, I wanted to search some names today because of thread by Coolcryptovator - Fake account.. This is just a head-ups.

[Vod]

Hey Vod, it's me again
First of all I appreciate your efforts on keeping this site afloat.

This morning when I tried to search for a username, I got the compilation error again. Not sure how long it has been going on but i thought that I could alert you here.

Let me confirmed that, I wanted to search some names today because of thread by Coolcryptovator - Fake account.. This is just a head-ups.

Made a change to the icons (show DT1 Inclusion Strength when you hover over to DT1 icon) just before bed last night, and I guess I missed the search page, which I just changed now.   Sorry.  Still, I need to rework the search since the database has changed considerably since it was written.

I'm going to add a page where one can report a bug and include any private info necessary without worrying they are announcing an exploit.  This will also stop the troubleshooting taking place in Project Development.  Look for a report icon on the page footer within the next week. 

Also, I will be adding a page showing how often different data is updated.  You can always see the website changes here:
https://bpip.org/changes.aspx

[Last of the V8s]

The activity column is showing merit data, or something.
Love the site. Love the hover-y things now. Welcome back.

[Vod]

The activity column is showing merit data, or something.
Love the site. Love the hover-y things now. Welcome back.

Thanks for pointing that out - copy/paste mistake I think.

ibminer is the one creating all the neat designs and theme selections.

I not not "back", as I have not finished my metamorphosis yet (makes sense to me) and I'm still not ready to deal with the amount of dishonesty and manipulation on this forum.   I'll just pop in every few days with a preset agenda, then disappear again.

(This reply was not on my agenda but you posted so fast I was still online to address it).

[Last of the V8s]

The activity column is showing merit data, or something.
Love the site. Love the hover-y things now. Welcome back.

Thanks for pointing that out - copy/paste mistake I think.

ibminer is the one creating all the neat designs and theme selections.

I not not "back", as I have not finished my metamorphosis yet (makes sense to me) and I'm still not ready to deal with the amount of dishonesty and manipulation on this forum.   I'll just pop in every few days with a preset agenda, then disappear again.

(This reply was not on my agenda but you posted so fast I was still online to address it).

Sounds like a great way to deal. Wish you the best.

edit: already corrected, thx