[BPIP] Bitcointalk Public Information Project [Back in Action]

[suchmoon]

This was a bit weird - web server seemed to have had a memory leak. Used up all memory and was just sitting there not able to serve any new requests. I have restarted it, should be ok now.

Looks everything is good for now (i guess?). Can you tell if upgrading the server is a solution or just a soft reboot helps a lot? Also, how you able to know this issue, is it only a notification from this thread or the server's service email provider remind you this time.

It's the first time I'm seeing this particular issue so I'm not too worried unless it starts happening more often.

I did get a server notification but I appreciate people posting in this thread when there is an issue.

[DYING_S0UL]

This was a bit weird - web server seemed to have had a memory leak. Used up all memory and was just sitting there not able to serve any new requests. I have restarted it, should be ok now.

I can confirm that everything works just fine right now  

Yup it's working now, same from my side. All good! 

[God Of Thunder]

Hi there.

I am curious when BPIP actually updates the Latest DT1 lists. Because theymos reshuffles it on the first day of each month. But it seems BPIP is always updating the list late. It's the 4th of November already but I can see that the both extension and the website showing the wrong data. Also, I often find that the earned merit is not correct which shows via extension. Probably that happens due to unexpected downtime.

May I know when we can expect updated data? I would mention @ibminer and @suchmoon.

[LoyceV]

May I know when we can expect updated data? I would mention @ibminer and @suchmoon.

If it's automated this could be linked to a post scraper and update it within a minute of theymos' post.

[God Of Thunder]

May I know when we can expect updated data? I would mention @ibminer and @suchmoon.

If it's automated this could be linked to a post scraper and update it within a minute of theymos' post.

I don't think it's automatic. Because this is not the first time I saw that the DT1 list wasn't updated timely. Since I always use the BPIP extension on my browser, I often notice that BPIP takes longer to update. Four days is too late, to be honest. Do you update it automatically on your website? If so, then I guess ibminer or suchmoon should find some free time to be in front of their workstation and make some improvement for BPIP.

[LoyceV]

Do you update it automatically on your website?

No, this is one of the few things I still do manually. The reason is that dealing with a list of usernames is always annoying when there are weird characters involved.

[God Of Thunder]

No, this is one of the few things I still do manually. The reason is that dealing with a list of usernames is always annoying when there are weird characters involved.

Well, there are only a few hundred names. I don't know what limitations you are talking about. But if you want to automate the process and then it bugs something, then it is okay to do it manually. But if you are confident that you may do some troubleshooting and make it automatic, then it will be best for you and the forum members. By the way, BPIP already updated the data yesterday, and it's showing the correct data again.

[LoyceV]

Well, there are only a few hundred names. I don't know what limitations you are talking about.

This guy for instance is my cryptonite....

[examplens]

This guy for instance is my cryptonite....

Speaking of twisted usernames, I didn't follow how are handled users like ~DefaultTrust or ~~DefaultTrust?
Didn't they make a mess with the DT lists?

[LoyceV]

Speaking of twisted usernames, I didn't follow how are handled users like ~DefaultTrust or ~~DefaultTrust?
Didn't they make a mess with the DT lists?

The first one spammed the Trust lists (so I blacklisted him), but it should work:

If you want to trust someone whose name begins with a tilde, prefix their name with a backslash.

He only has one inclusion, and adding a backlash isn't an accident.

[PowerGlove]

This guy for instance is my cryptonite....

Hmm... I see Cøbra instead of Cøbra.

Code: (In a Python REPL)

>>> 'Cøbra'.encode('utf-8').decode('iso-8859-1') == 'Cøbra'
True

What's happening there, I think, is that you're serving UTF-8 content in the context of a fallback legacy encoding:

HTML requires UTF-8 to be explicitly declared to avoid fallback to a legacy encoding.

I don't see a character encoding in your page's HTTP response:

Code:

$ wget --server-response -qO /dev/null https://loyce.club/trust/2024-11-02_Sat_05.07h/249495.html
  HTTP/1.1 200 OK
  Content-Type: text/html
  Content-Length: 21752
  Connection: keep-alive
  Date: Sat, 09 Nov 2024 07:03:07 GMT
  Server: Apache/2.4.29 (Ubuntu)
  Last-Modified: Sat, 09 Nov 2024 05:48:09 GMT
  ETag: "54f8-62674698a5840"
  Accept-Ranges: bytes
  Vary: Accept-Encoding
  Access-Control-Allow-Origin: https://bitcoindata.science
  X-Cache: Miss from cloudfront
  Via: 1.1 57bc54093a2e2c99ca194f2955ba3d1c.cloudfront.net (CloudFront)
  X-Amz-Cf-Pop: FRA60-P6
  X-Amz-Cf-Id: i-5LtN8UmQj2RVIaKnQC07C_QwHXipW4-ExrP1K1UUMQLqPKFY0K0g==

I also don't see anything within the page itself to indicate that it's in UTF-8 (like one of: a <meta charset="utf-8">, or a <meta http-equiv="Content-Type" content="text/html; charset=utf-8">, or a BOM).

The other way to go would be to ensure that the content actually is in something like ISO-8859-1 before serving it, but considering that it already looks to be in UTF-8, you may as well just declare that somewhere. ("Explicit is better than implicit.", as a wise coder once said [1].)

[1] I just noticed that that wise coder (Tim Peters) was recently suspended for three months (due to alleged CoC violations). Reading through that (mostly) brain-damaged list of cited objections reminds me why I tend to just work on things by myself and in private these days. I mean, one of those objections mentions, as if it were a bad thing, that he called an old SNL skit "genuinely funny"... So what? He's not allowed to decide on his own what's funny and what's not? I mean, read this post (made before the suspension), and tell me, is that someone who needs to be "educated" on acceptable conduct within a community?

[ibminer]

I don't think it's automatic. Because this is not the first time I saw that the DT1 list wasn't updated timely. Since I always use the BPIP extension on my browser, I often notice that BPIP takes longer to update. Four days is too late, to be honest. Do you update it automatically on your website? If so, then I guess ibminer or suchmoon should find some free time to be in front of their workstation and make some improvement for BPIP.

The DT1 job is automatic under normal circumstances, the https://bpip.org/TrustLog on the site should be getting updated every ~5 minutes. Are you seeing these delays on the extension only or the BPIP.org site as well?  I ask because there are more troubleshooting variables in play when thinking about the extension. In general, outside of potential temporary parser issues (i.e. locked DT-related jobs), which I haven't seen myself recently, there should never be a 4 day delay on the site itself for DT info.

~

I thought browsers default to UTF-8 when displaying even if there is nothing specified in the source, but it looks like firefox, at least, is attempting to interpret the encoding based on the content, and picking poorly... definitely best to specify.

[God Of Thunder]

The DT1 job is automatic under normal circumstances, the https://bpip.org/TrustLog on the site should be getting updated every ~5 minutes. Are you seeing these delays on the extension only or the BPIP.org site as well?  I ask because there are more troubleshooting variables in play when thinking about the extension. In general, outside of potential temporary parser issues (i.e. locked DT-related jobs), which I haven't seen myself recently, there should never be a 4 day delay on the site itself for DT info.

Nah, not only on extensions. It happens on both the website and the extension. I thought you guys update it manually every month when theymos post the new DT1 members list every month. As LoyceV said, he does it manually for his website as well. I thought you guys did it manually because this is not the first time I saw the DT reshuffle wasn't updated timely. If you check the Trust log page and see the when bpip noticed column, you will see that BPIP updated the list on 4th November, which was right after I wrote in this thread.

[ibminer]

Nah, not only on extensions. It happens on both the website and the extension. I thought you guys update it manually every month when theymos post the new DT1 members list every month. As LoyceV said, he does it manually for his website as well. I thought you guys did it manually because this is not the first time I saw the DT reshuffle wasn't updated timely. If you check the Trust log page and see the when bpip noticed column, you will see that BPIP updated the list on 4th November, which was right after I wrote in this thread.

Thank you, I'm only seeing 2 out of 11 months the DT shuffle was not on time, the 1st time being in January which you had alerted us on, and the 2nd time being this month. I'm guessing there must have been a locked job holding up the parsing, I know there were issues with parsing around Oct. 28th due to a DB log file going over its usage, but that was resolved pretty quickly by suchmoon, so I don't believe it would have had any issues on Nov. 1st, but possibly.

If you look at the other 9 out of 11 previous months, its been within ~5 minutes of theymos posting.
Keep letting us know if you see any delays in the future!

[suchmoon]

Thank you, I'm only seeing 2 out of 11 months the DT shuffle was not on time, the 1st time being in January which you had alerted us on, and the 2nd time being this month. I'm guessing there must have been a locked job holding up the parsing, I know there were issues with parsing around Oct. 28th due to a DB log file going over its usage, but that was resolved pretty quickly by suchmoon, so I don't believe it would have had any issues on Nov. 1st, but possibly.

I added automatic override if a job remains locked for more than 24 hours, which is what I think happened here, just not sure why it took 4 days, should have been quicker. And not quite clear why it got locked to begin with. I need to research this a bit more.

[God Of Thunder]

Thank you, I'm only seeing 2 out of 11 months the DT shuffle was not on time, the 1st time being in January which you had alerted us on, and the 2nd time being this month.

Probably, that was the first time I appeared on the DT network, and I was checking my profile to see if it was updated. So, I remember that particular moment. Also, this is the first time I was elected as DT1, and I was excited to see an update on BPIP and BPIP delayed this time. I usually do not check every month if it was updated timely. I have checked two times, and it was delayed two out of two. Probably just a coincidence or bad luck. Thank you for the quick fix and for looking at the issues promptly.

[logfiles]

@suchmoon @ibminer

Just an alert. It seems the website is down/offline, I am just seeing a blank page. The extension functionality also seems to have been affected, I don't know how long it has been off. It might be worth checking out

Edit:
The home page can now load, but the trying to visit individual profile takes forever to load.

[Alone055]

Hi @ibminer @suchmoon.

It's nothing major, but I have noticed that the "hover" feature on the question marks, which shows more information about forum stats, doesn't work efficiently. I'm talking about these:



Generally, when you hover over an element that has the ':hover' pseudo-class in CSS, you should see the content that is supposed to be displayed at once, but it isn't working sometimes on these "?" elements. Mostly, if you hover on the upper part, it works, but on the lower part, the bubble containing the extra information blinks continuously but doesn't stop. I tried taking a snap of that, but it isn't showing the blinking in the snap.

As I said earlier, it's nothing major, but if it can and should take some of your time, please check and fix it.

Cheers.

Edit: I tried other similar elements, and they are working fine even when I hover over the lower part.

[ibminer]

Thanks, I've noticed this in the past but never really dug into it... I'll adjust the height glitch on the main page ?'s on the next publish.

[examplens]

Is there any explanation for why user @Whale is not in the BPIP database?
Here is the profile link https://bitcointalk.org/index.php?action=profile;u=3609918
It should be on the BPIP link https://bpip.org/Profile?id=3609918, but the result is https://bpip.org/?notindatabase--3609918

The user was registered a year ago, 13 February 2024. At first, I thought that the error was caused by the fact that the username starts with @, but for example @bb is in the database, BPIP