[TELEGRAM] Yet Another BitcoinTalk Notification BOT (merits, mentions, topics,+)

[joker_josue]

Forum was extra slow today (DDoS?) and cloudflare went full paranoid mode, like LoyceV said. Nothing I can do.

When it returns to normality, will the site be able to scrape from the last point where it was? Or will the information produced so far not be collected?

[1714329348]

1714329348

[TryNinja]

When it returns to normality, will the site be able to scrape from the last point where it was? Or will the information produced so far not be collected?

No. You’ll not get a notification for the past non-scraped posts/merits. The bot will only resume from that time and beyond.

[yahoo62278]

@TryNinja is the bot experiencing issues? Maybe because the forum is having issues it's fucking with the bot? I made a thread last night and had it locked until I finished editing. Checked today and had a few merits sent, but I got 0 notifications on telegram.

I don't think it's anything on my end as I have had 0 issues until the last 24 hours. Maybe it's just me?

Nevermind, I'm always telling people to read past replies and then my dumbass fails to do it. Hopefully the issue is fixed soon, disregard this post.

[Learn Bitcoin]

@TryNinja is the bot experiencing issues? Maybe because the forum is having issues it's fucking with the bot? I made a thread last night and had it locked until I finished editing. Checked today and had a few merits sent, but I got 0 notifications on telegram.

I don't think it's anything on my end as I have had 0 issues until the last 24 hours. Maybe it's just me?

Nevermind, I'm always telling people to read past replies and then my dumbass fails to do it. Hopefully the issue is fixed soon, disregard this post.

Nope. It's not only you. The scrapper doesn't work for over 24 hours now. The Cloudflare is blocking the scrapper. I would quote LoyceV and TryNinja from this post.

Cloudflare on the forum is blocking scrapers, mine can't do anything either
Once in a while Cloudflare goes into impossible-mode. To test: visit the forum in a private browser window, if you see Cloudflare, scrapers won't work.

Once again, I am not receiving notifications for new mentions and merits. It seems TryNinja was online a few minutes ago. Not sure If you have noticed this or not. If your computer is fixed now, you may want to check what is happening. Ninjastic.space is working fine for me. Is it only for me, or someone else has the same issue?

Forum was extra slow today (DDoS?) and cloudflare went full paranoid mode, like LoyceV said. Nothing I can do.

No. You’ll not get a notification for the past non-scraped posts/merits. The bot will only resume from that time and beyond.

What about the posts made in the last 24 hours? Would your website scrap them or not? Do we have to use /setmerit again in the bot to fix merit count?

[BitcoinGirl.Club]

Edit: it seems some services are down almost for five hours!

Cloudflare on the forum is blocking scrapers, mine can't do anything either
Once in a while Cloudflare goes into impossible-mode. To test: visit the forum in a private browser window, if you see Cloudflare, scrapers won't work.

So all these mess are for Cloudflare?
I thought it had something to do from the forum server side.
Earlier I noticed there are no notification emails from the boards where I have my notification active. The last one was few hours ago.

Edit:
It looks like the posting issue has been resolved. This is my second post that was successfully posted without seeing the server error. Also, I feel the pages are loading faster than ever.

[Bitcoin_Arena]

So all these mess are for Cloudflare?
I thought it had something to do from the forum server side.

Yeah, it's Cloudflare causing this and not particularly the forum.

Edit:
It looks like the posting issue has been resolved. This is my second post that was successfully posted without seeing the server error. Also, I feel the pages are loading faster than ever.

No, I think it's still random. Sometimes the posts get published successfully on the first attempt, other times the error pops up, but we hope the mess gets fixed some. It's very nagging when you are used to the forum loading very quick and smoothly and now it's just slow with errors at times.

[LoyceV]

You’ll not get a notification for the past non-scraped posts/merits. The bot will only resume from that time and beyond.

Considering how long this takes, and how many posts I've missed by now, I'm planning to make a "catch up" scraper: once the forum works again, I can check the latest topics with new posts on each board, and scrape the last pages of all of them until I caught up to the start of the outage. It will mean some redundant scraping, and I won't catch deleted posts, but at least the voids in my archive will get smaller.
If I can find the time, I expect it to be quite a lot of work.

So all these mess are for Cloudflare?
I thought it had something to do from the forum server side.

Usually, this happens because of a DDOS on the forum. As theymos wrote:

The Internet is seriously flawed if everyone needs to huddle behind these huge centralized anti-DDoS companies in order to survive...

[examplens]

So all these mess are for Cloudflare?
I thought it had something to do from the forum server side.

Usually, this happens because of a DDOS on the forum. As theymos wrote:

The Internet is seriously flawed if everyone needs to huddle behind these huge centralized anti-DDoS companies in order to survive...

I noticed that both, the TryNinja TG bot and LoyceV scraper, notification bots are down these days, I assumed it was related to DDoS protection due to extra Cloudflare verification in the last few days.

Considering that these are already proven add-ons, and very useful for the forum, I assume that both bots always come from the same IP address. So I wonder if an exception can be made just for them so that they always have direct access, probably read-only is enough. I believe that is a question for theymos, not sure how technically feasible it is

[TryNinja]

Considering that these are already proven add-ons, and very useful for the forum, I assume that both bots always come from the same IP address. So I wonder if an exception can be made just for them so that they always have direct access, probably read-only is enough. I believe that is a question for theymos, not sure how technically feasible it is

Jokes on you, theymos already whitelisted our IPs.

I’m not sure why it isn’t enough, but well… it’s cloudflare.

[Nwada001]

Considering that these are already proven add-ons, and very useful for the forum, I assume that both bots always come from the same IP address. So I wonder if an exception can be made just for them so that they always have direct access, probably read-only is enough. I believe that is a question for theymos, not sure how technically feasible it is

Jokes on you, theymos already whitelisted our IPs.

I’m not sure why it isn’t enough, but well… it’s cloudflare.

Just got a notification now so I believe the bot is back to normal.
New mentioned and new topic notification was just sent to me few minutes ago

[TryNinja]

Bot is online again!! (for now)

BetterStack shows at least 1 day and 16 hours total downtime, longest one so far I believe.

[LoyceV]

Considering that these are already proven add-ons, and very useful for the forum, I assume that both bots always come from the same IP address. So I wonder if an exception can be made just for them so that they always have direct access, probably read-only is enough. I believe that is a question for theymos, not sure how technically feasible it is

Jokes on you, theymos already whitelisted our IPs.

Joke's on me: theymos fixed the whitelisting, but my loyce.club server has a new IP by now (also because of a DDOS). I've asked theymos to also whitelist the new IP.

Update: my scraper is back online! Thanks theymos

[BitcoinGirl.Club]

Considering that these are already proven add-ons, and very useful for the forum, I assume that both bots always come from the same IP address. So I wonder if an exception can be made just for them so that they always have direct access, probably read-only is enough. I believe that is a question for theymos, not sure how technically feasible it is

Jokes on you, theymos already whitelisted our IPs.

Joke's on me: theymos fixed the whitelisting, but my loyce.club server has a new IP by now (also because of a DDOS). I've asked theymos to also whitelist the new IP.

My man is already in trouble. One of my post was deleted and I am 100% sure I did not delete it. It does not look like it was deleted by moderators as I never received a PM notification. More to add it, the post was not something off topic, in fact it was 101% on topic. How it was deleted, God knows.

I hope the IP whitelisting is just a click to do and it does not give much work to our main man.

[Agbe]

Bot is online again!! (for now)

BetterStack shows at least 1 day and 16 hours total downtime, longest one so far I believe.

I didn't noticed the downtime of the bot but and I was not bother, because was busy with family activities. Since yesterday to this afternoon I have not gotten notification and only in this evening that I have started seen messages in the in bot. We thank God for the restoration of the bot.

[holydarkness]

[...]
My man is already in trouble. One of my post was deleted and I am 100% sure I did not delete it. It does not look like it was deleted by moderators as I never received a PM notification. More to add it, the post was not something off topic, in fact it was 101% on topic. How it was deleted, God knows.

I hope the IP whitelisting is just a click to do and it does not give much work to our main man.

Hmm... I was a bit intrigued by this case too. I happened to follow that thread you referred and read that post too before it got migrated to limbo, so I know it was there. But it's not archived by ninjastic too, how likely is it that ninjastic also affected by cloudflare and couldn't scrap some posts?

If it helps, though perhaps a bit overkill, I archived the search result for that thread, just in case we finally got the cloudflare issue and the post suddenly... reemerged. LOL.

I didn't noticed the downtime of the bot but and I was not bother, because was busy with family activities. Since yesterday to this afternoon I have not gotten notification and only in this evening that I have started seen messages in the in bot. We thank God for the restoration of the bot.

It's actually quite fun, almost feels like walking in the dark because we know nothing about our surrounding and have to check everything manually. Suddenly my merit became this number, and then that number, all without any notification; I only noticed people replied to my post because that thread bumped in the watchlist/new-replies, while my phone is completely silent. Feels like, though temporarily, thrown back to stone age, LOL. It's nice to be reminded every now and then what I take for granted, I'm really grateful for the bot.

[LTU_btc]

Great to see that bot is working again. Already got first notification after quite long time. After using bot for quite some time, few last days without it using forum become not very convenient and react to replies on time.
Not that it matters so much, but as I understand we won't get notification for posts and other things that happened during downtime?

[TryNinja]

Not that it matters so much, but as I understand we won't get notification for posts and other things that happened during downtime?

No.

One day, maybe, I’ll see if I can code a fallback option to scrape old posts and notify of everything that was missed (i.e “The bot was down for X hours. You received X merits and was mentioned Y times. - list here -“).

And also alert people when there is a long downtime.

[Learn Bitcoin]

My man is already in trouble. One of my post was deleted and I am 100% sure I did not delete it. It does not look like it was deleted by moderators as I never received a PM notification. More to add it, the post was not something off topic, in fact it was 101% on topic. How it was deleted, God knows.

I hope the IP whitelisting is just a click to do and it does not give much work to our main man.

I guess you are aware of recent cases of session hijacking or something like that. Hackers get access to users' accounts and take loans from lending services. Here is the case where the hacker was successful in getting a $1000 loan using an account https://bitcointalk.org/index.php?topic=5459055.0 if you were not joking about the deleted posts, it's worth checking your IP log https://bitcointalk.org/myips.php to make sure your session wasn't hijacked!

Or was it from a self-moderated thread?

[jrrsparkles]

My man is already in trouble. One of my post was deleted and I am 100% sure I did not delete it. It does not look like it was deleted by moderators as I never received a PM notification. More to add it, the post was not something off topic, in fact it was 101% on topic. How it was deleted, God knows.

I hope the IP whitelisting is just a click to do and it does not give much work to our main man.

I guess you are aware of recent cases of session hijacking or something like that. Hackers get access to users' accounts and take loans from lending services. Here is the case where the hacker was successful in getting a $1000 loan using an account https://bitcointalk.org/index.php?topic=5459055.0 if you were not joking about the deleted posts, it's worth checking your IP log https://bitcointalk.org/myips.php to make sure your session wasn't hijacked!

Or was it from a self-moderated thread?

Even if it was in the self mod topic and the creator deletes someone's post still the user will receive a notification PM about the deletion. So the only possibility is the whole thread might be deleted by mods in that case we won't get any notification.

Great to see that bot is working again. Already got first notification after quite long time.

Are you sure? Can somebody confirm that?

Cause for me it is still not giving any notification about mentions and the problem with cloudfare still exists.

[joker_josue]

Are you sure? Can somebody confirm that?

Cause for me it is still not giving any notification about mentions and the problem with cloudfare still exists.

I also received some notifications, but not all.
The problem is intermittent. Sometimes the bots are able to gather the information, sometimes they are not.

The issue here is that bot creators can't do much more. So we really have to wait for the situation with Coludflare to be normalized.