[TELEGRAM] Yet Another BitcoinTalk Notification BOT (merits, mentions, topics,+)

[giammangiato]

@TryNinja

I am very happy that others have developed such a thing
we can learn many things from each other
we can exchange ideas and become better coder and bot developer

I wanted to congratulate you and thank you for mentioning me, I am truly honored

[asche]

Hey TryNinja, I thought I'd try your bot after using giammangiato's

One things irritates me, and I believe people with simplier nick's will get even more of these.

Every time someone posts a word containing my nick I will get a notification.

Lately it was Italian, but it could be German as well. Best idea would be to make rules to notify 'nickname + {, ; . ... 's}' etc but not with any string after/before the nickname. That would avoid any false positives.

[TryNinja]

Hey TryNinja, I thought I'd try your bot after using giammangiato's

One things irritates me, and I believe people with simplier nick's will get even more of these.

Every time someone posts a word containing my nick I will get a notification.

Lately it was Italian, but it could be German as well. Best idea would be to make rules to notify 'nickname + {, ; . ... 's}' etc but not with any string after/before the nickname. That would avoid any false positives.

Hey man, can you give me some examples? I can add some strict mode which would make harder to get notified with those fase positives. For names like mine, the way it happens right now it’s probably the best, since I don’t miss anything (every single TryNinja gets me a notification). But I can understand how this can go bad if you have a name that is a common word.

[asche]

Hey man, can you give me some examples? I can add some strict mode which would make harder to get notified with those fase positives. For names like mine, the way it happens right now it’s probably the best, since I don’t miss anything (every single TryNinja gets me a notification). But I can understand how this can go bad if you have a name that is a common word.

Sure thing.

here you go

Le mascherine di per se giocano un ruolo importante quanto cruciale, la vera utilità non sta nel proteggerci dal contagio ma dal non contagiare gli altri, questo per quanto riguarda le mascherine chirurgiche che spesso sentiamo dire che sono monouso e con protezione efficace sulle 24h, purtroppo è una info un po sbagliata, le mascherine chirurgiche non hanno nessun filtro che protegge chi le indossa ma fa da barriera ad un possibile contagio tra chi la usa e le persone che abbiamo attorno, poi esistono le ffp2 e ffp3 che a differenza delle chirurgiche hanno al loro interno un filtro di carbonio, la differenza tra le due è sostanzialmente 1 la ffp2 è senza valvola invece la ffp3 si. è sono tra le mascherine che più fanno da barriera protettiva anche a chi la usa, ma il filtro comunque non da protezione effettiva per più di 24h senza contare anche l'elevato costo. A mio avviso (vista la prostituzione mediatica che è stata fatta per impaurire il più possibile) basta semplicemente tenere pochi piccoli accorgimenti e utilizzare semplicemente la mascherina chirurgica e guanti solo al bisogno, non ha affatto senso tenersi la mascherina addosso anche in auto mentre siete da soli (LOL! quando li vedo scoppio a ridere) utilizzarli solamente quando c'è calca o nei luoghi chiusi e ristretti

vorrei spezzare una arancia nei confronti di chi usa la mascherina anche in auto (come me)
io non la uso in auto, ma quando la metto non la tocco piu.. di conseguenza la tengo sempre (anche in auto) per non sporcarla o romperla

questo è il motivo - personale - per cui la tengo anche in auto e non per proteggermi dall'abre magique

On that page you find 12 times "asche".

If you chose to mitigate that issue, you should also think about keeping notifications for tags.

[TryNinja]

Le mascherine di

Ok, this shouldn't be happening in this case. You should only get notified if someone writes your exact name (asche, @asche, Asche) and not mustasche or something like this. Sorry about that.

If you chose to mitigate that issue, you should also think about keeping notifications for tags.

You mean, @asche?

[asche]

You mean, @asche?

I mean bbcode tags.
A list of things that should work imho, and any combination of these.

Code:

[b]asche[/b]
[s]asche[/s]
[u]asche[/u]
[i]asche[/i]
@asche
@asche?
asche?
asche's
asche,
asche!
asche:
asche...
asche;
asche]
asche)
asche}
=asche
asche=

Of course there are probably more possibilities

[TryNinja]

I mean bbcode tags.
A list of things that should work imho, and any combination of these.

Thanks a lot. I just pushed an update that should fix 99% of those issues.

Now, you should get notified for those:

Code:

asche
[b]asche[/b]
[s]asche[/s]
[u]asche[/u]
[i]asche[/i]
[b]@asche[/b]
@asche
@asche?
asche?
asche's
asche,
asche!
asche:
asche...
asche;
asche]
asche)
asche}
=asche
asche=

But not those:

Code:

asche2
aasche
[b]asche2[/b]
mustasche
aschepody
mascherine

Sorry if you got useless notifications before. That's really not what I want to happen.

[asche]

Sorry if you got useless notifications before. That's really not what I want to happen.

No problem man, just looking to help you to fine tune your bot

Nice reactivity anyway! Thank you!

[LoyceV]

Bonus:
- Since I'm already scraping and saving posts, I'm also providing a website that lets you easily search for posts with filters (author, text, in X topic and date range) and share the scraped post so you can send to someone (this original post, for example) or even archive it. I cleaned the database to make some changes and release the bot, so posts just go as far as May 14th. But I have enough hosting and space for at least 1 year of posts (and then I can renew), so you may be able to use it better in the future.

Can I interest you in the huge collection of posts I have collected so you can already search posts created in the past 10 months? I have the data, but lack a decent search system. My data format is quite simple, and if needed I can probably convert it so something you can import.

[Lillominato89]

Hey man, can you give me some examples? I can add some strict mode which would make harder to get notified with those fase positives. For names like mine, the way it happens right now it’s probably the best, since I don’t miss anything (every single TryNinja gets me a notification). But I can understand how this can go bad if you have a name that is a common word.

Sure thing.

here you go

Le mascherine di per se giocano un ruolo importante quanto cruciale, la vera utilità non sta nel proteggerci dal contagio ma dal non contagiare gli altri, questo per quanto riguarda le mascherine chirurgiche che spesso sentiamo dire che sono monouso e con protezione efficace sulle 24h, purtroppo è una info un po sbagliata, le mascherine chirurgiche non hanno nessun filtro che protegge chi le indossa ma fa da barriera ad un possibile contagio tra chi la usa e le persone che abbiamo attorno, poi esistono le ffp2 e ffp3 che a differenza delle chirurgiche hanno al loro interno un filtro di carbonio, la differenza tra le due è sostanzialmente 1 la ffp2 è senza valvola invece la ffp3 si. è sono tra le mascherine che più fanno da barriera protettiva anche a chi la usa, ma il filtro comunque non da protezione effettiva per più di 24h senza contare anche l'elevato costo. A mio avviso (vista la prostituzione mediatica che è stata fatta per impaurire il più possibile) basta semplicemente tenere pochi piccoli accorgimenti e utilizzare semplicemente la mascherina chirurgica e guanti solo al bisogno, non ha affatto senso tenersi la mascherina addosso anche in auto mentre siete da soli (LOL! quando li vedo scoppio a ridere) utilizzarli solamente quando c'è calca o nei luoghi chiusi e ristretti

vorrei spezzare una arancia nei confronti di chi usa la mascherina anche in auto (come me)
io non la uso in auto, ma quando la metto non la tocco piu.. di conseguenza la tengo sempre (anche in auto) per non sporcarla o romperla

questo è il motivo - personale - per cui la tengo anche in auto e non per proteggermi dall'abre magique

On that page you find 12 times "asche".

If you chose to mitigate that issue, you should also think about keeping notifications for tags.

forgive me asche, it was not my intention to tag you continuously. Unfortunately the masks are needed 😁

Mascherine => masks

[Csmiami]

have you guys started merging both bots?
I've just received the merits notification on giamancciatos first, with some cryptic message before yours

Sorry for typos and stuff, I'm on the phone enjoying the sunlight on the street

[TryNinja]

have you guys started merging both bots?

Well, I have increased the time between each merit scraping and now there is a lot more users than before, so it takes more time (reasoning in the change log). Usually it doesn't take more than 5 minutes for the merit notification to come. Mentions are still quick, though.

I've just received the merits notification on giamancciatos first, with some cryptic message before yours

What cryptic message?

I'll go back to improving the bot but in currently trying to use Loyce's post data on this bot's side project (http://posts.ninjastic.space/). Right now, starting to scrape his 2,5 million .html files to insert in my database. My HD almost froze for a moment.

[Csmiami]

....

Nah, yours is still working fine

(UP) MERITS 382 your merit page https://bitcointalk.org/index.php?action=merit;u=903175
 From  for

The "from for" was the odd message, but not on your bot. But as I recall seeing the message from this morning saying that you 2 could collaborate, I assumed some playing around had been done.

I really hate the forum on the phone....

[TryNinja]

The "from for" was the odd message, but not on your bot.

He is probably testing some stuff.

But as I recall seeing the message from this morning saying that you 2 could collaborate, I assumed some playing around had been done.

I think he made his bot with PHP (or at least I assume), while mine is done with Node.js. I also tend to make a lot of critical changes pretty fast so I'm not sure how that would work. Thankfully, I'm testing a lot of stuff to avoid breaking the bot every couple of hours.

I really hate the forum on the phone....

Me too... the idea of creating an open source mobile app for the forum already crossed my mind (I only wish the forum had an open API..). We can only hope for Epochtalk to come.

Now back to extracting a few GBs of files and running it through an custom parser.

[asche]

....

Nah, yours is still working fine

(UP) MERITS 382 your merit page https://bitcointalk.org/index.php?action=merit;u=903175
 From  for

The "from for" was the odd message, but not on your bot. But as I recall seeing the message from this morning saying that you 2 could collaborate, I assumed some playing around had been done.

I really hate the forum on the phone....

You'd have to check on giammanto's thread. He is implementing an improvement, however it seems to be a bit buggy for the time being.

[LoyceV]

Well, I have increased the time between each merit scraping and now there is a lot more users than before, so it takes more time (reasoning in the change log). Usually it doesn't take more than 5 minutes for the merit notification to come. Mentions are still quick, though.

Are you scraping each user's Merit summary instead of just scraping Recent merits? You'll need to scrape the Merited post to see who received the Merit, but it's probably faster (and less scraping) than checking all individual users for Merit transactions.

[TryNinja]

Are you scraping each user's Merit summary instead of just scraping Recent merits? You'll need to scrape the Merited post to see who received the Merit, but it's probably faster (and less scraping) than checking all individual users for Merit transactions.

Yes. Thinking about it now, I could probably do something even better to avoid scraping the posts (again). Since I already scrape every new post shown in the recent posts page (along with its id), I could check for which post id the merit was sent (I can get that from the URL of the post) and see if the posts exists in the database. If it does, I check which user did that post (which I also save). If its an user of the bot, I send him a notification.

But I'm not sure if its worth doing a lot of changes in my database and code for that. Maybe in the future.

Btw, I managed to get your files in my HD (after ~1 hour of extraction and some freezing) and to make a scrapper that loops through them and makes an entry in the database. But I then noticed that they do not contain a title (only some old ones?) or exact date, so they can't just be inserted in my DB the way it is structured now. I'm thinking about making a page and table just for your posts, so you can at least be able to search by content and author (not sure if that can be done easily with 2m+ posts).

[Csmiami]

I've just been mentioned in another thread, and the bot has given the following message:

@Csmiamii think this work, try with me

See how there's a double "i" at the end of the nick. I've checked the post in Loyce Club, and it's not a typo that got fixed.

[TryNinja]

I've just been mentioned in another thread, and the bot has given the following message:

@Csmiamii think this work, try with me

See how there's a double "i" at the end of the nick. I've checked the post in Loyce Club, and it's not a typo that got fixed.

You are right, there is no typo. This happened because this is the post:

@Csmiami

i think this work, try with me

Notice the first line ends with Csmiami, and the second starts with "i think". The bot removes all the line breaks, so the "i" goes next to your name, making it all one line.

I think I can add an space when there is a line break, instead of just removing it completely. Done!


Btw, since I'm already making this post: I found an issue which I had with BitcoinTalk, where pretty much once per day a request would result in the "getaddrinfo EAI_AGAIN" error, which would cause the bot to get stuck. I have found a workaround for the bot getting stuck with it (which is the important part), but I still didn't find how to avoid this error (or if I can even avoid it). If anyones know more about this, let me know, please.

[dkbit98]

Using this bot for few days and I love it so far.
It has all the features I need... and I am also waiting for planned ignore option.

One small thing I would like is to have menu be closed by default, and not opened.
I don't use it all the time, it takes space and I always have to close it.