Bitcoin Forum

Other => Meta => Topic started by: CapnSparrow on January 16, 2019, 06:21:06 PM



Title: Browser Addon That Helps You Ignore Spammy Comments
Post by: CapnSparrow on January 16, 2019, 06:21:06 PM
I see too many rubbish and spammy comments throughout the forum. They are usually written without reading the OP and they usually contain repeated stuff which is useless for readers. I've noticed that these posters have something in common: they have ads (mostly ICO) in their signatures.

I respect everbody's freedom to post whatever they want. I'll also use my freedom to use a browser addon to hide those useless comments. I've been using it for some time and now I want to share it with the community.

NOTE: Although I consider the addon stable, please note that it's still in beta. It may give false positive results in some circumstances.

How does it work? When a post has an ICO related ad in its signature, the whole post is automatically made transparent by the addon. If the user hovers mouse on it, it becomes readable and when unhovers then it gets transparent again. There is a treshold of 1000 merits, users above that don't get blocked by the addon.

Installation: The addon is a "user script". So in order to install it you first have to install Tampermonkey (https://chrome.google.com/webstore/detail/tampermonkey/dhdgffkkebhmkfjojejmpbldmpobfkfo) for Chrome or Greasemonkey (https://addons.mozilla.org/tr/firefox/addon/greasemonkey/) for Firefox. Once you install it, click the link below to install my addon:

https://gist.github.com/CapnSparrow/d1f4f3d48c776279895a497a2eabe266/raw/084c8bea6b6207337c5334f394f174466b9d39b9/bitcointalk-poor-comment-blocker.user.js (https://gist.github.com/CapnSparrow/d1f4f3d48c776279895a497a2eabe266/raw/084c8bea6b6207337c5334f394f174466b9d39b9/bitcointalk-poor-comment-blocker.user.js)

Is this safe? Yes. It works offline in your browser and is open source.

Source code: https://gist.github.com/CapnSparrow/d1f4f3d48c776279895a497a2eabe266

I hope you enjoy it. Feedback is welcome.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: DarkStar_ on January 16, 2019, 06:28:36 PM
Your link is broken. Here's a rehosted version you can use to install it: https://gist.github.com/DarkStarFTW/9b281cc74f6f81fff249c685315fb451/raw/6102f0f07b549d1daeb89f03100bb3ef1b79d91c/spamcomment.user.js

(disclaimer: not responsible for any damages from installing the script. code looks fine though)



A suggestion: Could you also collapse the spammy post, so that it doesn't take up as much space? Kind of like how reddit works. (https://i.imgur.com/wpTafCF.png) It would make browsing threads much easier, as you wouldn't have to scroll endlessly to get past posts from ICO spam.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: suchmoon on January 16, 2019, 06:52:21 PM
Nice. Although using jQuery is a bit of an overkill. Regular DOM functions are robust enough nowadays.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: CapnSparrow on January 16, 2019, 07:08:56 PM
Your link is broken.

Fixed, thanks.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: suchmoon on January 16, 2019, 07:29:41 PM
Few popular member such as suchmoon got blocked by your script :D

LOL

Serves me right for promoting an ICO.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: jackg on January 16, 2019, 07:34:14 PM
Few popular member such as suchmoon got blocked by your script :D

LOL

Serves me right for promoting an ICO.

I pmd the fix to you auchmoon which is probably a lot easier than op making his code more complex.

Although there are a lot of good quality posts that come from newbies promoting icos.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: suchmoon on January 16, 2019, 08:04:20 PM
I pmd the fix to you auchmoon which is probably a lot easier than op making his code more complex.

Thanks mate, I'm back from the dead invisible.

Actually I don't know, I'm not using the script but it's a solid hack, should be good :)


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: hatshepsut93 on January 16, 2019, 08:15:52 PM
I suggest you to remove "casino" and "dice" from your blocklist, there are some high-paying Bitcoin signature campaigns (FortuneJack and others) with this word in their signatures, so your script actually filters some decent posters. Filtering ICO spammers should be just enough.

Check this thread (https://bitcointalk.org/index.php?topic=615953.0l) to see all the bitcoin-paid signature campaigns to avoid false-positives in your script.

Also, your logic of minimal merit to bypass blocking doesn't calculate earned merit and uses only raw merit instead, on practice it will let pass people with 0 earned merit while sometimes ignoring those with hundreds of earned merit.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: DarkStar_ on January 16, 2019, 08:30:36 PM
I suggest you to remove "casino" and "dice" from your blocklist, there are some high-paying Bitcoin signature campaigns (FortuneJack and others) with this word in their signatures, so your script actually filters some decent posters. Filtering ICO spammers should be just enough.

Stake is causing quite a bit of spam too. 777Coin, BitVest and Bitsler both have a bunch of spam megathread posters as well who make spammy comments outside of spam megathreads, so it's not a bad idea to filter them. FortuneJack does seem to have decent posters though


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: CapnSparrow on January 16, 2019, 08:32:51 PM
Nice. Although using jQuery is a bit of an overkill. Regular DOM functions are robust enough nowadays.

You're right but that's a challenge for me. If someone makes the required code conversion I'll happily update the source.

2. Add user whitelist option. Few popular member such as suchmoon got blocked by your script :D

I've just implemented a treshold of 1000 merits. Users above that won't get hunted. However I'm not sure if that number is fine; what do you guys think?

A suggestion: Could you also collapse the spammy post, so that it doesn't take up as much space? Kind of like how reddit works. (https://i.imgur.com/wpTafCF.png) It would make browsing threads much easier, as you wouldn't have to scroll endlessly to get past posts from ICO spam.

I'll look into this if I find some time.

I suggest you to remove "casino" and "dice" from your blocklist, there are some high-paying Bitcoin signature campaigns (FortuneJack and others) with this word in their signatures, so your script actually filters some decent posters. Filtering ICO spammers should be just enough.

Check [ur=https://bitcointalk.org/index.php?topic=615953.0l]this thread[/url] to see all the bitcoin-paid signature campaigns to avoid false-positives in your script.

Hmm. Philosophy of the addon is "blocking users who are posting around for the sake of ads and not for adding to discussions". I'm not aware what kind of deals are available between users and advertisers. Does the case you point doesn't encourage users to post useless stuff? What are they get paid for?


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: hatshepsut93 on January 16, 2019, 08:35:05 PM
I suggest you to remove "casino" and "dice" from your blocklist, there are some high-paying Bitcoin signature campaigns (FortuneJack and others) with this word in their signatures, so your script actually filters some decent posters. Filtering ICO spammers should be just enough.

Stake is causing quite a bit of spam too. 777Coin, BitVest and Bitsler both have a bunch of spam megathread posters as well who make spammy comments outside of spam megathreads, so it's not a bad idea to filter them.

Sure, but there's probably some good posters even in those campaigns. OP's idea with taking merit into account can prevent false-positives, but it needs to be improved to calculate earned merit.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: CapnSparrow on January 16, 2019, 08:39:16 PM
Also, your logic of minimal merit to bypass blocking doesn't calculate earned merit and uses only raw merit instead, on practice it will let pass people with 0 earned merit while sometimes ignoring those with hundreds of earned merit.

I'm kind of new to the forum. Could you clarify the difference between raw merit and earned merit?


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: DarkStar_ on January 16, 2019, 08:42:18 PM
Also, your logic of minimal merit to bypass blocking doesn't calculate earned merit and uses only raw merit instead, on practice it will let pass people with 0 earned merit while sometimes ignoring those with hundreds of earned merit.

I'm kind of new to the forum. Could you clarify the difference between raw merit and earned merit?

When the forum first introduced the merit system, everyone was given enough merit to keep their current rank. For example, since I was Legendary at the time, I was given 1000 free merits. I currently have 1537 merits. 537 of those were earned by me, and 1000 of them were given to me for free.

There are a bunch of people with over 1000 merits, but make spammy posts (ex BTCEvo  (https://bitcointalk.org/index.php?action=profile;u=359888)in my opinion, who has 1007 merits but posts that repeat what has already been said/don't make sense. Only 7 of those were earned by them)


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: mikeywith on January 16, 2019, 08:45:34 PM
I suggest you to remove "casino" and "dice" from your blocklist

there are also  ICO signatures with very good quality posts like the "HoweyCoins" signature.

I am not against any sort of signatures, but this browser is suppose to give you a spam-free experience and with those words being removed from the blocklist it will only make it less efficient for sure.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: DarkStar_ on January 16, 2019, 08:47:17 PM
I suggest you to remove "casino" and "dice" from your blocklist

there are also  ICO signatures with very good quality posts like the "HoweyCoins" signature.

Reference for HoweyCoins: https://bitcointalk.org/index.php?topic=3920469.0

Basically a joke from theymos that some notable members are promoting for fun (and not money)


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: CapnSparrow on January 16, 2019, 09:01:05 PM
Quote
When the forum first introduced the merit system, everyone was given enough merit to keep their current rank. For example, since I was Legendary at the time, I was given 1000 free merits. I currently have 1537 merits. 537 of those were earned by me, and 1000 of them were given to me for free.

There are a bunch of people with over 1000 merits, but make spammy posts (ex BTCEvo  (https://bitcointalk.org/index.php?action=profile;u=359888)in my opinion, who has 1007 merits but posts that repeat what has already been said/don't make sense. Only 7 of those were earned by them)

Is it possible to find that out via the UI? If that's not the case I think the only thing we can do is to increase the treshold.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: mikeywith on January 16, 2019, 09:21:05 PM

Reference for HoweyCoins: https://bitcointalk.org/index.php?topic=3920469.0

Basically a joke from theymos that some notable members are promoting for fun (and not money)

 i know what HoweyCoins ICO is , i wouldn't be "shilling" it otherwise !.  i meant if we were to make exceptions for "dice" and "casino" and allowing signatures for campaigns you mentioned in your comment then this will open the door for ICOs too.



Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: DarkStar_ on January 16, 2019, 09:51:46 PM

Reference for HoweyCoins: https://bitcointalk.org/index.php?topic=3920469.0

Basically a joke from theymos that some notable members are promoting for fun (and not money)

 i know what HoweyCoins ICO is , i wouldn't be "shilling" it otherwise !.  i meant if we were to make exceptions for "dice" and "casino" and allowing signatures for campaigns you mentioned in your comment then this will open the door for ICOs too.

I know, I was pointing it out for CapnSparrow who is new and likely would have not known.

Quote
When the forum first introduced the merit system, everyone was given enough merit to keep their current rank. For example, since I was Legendary at the time, I was given 1000 free merits. I currently have 1537 merits. 537 of those were earned by me, and 1000 of them were given to me for free.

There are a bunch of people with over 1000 merits, but make spammy posts (ex BTCEvo  (https://bitcointalk.org/index.php?action=profile;u=359888)in my opinion, who has 1007 merits but posts that repeat what has already been said/don't make sense. Only 7 of those were earned by them)

Is it possible to find that out via the UI? If that's not the case I think the only thing we can do is to increase the treshold.

Unfortunately not.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: hatshepsut93 on January 16, 2019, 10:15:00 PM

Is it possible to find that out via the UI? If that's not the case I think the only thing we can do is to increase the treshold.

Here's my attempt at this: https://gist.github.com/Tiramisu77/155f1e076c58728efc06131c7226baee

The results are not guaranteed to be always correct, because the function assumes that the user has maxed up their activity throughout the period between today and the day merit system went live, it also assumes that Legendaries rank-up at 902 activity (in reality it's random between 775 and 1030).

Also, I couldn't find the exact date when merit system went live, so I used Jan 24, 2018, please correct me if I'm wrong.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: o_e_l_e_o on January 16, 2019, 10:28:44 PM
I am in two minds about this.

On one hand, the spam problem is huge. The majority of topics, and even some entire boards, are unreadable due to bounty spam. I don't blame anyone who wants to try to hide all this nonsense for either an easier forum experience or simply their own sanity, and good work from OP to create this script.

On the other hand, everyone has to start somewhere. While the majority of bounty spammers will be bounty spammers for life, there are undoubtedly a small number who will mature over their time in the forum and become useful contributors. They will never achieve that if senior members are ignoring all their posts, not responding to their questions, and not involving them in discussions. By ignoring them all, we'll also be preventing the few good ones from earning any merit.

As I said, I have no issues with people who want to use this, but it feels too much like newbie jail for me.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: LoyceMobile on January 16, 2019, 10:32:16 PM
Quote
When the forum first introduced the merit system, everyone was given enough merit to keep their current rank. For example, since I was Legendary at the time, I was given 1000 free merits. I currently have 1537 merits. 537 of those were earned by me, and 1000 of them were given to me for free.

There are a bunch of people with over 1000 merits, but make spammy posts (ex BTCEvo  (https://bitcointalk.org/index.php?action=profile;u=359888)in my opinion, who has 1007 merits but posts that repeat what has already been said/don't make sense. Only 7 of those were earned by them)

Is it possible to find that out via the UI? If that's not the case I think the only thing we can do is to increase the treshold.
I can get you a list of users who earned more than a certain amount of merit.
Does that work to whitelist them all?

Even if you put the threshold at 2 merit you'll rejected most spammers.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: CapnSparrow on January 16, 2019, 10:32:46 PM
I know, I was pointing it out for CapnSparrow who is new and likely would have not known.

Thanks. I've added "HoweyCoins" as an exception. It's fair to do that for HoweyCoins.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: CapnSparrow on January 16, 2019, 11:07:44 PM
Here's my attempt at this: https://gist.github.com/Tiramisu77/155f1e076c58728efc06131c7226baee

The results are not guaranteed to be always correct, because the function assumes that the user has maxed up their activity throughout the period between today and the day merit system went live, it also assumes that Legendaries rank-up at 902 activity (in reality it's random between 775 and 1030).

Also, I couldn't find the exact date when merit system went live, so I used Jan 24, 2018, please correct me if I'm wrong.

I've reviewed the code. Thanks for the effort but that's too many assumptions for the task. Trusting raw merit number might be more safe here. If it doesn't work out, we may implement "userExceptions" list which is the list of users who have too many merits but still spam. I guess that list wouldn't be too long.

I can get you a list of users who earned more than a certain amount of merit.
Does that work to whitelist them all?

Thanks but I guess that list would be too long to maintaiin. Let try the current approach for some time and see if it works out.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: LoyceMobile on January 16, 2019, 11:10:43 PM
I maintain that list already and can easily add another weekly upload if you want to give it a try.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: jackg on January 16, 2019, 11:17:24 PM
Quote
When the forum first introduced the merit system, everyone was given enough merit to keep their current rank. For example, since I was Legendary at the time, I was given 1000 free merits. I currently have 1537 merits. 537 of those were earned by me, and 1000 of them were given to me for free.

There are a bunch of people with over 1000 merits, but make spammy posts (ex BTCEvo  (https://bitcointalk.org/index.php?action=profile;u=359888)in my opinion, who has 1007 merits but posts that repeat what has already been said/don't make sense. Only 7 of those were earned by them)

Is it possible to find that out via the UI? If that's not the case I think the only thing we can do is to increase the treshold.
the best way I think this can be done is by saying.
If usermerit < 500 and > 300 then show their posts
If usermerit < 1000 and > 600 then show their posts
If usermerit > 1100 then show their posts
Maybe also if merit > activity


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: AverageGlabella on January 17, 2019, 01:26:41 AM
I am in two minds about this.

On one hand, the spam problem is huge. The majority of topics, and even some entire boards, are unreadable due to bounty spam. I don't blame anyone who wants to try to hide all this nonsense for either an easier forum experience or simply their own sanity, and good work from OP to create this script.

On the other hand, everyone has to start somewhere. While the majority of bounty spammers will be bounty spammers for life, there are undoubtedly a small number who will mature over their time in the forum and become useful contributors. They will never achieve that if senior members are ignoring all their posts, not responding to their questions, and not involving them in discussions. By ignoring them all, we'll also be preventing the few good ones from earning any merit.

As I said, I have no issues with people who want to use this, but it feels too much like newbie jail for me.

Spam is a massive issue and this approach is ignoring the problem rather than solving it. What could be a better approach is to automatically report certain replies instead of ignoring them. This could become a problem because of the workload for the staff members but I think would proactively help the forum rather than ignoring one of its biggest issues. That also means that if the users start to improve their post quality they aren't just going to get ignored.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: o_e_l_e_o on January 17, 2019, 08:10:22 AM
Spam is a massive issue and this approach is ignoring the problem rather than solving it.

I don't think there is a way of ever solving the spam issue, short of having every post manually reviewed by a moderator prior to being posted, which is obviously completely untenable. More active reporters and more sub-board moderators would help, but that's a whole 'nother conversation. As I said, I can't blame people for wanting to ignore the problem, but I'm just not too keen on ignoring the users, and therefore removing their only way out of that behavior and condemning them to be spammers forever.

Edit: Spelling


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: CapnSparrow on January 17, 2019, 08:48:47 AM
As I said, I can't blame people for wanting to ignore the problem, but I'm just not to keen on ignoring the users, and therefore removing their only way out of that behavior and condemning them to be spammers forever.

You're a nice person. On the other hand, the addon doesn't ignore them forever. When they remove ads from signature they become visible again. But I guess you think they will never know what the problem is, so won't change signature.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: jackg on January 17, 2019, 11:28:58 AM
Spam is a massive issue and this approach is ignoring the problem rather than solving it.

I don't think there is a way of ever solving the spam issue, short of having every post manually reviewed by a moderator prior to being posted, which is obviously completely untenable. More active reporters and more sub-board moderators would help, but that's a whole 'nother conversation. As I said, I can't blame people for wanting to ignore the problem, but I'm just not too keen on ignoring the users, and therefore removing their only way out of that behavior and condemning them to be spammers forever.

Edit: Spelling

The altcoin board is a board that is well moderated. I've reported posts that have been deleted within seconds of them being posted.

There are users who have been ignored in the altcoin board long enough that the work their way into making a thread in the b&h board which I think is a great start...


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: LoyceV on January 29, 2019, 07:47:13 PM
I can get you a list of users who earned more than a certain amount of merit.
Does that work to whitelist them all?
Thanks but I guess that list would be too long to maintaiin. Let try the current approach for some time and see if it works out.
Just in case, here it is:
See http://loyce.club/Merit/userID_merit.txt, updated weekly (usually on a Friday/Saturday, after processing theymos' weekly Merit data dump).

This list only shows users who had a Merit transaction, if someone with "0 Merit" is on the list, that means he only sent Merit.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: CapnSparrow on February 09, 2019, 10:23:44 AM
Just in case, here it is:
See http://loyce.club/Merit/userID_merit.txt, updated weekly (usually on a Friday/Saturday, after processing theymos' weekly Merit data dump).

This list only shows users who had a Merit transaction, if someone with "0 Merit" is on the list, that means he only sent Merit.

Thanks for the list. However this user-script's approach is a little different. Key points are:

1. Someone who is shilling a coin in signature is a coin shiller.
2. Having too much merit doesn't change this situation (Yes, I made an exception in this script upon feedback and actually I'm not comfortable with that. It may change in the future.).
3. I'm not interested in what a coin shiller has to say.
4. Also I don't want to completely remove what a coin shiller says. Only make reading it more difficult. Hence the mouse-over animation. That difficulty helps me remember that that comment is probably a spammy comment.

The user script currently addresses above issues. Injecting a huge key-value DB in the script is not necessary at this time.

Thanks again for the feedback.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: UserU on February 09, 2019, 12:07:17 PM
Only ICOs are targeted right? Casinos exempted?


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: CapnSparrow on February 09, 2019, 12:50:52 PM
Casinos included. Signature ads tempt users to post spammy, useless comments (most of the time). If there are different kind of ad deals in this area please correct me.

My point is when some users post garbage comments only to show their signature to more people.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: UserU on February 09, 2019, 03:10:54 PM
Casinos included. Signature ads tempt users to post spammy, useless comments (most of the time). If there are different kind of ad deals in this area please correct me.

My point is when some users post garbage comments only to show their signature to more people.

While I do agree with you, there are some who genuinely converse with one another (such as quoting).

Nevertheless, it takes trial and error to perfectly filter spammy and genuine contributions.


Title: Re: Browser Addon That Helps You Ignore Spammy Comments
Post by: Pmalek on February 10, 2019, 09:42:13 AM
Casinos included. Signature ads tempt users to post spammy, useless comments (most of the time).
You should take a look at this thread > https://bitcointalk.org/index.php?topic=615953.0 < listing Bitcoin Signature Campaigns and then check the members that take part in those campaigns. You will see that some of the most trusted and/or best posters on the Forum take part in some kind of signature campaign. So putting everyone in the same boat by saying they post 'useless comments (most of the time)' is a bit over exaggerated.