Bitcoin Forum

Bitcoin => Project Development => Topic started by: Evil-Knievel on April 13, 2016, 12:47:55 PM



Title: Automatic SPAM Deletion Bot for Self Moderated Topics
Post by: Evil-Knievel on April 13, 2016, 12:47:55 PM
If you have any feature requests,
just post them here and I will take care of it.



UPDATE: Feature to filter out certain keywords has been added


Github Repository:
https://github.com/OrdinaryDude/XXLTerminate (https://github.com/OrdinaryDude/XXLTerminate)

XXLTerminate - An Automatic SPAM Deletion Bot for Self Moderated Topics
(Note, this work is based on XSTerminate, so the credits go to: https://bitcointalk.org/index.php?topic=850210.0)

XXLTerminate is a bot that can crawl new messages in your thread and delete posts from unwelcome members or delete posts that contain one of multiple, forbidden keywords.
XXLTerminate is a python program with only two dependencies: pyyaml and BeautifulSoup. The dependencies can be installed by

Code:
sudo pip install -r requirements.txt

Usage

Code:
xxlterminate deletebot.yml

Configuration

The file "lusers.txt" contains all unwanted users, one per line.

The file "lwords.txt" contains all unwanted keywords (regardless of the user), one per line.

The file "deletebot.yml" is a yaml file which contains several important settings.

user: the bitcointalk username
password: the bitcointalk password (remove or make null for getpass)
topic: the bitcointalk topic number found in the topic url
lusers: the luser blacklist with one luser name per line
lwords: the lwords blacklist with one prohibited word per line
sleep: be nice to bitcointalk by sleeping between thread reloads
cookiefile: the file wherein cookies are stored
debug: prints debug output if set to "true"; omit or set to false if unwanted
The settings "sleep", "debug" can be changed in the config file while the bot is live and the bot will adjust its behavior upon the next reload of the thread messages.


Title: Re: Automatic SPAM Deletion Bot for Self Moderated Topics
Post by: Hazelnutter on April 13, 2016, 04:40:30 PM
This looks pretty cool, I'll have to test it out soon.
Nice work, Evil-Knievel.


Title: Re: Automatic SPAM Deletion Bot for Self Moderated Topics
Post by: ed_teech on April 16, 2016, 07:18:04 AM
Cool ! I remember Hondo's work on XSTerminate was very efficient for the XST thread.


Title: Re: Automatic SPAM Deletion Bot for Self Moderated Topics
Post by: Slark on April 17, 2016, 10:48:49 AM
It is not really spam remover per se, this script  is not intelligent enough - it is tool which can only delete every post of unwanted users based on predefined list of spammers.
I guess it can be useful as moderation tool in long and heavy trolled threads.


Title: Re: Automatic SPAM Deletion Bot for Self Moderated Topics
Post by: KenR on April 17, 2016, 10:51:59 AM
Nice attempt.Don't know how accurate the spam detection will be.How does the bot find out if a particular post is a spam ? Length ? Rank ? Its not really needed when the owner of the thread can delete spam by click of just one button.Not saying its not nice to automate stuff but when manually you can achieve more accuracy ,why not just let it be like that.


Title: Re: Automatic SPAM Deletion Bot for Self Moderated Topics
Post by: ed_teech on April 18, 2016, 06:29:12 AM
Nice attempt.Don't know how accurate the spam detection will be.How does the bot find out if a particular post is a spam ? Length ? Rank ? Its not really needed when the owner of the thread can delete spam by click of just one button.Not saying its not nice to automate stuff but when manually you can achieve more accuracy ,why not just let it be like that.

This tool was developed to fight trolls in altcoin spam wars. As these fanboys' users were known, this was the tool to remove their spam from the thread. The amount of spam was so high that announcements and constructive posts were not visible to future investors, and a moderator was not always available to clean it up.


Title: Re: Automatic SPAM Deletion Bot for Self Moderated Topics
Post by: Evil-Knievel on April 20, 2016, 08:22:27 AM
I have just pushed a major update to the git.

Now, not only can you permanently delete certain users but you can also define certain keywords that will cause the according message to be deleted immediately regardless of who has posted it (one forbidden keyword per line has to be specified in lwords.txt).



Title: Re: Automatic SPAM Deletion Bot for Self Moderated Topics
Post by: Evil-Knievel on April 20, 2016, 08:43:00 AM
It is not really spam remover per se, this script  is not intelligent enough - it is tool which can only delete every post of unwanted users based on predefined list of spammers.
I guess it can be useful as moderation tool in long and heavy trolled threads.

It just became a little more intelligent ;-) You can now filter by keywords.


Title: Re: Automatic SPAM Deletion Bot for Self Moderated Topics
Post by: Evil-Knievel on April 20, 2016, 04:25:28 PM
Warning, there seems to be some problem when the "keyword" appears somewhere else on the page . Maybe someone can check and fix that, I have not that much time at the moment.