Talksearch.io - Advanced Bitcointalk Search Engine

[LoyceV]

That may not be necessary anymore - theymos suggested I should use the sitemap.xml page. It's a little convoluted, but I managed to hack together a script that will check for deleted/updated posts.

Does this allow you to track all edited posts? More specifically: can you track all posts in which a (spam) URL was added later? I've seen many spambots do this to create a backlink without quickly getting caught.

[NotATether]

That may not be necessary anymore - theymos suggested I should use the sitemap.xml page. It's a little convoluted, but I managed to hack together a script that will check for deleted/updated posts.

Does this allow you to track all edited posts? More specifically: can you track all posts in which a (spam) URL was added later? I've seen many spambots do this to create a backlink without quickly getting caught.

Yes, absolutely. In fact, the reason why I haven't released any updates for the search engine is because I'm waiting for my scraper to catch up on the back-log of edited posts. Admittedly, it could take several months before it's finished. I just hope a firmware update doesn't force me to reboot before then.

[NotATether]

Bump!

[NotATether]

Talksearch is a easiest way to post photos in Bitcointalk. Easy to post photos and a helpful post.

I have been thinking of creating an image search for quite some time.


The updating runner is currently processing topic IDs around the 500k range, which means that topics made before 2014 are now completely in sync.

[GazetaBitcoin]

Hey NotATether, please be aware that a new translation was made by AOBT for your topic:

- Japanese translation, made by Akuma_

Are you so kind, please, to add it to OP as well?

[NotATether]

Hey NotATether, please be aware that a new translation was made by AOBT for your topic:

- Japanese translation, made by Akuma_

Are you so kind, please, to add it to OP as well?

Tomorrow this user already asked me for permission.

[NotATether]

New content update v1.1.2 published

This update improves the search algorithm. Previously, titles were disproportionately boosted. This lead to spam topics such as "sell sell sell" appearing near the top of results when you search for "sell bitcoin". Also, each post message has a title field, but titles are really only applicable for OPs. In the future, I plan to add a new field for distinguishing between title post and not title post.

Also, filler words like "a", "the", "or" etc used to be filtered out of search queries - this has been fixed now, so when your query contains these words, you should now see results instead of the message "no results found".

[NotATether]

What are some features you guys would like to see in Talksearch? (besides translations, which I'm already working on)

Edit: I am planning on caching recent search results for a very short time (maybe 10 minutes or something), so that clicking on Page 2/3/4/5/etc. does not trigger an additional search call on the backend.