Talksearch.io - Advanced Bitcointalk Search Engine

[NotATether]

New content update v1.0.3 and backend update v1.0.2 published

These updates add advanced search capability to Talksearch.

Search features:

• Searching by user ID, topic, board, and date is now possible.

App features:

• Added dark mode theme.
• Add advanced search section to the front page.
• Advanced search parameters appear in the query string with colons. For example: "bitcointalk author_uid:35".

48 million posts have been index now. We are approaching indexing completion.

Have you ever thought about a post/topic author rating system?

A higher ranked user - more posts, merit, ranking - has passes the filters. The rest have to go through tighter filters. This may help reduce the number of posts analyzed, and help filter better.

I don't like such a system because it will bias search results for users with a lot of merit.

[cygan]

New content update v1.0.2 published
✂️

very nice to see another update of your search engine
to update the translated threads from (taufik123, satscraper, Abdulzuruku01, katanic97, Adiljutt156, mela65, r_victory, GazetaBitcoin, Danica22 and Porfirii) i would ask you to update your op and the changelog - but you were probably planning to do that anyway

[taufik123]

New content update v1.0.2 published

Shouldn't this be a v1.0.3 update, because there was already a v1.0.2 update

New app update v1.0.2 published

[nutildah]

I think they get the overall sentiment, especially the last one, but it would be unwise to rely only on a LLM as a universal quality score.

Agreed -- what is interesting or relevant to a LLM might not be so for people actually utilizing your search engine.

Additional measures must be taken in place to identify e.g. application posts, obviously AI-generated posts, and such in order to not return them in search results.

I like the initiative you're talking here. Whats interesting is that, last I checked, Google doesn't filter out AI-generated content, but it may do so in the future if it turns out that nobody wants to read such content, thereby making their search results not as accurate or relevant to the query as could potentially be. Seems like it would be super easy to game SEO ranking with AI content, so I don't know why they wouldn't attempt to block it.

[NotATether]

New content update v1.0.2 published

Shouldn't this be a v1.0.3 update, because there was already a v1.0.2 update

New app update v1.0.2 published

You're right - But only the frontend would be v1.0.3, because there was no v1.0.2 update for the backend.

I like the initiative you're talking here. Whats interesting is that, last I checked, Google doesn't filter out AI-generated content, but it may do so in the future if it turns out that nobody wants to read such content, thereby making their search results not as accurate or relevant to the query as could potentially be. Seems like it would be super easy to game SEO ranking with AI content, so I don't know why they wouldn't attempt to block it.

I am fortunate that my preliminary tests can detect AI to a similar degree of accuracy to other types of spam.


New content update v1.0.4 published

This is a minor update that adds missing time controls for the Date From and Date To filters.

All posts up to March 2025 have now been indexed. I am actively working on enabling real-time indexing.

[NotATether]

All posts from March - June 2025 are now being uploaded to the index, while I continue to contrive an automated solution to this problem.

Edit: this batch was uploaded with wrong dates which will cause search errors, and has been deleted and is being reuploaded again.

Edit 2: All done.

I want to implement a spam score as soon as possible, but I'm still not exactly sure how I will do that without re-indexing all the posts. At any rate, I will figure something out.

[Rashlyowl]

Hey bros @NotATether, is it possible to implement pagination/paging directly on the site?



When I've gone too far, I want to go back to the page I want, but opening previous pages is a barrier for me. The solution is actually easy, just by changing:

Current page

Code:

https://talksearch.io/search?q=Bitcointalk&page=9

To

Page I want to see

Code:

https://talksearch.io/search?q=Bitcointalk&page=4

But it makes me a bit annoyed, after all, pagination can improve user experience to a better level.

[NotATether]

Hey bros @NotATether, is it possible to implement pagination/paging directly on the site?



When I've gone too far, I want to go back to the page I want, but opening previous pages is a barrier for me. The solution is actually easy, just by changing:

Current page

Code:

https://talksearch.io/search?q=Bitcointalk&page=9

To

Page I want to see

Code:

https://talksearch.io/search?q=Bitcointalk&page=4

But it makes me a bit annoyed, after all, pagination can improve user experience to a better level.

As you said, this sort of change is very easy to do, and I will make sure to find some time with it.

Due to a lack of software available on Github for this purpose, I'm currently busy building a project for calculating "embeddings" in text classification LLMs. It is a software that is blatantly missing from open-source repositories, and essential for anybody who is building a search application without a paid-for Elasticseearch subscription, which are expensive, even though they package AI search directly.

The hope is that some others in the AI community will find it useful. So I am not indexing new posts for now as the spam score calculation depends on this. Or maybe I will do that in parallel as it will benefit all. Technically, i can do it from a terminal using python scripts, but who likes doing it that way?

Edit: This is what it's going to look like: https://bert-embedding-playground.lovable.app/ - it's designed to be self-hosted. This is just the frontend though, I haven't written much of the backend yet. And even the frontend was made by AI, because I suck at designing HTML by hand.


(Modified again to avoid double-posting)

New app update v1.0.5 published

This is a minor update that adds detailed pagination to search results.

[NotATether]

In the near future, after I set up the scraper to run automatically on the index, I will set up an API for retrieving posts, topics and users and enable limited access to it.

The Elasticsearch cluster is healthy at the moment and is running without issues.

Thank you for using Talksearch.


PSA: Date filtering older than September, 2020 posts does not work properly. I will create a new index to fix this.


New content update v1.0.3 published

This is a minor update that implements a workaround to the date filtering bug described above. A long-term re-indexing will be done at a future time.