[BETA] [NEW] beta.ninjastic.space (forum search, archive and data visualization)

[dkbit98]

Now working on the user merits page. Lots to be done, but first features are live.

This new feature looks great so far.
When I wanted to look merit transactions, connections and history I always had to visit BPIP website and Merit Dashboard, but I think new Ninjastic is going to be better for this.

I've added post edited versions. This post, for example: https://beta.ninjastic.space/post/65237800/versions

Great work, I just hope you won't run out of resources in your hosting because of this additional archived posts.

[TryNinja]

Vastly improved the diff algo! Still there might be some edge cases, let's see.

This new feature looks great so far.
When I wanted to look merit transactions, connections and history I always had to visit BPIP website and Merit Dashboard, but I think new Ninjastic is going to be better for this.

Let me know what you think, I would like feedback specifically from people who need to check this data to make reports, find alt accounts, etc...

Great work, I just hope you won't run out of resources in your hosting because of this additional archived posts.

I have 1.5 TB and can do even more if needed, it will be fine.

[TryNinja]

New update

User notifications page!

So you don't like telegram and that's why you don't use my telegram notification bot...

You also don't like SimpleX, an open-source E2E-encrypted chat app, and that's why you don't use my simplex notification bot...

Well, you don't have any more excuses, because now you can see your mentions and merits directly on the browser!

For example: https://beta.ninjastic.space/user/id/459836/notifications

The page is updated in real time (as my bot scrapes the posts/merits) and you can toggle a sound notification by clicking the speaker button. You'll hear a ping when there is anything new, so you can keep the page open on the background.

[joker_josue]

Well, you don't have any more excuses, because now you can see your mentions and merits directly on the browser!

Great update! Congratulations.

Now, I can be on my PC doing other tasks, without having to refresh the forum to see if I have new things to read. 


Will it only work with posts and merit, or are you thinking of evolving to be able to mark topics or something like that?

[TryNinja]

Will it only work with posts and merit, or are you thinking of evolving to be able to mark topics or something like that?

I could do some more stuff that we have on the telegram/simplex bot, like tracked topics and users, but that's a bit more complicated since there is no authentication. What if I pretend to be you, joker_josue, and say I want to track the topic XXX? Then you visit your notifications page and there's a bunch of random posts there? How do I verify that it's the real joker_josue that wants to track that topic?

[LoyceV]

For example: https://beta.ninjastic.space/user/id/459836/notifications

That's just my notification bot with extra steps It's nice though, you can add more features, I can't easily do that.

How do I verify that it's the real joker_josue that wants to track that topic?

You could use one of the ancient field in his profile, for instance "AIM:". If you keep codes short, you can fit multiple things in there: T5534972 to track this topic, U557798 to track you. But it won't fit many topics.

[joker_josue]

Will it only work with posts and merit, or are you thinking of evolving to be able to mark topics or something like that?

I could do some more stuff that we have on the telegram/simplex bot, like tracked topics and users, but that's a bit more complicated since there is no authentication. What if I pretend to be you, joker_josue, and say I want to track the topic XXX? Then you visit your notifications page and there's a bunch of random posts there? How do I verify that it's the real joker_josue that wants to track that topic?

Yes, this may seem like a problem.

Unless you create a token authentication system, where only those who have the token receive the respective chosen notifications.

It is just an idea, which is perhaps complex and without great priority.

[NotATether]

Yes, this may seem like a problem.

Unless you create a token authentication system, where only those who have the token receive the respective chosen notifications.

It is just an idea, which is perhaps complex and without great priority.

There's an easy solution for that.

Make a small website where people can enter their Bitcointalk user ID and email address and subscribe to receive post messages (TryNinja already has some kind of prototype I see).

Then use any mailing list service, like Mailgun, Sendgrid or SES.

Each time someone pings a user, if they are subscribed they get s notification.

Pros:

- You can privately send users a message.
- Very fast.

Cons:

- A mailing list is not free. This will probably be a dealbreaker.

This system can also be adapted to send messages to Telegram or Discord handles, as other people have already built, without paying any money for that.

[NotATether]

@TryNinja

How is your system detecting whether a post/topic is archived as opposed to just locked?

[TryNinja]

How is your system detecting whether a post/topic is archived as opposed to just locked?

I'm not sure what exactly you're talking about. What do you mean with "archived"? I don't track that or if a topic has been locked.

[NotATether]

How is your system detecting whether a post/topic is archived as opposed to just locked?

I'm not sure what exactly you're talking about. What do you mean with "archived"? I don't track that or if a topic has been locked.

Some topics are locked by an administrator and cannot be unlocked by the OP after that.

I remember this discussion coming up on the Meta board, but I cannot find the original topic (not even with my own search engine LOL)

[TryNinja]

Some topics are locked by an administrator and cannot be unlocked by the OP after that.

I remember this discussion coming up on the Meta board, but I cannot find the original topic (not even with my own search engine LOL)

To answer your previous question, I don't track any of that.

Found this with ninjastic:

If it's your thread, try unlocking it. If it doesn't allow you then a mod or an admin locked it. If it isn't yours, then AFAIK there is no way to tell (without obviously asking the author to try and unlock it). Not sure whether that's intentional or just how SMF 1.x works.

So I guess you just can't know.

[PowerGlove]

So I guess you just can't know.

It's a little off-topic for this thread, but, just so you know:

[joker_josue]

So I guess you just can't know.

It's a little off-topic for this thread, but, just so you know:

Another new scraping, to add a field that was not being covered in the previous scrapings. 

[NotATether]

Thanks PowerGlove, I knew it had to be somewhere.

[Cyrus]

So I guess you just can't know.

It's a little off-topic for this thread, but, just so you know:

This might come in handy. Today I learned! Didn't realize theymos implemented it (it also slipped my mind), thanks again!

[TryNinja]

Cool update, now diving in the AI territory!

There is a new command button (Ctrl + K) on the navbar where you can:

- quickly search posts with natural language
- go to archived posts with the post id or url

Query examples:
- Posts by satoshi and theymos where they mention "block size"
- Posts from the Meta board, from the past 30 days and sorted by newest
- Posts by TryNinja between 2024 and 2025 that received at least 1 merit
- Posts by TryNinja that were merited by LoyceV
- "If you don’t believe it or don’t get it, I don’t have the time to try to convince you, sorry."
- author:"TryNinja" content:"I like ninjas"

To go to an archived post quickly, just write the post id or paste the entire post/topic URL (example: https://bitcointalk.org/index.php?topic=5534972.msg65251547#msg65251547).



Demo gif:




More to come...

[joker_josue]

Cool update, now diving in the AI territory!

There is a new command button (Ctrl + K) on the navbar where you can:

- quickly search posts with natural language
- go to archived posts with the post id or url

Another good feature.

Now, I must be really bad at giving commands, because I asked "first post made by joker_josue" and it doesn't indicate the first post. 

[TryNinja]

Now, I must be really bad at giving commands, because I asked "first post made by joker_josue" and it doesn't indicate the first post. 

It doesn't work like this... yet.

Right now it's a prompt to filters system. So anything you can filter on the /search page you can specify on the prompt.

Since you can filter by author, board, date range, topic id, merit amount, merited from X, quotes from Y, quotes to post Z, that's what the AI understands.

Ex: "Posts by joker_josue on 2nd april 2025 where he received merits from TryNinja" -> https://beta.ninjastic.space/search?author=joker_josue&date_min=2025-04-02&date_max=2025-04-02&merits_from=TryNinja&limit=20

[joker_josue]

Now, I must be really bad at giving commands, because I asked "first post made by joker_josue" and it doesn't indicate the first post. 

It doesn't work like this... yet.

Right now it's a prompt to filters system. So anything you can filter on the /search page you can specify on the prompt.

Since you can filter by author, board, date range, topic id, merit amount, merited from X, quotes from Y, quotes to post Z, that's what the AI understands.

Ex: "Posts by joker_josue on 2nd april 2025 where he received merits from TryNinja" -> https://beta.ninjastic.space/search?author=joker_josue&date_min=2025-04-02&date_max=2025-04-02&merits_from=TryNinja&limit=20

OK. I get the idea.

It's a different way of searching, but useful in cases where we have two or three ideas of what we want to look for, but we don't know where to look.