Ninjastic.space - BitcoinTalk Post/Address archive + API

[Rikafip]

Notice: Some of the elasticsearch indexes used on the ninjastic.space archive have been corrupted, so I started the process of rebuilding them.

There are millions of post to index, so this should take a few hours (1+ day?) to complete.

I guess you are still working on it as I was just about to finish my local boards monthly overview when I noticed that this elasticsearch thing (didn't even know its caleld that ) is not working.

Any update on when it might be ready to use again?

I can use your faulty website as an excuse of my delayed publication of the monthly Italian board overview.

As we say in Croatia, "good excuse is worth in gold" (loosely translated). 

[TryNinja]

We are back!

Posts from when the server downtime occurred are still missing (explains the sharp decline on the 'posts per day' chart), I might make a script to scrape them later.

[joker_josue]

We are back!

Posts from when the server downtime occurred are still missing (explains the sharp decline on the 'posts per day' chart), I might make a script to scrape them later.

Congratulations on the work you did in trying to get everything operational. Sometimes it's not easy when these complications arise.

Regarding those "lost days", if we can recover it is good. Otherwise, don't be too worried either. 

[dkbit98]

We are back!

Posts from when the server downtime occurred are still missing (explains the sharp decline on the 'posts per day' chart), I might make a script to scrape them later.

Nice to see Ninjastic.space back, I was starting to get worried about it.
Speaking about archiving, one of the biggest internet archiving websites archive.org is currently under heavy ddos attacks.
Lot of websites get attacked recently by ''someone'' who was unlimited printed money to spend.  

[hosseinimr93]

Thank you Tryninja for the efforts on making the service working well again.

Tryninja, the problem I reported in my previous post in this thread hasn't been solved yet. It seems that's a different issue, maybe with the letter ø and not related to the recent problem. I still get a blank page when searching for the posts made by Cøbra.

[BlackHatCoiner]

Searching for "ø" works fine. Perhaps it's unrelated to the letter, and it's Cøbra's posts the problem. 

[hosseinimr93]

Searching for "ø" works fine. Perhaps it's unrelated to the letter, and it's Cøbra's posts the problem.  

The problem is not only with Cøbra's posts, but also with the posts that contain the word Cøbra.

I don't get any result when I search for the posts that contain the words "Cøbra" and "core". Even if there is no post containing both of those words, it should display a message saying "Total results: 0", not a blank page.
The weird thing is that the search engine works well, when I search for the posts that contain the words "Cøbra" and "bitcoin".

[joker_josue]

Suggestion:
When using post search, it will be possible to set only the first post in a topic to list.

Imagine that I wanted to know all the topics that have the word "Merit" in the title, but I don't want to see the answers to these topics, just the OP.

[JeromeTash]

Imagine that I wanted to know all the topics that have the word "Merit" in the title, but I don't want to see the answers to these topics, just the OP.

Enter the key word under the post content text both but then enter "-Re" in the topic search text box. Since almost all members just reply to the topic without editing the post title. Almost of the replies will be excluded in the search results. This is the closest you can get as of now.


@TryNinja, there's something about the tool right now. It does seem to be so slow and does not show any results after sometime

For example, I tried to search for "smspva" or other common word under Post Content without specifying anything else and this is all I got after a long wait.

Something went wrong...

[joker_josue]

Imagine that I wanted to know all the topics that have the word "Merit" in the title, but I don't want to see the answers to these topics, just the OP.

Enter the key word under the post content text both but then enter "-Re" in the topic search text box. Since almost all members just reply to the topic without editing the post title. Almost of the replies will be excluded in the search results. This is the closest you can get as of now.

I'm going to try this "trick". Thanks for the tip. 

[Crypto Library]

I don't know is it a bug or Or I didn't understand that it works ways and I'm sorry if I repeating this issue.
What I want to talk about is the screenshot on the left side showing my post activity from June 1st at 00:00:01 to 7th at 23:59:59. But what I am facing is that when I copy and save this link and access the link again it defaults to showing time on the right side(2024-05-31 18:00:01 to 2024-06-07 17:59:59). I actually want to know why it's not showing the time I filtered it?
I have shown through screenshots to explain the matter.

Here is the link for checking- https://ninjastic.space/search?after_date=2024-06-01T00%3A00%3A01&author=Crypto%20Library&before_date=2024-06-07T23%3A59%3A59

[suchmoon]

I don't know is it a bug or Or I didn't understand that it works ways and I'm sorry if I repeating this issue.
What I want to talk about is the screenshot on the left side showing my post activity from June 1st at 00:00:01 to 7th at 23:59:59. But what I am facing is that when I copy and save this link and access the link again it defaults to showing time on the right side(2024-05-31 18:00:01 to 2024-06-07 17:59:59). I actually want to know why it's not showing the time I filtered it?

It seems to be assuming that your supplied filter time is in your time zone (i.e. your computer/phone/browser time zone) and then converts it to forum time (UTC).

I tried it a few different ways and it looks like it filters correctly based on your saved link (i.e. midnight to midnight forum time), it just displays the filter wrong.

[giorgione]

We are back!

Posts from when the server downtime occurred are still missing (explains the sharp decline on the 'posts per day' chart), I might make a script to scrape them later.

I just discovered your site (I am new as you can see) I have to say it is fantastic
thanks for the work you have done!
Can I also peek at the code?

[~speedx~]

I just discovered your site (I am new as you can see) I have to say it is fantastic
thanks for the work you have done!
Can I also peek at the code?

Are you looking for the source codes ? here I am quoting the post, you will get both ninjastic.space and also the notification bot.

Finally decided to move the code from my personal github (on a private repo) to my anon github (ninjastic), so here it is: the source code for the bot and ninjastic.space website.

https://github.com/ninjastic/bitcointalk-supernotifier-v2
https://github.com/ninjastic/bitcointalk-ninjastic-web

Now, of course...

Is the code well documented? No.
Is the code clean? Nah.
Will someone get curious and decide to go around the code for some reason? Idk, but that's why this is here.

I learned a lot with this project, so I kept changing patterns all the time and thus, the code is kinda inconsistent and not very well built (but it works!). Have fun.

[logfiles]

Question: Is there away of inverting the search results from the earliest post containing the keyword(s) being displayed at the Top to the Latest post containing the keyword(s) being displayed at the bottom? This would come in handy, especially if the search results are in hundreds and require one to keep scrolling to the bottom.

[giorgione]

Are you looking for the source codes ? here I am quoting the post, you will get both ninjastic.space and also the notification bot.

Thank you very much my friend, very appreciated.

[logfiles]

TryNinja, I just wanted to alert you that the website seems to be down at the moment, you might want to check it out and see what is causing this. I am not sure for how long it has been down, but I believe the same is happening for everyone else (please someone/other members confirm if this is the case)

[joker_josue]

TryNinja, I just wanted to alert you that the website seems to be down at the moment, you might want to check it out and see what is causing this. I am not sure for how long it has been down, but I believe the same is happening for everyone else (please someone/other members confirm if this is the case)

I confirm that it also doesn't seem to be working correctly here.
After some time "thinking" the following message appears: "Something went wrong".

[TryNinja]

My appologies everyone. No idea what's happening but my server seems to be lagging quite a bit the past few weeks and I'm always needing to restart the bot and the ninjastic website. Don't have a lot of time to debug it, so it's being a pain.

[TryNinja]

The situation has improved and most posts missing from previous downtime were scraped.

Soon will do a full scan for what else may be missing on the entire archive.