Ninjastic.space - BitcoinTalk Post/Address archive + API

[LoyceV]

For example, this post of yours: Re: TalkImg.com - Image hosting for BitcoinTalk, image appears invalid on Ninjastic [1].

It's the same on loyce.club.
The image on Bitcointalk links to:

Code:

https://talkimg.com/images/2023/05/10/msedge_7bHLnl7tph8fdbbc2c847cfb7d.png

And the archived one links to:

Code:

https://ip.bitcointalk.org/?u=https%3A%2F%2Ftalkimg.com%2Fimages%2F2023%2F05%2F10%2Fmsedge_7bHLnl7tph8fdbbc2c847cfb7d.png&t=649&c=6mSbYXUeWRSXOg

If you check the page source of the current post on Bitcointalk, you'll see this link:

Code:

https://ip.bitcointalk.org/?u=https%3A%2F%2Ftalkimg.com%2Fimages%2F2023%2F05%2F10%2Fmsedge_7bHLnl7tph8fdbbc2c847cfb7d.png&t=653&c=WqDhtvY22P0aDw

I'm think the part after ".png" is created by Bitcointalk's image proxy, and the rest of the link is exactly the same. Both links don't work if I enter them directly into my browser. That makes me believe joker_josue fixed limiting talkimg.com to only Bitcointalk. I'll post in his topic.

[1714253771]

1714253771

[1714253771]

1714253771

[1714253771]

1714253771

[xLays]

I tried to search a Bitcoin Address using Ninjastic.space that only posted on their profile. Which I mean the bitcoin address can you only see here:
https://bitcointalk.org/index.php?action=profile (addresses never posted in threads or any topic)

The search result of the address is 0 since it was not posted in any thread & topic. Is it posible that you can add this feature where once we search a bitcoin address the profile bitcoin addresses will be included to the search result?

[LoyceV]

Is it posible that you can add this feature where once we search a bitcoin address the profile bitcoin addresses will be included to the search result?

Your best bet it probably just to use Google:

Code:

site:bitcointalk.org 1NXYoJ5xU91Jp83XfVMHwwTUyZFK64BoAD

Downloading all profiles once would take at least 6 weeks, and about 150 GB forum bandwidth. Checking them all on a regular basis is even worse.
If you know which profile you're looking for, you may find an old snapshot on one of the archive sites (archive.org, archive.is and more).

[dkbit98]

I tried to search a Bitcoin Address using Ninjastic.space that only posted on their profile.

Ninjastic can't search any information posted in member profiles including addresses, and I don't think it can search stuff posted in signatures.
So for example if I post random bitcoin address in my signature, it won't be detected by Ninjastic, someone correct me if I am wrong.

[Bitcoin_Arena]

Could Ninjastic be missing out on some results.

I search about all the addresses posted by this user: Jocuserious and also checked the "include child boards" check box - https://ninjastic.space/addresses?author=Jocuserious&child_boards=true

It shows all the other addresses he posted except the recent one. Any ideas on what happened?

[TryNinja]

Could Ninjastic be missing out on some results.

I search about all the addresses posted by this user: Jocuserious and also checked the "include child boards" check box - https://ninjastic.space/addresses?author=Jocuserious&child_boards=true

It shows all the other addresses he posted except the recent one. Any ideas on what happened?

https://ninjastic.space/post/62873121

[nutildah]

I think I broke your website 

I was jiggling it too hard and now I'm just getting a "Something went wrong..." message, when the page can load at all.

My bad.

[TryNinja]

I think I broke your website 

I was jiggling it too hard and now I'm just getting a "Something went wrong..." message, when the page can load at all.

My bad.

I think you're fine, lol. My server just lost connection for a bit apparently (?) since I see a bunch of "Temporary failure in name resolution" errors.

[dkbit98]

I was jiggling it too hard and now I'm just getting a "Something went wrong..." message, when the page can load at all.

I am getting a lot more similar messages on other websites in last few weeks, so maybe it's not just issue with Ninjastic.space.
Using Tor browser different IP address usually works as a quick fix for me.

[DYING_S0UL]

~snip~

Hey, TryNinja  

I have noticed something with Ninjastic. I joined the YoMix signature campaign on October 21, posting my BTC address. So the issue is that I can't find my address when I search for it on Ninjastic. There aren't any favorite addresses either. I don't know how many days it takes to update the Ninjastic database. So I'm a little confused, as a week has passed since my post. Maybe you can give some clarity to it.

Cheers,
DYING_S0UL

[TryNinja]

I have noticed something with Ninjastic. I joined the YoMix signature campaign on October 21, posting my BTC address. So the issue is that I can't find my address when I search for it on Ninjastic. There aren't any favorite addresses either. I don't know how many days it takes to update the Ninjastic database. So I'm a little confused, as a week has passed since my post. Maybe you can give some clarity to it.

Because you originally posted "res" and only after edited the post with your address.

https://ninjastic.space/post/63032633

The scraper currently doesn't check addresses on edits.

[DYING_S0UL]

Becauase you originally posted "res" and only after edited the post with your address.

https://ninjastic.space/post/63032633

The scraper currently doesn't check addresses on edits.

Ow I see. Understood, Thanks  

[PytagoraZ]

I have noticed something with Ninjastic. I joined the YoMix signature campaign on October 21, posting my BTC address. So the issue is that I can't find my address when I search for it on Ninjastic. There aren't any favorite addresses either. I don't know how many days it takes to update the Ninjastic database. So I'm a little confused, as a week has passed since my post. Maybe you can give some clarity to it.

Becauase you originally posted "res" and only after edited the post with your address.

https://ninjastic.space/post/63032633

The scraper currently doesn't check addresses on edits.

I did testing on this. It turned out to be true, Ninjastic only recorded the address in the initial post and did not record the address after editing.

https://bitcointalk.org/index.php?topic=5475270.msg63210828#msg63210828

Will ninjastic only record the initial post? Ninjastic won't record if members edit it multiple times?

[DYING_S0UL]

Becauase you originally posted "res" and only after edited the post with your address.
https://ninjastic.space/post/63032633
The scraper currently doesn't check addresses on edits.

I did testing on this. It turned out to be true, Ninjastic only recorded the address in the initial post and did not record the address after editing.
https://bitcointalk.org/index.php?topic=5475270.msg63210828#msg63210828
Will ninjastic only record the initial post? Ninjastic won't record if members edit it multiple times?

Is it only true for address only? I mean, I know we can check content also, if anything was changed and look for the changes. But what if we edit it like 10 times. Will it record it all? Or will it just show the difference between the initial and ending part? The middle edits won't record. If that were true, anything can be written in the middle and not get caught with it. I guess I'll have to test it to prove my theory. Who knows!

[komisariatku]

Becauase you originally posted "res" and only after edited the post with your address.
https://ninjastic.space/post/63032633
The scraper currently doesn't check addresses on edits.

I did testing on this. It turned out to be true, Ninjastic only recorded the address in the initial post and did not record the address after editing.
https://bitcointalk.org/index.php?topic=5475270.msg63210828#msg63210828
Will ninjastic only record the initial post? Ninjastic won't record if members edit it multiple times?

Is it only true for address only? I mean, I know we can check content also, if anything was changed and look for the changes. But what if we edit it like 10 times. Will it record it all? Or will it just show the difference between the initial and ending part? The middle edits won't record. If that were true, anything can be written in the middle and not get caught with it. I guess I'll have to test it to prove my theory. Who knows!

I'm guessing that ninjastic only records the initial post and doesn't record subsequent posts if they have been edited. This can be used by members who do not want their addresses recorded by Ninjastic, so they can add addresses by editing posts

I think so because ninjastic only displays original posts and does not display edited posts. But I've never experimented with it. You can try

[PytagoraZ]

Becauase you originally posted "res" and only after edited the post with your address.
https://ninjastic.space/post/63032633
The scraper currently doesn't check addresses on edits.

I did testing on this. It turned out to be true, Ninjastic only recorded the address in the initial post and did not record the address after editing.
https://bitcointalk.org/index.php?topic=5475270.msg63210828#msg63210828
Will ninjastic only record the initial post? Ninjastic won't record if members edit it multiple times?

Is it only true for address only? I mean, I know we can check content also, if anything was changed and look for the changes. But what if we edit it like 10 times. Will it record it all? Or will it just show the difference between the initial and ending part? The middle edits won't record. If that were true, anything can be written in the middle and not get caught with it. I guess I'll have to test it to prove my theory. Who knows!

I do not know about that. However, for the experiment I did, Ninjastic only displayed my unedited posts. Maybe ninjastic doesn't record edited posts or maybe ninjastic takes longer for edited posts to be recorded.

[Vod]

I do not know about that. However, for the experiment I did, Ninjastic only displayed my unedited posts. Maybe ninjastic doesn't record edited posts or maybe ninjastic takes longer for edited posts to be recorded.

He probably grabs them the same way I did - from the recent posts on the front page.   I couldn't figure out a way to detect an edited post to re-scrape it.

[PX-Z]

I do not know about that. However, for the experiment I did, Ninjastic only displayed my unedited posts. Maybe ninjastic doesn't record edited posts or maybe ninjastic takes longer for edited posts to be recorded.

It is, but only after 5 minutes. So if you edited your posts so many times at least 4x before that time ^{(5 minutes)}, then probably the last thing it will record is the post content after 5 minutes.

- Check the unedited/archived posts along with their edited version made up to 5 minutes later.

[joker_josue]

I do not know about that. However, for the experiment I did, Ninjastic only displayed my unedited posts. Maybe ninjastic doesn't record edited posts or maybe ninjastic takes longer for edited posts to be recorded.

It is, but only after 5 minutes. So if you edited your posts so many times at least 4x before that time ^{(5 minutes)}, then probably the last thing it will record is the post content after 5 minutes.

- Check the unedited/archived posts along with their edited version made up to 5 minutes later.

Exactly. Basically, the site only does two scrapes: one when the post is made, and another 5 minutes later.
Everything that is done between 1 second and 5 minutes is not recorded, only what exists in minute 5. Any edits made after minute 5 will not be recorded.

I think there are cases where OPs would make sense to do more scraping, even if it was through solition. But, I understand why this is not the case.

[FatFork]

I do not know about that. However, for the experiment I did, Ninjastic only displayed my unedited posts. Maybe ninjastic doesn't record edited posts or maybe ninjastic takes longer for edited posts to be recorded.

It is, but only after 5 minutes. So if you edited your posts so many times at least 4x before that time ^{(5 minutes)}, then probably the last thing it will record is the post content after 5 minutes.

- Check the unedited/archived posts along with their edited version made up to 5 minutes later.

Exactly. Basically, the site only does two scrapes: one when the post is made, and another 5 minutes later.
Everything that is done between 1 second and 5 minutes is not recorded, only what exists in minute 5. Any edits made after minute 5 will not be recorded.

I think there are cases where OPs would make sense to do more scraping, even if it was through solition. But, I understand why this is not the case.

That's right.  Bitcointalk has so many posts that scraping all of them continuously is not feasible and  you're right - With millions of new posts popping up all the time, it's impossible to keep track of every single edit made on every single post. Essentially, any edits made between scrape A and scrape B would be missed.  And anything edited after the most recent scrape would be missed too.