Ninjastic.space - BitcoinTalk Post/Address archive + API

[dkbit98]

I have tried many times to view my profile details from this website but why my profile details are not showing up?  Please request the knowledgeable members of the forum to solve my problem.

This is weird, and I think it's probably a bug, but you can try contacting developer TryNinja and see if he can fix this for you manually.
I checked several newbie profiles and they all have normal graphical board activity pie chart shown, so you are the only one I saw with this issue.
Maybe there was some issues with Ninjastic servers on the day when you registered in forum on October 19.

[1714280428]

1714280428

[1714280428]

1714280428

[1714280428]

1714280428

[1714280428]

1714280428

[1714280428]

1714280428

[1714280428]

1714280428

[TryNinja]

I have tried many times to view my profile details from this website but why my profile details are not showing up?  Please request the knowledgeable members of the forum to solve my problem.

Thanks.

Fixed an issue where some pages would return the wrong userId and thus the wrong data (i.e yours was returning "Velinda LDL").

[LDL]

I have tried many times to view my profile details from this website but why my profile details are not showing up?  Please request the knowledgeable members of the forum to solve my problem.

Thanks.

Fixed an issue where some pages would return the wrong userId and thus the wrong data (i.e yours was returning "Velinda LDL").

My problem is already solved.  I can see all the activity on my profile now.  Many thanks to TryNinja for solving my problem.

[Rikafip]

Hey @TryNinja

I don't know if you noticed, but new local board (Nigerian) has been created so when you plan to add it? I have to start working on a new monthly overview and I can't do it without you updating ninjastic.space first. Cheers! 

[TryNinja]

I don't know if you noticed, but new local board (Nigerian) has been created so when you plan to add it? I have to start working on a new monthly overview and I can't do it without you updating ninjastic.space first. Cheers! 

Thank you for the warning. It has been added!

[Rikafip]

Thank you for the warning. It has been added!

That was quick, cheers!

edit: Hm, boards there are sorted by the date of creation right, so Nigerian should be at the bottom? Anyway, for some reason I just can't find it so I don't know if its just me being incapable or if it will take some time to actually appear?

[hosseinimr93]

Anyway, for some reason I just can't find it so I don't know if its just me being incapable or if it will take some time to actually appear?

I don't think the problem is on your side.
I can't find Nigerian in the boards list either. I even did a hard refresh with CRTL+F5, but it wasn't helpful.

[bitcampaign]

website error doesn't seem to count properly even stopped counting post count, has anyone seen it

[LoyceV]

doesn't seem to count properly

See Forum's Cloudflare turned to always on? (S.O.S bots). For the last 3 hours and 17 minutes, Cloudflare is blocking my scraping

[bitcampaign]

doesn't seem to count properly

See Forum's Cloudflare turned to always on? (S.O.S bots). For the last 3 hours and 17 minutes, Cloudflare is blocking my scraping

it really worries me to make a post if it doesn't count there because almost the average signature campaign organizer always uses ninjastic as a reference, will the problem be solved

[FatFork]

it really worries me to make a post if it doesn't count there because almost the average signature campaign organizer always uses ninjastic as a reference, will the problem be solved

Oh, no need to worry your pretty little head about it. After all, it's not like you're participating in any signature campaigns or anything. 

[Hispo]

Ninjastic and the Telegram bot seems to be back on track and working as intended, however it catches my attention that Ninjastic webpage did not update properly and do not seem to register the posts I made during the down time, it only started counting after it came online again, I believe it happens the same with a couple of merits I received today.

[TryNinja]

Anyway, for some reason I just can't find it so I don't know if its just me being incapable or if it will take some time to actually appear?

I don't think the problem is on your side.
I can't find Nigerian in the boards list either. I even did a hard refresh with CRTL+F5, but it wasn't helpful.

Sorry, some caching issues on my end. Try now.


After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck.

[Rikafip]

Sorry, some caching issues on my end. Try now.

Yeah I can see now Nigerian board, thanks once again! And no worries, I wasn't in a big hurry as I can't start with the local boards overview before year is over anyway.

After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck.

It would be great if you could somehow add posts written in their original thread.

[joker_josue]

After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck.

These are things that happen... you need to be patient.
You will be able to recover the data that was not collected, as they are still here. 

[LoyceV]

maybe look at bypassing CF. Wish me luck.

Good luck
The only thing I could think of, was using an actual Firefox browser to open and save a page, but I couldn't get it working.

[TryNinja]

After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck.

Update: theymos has whitelisted my bot, so probably no more downtime related to Cloudflare.

Thanks @LoyceV for asking for it.

[PowerGlove]

After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck.

Did you ever get around to doing this? (Sorry to bug you so soon after your adventure holiday. Hope you had a blast, by the way.)

Are outage-related "holes" in your data something you have any defense for? Do you repair them manually after each outage, or are they automatically repaired (given enough time) with periodic re-scraping?

Asking because I spotted some merit (the middle transaction, from ETFbitcoin) that didn't make it into your database:

[TryNinja]

After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck.

Did you ever get around to doing this? (Sorry to bug you so soon after your adventure holiday. Hope you had a blast, by the way.)

Not yet, but I see how this is important, so I plan to prioritize it this week. Thanks for the reminder.

Are outage-related "holes" in your data something you have any defense for? Do you repair them manually after each outage, or are they automatically repaired (given enough time) with periodic re-scraping?

Nope, which I agree isn't ideal. I also plan to work on it this week.

[TryNinja]

I'm thinking about doing some changes to my database's structure to make it easier to develop some new features.

Instead of archiving each post with the author and author_uid field, insert only the author_uid which will reference the user/author from another table.

table posts

post_id    topic_id   author_uid
1234       4321       557798

table authors

author      author_uid
TryNinja    557798

What this changes: If someone changes their username, that will be changed for all of his posts (old and new).

Example: TheBeardedBaby === iasenko

TheBeardedBaby https://loyce.club/archive/posts/6172/61728758.html
iasenko https://loyce.club/archive/oldposts/241/241988xx.html#msg24198805

His first post (and all others made when he had the username iasenko), would now show up as TheBeardedBaby instead.


Since this change requires a lot of work and time (especially to update the database entries), I want to know if anyone has anything against the idea (cc @LoyceV)