[BETA] [NEW] beta.ninjastic.space (forum search, archive and data visualization)

[TryNinja]

Yet again, I'm releasing a new beta for the new ninjastic.space website.

I had previously released a beta focused on a new search mechanism which was deemed too confusing for some people, so I decided to take a different route and also took some time to work on more pages besides searching. First, old, now deactivated beta: [deprecated] [BETA] NEW ninjastic.space search

There is still a lot of work to be done (tons of features to implement), but I think building in public is better since I can get feedback and change stuff a lot faster. Posts searching is done so that's why I'm releasing this now.

The new website can be accessed here: https://beta.ninjastic.space

The new website is faster, has (or will have) more features, and will make my life easier when working on new features.

A bunch of small things have been added, like images loading through my own proxy (until now, old forum-proxied images appear broken because their url are invalid, so you can't see images on older archived posts). Or quickly add an user, topic, or board from the search results list to the filters.


Posts and merits

You can see merits data when searching or looking at the archived posts. Click the small scroll icon on the post header (next to merits) to see a full log of merit txs fot that post.



^NEW Shows post edit versions (and deletions!)






Better post searching



- multiple users
- multiple topics
- multiple boards
- exclude authors, topics, boards
- posts with or without merits
- posts with X merit received
- posts merited by X or Y user
- search only the unquoted content of the post
- search only the quoted content of the post
- posts with quotes from X user
- posts with a specific word inside a quote
- sort by relevance (i.e better word matching), newest/oldest, more/fewer merits.

- Search with natural language on the command dialog (ctrl + K). For example: Posts from TryNinja that received at least 1 merit from LoyceV, on board Meta, since last month.
- Search edited posts as well (disable on "others" filter button)! ^NEW

EXAMPLE: Posts by TryNinja or Loyce on board Meta+childs that have received at least 10 merits, ordered by merits count (desc): https://beta.ninjastic.space/search?author=TryNinja,LoyceV&board_id=24&child_boards=true&merit_min=10&limit=20&sort_by=merits_desc

You can also filter posts inside a topic archive page, for example, topic #5273824 (original ninjastic.space) but only posts by TryNinja: https://beta.ninjastic.space/topic/5273824?author=TryNinja&sort_by=date_asc


User profiles and charts

User profiles will include a lot more data. For example, see someone's entire post and merit monthly/daily chart. You can click on a chart date point to see all txs on that period (i.e all merits on a month or day to see what that merit peak was): https://beta.ninjastic.space/user/id/557798





The same is also valid for other charts, like the top 24h merit senders/receivers on the home page.



Things to come

Almost every day I'll try to have new features released, so expect things to change fast.

Some stuff coming soon:

- Boards page with charts and data about most active users, merit senders/receivers, topics, etc... on all different boards.
- Addresses search and data page (like the current website, but much improved: https://ninjastic.space/addresses).
- Merits tab on the user page for better data visualization, search merits, see who merits who and on which topics and boards, etc...\
- Post edit history (will be a lot better than what we current have).
- [insert your idea here]

[Hatchy]

This is pretty better than the previous version TryNinja. I tried hovering round the new features and they seem to be working very fine. I also like the idea of merit data you added as well. I would request if you could add a button for user to be able to tweek between light or dark mode, while using the site. Though dark mode is fine, but not all user would enjoy using the dark as default mode. Congratulations on this mate.

[LoyceV]

First impression: the graph really highlights how crazy ICO times were on Bitcointalk!
A short test shows the search works fine. I can get used to this

You caught me right after I unloaded some sMerit yesterday:

Note: the sorting can be improved.

[ABCbits]

Some thoughts and feedback.
1. Some of the statistic reminds me of Bitcointalk Merit Dashboard by DdmrDDmr on https://public.tableau.com/app/profile/ddmrddmr/viz/BitcointalkMeritDashboard/GlobalSummary. You could visit his dashboard to get some ideas.
2. Chart "Merits Showing merits per month" currently have start date somewhere before 2016, but IIRC merit system introduced somewhere on late 2017/early 2018. So you may want to change start date for this chart.
3. Personally i'd like to see chart about total post and merit/post ratio for each board.

I would request if you could add a button for user to be able to tweek between light or dark mode, while using the site. Though dark mode is fine, but not all user would enjoy using the dark as default mode.

FWIW, the website shows light mode when i accessed it with Tor Browser. So i expect your experience is related with your browser/OS configuration.

[SFR10]

- [insert your idea here]

Concerning the stats on a user's page, is it possible to have the same line chart functions ^{[Last week/last month/Last year/All time]} for the bar graph of the most active boards section?
^{- It doesn't have to be a separate function, so it can automatically apply to this part as well.}

FWIW, I really like its smoothness ^{[especially for the line charts]} and how posts are shown ^{[it feels like SMF or rather exactly this forum]}.

[examplens]

At first look, here is one bug
For example, to view merit by period, it is not possible to click on "click to view data" because the hint cloud moves with the pointer (on desktop PC)

[TryNinja]

This is pretty better than the previous version TryNinja. I tried hovering round the new features and they seem to be working very fine. I also like the idea of merit data you added as well. I would request if you could add a button for user to be able to tweek between light or dark mode, while using the site. Though dark mode is fine, but not all user would enjoy using the dark as default mode. Congratulations on this mate.

There is already a light and dark mode switch. I guess you're on mobile? I forgot to add the button on the responsive sidebar, it should be there now.

Note: the sorting can be improved.

Fixed.

2. Chart "Merits Showing merits per month" currently have start date somewhere before 2016, but IIRC merit system introduced somewhere on late 2017/early 2018. So you may want to change start date for this chart.

That's because both charts (posts and merits) are synced so you can compare everything in the same period. You can see that better if you click the "last month" button or brush a specific period.

3. Personally i'd like to see chart about total post and merit/post ratio for each board.

It will be added.

Concerning the stats on a user's page, is it possible to have the same line chart functions ^{[Last week/last month/Last year/All time]} for the bar graph of the most active boards section?

Yes, I'll add that. It makes sense to see where someone posted the most recently.

At first look, here is one bug
For example, to view merit by period, it is not possible to click on "click to view data" because the hint cloud moves with the pointer (on desktop PC)

Just click the chart, you don't actually need to click on the hovered tooltip.

Here is a video I just recorded: https://streamable.com/7pz24y

I'll change the wording.

[criptoevangelista]

Very good @TryNinja, excellent, I am always impressed with this type of work that the community does here for the
forum, simply incredible and impeccable... I wish you much success in everything you do.

[TryNinja]

Most active boards on user page now show the data for the selected date range (cc @SFR10).

Here is a demo gif:




And new:
- You can now click on the user's post chart and most active boards chart to quickly search results associated to that data point. That is, click the "Meta" bar to quickly go to the search page with the filters for the user, board, and period date range.

[dkbit98]

I appreciate you are working on updating Ninjastic.space website, and I will try to give my honest feedback here.
Maybe I am used to current website style but I don't like the way new website is showing recent posts, that is basically just titles.
I like how old version had the option to show Normal, Collapsed and Compact style, so you should bring that back on new version.
Another thing I want to see is always active search bar field on top, so that we can search any text without clicking and opening new page.
I will do more testing and report later if I see more things that needs to be improved.

[un_rank]

I love how responsive the website is and the color scheme. The user section also allows me select the user I want when I type in the first few letters which will be useful when you cannot quite remember the username but have an idea of it.

Great work as always TryNinja, this is an awesome design.

- Jay -

[Vod]

Well done, OP!  A modern responsive look, and much faster than your old site!

Do you have an API designed yet?  I'd like to be one of the testers, if I may. 

I long ago gave up on my search engine, cause who can compete with the energy and resourcefulness of a ninja?   Combined with the reliability of Loyce's (non-database) parsing, there is no need for me to grab posts other than for personal archive and I'd like to even give up on that once you or Loyce gets an API.

The early beta release, can it be tied to competition?     https://bitcointalk.org/index.php?topic=5503125.0  I think his tool will be used different than yours, but I have concerns about the way he is collecting data and his solution to duplicates.  :/  In any case, I hope the two of you can work together and refer users to the other site when applicable.    I hope the two of you do not go into competition (that's why I left the feature development) because with today's modern frameworks, you'll each be building the same thing and will be rushing to get features out before they are fully tested!   Luckily, common mistakes like SQL injection are a thing of the past, but new vulnerabilities will be introduced every day.

If you don't mind, I'll give you some feedback after I Use it for a while. 

[TryNinja]

Maybe I am used to current website style but I don't like the way new website is showing recent posts, that is basically just titles.

Well, the current website doesn't have any "recent posts" list so anything at all is an improvement. It makes the home page slicker with the real time updating and gives a feeling of a forum that is alive.

I like how old version had the option to show Normal, Collapsed and Compact style, so you should bring that back on new version.

That's planned.

Another thing I want to see is always active search bar field on top, so that we can search any text without clicking and opening new page.

I've added a fixed header which should show a search bar when scrolling down the search page. I have a few other ideas to maybe make accessing a post/topic/user archive faster.

Do you have an API designed yet?  I'd like to be one of the testers, if I may.  

Nope, but the old one still works fine (I lost the docs page code, though): api.ninjastic.space

The early beta release, can it be tied to competition?    https://bitcointalk.org/index.php?topic=5503125.0  I think his tool will be used different than yours, but I have concerns about the way he is collecting data and his solution to duplicates.  :/  In any case, I hope the two of you can work together and refer users to the other site when applicable.    I hope the two of you do not go into competition (that's why I left the feature development) because with today's modern frameworks, you'll each be building the same thing and will be rushing to get features out before they are fully tested!   Luckily, common mistakes like SQL injection are a thing of the past, but new vulnerabilities will be introduced every day.

NotATether has other plans with his websites and I wish he succeeds in making his google-like search engine. Mine is more of an archive and data visualization/analytics.

All feedback and good ideas are very welcomed.

[rdluffy]

Congratulations TryNinja!
It's a very good tool, especially for campaign managers, I imagine it will make their work even easier and more complete

I really like visualizing my statistics and seeing them in graphs

I'm going to spend some time discovering the features here
I found Most active topics interesting, and I really like the more minimalist, simple and effective design of the page, it's looking really good and easy to find things

[joker_josue]

Great job TryNinja, congratulations.

I'll give you some suggestions for the home page (which in my opinion is already very good).

- In the scrollbar of the latest posts (the idea is very interesting), when clicking it goes to the post page within Ninjastic, but it could be interesting to have a button that takes you directly to the forum post. You could put the "open post" icon next to the minutes, for example.

- In the "Most active topics" section you could add a droplist, which would give you the possibility to choose a tab. Because the chance of only posts from the gambling tab appearing is very high. It would be interesting to understand which posts were most popular in the last 24 hours in other tabs.

- In the tops section, it could be interesting to see the top of those who created the most topics and those who made the most posts.

[Mitchell]

The new version looks amazing, well done! Having said that, searching for URLs still doesn't work as expected (for both the old and new version).

Searching for chainnews24 returns zero results (now one because of this post), but I expect to find this post. Malware site, do not actually visit.

[TryNinja]

- In the scrollbar of the latest posts (the idea is very interesting), when clicking it goes to the post page within Ninjastic, but it could be interesting to have a button that takes you directly to the forum post. You could put the "open post" icon next to the minutes, for example.

Added, will push it with some other changes soon.

- In the "Most active topics" section you could add a droplist, which would give you the possibility to choose a tab. Because the chance of only posts from the gambling tab appearing is very high. It would be interesting to understand which posts were most popular in the last 24 hours in other tabs.

Also added. The boards page will also allow you to see this data about specific boards more easily.

- In the tops section, it could be interesting to see the top of those who created the most topics and those who made the most posts.

Also added.

Great suggestions, thanks.

The new version looks amazing, well done! Having said that, searching for URLs still doesn't work as expected (for both the old and new version).

Searching for chainnews24 returns zero results (now one because of this post), but I expect to find this post. Malware site, do not actually visit.

https://beta.ninjastic.space/search?content=nstoken.chainnews24 works, because that's what my database sees as the full URL (nstoken.chainnews24 != chainnews24). I'll see if I can break the URL in smaller tokens so something like beta.ninjastic.space is found when you search for ninjastic.space (right now they are two different things, like in your case).

[TryNinja]

Few updates...

- It's now easier to find urls, for example, this was fixed and searching for "chainnews24" now returns all posts with that url:

Searching for chainnews24 returns zero results (now one because of this post), but I expect to find this post. Malware site, do not actually visit.

Or as reported by LoyceV ages ago, now also fixed:

Allow me to adjust this request: it seems like you exclude  URLs from the "default" posts search, so if I search for "smartprivatekeyhack", I don't get to see this post. I'm pretty sure it's a scam, and wanted to check if more accounts posted that link.
I can use my own tools, but yours is faster.

- Fixed usernames being all lowercase when doing aggregations as reported by @Rikafip here (also valid for the old ninjastic.space).

- Added "Most active users" bar chart on the home page.

- Added optional "Flexible content" filter to search for stuff that doesn't need to match all keywords (For example, searching "i love pizza" will return posts that have love or pizza. You can sort by Relevance to order the results by the ones that better match your search).

And some more.

[joker_josue]

- Added "Most active users" bar chart on the home page.

Good improvements.

Can you create a filter in this field to remove bot users from the list? It might be complicated, because it would require you to create a database for these users. But, here's a suggestion.

[dkbit98]

Few updates...

Can you add searching of members with ID numbers?
For example your ID is 557798 and it is visible in NinjasticBeta profile page, but nothing comes up if I enter this number in user search field.
I guess that number shown next to the username in search field is total number of posts including deleted.

Another small suggestion is to make Ninjasitc logo clickable, and that should open main page.