⭕️ BitList.co - Bitcointalk Archive | Data Visualization & Search 🔍 [Ninjastic]

[ABCbits]

@TryNinja these subdomain currently can't be accessed.

https://status.ninjastic.space/
https://docs.ninjastic.space/

Firefox shows code SSL_ERROR_INTERNAL_ERROR_ALERT", while Chromium shows code "ERR_SSL_PROTOCOL_ERROR". You may want to check those subdomain.

[msampa]

@TryNinja Same issue for me, can't reach the API documentation on https://docs.ninjastic.space/, SSL issue.

Do you guys know if there is any API endpoint to search by keyword in the posts content?

Thanks

[ABCbits]

Do you guys know if there is any API endpoint to search by keyword in the posts content?

You can visit https://ninjastic.space/search, enable developer tool to enter Network tab and then perform search to discover how to use the API. Here's an example when i search "electrum" on post content.

Code:

GET https://api.ninjastic.space/posts?content=electrum&limit=100

[TryNinja]

@TryNinja Same issue for me, can't reach the API documentation on https://docs.ninjastic.space/, SSL issue.

Do you guys know if there is any API endpoint to search by keyword in the posts content?

Thanks

I migrated servers and forgot about the API docs. Now I'm looking for them and don't think I have the schema anymore (my old server is down for good).

I'm working on a new website, so not worth doing everything again. If you need anything, feel free to ask and I'll help you out.

For now:

https://api.ninjastic.space/posts

Code:

author
- string for username

author_uid
- number for user id

content
- elasticsearch simple query string (https://www.elastic.co/guide/en/elasticsearch/reference/current/query-dsl-simple-query-string-query.html)
- example, posts with bitcoin that don't have the word ethereum: bitcoin -ethereum
- example, posts with the exact phrase bitcoin is awesome: "bitcoin is awesome" (remember to include the quotes)

title
- elasticsearch simple query string

topic_id
- number for topic id

board
- number for board id

child_boards
- 1 or true to search for child boards from board id

last
- post id greater than

after
- post id lower than

after_date
- date greater than or equal

before_date
- date lower than or equal

limit
- results per request (max of 200)

order
- "asc" or "desc, ordering by date

[TryNinja]

I'm working for real on a new website from the ground up, new tech, faster, a lot more details.

Which features do you miss the most on the current website? Any feedback is appreciated!

I think people will like the many improvements, just a matter of time until a beta is released.

[Rikafip]

@TryNinja I don't know why, but every time I generate liste, it gives me names of users without capital letters, and its been going on for at least few days now.

Am I doing something wrong, or there is a problem on ninjastic.space side?

[TryNinja]

@TryNinja I don't know why, but every time I generate liste, it gives me names of users without capital letters, and its been going on for at least few days now.

Am I doing something wrong, or there is a problem on ninjastic.space side?

During the server migration, while I reindexed the data, I forgot a detail which indexed the usernames in lowercase, initially necessary for case insensitive searches. I'll have to run another reindex with the fixed values.

[Rikafip]

During the server migration, while I reindexed the data, I forgot a detail which indexed the usernames lowercased, initially necessary for case insensitive searches. I'll have to run another reindex with the fixed values.

Cheers!

I noticed something was wrong few days ago when I was making that local boards overview, but I thought I messed up something as I tried to automate table creation, only now (when I was making overview for my local board) to realize its actually on ninjastic.space side.

[examplens]

I saw this by accident, although I didn't even know it existed until now. The loading balance of some addresses seems to have a certain problem, so after a while, the message "Something went wrong..." appears.

[LoyceV]

Can you look into this?

ninjastic.space has missed at least one wallet address he's posted: [link] ~

Code:

1CHAriTyyuCzLdXshSDVohyjgxTxW9Bhx

Search by address doesn't show the user's post, but search by username and address shows it.

[TryNinja]

Can you look into this?

ninjastic.space has missed at least one wallet address he's posted: [link] ~

Code:

1CHAriTyyuCzLdXshSDVohyjgxTxW9Bhx

Search by address doesn't show the user's post, but search by username and address shows it.

Thanks. I think my scraper missed it because of the period right after the address.

1CHAriTyyuCzLdXshSDVohyjgxTxW9Bhx = ok
1CHAriTyyuCzLdXshSDVohyjgxTxW9Bhx. = not detected as a valid address

I'll confirm this tomorrow and make sure I do a rescan on the entire archive if that's the case, maybe some more addresses were missed.

[msampa]

Hi all,

Do you know what's the API rate limit, as the documentation is not reachable anymore? Any max calls per minute or second or hour?

Thanks,

Marc

[TryNinja]

NEW BETA is up: https://beta.ninjastic.space

Topic for discussion: [BETA] [NEW] beta.ninjastic.space (forum archive and data visualization)

Hi all,

Do you know what's the API rate limit, as the documentation is not reachable anymore? Any max calls per minute or second or hour?

Thanks,

Marc

It's fixed at 100 requests per minute.

[masulum]

Hi bro, I currently have an experimental project but for now I am constrained to do updates, so, maybe I need an API from ninjastic for this experiment, can I use it? for the web that I am working on is more focused on grouping members who participate in the bitcointalk signature campaign. statistical data such as merit, last 8 days posts and others, if I do scrape continuously, it might be less effective, if the scrape is scheduled it might be possible, but the data update might be slower. especially having to think about how to avoid blocking access. from Bitcointalk

just preview.

[Crypto Library]

I don't know if this kind of suggestion has already been made and if it has been done, I apologize in advance.

My suggestion is that when we search using your ninjastic.space with this kind of filter, all the deleted posts and non-deleted posts of that week come together in front of us.
In which many times during campaign management, we don't find that which posts were been deleted and which weren't deleted, so we count them all. I'm not saying that we can't go and check each post individually, but the tools are for making our life more easy, which your ninjastic.space has done for us already, so I want to say through my suggestion that there are enough searching parameters here, if you want, you can add another parameter like "excluding deleted post". Then we can only see the posts that are in forum from that member.


For example something like this or that's what you prefer:

[TryNinja]

Hi bro, I currently have an experimental project but for now I am constrained to do updates, so, maybe I need an API from ninjastic for this experiment, can I use it? for the web that I am working on is more focused on grouping members who participate in the bitcointalk signature campaign. statistical data such as merit, last 8 days posts and others, if I do scrape continuously, it might be less effective, if the scrape is scheduled it might be possible, but the data update might be slower. especially having to think about how to avoid blocking access. from Bitcointalk

Yes, you can use the API as long as there is no abuse (no spam).

There is already a working one, but the docs are gone since I migrated servers. What data do you need?

My suggestion is that when we search using your ninjastic.space with this kind of filter, all the deleted posts and non-deleted posts of that week come together in front of us.
In which many times during campaign management, we don't find that which posts were been deleted and which weren't deleted, so we count them all. I'm not saying that we can't go and check each post individually, but the tools are for making our life more easy, which your ninjastic.space has done for us already, so I want to say through my suggestion that there are enough searching parameters here, if you want, you can add another parameter like "excluding deleted post". Then we can only see the posts that are in forum from that member.

I can add a filter for non-deleted posts on the beta.ninjastic.space search page (have you checked that yet?). But do keep in mind that my scraper only checks posts when they are created, after 5 minutes, 30 minutes, then 7 days. So you might count a post that has been deleted but my scraper just doesn't know yet.

I might consider doing more rescrapes, like every 24h until 7 days have passed.

[joker_josue]

I might consider doing more rescrapes, like every 24h until 7 days have passed.

I think you should create a button system to request a new scrape.
So, the user would click on this button, and the topic/post or the user (you had to see how it would be better), would enter a list of extra scrapings, which would be executed at a certain time of the day.

For example, I want the TalkImg OP to be scraped again after an update. I would go to your site, open the post there and request the scraping. The site would scrape the OP again at midnight. This would only happen again if I or another user made a new request.

[TryNinja]

I might consider doing more rescrapes, like every 24h until 7 days have passed.

I think you should create a button system to request a new scrape.
So, the user would click on this button, and the topic/post or the user (you had to see how it would be better), would enter a list of extra scrapings, which would be executed at a certain time of the day.

For example, I want the TalkImg OP to be scraped again after an update. I would go to your site, open the post there and request the scraping. The site would scrape the OP again at midnight. This would only happen again if I or another user made a new request.

That’s planned but need to thing about how I can prevent abuse. What if someone changes a single character and spam new rescrapes? My db would be filled with crap. Might even change how the changes are stored to save on storage, because right now I store the entire post content, even if the user only adds an extra dot.

[masulum]

Yes, you can use the API as long as there is no abuse (no spam).

There is already a working one, but the docs are gone since I migrated servers. What data do you need?

thanks for that permission, so my plans, I will grab data for profile stats, like merit, merit 120-day, rank, and their last 8 days posts. From api, to my database for cache, and will try to load again after 00:00 UTC to find new data (after online), only for users that already submitted to my websites. it will stop to request if there is no more new data. But I'm still afraid, it is making your db working too hard because this, i will implemented for around 10 users first, just for testing. if someday, i want more data, i will contact you again, to make sure, my sites not making trouble to your website.

[Pmalek]

@TryNinja
I think the beta site of the new Ninjastic Space is missing an important search feature that the old version of the service had. I don't see 'Ignore Topic' anywhere. it's a cool option to have. It removes all search results from a particular thread that you don't want displayed. Does that exist in beta.ninjastic.space under a different name and if not could you please add it?