Bitcoin Forum
March 28, 2024, 11:29:19 AM *
News: Latest Bitcoin Core release: 26.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: [1] 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 »
  Print  
Author Topic: Ninjastic.space - BitcoinTalk Post/Address archive + API  (Read 15079 times)
TryNinja (OP)
Legendary
*
Offline Offline

Activity: 2786
Merit: 6856



View Profile WWW
September 06, 2020, 01:07:12 AM
Last edit: August 16, 2021, 07:45:56 PM by TryNinja
Merited by BlackHatCoiner (50), PowerGlove (50), hugeblack (43), LoyceV (42), nutildah (42), Welsh (40), DarkStar_ (30), dkbit98 (30), fillippone (30), Mitchell (25), vapourminer (24), ABCbits (23), hosseinimr93 (21), NeuroticFish (20), 1miau (20), Rikafip (18), mprep (15), marlboroza (15), xhomerx10 (10), suchmoon (10), dbshck (10), Rath_ (10), Symmetrick (10), o_e_l_e_o (8), ibminer (8), Vod (5), OmegaStarScream (5), AB de Royse777 (5), malevolent (4), Daniel91 (4), NotATether (4), Cyrus (3), stompix (3), DdmrDdmr (3), Tytanowy Janusz (3), JayJuanGee (2), BitMaxz (2), SFR10 (2), crwth (2), witcher_sense (2), bitmover (2), Mahdirakib (2), dragonvslinux (2), Heisenberg_Hunter (2), Csmiami (2), Ryu_Ar1 (2), 0x256 (2), babo (1), mocacinno (1), Lafu (1), eaLiTy (1), actmyname (1), sabotag3x (1), coinlocket$ (1), mole0815 (1), Husna QA (1), ChiBitCTy (1), Bthd (1), TheBeardedBaby (1), bL4nkcode (1), cryptoaddictchie (1), Coyster (1), webtricks (1), famososMuertos (1), Peanutswar (1), -doubleU- (1), SiNeReiNZzz (1), Aveatrex (1), paid2 (1), kaggie (1), DirtyKeyboard (1)
 #1

The new ninjastic.space website is out! Remade from scratch.

Features:

- New darkmode design.
- Search posts by author, topic id, content, date range and/or board.
- Search addresses for posts and connections between users (Bitcoin and Ethereum).
- How many posts/merits were made/sent every day.
- RTL support for RTL-languages (e.g Arabic).
- Check the unedited/archived posts along with their edited version made up to 5 minutes later. NEW
- Check user stats (e.g posts per board, posts per day), mentioned addresses, etc.... NEW

Pages:

- Unedited/archived post: https://ninjastic.space/post/55139442
- Unedited/archived posts on specific topic: https://ninjastic.space/topic/5273824
- Unedited/archived posts by address: https://ninjastic.space/address/1NinjabXd5znM5zgTcmxDVzH4w3nbaY16L
- User stats, favorite topics, deleted/edited posts and addresses: https://ninjastic.space/user/TryNinja NEW

API:

If you have a cool project or project idea that requires any posts/addresses data, I can help you with my REST API.

Here is the documentation: https://docs.ninjastic.space

Source Code:

- https://bitcointalk.org/index.php?topic=5273824.msg57711630#msg57711630

Donations

100% of the donations will be used to pay the bot and website expenses (~$18/month):

BTC Bech32: bc1qlfzjqgleh3pg7l63p9fc596uqv30hqr9dpg59q
BTC Legacy: 1NinjabXd5znM5zgTcmxDVzH4w3nbaY16L

New ideas are highly appreciated!

..JAMBLER.io..Create Your Bitcoin Mixing
Business Now for   F R E E 
▄█████████████████████████████
█████████████████████████
████▀████████████████████
███▀█████▄█▀███▀▀▀██████
██▀█████▄█▄██████████████
██▄▄████▀▄▄▄▀▀▀▀▀▄▄██████
█████▄▄▄██████████▀▄████
█████▀▄█▄██████▀█▄█████
███████▀▄█▀█▄██▀█▄███████
█████████▄█▀▄█▀▄█████████
█████████████████████████
█████████████████████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
      OUR      
PARTNERS

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
▄█████████████████████████████
████████▀▀█████▀▀████████
█████▀█████████████▀█████
████████████████████████
███████████████▄█████████
█████████████████████████
█████████████████████████
█████████████████████████
███████████████▀█████████
████████████████████████
█████▄█████████████▄█████
████████▄▄█████▄▄████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
   INVEST   
BITCOIN

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
Bitcoin mining is now a specialized and very risky industry, just like gold mining. Amateur miners are unlikely to make much money, and may even lose money. Bitcoin is much more than just mining, though!
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
1711625359
Hero Member
*
Offline Offline

Posts: 1711625359

View Profile Personal Message (Offline)

Ignore
1711625359
Reply with quote  #2

1711625359
Report to moderator
1711625359
Hero Member
*
Offline Offline

Posts: 1711625359

View Profile Personal Message (Offline)

Ignore
1711625359
Reply with quote  #2

1711625359
Report to moderator
Tytanowy Janusz
Legendary
*
Offline Offline

Activity: 2142
Merit: 1622


View Profile
September 06, 2020, 06:57:26 AM
Merited by TryNinja (1)
 #2

Great tool. I needed something like that.

Maybe I'm doing something wrong but it looks to me that search function needs a little bug-fix. When i put Topic ID and content bot finds me all post with this content without filtering to given topic.
TryNinja (OP)
Legendary
*
Offline Offline

Activity: 2786
Merit: 6856



View Profile WWW
September 06, 2020, 07:01:00 AM
 #3

Great tool. I needed something like that.

Maybe I'm doing something wrong but it looks to me that search function needs a little bug-fix. When i put Topic ID and content bot finds me all post with this content without filtering to given topic.
Oopss.. forgot an "&" in the query string. Please, try again.

..JAMBLER.io..Create Your Bitcoin Mixing
Business Now for   F R E E 
▄█████████████████████████████
█████████████████████████
████▀████████████████████
███▀█████▄█▀███▀▀▀██████
██▀█████▄█▄██████████████
██▄▄████▀▄▄▄▀▀▀▀▀▄▄██████
█████▄▄▄██████████▀▄████
█████▀▄█▄██████▀█▄█████
███████▀▄█▀█▄██▀█▄███████
█████████▄█▀▄█▀▄█████████
█████████████████████████
█████████████████████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
      OUR      
PARTNERS

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
▄█████████████████████████████
████████▀▀█████▀▀████████
█████▀█████████████▀█████
████████████████████████
███████████████▄█████████
█████████████████████████
█████████████████████████
█████████████████████████
███████████████▀█████████
████████████████████████
█████▄█████████████▄█████
████████▄▄█████▄▄████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
   INVEST   
BITCOIN

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
Tytanowy Janusz
Legendary
*
Offline Offline

Activity: 2142
Merit: 1622


View Profile
September 06, 2020, 07:04:24 AM
Last edit: September 06, 2020, 07:16:31 AM by Tytanowy Janusz
 #4

Oopss.. forgot an "&" in the query string. Please, try again.

Still the same. Put some more "&" Smiley



edit (answering post below to avoid spam):

@TryNinja You were right. Cashed version was the case. It works great now.
TryNinja (OP)
Legendary
*
Offline Offline

Activity: 2786
Merit: 6856



View Profile WWW
September 06, 2020, 07:06:19 AM
 #5

Still the same. Put some more "&" Smiley
I'm 100% sure you are looking at a cached version of the page. Grin

Try Ctrl + F5 to clear the cache and try once again.

..JAMBLER.io..Create Your Bitcoin Mixing
Business Now for   F R E E 
▄█████████████████████████████
█████████████████████████
████▀████████████████████
███▀█████▄█▀███▀▀▀██████
██▀█████▄█▄██████████████
██▄▄████▀▄▄▄▀▀▀▀▀▄▄██████
█████▄▄▄██████████▀▄████
█████▀▄█▄██████▀█▄█████
███████▀▄█▀█▄██▀█▄███████
█████████▄█▀▄█▀▄█████████
█████████████████████████
█████████████████████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
      OUR      
PARTNERS

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
▄█████████████████████████████
████████▀▀█████▀▀████████
█████▀█████████████▀█████
████████████████████████
███████████████▄█████████
█████████████████████████
█████████████████████████
█████████████████████████
███████████████▀█████████
████████████████████████
█████▄█████████████▄█████
████████▄▄█████▄▄████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
   INVEST   
BITCOIN

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
LoyceV
Legendary
*
Offline Offline

Activity: 3262
Merit: 16315


Thick-Skinned Gang Leader and Golden Feather 2021


View Profile WWW
September 06, 2020, 09:05:31 AM
 #6

- New darkmode design.
For archiving purposes, I don't like editing the font colors away from the original.

Quote
- Unedited/archived post: https://ninjastic.space/post/55139442
That's easier than https://loyce.club/archive/posts/5513/55139442.html Smiley Databases FTW Shocked

Quote
(thanks to @LoyceV for his oldposts archive).
You're welcome Smiley Under "archived", it's safe to change "This may or may not represent the time and date the post was made" to something like "This was long after the post was made".
Also: the word is scraped, not scrapped, right?

Quote
- Unedited/archived posts by address
I'll see what I can pull out of your data dump when I have the time Smiley

█▀▀▀











█▄▄▄
▀▀▀▀▀▀▀▀▀▀▀
e
▄▄▄▄▄▄▄▄▄▄▄
█████████████
████████████▄███
██▐███████▄█████▀
█████████▄████▀
███▐████▄███▀
████▐██████▀
█████▀█████
███████████▄
████████████▄
██▄█████▀█████▄
▄█████████▀█████▀
███████████▀██▀
████▀█████████
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
c.h.
▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄
▀▀▀█











▄▄▄█
▄██████▄▄▄
█████████████▄▄
███████████████
███████████████
███████████████
███████████████
███░░█████████
███▌▐█████████
█████████████
███████████▀
██████████▀
████████▀
▀██▀▀
TryNinja (OP)
Legendary
*
Offline Offline

Activity: 2786
Merit: 6856



View Profile WWW
September 06, 2020, 09:15:10 AM
 #7

For archiving purposes, I don't like editing the font colors away from the original.
You have a point. I will change that.

You're welcome Smiley Under "archived", it's safe to change "This may or may not represent the time and date the post was made" to something like "This was long after the post was made".
Also: the word is scraped, not scrapped, right?
Thanks. I still make this mistake more often than I should. Grin

Quote
- Unedited/archived posts by address
I'll see what I can pull out of your data dump when I have the time Smiley
I plan to always make a new dump every few days so anyone can download it when they want/need it. Make sure to take a look at http://public.ninjastic.space to get the latest one when you decide to use it.

..JAMBLER.io..Create Your Bitcoin Mixing
Business Now for   F R E E 
▄█████████████████████████████
█████████████████████████
████▀████████████████████
███▀█████▄█▀███▀▀▀██████
██▀█████▄█▄██████████████
██▄▄████▀▄▄▄▀▀▀▀▀▄▄██████
█████▄▄▄██████████▀▄████
█████▀▄█▄██████▀█▄█████
███████▀▄█▀█▄██▀█▄███████
█████████▄█▀▄█▀▄█████████
█████████████████████████
█████████████████████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
      OUR      
PARTNERS

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
▄█████████████████████████████
████████▀▀█████▀▀████████
█████▀█████████████▀█████
████████████████████████
███████████████▄█████████
█████████████████████████
█████████████████████████
█████████████████████████
███████████████▀█████████
████████████████████████
█████▄█████████████▄█████
████████▄▄█████▄▄████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
   INVEST   
BITCOIN

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
SFR10
Legendary
*
Offline Offline

Activity: 2954
Merit: 3388


Crypto Swap Exchange


View Profile WWW
September 06, 2020, 09:34:25 AM
Merited by OmegaStarScream (1)
 #8

And you can always suggest/ask for a different kind of data. Just post here/PM me.
Is it possible to get the "general statistics for each user [e.g. like this]"?
- I'm after the last two stats (Most Popular Boards By Posts and Activity).

I noticed it shows "(Unknown Title)" for threads written in languages other than English [not a big deal though].
- Apart from that, it looks great. Bookmarked.

█▀▀▀











█▄▄▄
▀▀▀▀▀▀▀▀▀▀▀
e
▄▄▄▄▄▄▄▄▄▄▄
█████████████
████████████▄███
██▐███████▄█████▀
█████████▄████▀
███▐████▄███▀
████▐██████▀
█████▀█████
███████████▄
████████████▄
██▄█████▀█████▄
▄█████████▀█████▀
███████████▀██▀
████▀█████████
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
c.h.
▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄
▀▀▀█











▄▄▄█
▄██████▄▄▄
█████████████▄▄
███████████████
███████████████
███████████████
███████████████
███░░█████████
███▌▐█████████
█████████████
███████████▀
██████████▀
████████▀
▀██▀▀
protrader786
Member
**
Offline Offline

Activity: 104
Merit: 61


View Profile
September 06, 2020, 09:55:42 AM
 #9

<..>
Hey SRF, can I know how you were able to manage to view user stats please? Or is it just an old archive ? When I click on my profile or others profiles to see the stats, it tells me that user stats are disabled. Please let me know.

Earn free BTC, ETH, XRP, TRX, BCH, DOGE every hour just by staying active in the chat, logging into discord, checking telegram and much more
Stalker22
Legendary
*
Offline Offline

Activity: 1456
Merit: 1338



View Profile
September 06, 2020, 10:18:19 AM
 #10

This is a great tool and I'm really glad I came across this thread. Well done, TryNinja!
This can really make it easier to search forum posts, especially when discovering alt accounts of ban evaders or merit abusers.

Hey SRF, can I know how you were able to manage to view user stats please? Or is it just an old archive ? When I click on my profile or others profiles to see the stats, it tells me that user stats are disabled. Please let me know.

I believe it is an old archive. That's why SFR10 asked if TryNinja could do something similar with his data.

█████████████████████████████
█████████▀     ▄██ ▀▀████████
█████▀ ▀██▀▀▀▀▀▀▀▀▀▄▄  ▀█████
████  ▄▀▀▄█████████▄▀▀▄██████
███▄▄█▀▄██████▀ ▀████▄▀█▀ ▀██
██▀▀█▌▐█   ▀▀▀   █████▌▐█  ██
██  █ ███▄▄▄      ▀▀▀▀█ █  ██
██  █▌▐████▌         ▄▌▐█████
███▄██▄▀█████▄   ▄▄██▀▄█ ▀███
████▀ ▀▄▄▀███▀    █▀▄▄▀  ████
█████▄  ▀▀▄▄▄▄▄▄▄▄▄██▄ ▄█████
████████▄▄██       ██████████
█████████████████████████████
         ▄██▄     ▄
        █████   ▄████
       █████▌  █████▌
      ██████████████
     ███▀█████▀██▀████▄
   ▄▄▄▄▄██████████████
 ▄▄██████▄██▄▄██████▄█▀
▐██████████████████████▄
 ▀████████         ████▀
   ▀███████▄     ▄███▀
    ███████████████▀
  ▄█████████████████
▄▄███████████████████▄
               ▄███▄
            ▄████████

        ▄▄██████████
       █▀▀▀██▀▀▀████
      ███████████
    ▀▀▀████████████
      ▀███████████▀
      ▄███████████▄
 ▄
    ▀▀▀▀▀▀▀▀███▀▀   ▄
▀▀█▀▀
███████████▀▀▀█▀▀
    ████████████████
    ████████████████
▄▄▄▄▄▄███████████████▄▄▄▄▄▄
.
..PLAY NOW..
       ▄▄▄▄ ▄▄█████▄
     ████████████████
 ▄▄▄█████████████████████▄
███████████████████████████▄▄
▀█████████████████████████████
  ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
       ▄█▄      ██
    ▄█▄▄█▄▄█▄          ▄▄
    ▄▄▄███▄▄▄    ▄ ▄ ▄ ▀▀
     ▀ ▄█▄ ▀  ▀▄█ ▀█▀ █▄▀
    ▄▄  ▀     ▀▀▀▀███▀▀▀▀
    ▀▀        ▀██▀▀█▀▀██▀
         ██   ▀ ▀▄▀█▀▄▀ ▀
TryNinja (OP)
Legendary
*
Offline Offline

Activity: 2786
Merit: 6856



View Profile WWW
September 06, 2020, 10:24:01 AM
 #11

I really like the feature search post, it's more efficient that using google search and have some unique search option.
Thanks! It was hard to make it usable with 47m+ posts, so I'm glad it's working. I had to learn a lot about how databases work and indexes. It's not perfect, though.

Is it possible to get the "general statistics for each user [e.g. like this]"?
- I'm after the last two stats (Most Popular Boards By Posts and Activity).
Yes! Or kinda of. I'm already working on something like this.

Some stats won't be available, since I can't get them (votes casted, polls created, time spent online, topics created, most popular boards per activity, etc...). But you will be able to see stuff like in which boards you posted the most (and when you did it).

I noticed it shows "(Unknown Title)" for threads written in languages other than English [not a big deal though].
The "Unknown Title" shows up for the posts Loyce provided to me. His data didn't include any title, so I would need to scrape everything from zero to get them. New posts and posts which got notified to a bot user have their title.

..JAMBLER.io..Create Your Bitcoin Mixing
Business Now for   F R E E 
▄█████████████████████████████
█████████████████████████
████▀████████████████████
███▀█████▄█▀███▀▀▀██████
██▀█████▄█▄██████████████
██▄▄████▀▄▄▄▀▀▀▀▀▄▄██████
█████▄▄▄██████████▀▄████
█████▀▄█▄██████▀█▄█████
███████▀▄█▀█▄██▀█▄███████
█████████▄█▀▄█▀▄█████████
█████████████████████████
█████████████████████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
      OUR      
PARTNERS

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
▄█████████████████████████████
████████▀▀█████▀▀████████
█████▀█████████████▀█████
████████████████████████
███████████████▄█████████
█████████████████████████
█████████████████████████
█████████████████████████
███████████████▀█████████
████████████████████████
█████▄█████████████▄█████
████████▄▄█████▄▄████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
   INVEST   
BITCOIN

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
LoyceV
Legendary
*
Offline Offline

Activity: 3262
Merit: 16315


Thick-Skinned Gang Leader and Golden Feather 2021


View Profile WWW
September 06, 2020, 10:49:03 AM
Merited by TryNinja (1)
 #12

Some stats won't be available, since I can't get them (~topics created
Just a thought: you can probably get this if you check which user made the first post in each topic.

Quote
The "Unknown Title" shows up for the posts Loyce provided to me. His data didn't include any title, so I would need to scrape everything from zero to get them. New posts and posts which got notified to a bot user have their title.
Most topics have been deleted, so if you scrape those titles, you can skip a few million topics to speed things up.

█▀▀▀











█▄▄▄
▀▀▀▀▀▀▀▀▀▀▀
e
▄▄▄▄▄▄▄▄▄▄▄
█████████████
████████████▄███
██▐███████▄█████▀
█████████▄████▀
███▐████▄███▀
████▐██████▀
█████▀█████
███████████▄
████████████▄
██▄█████▀█████▄
▄█████████▀█████▀
███████████▀██▀
████▀█████████
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
c.h.
▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄
▀▀▀█











▄▄▄█
▄██████▄▄▄
█████████████▄▄
███████████████
███████████████
███████████████
███████████████
███░░█████████
███▌▐█████████
█████████████
███████████▀
██████████▀
████████▀
▀██▀▀
Stalker22
Legendary
*
Offline Offline

Activity: 1456
Merit: 1338



View Profile
September 06, 2020, 12:06:05 PM
 #13

I can't even image how difficult it is.

It's just matter of convenience, but it is possible to bold text on the posts that matches the content/keyword? For example, if i use content/keyword "blockchain", all texts containing "blockchain" would be bolded automatically.

You mean, something like, how bitcointalk search function does? Yeah, that would be nice. I'm sure TryNinja can make the search term highlighted in the results.

█████████████████████████████
█████████▀     ▄██ ▀▀████████
█████▀ ▀██▀▀▀▀▀▀▀▀▀▄▄  ▀█████
████  ▄▀▀▄█████████▄▀▀▄██████
███▄▄█▀▄██████▀ ▀████▄▀█▀ ▀██
██▀▀█▌▐█   ▀▀▀   █████▌▐█  ██
██  █ ███▄▄▄      ▀▀▀▀█ █  ██
██  █▌▐████▌         ▄▌▐█████
███▄██▄▀█████▄   ▄▄██▀▄█ ▀███
████▀ ▀▄▄▀███▀    █▀▄▄▀  ████
█████▄  ▀▀▄▄▄▄▄▄▄▄▄██▄ ▄█████
████████▄▄██       ██████████
█████████████████████████████
         ▄██▄     ▄
        █████   ▄████
       █████▌  █████▌
      ██████████████
     ███▀█████▀██▀████▄
   ▄▄▄▄▄██████████████
 ▄▄██████▄██▄▄██████▄█▀
▐██████████████████████▄
 ▀████████         ████▀
   ▀███████▄     ▄███▀
    ███████████████▀
  ▄█████████████████
▄▄███████████████████▄
               ▄███▄
            ▄████████

        ▄▄██████████
       █▀▀▀██▀▀▀████
      ███████████
    ▀▀▀████████████
      ▀███████████▀
      ▄███████████▄
 ▄
    ▀▀▀▀▀▀▀▀███▀▀   ▄
▀▀█▀▀
███████████▀▀▀█▀▀
    ████████████████
    ████████████████
▄▄▄▄▄▄███████████████▄▄▄▄▄▄
.
..PLAY NOW..
       ▄▄▄▄ ▄▄█████▄
     ████████████████
 ▄▄▄█████████████████████▄
███████████████████████████▄▄
▀█████████████████████████████
  ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
       ▄█▄      ██
    ▄█▄▄█▄▄█▄          ▄▄
    ▄▄▄███▄▄▄    ▄ ▄ ▄ ▀▀
     ▀ ▄█▄ ▀  ▀▄█ ▀█▀ █▄▀
    ▄▄  ▀     ▀▀▀▀███▀▀▀▀
    ▀▀        ▀██▀▀█▀▀██▀
         ██   ▀ ▀▄▀█▀▄▀ ▀
Aveatrex
Sr. Member
****
Offline Offline

Activity: 840
Merit: 375



View Profile
September 06, 2020, 12:45:48 PM
 #14

Amazing! I see that you are making use of Reactjs, way to go Smiley .  I'm interested in your RESTful API, can you elaborate on how it works?






░░░▄▀█░░░▄░▄▄░▄░░░█▀▄
▄▄▄▀▀██▀░█▐▌█ ▀██▀▀▄▄▄
▐▌░░░▐▀░▄▀░▐▌░▀▄░▀▌░░░▐▌
▐▌░░░█░░▄▀▄▐▌▄▀▄░░█░░░▐▌
▐▌░░░█░░▀▄░▀▀░▄▀░░█░░░▐▌
▐▌░░▄░█▄░▀▄▐▌▄▀░▄█░▄░░▐▌
▐▌░█▄█░░▀▀▀██▀▀▀░░█▄█░▐▌
▐▌░░░░░░░░░░░░░░░░░░░░▐▌
▐█▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀█▌
▀▀▀▀▀▀▀█▀▀▀▀▀▀█▀▀▀▀▀▀▀
░░░░░░░▀▀▀▀▀▀▀▀▀▀
.
░░░░░░░░░░░░░▄█▄░░░░░░░▄█▄
░░░░░░░░░░░░░░░░░▄█▄░░░
░░░░▄▄▄▄▄░░░░░░░░░░░░░
░░█▀▄▄▀▄▄▀█░░░▐▌▐▌
░░░░░░░▐▌▐▌
░░░░░░░░█▄░░░░▄█
█▄█▄▄▄▄▄█▄█░░░░▄▄▀▀▀▄▄
░░░░▄▄▄░░░░░▄▀▄██▀█▌▀▄
░░░██▄██▄▄█▀█▌█▐█▄█▌█▐█
░░░░█▄▄▄▄▄█▄█▌█▐█▄█▌█▐█
░░░░█▄█░░░░░█▄▄█▄█▄█▄█
▀▄▄▄▄▄▄▄▄▄▄▀░░░▀▀▄█▄█▄▀▀
.


░░░██▄▄░░██░██
▄▄░░░░░▀█░█▄▐▌░░░░░▄▄▄
▀▀▀▀▀▀▀█▐▌▄█▐▌░░░░█░▀▀
░░░░░░█▀▄▄▄▄▄▄▀▀▀▀░░▄▄
░░░░░░█░▀▀▀▀▀▀▄█▀▀▀▀▀▀
░░▄▄▄▄▄░▄▄▄▄▄▄▀▄
░░▀▀░░█▄▀▀▀▀▀█▄▀
░░░░░░░█▐▌▀█░█
██▀▀▀▀▀▀▐▌░█░░▀▀▀▀▀▀█
░░░░░░░░██░░▀▀▀▀▀██░██
.
masulum
Legendary
*
Offline Offline

Activity: 2184
Merit: 1592


hmph..


View Profile WWW
September 06, 2020, 02:54:15 PM
 #15

Everything is good, the search post feature is very helpful, to make this feature are different with show the latest post from Bitcointalk, maybe you can add filter posts there. Not an important thing, just additional features maybe will help in the future.

Also, Link color need to change from blue with more soft color. I try to use this style:

Code:
a {
    color: darkorange;
    text-decoration: none;
    background-color: transparent;
    outline: none;
    cursor: pointer;
    -webkit-transition: color .3s;
    transition: color .3s;
    -webkit-text-decoration-skip: objects;
}

For me (maybe different experience with other users), background and the text color its doesn't match. if you are happy with that, its okay nothing to change.

example result:
       Test -       Test         

Contact me: on Telegram
suchmoon
Legendary
*
Offline Offline

Activity: 3640
Merit: 8906


https://bpip.org


View Profile WWW
September 06, 2020, 03:43:31 PM
Merited by TryNinja (4)
 #16

Nitpick: for the front-page charts perhaps it makes sense to exclude today otherwise the charts have a bit of a misleading dip at the end there.

Looks great. Very fast. Not sure how accurate it is though. I can't believe I said "cunt" only 7 times. Does it search only outside of quotes? Only full words?


TryNinja (OP)
Legendary
*
Offline Offline

Activity: 2786
Merit: 6856



View Profile WWW
September 06, 2020, 06:24:59 PM
Last edit: September 06, 2020, 07:16:05 PM by TryNinja
 #17

I can't even image how difficult it is.

It's just matter of convenience, but it is possible to bold text on the posts that matches the content/keyword? For example, if i use content/keyword "blockchain", all texts containing "blockchain" would be bolded automatically.
I think it is. I'll look at it later today.

Amazing! I see that you are making use of Reactjs, way to go Smiley .  I'm interested in your RESTful API, can you elaborate on how it works?
I have a few endpoints which will return the data you need. For example:

GET: /posts/55141939

Code:
{
  "id": "1c25054c-b1b8-41eb-8c66-697c8b697179",
  "post_id": 55142446,
  "topic_id": 5273824,
  "title": "Re: Ninjastic.space - BitcoinTalk Post/Address archive + API",
  "author": "Aveatrex",
  "author_uid": 950474,
  "content": "Amazing! I see that you are making use of Reactjs, way to go <img src=\"https://bitcointalk.org/Smileys/default/smiley.gif\" alt=\"Smiley\" border=\"0\"> .  I'm interested in your RESTful API, can you elaborate on how it works? ",
  "date": "2020-09-06T12:45:48.000Z",
  "boards": [
    "Other",
    "Meta"
  ],
  "archive": false
}

For me (maybe different experience with other users), background and the text color its doesn't match. if you are happy with that, its okay nothing to change.
It will be fixed. Thanks!

Nitpick: for the front-page charts perhaps it makes sense to exclude today otherwise the charts have a bit of a misleading dip at the end there.
Makes sense. I'll remove today's data.

Looks great. Very fast. Not sure how accurate it is though. I can't believe I said "cunt" only 7 times. Does it search only outside of quotes? Only full words?
Goddammit, you are right. I messed up big with my algo. I hate regex. Angry

I will fix it and the results should increase considerably for every other search. It does look inside quotes, but the regex is eating a few parts of the post it shouldn't when there are multiple quotes.

..JAMBLER.io..Create Your Bitcoin Mixing
Business Now for   F R E E 
▄█████████████████████████████
█████████████████████████
████▀████████████████████
███▀█████▄█▀███▀▀▀██████
██▀█████▄█▄██████████████
██▄▄████▀▄▄▄▀▀▀▀▀▄▄██████
█████▄▄▄██████████▀▄████
█████▀▄█▄██████▀█▄█████
███████▀▄█▀█▄██▀█▄███████
█████████▄█▀▄█▀▄█████████
█████████████████████████
█████████████████████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
      OUR      
PARTNERS

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
▄█████████████████████████████
████████▀▀█████▀▀████████
█████▀█████████████▀█████
████████████████████████
███████████████▄█████████
█████████████████████████
█████████████████████████
█████████████████████████
███████████████▀█████████
████████████████████████
█████▄█████████████▄█████
████████▄▄█████▄▄████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
   INVEST   
BITCOIN

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
suchmoon
Legendary
*
Offline Offline

Activity: 3640
Merit: 8906


https://bpip.org


View Profile WWW
September 07, 2020, 12:37:06 AM
 #18

Goddammit, you are right. I messed up big with my algo. I hate regex. Angry

I will fix it and the results should increase considerably for every other search. It does look inside quotes, but the regex is eating a few parts of the post it shouldn't when there are multiple quotes.

Maybe don't rush with that. Ignoring quotes could be a feature, at least an optional one. Most of the time I would probably want someone the user posted themselves, not when they quoted something.

However searching for partial words would be great. E.g. "bitcoin" should find "bitcoins". Or perhaps it should be an option too, for those cases where you don't want "ninja" to find "tryninja".



Let me know if you'd like some help with the unknown titles. I can give you a dump of post IDs and titles that could significantly reduce the number of posts you'd need to re-scrape.
alani123
Legendary
*
Offline Offline

Activity: 2352
Merit: 1403


Leading Crypto Sports Betting & Casino Platform


View Profile
September 07, 2020, 01:18:44 AM
Merited by LoyceV (2)
 #19

Since it's all in a DB, it would be possible to associate a user with all of the addresses they've posted, no? I see the opposite being available and I can't help but think of also searching by user.

..Stake.com..   ▄████████████████████████████████████▄
   ██ ▄▄▄▄▄▄▄▄▄▄            ▄▄▄▄▄▄▄▄▄▄ ██  ▄████▄
   ██ ▀▀▀▀▀▀▀▀▀▀ ██████████ ▀▀▀▀▀▀▀▀▀▀ ██  ██████
   ██ ██████████ ██      ██ ██████████ ██   ▀██▀
   ██ ██      ██ ██████  ██ ██      ██ ██    ██
   ██ ██████  ██ █████  ███ ██████  ██ ████▄ ██
   ██ █████  ███ ████  ████ █████  ███ ████████
   ██ ████  ████ ██████████ ████  ████ ████▀
   ██ ██████████ ▄▄▄▄▄▄▄▄▄▄ ██████████ ██
   ██            ▀▀▀▀▀▀▀▀▀▀            ██ 
   ▀█████████▀ ▄████████████▄ ▀█████████▀
  ▄▄▄▄▄▄▄▄▄▄▄▄███  ██  ██  ███▄▄▄▄▄▄▄▄▄▄▄▄
 ██████████████████████████████████████████
▄▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▄
█  ▄▀▄             █▀▀█▀▄▄
█  █▀█             █  ▐  ▐▌
█       ▄██▄       █  ▌  █
█     ▄██████▄     █  ▌ ▐▌
█    ██████████    █ ▐  █
█   ▐██████████▌   █ ▐ ▐▌
█    ▀▀██████▀▀    █ ▌ █
█     ▄▄▄██▄▄▄     █ ▌▐▌
█                  █▐ █
█                  █▐▐▌
█                  █▐█
▀▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▀█
▄▄█████████▄▄
▄██▀▀▀▀█████▀▀▀▀██▄
▄█▀       ▐█▌       ▀█▄
██         ▐█▌         ██
████▄     ▄█████▄     ▄████
████████▄███████████▄████████
███▀    █████████████    ▀███
██       ███████████       ██
▀█▄       █████████       ▄█▀
▀█▄    ▄██▀▀▀▀▀▀▀██▄  ▄▄▄█▀
▀███████         ███████▀
▀█████▄       ▄█████▀
▀▀▀███▄▄▄███▀▀▀
..PLAY NOW..
TryNinja (OP)
Legendary
*
Offline Offline

Activity: 2786
Merit: 6856



View Profile WWW
September 07, 2020, 01:48:17 AM
Merited by alani123 (1)
 #20

Maybe don't rush with that. Ignoring quotes could be a feature, at least an optional one. Most of the time I would probably want someone the user posted themselves, not when they quoted something.
I already plan to do that. The index I had created was not only removing the quotes but also parts of the original post, so changes are required anyways.

However searching for partial words would be great. E.g. "bitcoin" should find "bitcoins". Or perhaps it should be an option too, for those cases where you don't want "ninja" to find "tryninja".
You do get results for "bitcoins" if you search "bitcoin". Most plural words are equal to their singular forms when you do a search. Ninja and TryNinja are too far apart and something like this would probably result in a lot of false positives (like in this case).

Let me know if you'd like some help with the unknown titles. I can give you a dump of post IDs and titles that could significantly reduce the number of posts you'd need to re-scrape.
That would be great.

Since it's all in a DB, it would be possible to associate a user with all of the addresses they've posted, no? I see the opposite being available and I can't help but think of also searching by user.
Not exactly. Depends on the database schema. I'm already working on this, but I still didn't find a good solution that is fast and effective.

..JAMBLER.io..Create Your Bitcoin Mixing
Business Now for   F R E E 
▄█████████████████████████████
█████████████████████████
████▀████████████████████
███▀█████▄█▀███▀▀▀██████
██▀█████▄█▄██████████████
██▄▄████▀▄▄▄▀▀▀▀▀▄▄██████
█████▄▄▄██████████▀▄████
█████▀▄█▄██████▀█▄█████
███████▀▄█▀█▄██▀█▄███████
█████████▄█▀▄█▀▄█████████
█████████████████████████
█████████████████████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
      OUR      
PARTNERS

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
▄█████████████████████████████
████████▀▀█████▀▀████████
█████▀█████████████▀█████
████████████████████████
███████████████▄█████████
█████████████████████████
█████████████████████████
█████████████████████████
███████████████▀█████████
████████████████████████
█████▄█████████████▄█████
████████▄▄█████▄▄████████
▀█████████████████████████████
█████████████████████████████████████████████████
.
   INVEST   
BITCOIN

.
█████████████████████████████████████████████████
████▄
██
██
██
██
██
██
██
██
██
██
██
████▀
Pages: [1] 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 »
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!