Bitcoin Forum
June 24, 2019, 09:58:09 AM *
News: Latest Bitcoin Core release: 0.18.0 [Torrent] (New!)
 
   Home   Help Search Login Register More  
Pages: [1] 2 »  All
  Print  
Author Topic: [project] LoyceV's Profile and Trust Archive site  (Read 831 times)
LoyceV
Legendary
*
Offline Offline

Activity: 1526
Merit: 4135


Self-made Legendary outside Meta!


View Profile WWW
April 21, 2019, 04:26:30 PM
Last edit: June 12, 2019, 04:36:50 PM by LoyceV
Merited by TMAN (10), eckmar (5), malevolent (1), tyz (1), iasenko (1)
 #1

I'm testing my own little version of "archive.is", exclusively for Bitcointalk (see the reason why). There's one crucial difference: I save pages logged in, showing trust on DT2.

The current version only allows archiving of profiles and trust pages.

How to use it
Post one request anywhere on the forum (on a public board) without code-tags, and substitute the profile or trust page you need. Like this:
Code:
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=459836
or
LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=459836
It has to be a new post, I don't detect editing. You can delete or edit the post after a short period of time.
After about 10 seconds, go to http://loyce.club/archive/ for the result. If the list becomes long: use CTRL-F (until I create a search feature). To sort files by date, use http://loyce.club/archive/?MA.

Trust me?
To use this as an archived backup, you'll have to trust I don't edit the data. Before uploading, I add tags to stop search engines from indexing and to point search engines to the original location. Example:
Code:
<meta name="robots" content="noindex,noarchive,nosnippet" />
<link rel="canonical" href="https://bitcointalk.org/index.php?action=profile;u=459836" />
I use shared hosting, but keep local backups of all files. You can use any other archive website to archive http://loyce.club/archive/ again.

Disclaimer
I'm still testing this, if something fails, I might delete files.

Limitations
Only 1 URL per post.
I use Amsterdam time, not forum time.
Quotes are not ignored: if you quote a post with an archive link, it will be archived again.
It should work most of the time, but if my scraper doesn't catch your request within a few seconds, my computer might be offline. In that case: just try again later. I couldn't get ssh access to my webhost working, and I don't have a VPS yet.
I don't archive images (yet), so the avatar doesn't show in the archive.
I don't have the skills to create an nice GUI such as archive.is has. If someone wants to help that's much appreciated, until then, it's all about the data Smiley
There's a 10 minutes delay before the same page can be archived again.
Old versions will not be overwritten when the same page is archived again.
You can't archive LoyceBot (this would expose it's email address).
Theymos made some Trust changes. Until I improve things, only the first Trust page can be archived.

Test is!
Really, test it Cheesy

No spam
All my threads are now self-moderated to stop signature spam. I lost my self-mod status when I moved the thread. I will remove report all irrelevant posts. If you quote the entire OP, your entry will be deleted reported.

1561370289
Hero Member
*
Offline Offline

Posts: 1561370289

View Profile Personal Message (Offline)

Ignore
1561370289
Reply with quote  #2

1561370289
Report to moderator
1561370289
Hero Member
*
Offline Offline

Posts: 1561370289

View Profile Personal Message (Offline)

Ignore
1561370289
Reply with quote  #2

1561370289
Report to moderator
1561370289
Hero Member
*
Offline Offline

Posts: 1561370289

View Profile Personal Message (Offline)

Ignore
1561370289
Reply with quote  #2

1561370289
Report to moderator
Bitcoin Poker 3.0
The Largest Bitcoin Poker Site
Bad Beat Jackpot Available
No Limit Texas Hold'em Cash Games And Tournaments
PLAY NOW
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1561370289
Hero Member
*
Offline Offline

Posts: 1561370289

View Profile Personal Message (Offline)

Ignore
1561370289
Reply with quote  #2

1561370289
Report to moderator
1561370289
Hero Member
*
Offline Offline

Posts: 1561370289

View Profile Personal Message (Offline)

Ignore
1561370289
Reply with quote  #2

1561370289
Report to moderator
1561370289
Hero Member
*
Offline Offline

Posts: 1561370289

View Profile Personal Message (Offline)

Ignore
1561370289
Reply with quote  #2

1561370289
Report to moderator
LoyceV
Legendary
*
Offline Offline

Activity: 1526
Merit: 4135


Self-made Legendary outside Meta!


View Profile WWW
April 21, 2019, 04:27:08 PM
Last edit: April 21, 2019, 05:40:00 PM by LoyceV
 #2

Reserved

mdayonliner
Sr. Member
****
Offline Offline

Activity: 490
Merit: 362


I always respected forum rules even private ones


View Profile WWW
April 21, 2019, 04:32:16 PM
 #3

~How to use it
Post this anywhere on the forum (on a public board) without code-tags, and substitute the profile or trust page you need:
Code:
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=459836
It has to be a new post, I don't detect edits. You can delete or edit the post after a short period of time.
After about 10 seconds, go to http://loyce.club/archive/ for the result.

So it's basically LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=<userID>
?

For example:
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=1432468
Which will archive my profile?

I could not stand the lies against me anymore. I can not prove them wrong too. It's better I live in peace.
So, I am willingly locking mdayonliner. Thank you BitcoinTalk. Be addictive, be a Bitcoiner.
LoyceV
Legendary
*
Offline Offline

Activity: 1526
Merit: 4135


Self-made Legendary outside Meta!


View Profile WWW
April 21, 2019, 04:34:21 PM
Last edit: April 21, 2019, 04:48:17 PM by LoyceV
 #4

So it's basically LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=<userID>
?
Yes, or LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=<userID>

But only one archive request per post, and by quoting mine within code tags, it won't work.

mdayonliner made me add a few more checks, it should work again Smiley

For example:
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=1432468
Which will archive my profile?
This should work, but it should be the first "LoyceClubArchive" in your new post.

TryNinja
Legendary
*
Offline Offline

Activity: 1050
Merit: 1319


CS <3


View Profile
April 21, 2019, 04:46:08 PM
 #5

LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=557798

edit: Mine worked. See: http://loyce.club/archive/profile_557798_2019-04-21_Sun_18.46h.html

@Loyce which shared hosting do you use? If you don't mind...

mdayonliner
Sr. Member
****
Offline Offline

Activity: 490
Merit: 362


I always respected forum rules even private ones


View Profile WWW
April 21, 2019, 04:48:55 PM
 #6

LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=1432468

Trying again LOL after seeing TryNinja.

Update:
Worked this time  Smiley

Now I am curious why it did not work first time? @LoyceV

I could not stand the lies against me anymore. I can not prove them wrong too. It's better I live in peace.
So, I am willingly locking mdayonliner. Thank you BitcoinTalk. Be addictive, be a Bitcoiner.
mdayonliner
Sr. Member
****
Offline Offline

Activity: 490
Merit: 362


I always respected forum rules even private ones


View Profile WWW
April 21, 2019, 04:59:08 PM
 #7

Interesting. So it's basically the LoyceBot user LOL



By the way, people say you are AI, bot blab blab. I think you are a good data analyst and a developer who is interested in developing tools to read their data.

Another good work and this is impressive to me than anything else you have done in the past.

Keep up the good work mate.

I could not stand the lies against me anymore. I can not prove them wrong too. It's better I live in peace.
So, I am willingly locking mdayonliner. Thank you BitcoinTalk. Be addictive, be a Bitcoiner.
ETFbitcoin
Legendary
*
Offline Offline

Activity: 1680
Merit: 1811

Use SegWit and enjoy lower fees.


View Profile WWW
April 21, 2019, 05:03:21 PM
 #8

Let me try
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=359716

I don't have the skills to create an nice GUI such as archive.is has. If someone wants to help that's much appreciated, until then, it's all about the data Smiley

As lazy hobbyist, i'd recommend water.css or tacit.
While it can't be as good as archive.is, you don't need to add class/change HTML tags at all and most importantly it's better than plain HTML Tongue

LoyceV
Legendary
*
Offline Offline

Activity: 1526
Merit: 4135


Self-made Legendary outside Meta!


View Profile WWW
April 21, 2019, 06:25:30 PM
 #9

@Loyce which shared hosting do you use?
https://www.kayhosting.com/

Now I am curious why it did not work first time? @LoyceV
I had added a big red "offline" to the OP for testing.

Interesting. So it's basically the LoyceBot user LOL
Correct. I need a user account to see Trust.

Quote
Another good work and this is impressive to me than anything else you have done in the past.
This one wasn't that much work (yet*), my proudest work is still the Trust list viewer.

Let me try
I was expecting people to archive Trust-pages, not profiles.

Quote
As lazy hobbyist, i'd recommend water.css or tacit.
Thanks Smiley I'll keep this for when I have loads to time to figure it out.



*I have much more work on my TODO list: archive pages including images, and a hidden section for archiving Investigations, but don't expect this anytime soon.

TryNinja
Legendary
*
Offline Offline

Activity: 1050
Merit: 1319


CS <3


View Profile
April 21, 2019, 08:05:37 PM
 #10

Can I steal your idea to play around with it a little bit? Tongue

http://192.241.131.99/archive/

The code is pretty much in spaghetti mode but I thought it would be fun to try this.

akamit
Hero Member
*****
Offline Offline

Activity: 994
Merit: 545


It always seems impossible until it's done ~ NM


View Profile
April 21, 2019, 08:17:24 PM
 #11

Nice work again Loyce... Keep going!

I want to ask a silly question, not sure if it is relevant or not, does your bot captures IP address of members other than profile & trust page?

......
.L I V E C O I N . N E T.
.
..PROFITBOX..
██  █████████████████████████
  █████████▄      ▄██████████
█████████████▄  ▄████████████
    █████████████████████████
  ██████████▀    ▀█ ▀████████
████  █████▀  ▄▄  ▀█  ▀██████
  ████████▀  ▄██▄  ▀█   ▀████
    ██████   ▀██▀   ██   ████
  █████████▄      ▄██████████
██  █████████▄  ▄████████████
  ███████████████████████████
██  █████████████████████████
  █████████████████████▀ ███
█████████████████████▀   ███
    █████████████▀     ████
  █████████████▀   ██    ████
████  █████▀     ██    ████
  ███████▀   ██    ██    ████
    █████    ██    ██    ████
  ███████    ██    ██    ████
██  █████    ██    ██    ████
  ███████████████████████████
.....
LoyceV
Legendary
*
Offline Offline

Activity: 1526
Merit: 4135


Self-made Legendary outside Meta!


View Profile WWW
April 21, 2019, 09:34:04 PM
 #12

Can I steal your idea to play around with it a little bit? Tongue
Your interface looks better already Cheesy

does your bot captures IP address of members other than profile & trust page?
The forum doesn't show IP addresses from users. My hosting keeps normal webserver logs (from users who visit loyce.club).

Initscri
Hero Member
*****
Offline Offline

Activity: 1022
Merit: 623


KnowNoBorders.io


View Profile WWW
April 22, 2019, 07:09:47 AM
 #13

Might as well give er' a shot:

LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=186520



Yep, seems to work well! If future, maybe sending a PM may not be a bad idea (to notify of URL). Unsure if posting a reply as the bot may work as well (but may get a tad bit spammy)

   ▄▄██████▄▄
  ████████████
███▄▄
 ██████████████▀▀▀██▄
████████████████   ▀██▄
████████████████     ▀██
██████████████       ██▌
██████████████        ▐██
██▌▀▀██████▀▀         ▐██
▐██                   ██▌
 ██▄                 ▄██
  ▀██▄             ▄██▀
    ▀██▄▄▄     ▄▄▄██▀
      ▀▀█████████▀▀





█████████████████████████
███████▀▀       ▀▀███████
████▀   ▄ ▀███▀ ▄   ▀████
███  ▄████▄ ▀ ▄████▄  ███
██  ▄ ▀███▀ ▄ ▀███▀ ▄  ██
█  ▄██ ▀▀ ▄███▄ ▀▀ ██▄  █
█  █▀ ▄█ ███████ █▄ ▀█  █
█   ▄███▄ █████ ▄███▄   █
██  ████▀ ▄▄▄▄▄ ▀████  ██
███  ▀ ▄ ▀█████▀ ▄ ▀  ███
████▄  ▀▀▄ ███ ▄▀▀  ▄████
███████▄▄       ▄▄███████
█████████████████████████
████████     INDUSTRY LEADING CRYPTO SPORTSBOOK     ████████
PARTNER OF
WATFORD FC
LIVE
STREAMING
DAILY PRICE
BOOSTS
FAST & SECURE
PAYMENTS
█████████████████████████
███████▀▀       ▀▀███████
████▀  ▄█▄  ▀  ▄▄   ▀████
███  ▄  ▀    ▀█████▄  ███
██  ▀█▀   ▀█▄   ▀▀██▄  ██
█  ▄    █▄  ▀██▄▄  ▀█▄  █
█  █▀ ▄  ▀█▄  ▀███▄  ▀  █
█    ▄██  ▀██▄  ▀███▄   █
██  ▀████  ▀███▄  ▀█▀  ██
███  ▀████  ▀████▄    ███
████▄   ▀▀█▄  ▀▀▀   ▄████
███████▄▄       ▄▄███████
█████████████████████████
█████████████████████████
███████▀▀ █████ ▀▀███████
████▀    ▄█████▄    ▀████
█████▄▄█▀▀ ▄▄▄ ▀▀█▄▄█████
██▀███▀ ▄███▀███▄ ▀███▀██
█   █ ▄██▀     ▀██▄ █   █
█   █ ██         ██ █   █
█   █ ▀██▄▄█ █▄▄██▀ █   █
██▄███▄ ▀██▄▄▄██▀ ▄███▄██
█████▀▀█▄▄ ▀▀▀ ▄▄█▀▀█████
████▄    ▀█████▀    ▄████
███████▄▄ █████ ▄▄███████
█████████████████████████





.
..WIN WITH US!..
LoyceV
Legendary
*
Offline Offline

Activity: 1526
Merit: 4135


Self-made Legendary outside Meta!


View Profile WWW
April 22, 2019, 08:45:31 AM
 #14

maybe sending a PM may not be a bad idea (to notify of URL). Unsure if posting a reply as the bot may work as well (but may get a tad bit spammy)
Spam wouldn't be a problem, the user would have to add a "PM" tag to his post. But I don't have a bot that can post or PM.

bitdaric
Copper Member
Member
**
Offline Offline

Activity: 232
Merit: 17


View Profile
April 22, 2019, 12:50:58 PM
 #15

LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=1797137  Huh

➡️💯➡️ BitDaric (DARX) 💰😎👍
hatshepsut93
Hero Member
*****
Offline Offline

Activity: 1190
Merit: 723


Bitcoin realist


View Profile
April 23, 2019, 06:05:55 PM
 #16

Is there any reason why you don't save the full page with all the css, js and images? If you need some help, I might be able to help you, though I only work with node.js.


I don't archive images (yet), so the avatar doesn't show in the archive.


In the profile page avatars seem to be the only image with relative link, so you can just save them to /useravatars.

LoyceV
Legendary
*
Offline Offline

Activity: 1526
Merit: 4135


Self-made Legendary outside Meta!


View Profile WWW
April 23, 2019, 07:32:00 PM
 #17

Is there any reason why you don't save the full page with all the css, js and images? If you need some help, I might be able to help you, though I only work with node.js.
For the purpose of archiving evidence, I have the most important part covered. I wouldn't know how to archive all the extras, and I currently don't have the time to figure it out. I'd appreciate the help, but I know nothing about node.js.

Quote
In the profile page avatars seem to be the only image with relative link, so you can just save them to /useravatars.
Saving the avatar shouldn't be that difficult. When I have some time to kill, I'll move to a VPS and continue there.

iasenko
Hero Member
*****
Online Online

Activity: 602
Merit: 1082


I'm no longer on DT,protesting against the madness


View Profile WWW
April 23, 2019, 09:49:46 PM
Last edit: April 24, 2019, 04:10:03 AM by iasenko
 #18

What a lovely project you have here Smiley
Let me test it too.
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=1291828

As I understand I cannot archive both trust and profile in the same post, right?

I need to have two separate posts then.
Let's see what happens with trust.
LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=1291828

... I feel like a spammer here . With two consecutive posts.. ill remove one as soon as I see the result.

LoyceV
Legendary
*
Offline Offline

Activity: 1526
Merit: 4135


Self-made Legendary outside Meta!


View Profile WWW
April 24, 2019, 07:52:13 AM
 #19

http://loyce.club/archive/profile_1291828_2019-04-23_Tue_23.40h.html

Quote
As I understand I cannot archive both trust and profile in the same post, right?
Correct. I took the lazy approach to stop searching after the first hit. I hope to one day get a nice user interface instead of scraping the forum for entries.

Quote
Let's see what happens with trust.
LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=1291828
http://loyce.club/archive/trust_1291828_2019-04-23_Tue_23.49h.html

Quote
... I feel like a spammer here . With two consecutive posts.. ill remove one as soon as I see the result.
I used a thread in archival for testing, but I had to move the entire thread before I could delete the posts. It shouldn't take long though, you can delete your post after at most 8 seconds.

iasenko
Hero Member
*****
Online Online

Activity: 602
Merit: 1082


I'm no longer on DT,protesting against the madness


View Profile WWW
April 24, 2019, 08:54:39 AM
 #20

Yeah, I got both archives pretty fast. Just one note, the results can be arranged by date by default. Now they are arranged by name and you have to ether scroll to your name or search for you ID. Sure the 3rd option is to arrange them by date manually, as what I did. Wink

Pages: [1] 2 »  All
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!