Bitcoin Forum
September 27, 2020, 04:15:41 AM *
News: Latest Bitcoin Core release: 0.20.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: [1] 2 »  All
  Print  
Author Topic: [project] LoyceV's Profile and Trust Archive site - Active and updated!  (Read 1205 times)
LoyceV
Legendary
*
Offline Offline

Activity: 1988
Merit: 6977


Thick-Skinned Gang Leader


View Profile WWW
April 21, 2019, 04:26:30 PM
Last edit: November 18, 2019, 02:46:04 PM by LoyceV
Merited by TMAN (10), eckmar (5), TECSHARE (1), malevolent (1), tyz (1), TheBeardedBaby (1)
 #1

I'm testing my own little version of "archive.is", exclusively for Bitcointalk (see the reason why). There's one crucial difference: I save pages logged in, showing trust on DT2.

The current version only allows archiving of profiles and trust pages.

How to use it
Post LoyceClubArchive followed by the URL anywhere on the forum (on a public board) without code-tags, and substitute the profile or trust page you need. Post one line like this (it's okay if it's part of a bigger post):
Code:
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=459836
or
LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=459836
or
LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=459836;page=sent;offset=0
It has to be a new post, I don't detect editing. You can delete or edit the post after a short period of time.
After about 10 seconds, go to http://loyce.club/archive/ for the result. If the list becomes long: use CTRL-F (until I create a search feature). To sort files by date, use http://loyce.club/archive/?MD (newest first).

Update
As of today, all (paginated) Trust pages can be archived. Just copy the URL you want to archive.
Without offset, only the first 50 pages are shown. The default initial offset starts at "50", and shows feedback 51-550. In many cases users have less than 500 feedbacks in total. If you change the offset to 0, it shows feedback 0-500.
Note that you'll have to archive "trusted", "untrusted" and "sent" separately.

Trust me?
To use this as an archived backup, you'll have to trust I don't edit the data. Before uploading, I add tags to stop search engines from indexing and to point search engines to the original location. Example:
Code:
<meta name="robots" content="noindex,noarchive,nosnippet" />
<link rel="canonical" href="https://bitcointalk.org/index.php?action=profile;u=459836" />
I use shared hosting, but keep local backups of all files. You can use any other archive website to archive http://loyce.club/archive/ again.

Disclaimer
I'm still testing this, if something fails, I might delete files.

Limitations
Only 1 URL per post.
I use Amsterdam time, not forum time.
Quotes are not ignored: if you quote a post with an archive link, it will be archived again.
It should work most of the time, but if my scraper doesn't catch your request within a few seconds, my computer might be offline. In that case: just try again later.
I don't archive images (yet), so the avatar doesn't show in the archive.
I don't have the skills to create an nice GUI such as archive.is has. If someone wants to help that's much appreciated, until then, it's all about the data Smiley
There's a 10 minutes delay before the same page can be archived again.
Old versions will not be overwritten when the same page is archived again.
You can't archive LoyceBot (this would expose it's email address).
Theymos made some Trust changes. Until I improve things, only the first Trust page can be archived. As of today, all Trust pages can be archived.

Test it!
Really, test it Cheesy

No spam
Please Smiley I said please Cheesy



See [overview] LoyceV's useful data on Bitcointalk for more of my forum-related topics

1601180141
Hero Member
*
Offline Offline

Posts: 1601180141

View Profile Personal Message (Offline)

Ignore
1601180141
Reply with quote  #2

1601180141
Report to moderator
1601180141
Hero Member
*
Offline Offline

Posts: 1601180141

View Profile Personal Message (Offline)

Ignore
1601180141
Reply with quote  #2

1601180141
Report to moderator
AWARD-WINNING
CASINO
CRYPTO EXCLUSIVE
CLUBHOUSE
1500+
GAMES
2 MIN
CASH-OUTS
24/7
SUPPORT
100s OF
FREE SPINS
PLAY NOW
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1601180141
Hero Member
*
Offline Offline

Posts: 1601180141

View Profile Personal Message (Offline)

Ignore
1601180141
Reply with quote  #2

1601180141
Report to moderator
1601180141
Hero Member
*
Offline Offline

Posts: 1601180141

View Profile Personal Message (Offline)

Ignore
1601180141
Reply with quote  #2

1601180141
Report to moderator
1601180141
Hero Member
*
Offline Offline

Posts: 1601180141

View Profile Personal Message (Offline)

Ignore
1601180141
Reply with quote  #2

1601180141
Report to moderator
LoyceV
Legendary
*
Offline Offline

Activity: 1988
Merit: 6977


Thick-Skinned Gang Leader


View Profile WWW
April 21, 2019, 04:27:08 PM
Last edit: April 21, 2019, 05:40:00 PM by LoyceV
 #2

Reserved

mdayonliner
Sr. Member
****
Offline Offline

Activity: 490
Merit: 378


I always respected forum rules even private ones


View Profile WWW
April 21, 2019, 04:32:16 PM
 #3

~How to use it
Post this anywhere on the forum (on a public board) without code-tags, and substitute the profile or trust page you need:
Code:
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=459836
It has to be a new post, I don't detect edits. You can delete or edit the post after a short period of time.
After about 10 seconds, go to http://loyce.club/archive/ for the result.

So it's basically LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=<userID>
?

For example:
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=1432468
Which will archive my profile?

I could not stand the lies against me anymore. I can not prove them wrong too. It's better I live in peace.
So, I am willingly locking mdayonliner. Thank you BitcoinTalk. Be addictive, be a Bitcoiner.
LoyceV
Legendary
*
Offline Offline

Activity: 1988
Merit: 6977


Thick-Skinned Gang Leader


View Profile WWW
April 21, 2019, 04:34:21 PM
Last edit: April 21, 2019, 04:48:17 PM by LoyceV
 #4

So it's basically LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=<userID>
?
Yes, or LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=<userID>

But only one archive request per post, and by quoting mine within code tags, it won't work.

mdayonliner made me add a few more checks, it should work again Smiley

For example:
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=1432468
Which will archive my profile?
This should work, but it should be the first "LoyceClubArchive" in your new post.

TryNinja
Legendary
*
Offline Offline

Activity: 1512
Merit: 2738


Merit & Notifications bot: @BTTSuperNotifier_bot


View Profile WWW
April 21, 2019, 04:46:08 PM
 #5

LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=557798

edit: Mine worked. See: http://loyce.club/archive/profile_557798_2019-04-21_Sun_18.46h.html

@Loyce which shared hosting do you use? If you don't mind...

mdayonliner
Sr. Member
****
Offline Offline

Activity: 490
Merit: 378


I always respected forum rules even private ones


View Profile WWW
April 21, 2019, 04:48:55 PM
 #6

LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=1432468

Trying again LOL after seeing TryNinja.

Update:
Worked this time  Smiley

Now I am curious why it did not work first time? @LoyceV

I could not stand the lies against me anymore. I can not prove them wrong too. It's better I live in peace.
So, I am willingly locking mdayonliner. Thank you BitcoinTalk. Be addictive, be a Bitcoiner.
mdayonliner
Sr. Member
****
Offline Offline

Activity: 490
Merit: 378


I always respected forum rules even private ones


View Profile WWW
April 21, 2019, 04:59:08 PM
 #7

Interesting. So it's basically the LoyceBot user LOL



By the way, people say you are AI, bot blab blab. I think you are a good data analyst and a developer who is interested in developing tools to read their data.

Another good work and this is impressive to me than anything else you have done in the past.

Keep up the good work mate.

I could not stand the lies against me anymore. I can not prove them wrong too. It's better I live in peace.
So, I am willingly locking mdayonliner. Thank you BitcoinTalk. Be addictive, be a Bitcoiner.
ETFbitcoin
Legendary
*
Offline Offline

Activity: 2128
Merit: 2513

Use SegWit and enjoy lower fees.


View Profile WWW
April 21, 2019, 05:03:21 PM
 #8

Let me try
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=359716

I don't have the skills to create an nice GUI such as archive.is has. If someone wants to help that's much appreciated, until then, it's all about the data Smiley

As lazy hobbyist, i'd recommend water.css or tacit.
While it can't be as good as archive.is, you don't need to add class/change HTML tags at all and most importantly it's better than plain HTML Tongue

LoyceV
Legendary
*
Offline Offline

Activity: 1988
Merit: 6977


Thick-Skinned Gang Leader


View Profile WWW
April 21, 2019, 06:25:30 PM
Last edit: December 20, 2019, 01:25:55 PM by LoyceV
 #9

@Loyce which shared hosting do you use?
https://www.kayhosting.com/ They turned into a scam

Now I am curious why it did not work first time? @LoyceV
I had added a big red "offline" to the OP for testing.

Interesting. So it's basically the LoyceBot user LOL
Correct. I need a user account to see Trust.

Quote
Another good work and this is impressive to me than anything else you have done in the past.
This one wasn't that much work (yet*), my proudest work is still the Trust list viewer.

Let me try
I was expecting people to archive Trust-pages, not profiles.

Quote
As lazy hobbyist, i'd recommend water.css or tacit.
Thanks Smiley I'll keep this for when I have loads to time to figure it out.



*I have much more work on my TODO list: archive pages including images, and a hidden section for archiving Investigations, but don't expect this anytime soon.

TryNinja
Legendary
*
Offline Offline

Activity: 1512
Merit: 2738


Merit & Notifications bot: @BTTSuperNotifier_bot


View Profile WWW
April 21, 2019, 08:05:37 PM
 #10

Can I steal your idea to play around with it a little bit? Tongue

http://192.241.131.99/archive/

The code is pretty much in spaghetti mode but I thought it would be fun to try this.

akamit
Hero Member
*****
Offline Offline

Activity: 1330
Merit: 592


View Profile
April 21, 2019, 08:17:24 PM
 #11

Nice work again Loyce... Keep going!

I want to ask a silly question, not sure if it is relevant or not, does your bot captures IP address of members other than profile & trust page?
LoyceV
Legendary
*
Offline Offline

Activity: 1988
Merit: 6977


Thick-Skinned Gang Leader


View Profile WWW
April 21, 2019, 09:34:04 PM
 #12

Can I steal your idea to play around with it a little bit? Tongue
Your interface looks better already Cheesy

does your bot captures IP address of members other than profile & trust page?
The forum doesn't show IP addresses from users. My hosting keeps normal webserver logs (from users who visit loyce.club).

Initscri
Hero Member
*****
Offline Offline

Activity: 1400
Merit: 752


Join the world-leading crypto sportsbook NOW!


View Profile WWW
April 22, 2019, 07:09:47 AM
 #13

Might as well give er' a shot:

LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=186520



Yep, seems to work well! If future, maybe sending a PM may not be a bad idea (to notify of URL). Unsure if posting a reply as the bot may work as well (but may get a tad bit spammy)

  ▄▄█████▄▄███████▄▄
 ███████████
     ▀▀███▄
█████████████        ▀██▄
█████████████          ██▄
███████████            ██▄
██▀▀█████▀▀              ██
██                       ██
██                       ██
▀██                     ██▀
 ▀██                   ██▀
  ▀██▄               ▄██▀
    ▀███▄▄       ▄▄███▀
       ▀▀█████████▀▀
███████████    LEADING CRYPTO SPORTSBOOK & CASINO    ███████████
MULTI
CURRENCY
1500+
CASINO GAMES
CRYPTO EXCLUSIVE
CLUBHOUSE
FAST & SECURE
PAYMENTS
..PLAY NOW!..
LoyceV
Legendary
*
Offline Offline

Activity: 1988
Merit: 6977


Thick-Skinned Gang Leader


View Profile WWW
April 22, 2019, 08:45:31 AM
 #14

maybe sending a PM may not be a bad idea (to notify of URL). Unsure if posting a reply as the bot may work as well (but may get a tad bit spammy)
Spam wouldn't be a problem, the user would have to add a "PM" tag to his post. But I don't have a bot that can post or PM.

bitdaric
Copper Member
Member
**
Offline Offline

Activity: 238
Merit: 17


View Profile WWW
April 22, 2019, 12:50:58 PM
 #15

LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=1797137  Huh
hatshepsut93
Legendary
*
Online Online

Activity: 1652
Merit: 1336


( ͡° ͜ʖ ͡°)


View Profile
April 23, 2019, 06:05:55 PM
 #16

Is there any reason why you don't save the full page with all the css, js and images? If you need some help, I might be able to help you, though I only work with node.js.


I don't archive images (yet), so the avatar doesn't show in the archive.


In the profile page avatars seem to be the only image with relative link, so you can just save them to /useravatars.

LoyceV
Legendary
*
Offline Offline

Activity: 1988
Merit: 6977


Thick-Skinned Gang Leader


View Profile WWW
April 23, 2019, 07:32:00 PM
 #17

Is there any reason why you don't save the full page with all the css, js and images? If you need some help, I might be able to help you, though I only work with node.js.
For the purpose of archiving evidence, I have the most important part covered. I wouldn't know how to archive all the extras, and I currently don't have the time to figure it out. I'd appreciate the help, but I know nothing about node.js.

Quote
In the profile page avatars seem to be the only image with relative link, so you can just save them to /useravatars.
Saving the avatar shouldn't be that difficult. When I have some time to kill, I'll move to a VPS and continue there.

TheBeardedBaby
Legendary
*
Offline Offline

Activity: 1064
Merit: 2134


https://coinbistro.com/ test th new forum software


View Profile
April 23, 2019, 09:49:46 PM
Last edit: April 24, 2019, 04:10:03 AM by iasenko
 #18

What a lovely project you have here Smiley
Let me test it too.
LoyceClubArchive https://bitcointalk.org/index.php?action=profile;u=1291828

As I understand I cannot archive both trust and profile in the same post, right?

I need to have two separate posts then.
Let's see what happens with trust.
LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=1291828

... I feel like a spammer here . With two consecutive posts.. ill remove one as soon as I see the result.





.
.




░██████████████████░
████████████████████
█████████▀░░░███████
█████████░░▄████████
███████▀▀░░▀▀███████
███████▄▄░░▄▄███████
█████████░░█████████

█████████░░█████████

█████████▄▄█████████

████████████████████

░██████████████████░
░██████████████████░
████████████████████
████████████▀▀▀█▀███
███░▀█████▀░░░░░▀███
███▌░░░▀▀▀░░░░░░████
████▄░░░░░░░░░░░████
█████▀░░░░░░░░░█████

██████▄░░░░░▄▄██████

█████▄▄▄▄███████████

████████████████████

░██████████████████░
░██████████████████░
████████████████████
████████████████████
███████████▀▀░░▐████
███████▀▀░░░░░█████
████▀░░░▄█▀░░░▐█████
█████▄▄█▀░░░░░██████

███████▌▄▄▄▐██████

████████████████████

████████████████████

░██████████████████░
LoyceV
Legendary
*
Offline Offline

Activity: 1988
Merit: 6977


Thick-Skinned Gang Leader


View Profile WWW
April 24, 2019, 07:52:13 AM
 #19

http://loyce.club/archive/profile_1291828_2019-04-23_Tue_23.40h.html

Quote
As I understand I cannot archive both trust and profile in the same post, right?
Correct. I took the lazy approach to stop searching after the first hit. I hope to one day get a nice user interface instead of scraping the forum for entries.

Quote
Let's see what happens with trust.
LoyceClubArchive https://bitcointalk.org/index.php?action=trust;u=1291828
http://loyce.club/archive/trust_1291828_2019-04-23_Tue_23.49h.html

Quote
... I feel like a spammer here . With two consecutive posts.. ill remove one as soon as I see the result.
I used a thread in archival for testing, but I had to move the entire thread before I could delete the posts. It shouldn't take long though, you can delete your post after at most 8 seconds.

TheBeardedBaby
Legendary
*
Offline Offline

Activity: 1064
Merit: 2134


https://coinbistro.com/ test th new forum software


View Profile
April 24, 2019, 08:54:39 AM
 #20

Yeah, I got both archives pretty fast. Just one note, the results can be arranged by date by default. Now they are arranged by name and you have to ether scroll to your name or search for you ID. Sure the 3rd option is to arrange them by date manually, as what I did. Wink





.
.




░██████████████████░
████████████████████
█████████▀░░░███████
█████████░░▄████████
███████▀▀░░▀▀███████
███████▄▄░░▄▄███████
█████████░░█████████

█████████░░█████████

█████████▄▄█████████

████████████████████

░██████████████████░
░██████████████████░
████████████████████
████████████▀▀▀█▀███
███░▀█████▀░░░░░▀███
███▌░░░▀▀▀░░░░░░████
████▄░░░░░░░░░░░████
█████▀░░░░░░░░░█████

██████▄░░░░░▄▄██████

█████▄▄▄▄███████████

████████████████████

░██████████████████░
░██████████████████░
████████████████████
████████████████████
███████████▀▀░░▐████
███████▀▀░░░░░█████
████▀░░░▄█▀░░░▐█████
█████▄▄█▀░░░░░██████

███████▌▄▄▄▐██████

████████████████████

████████████████████

░██████████████████░
Pages: [1] 2 »  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!