Title: ㅤ Post by: Symmetrick on November 19, 2021, 04:38:44 PM ㅤ
Title: Re: Archive of forum pages Post by: bL4nkcode on November 19, 2021, 04:46:20 PM Are there any ways or services that the archive was created at once for the entire list of topics or posts? I guess archive services only work on a single page, unless there's an "All" button on Show the last topics started by this person page like other thread do.Loycev archive tool (https://loyce.club/archive/topics/) doesn't have a feature like that as well, only the all posts created by the user including the tread and replies. Maybe you/we can suggest it to him if it's possible. Title: Re: Archive of forum pages Post by: FatFork on November 19, 2021, 05:18:43 PM I have a question. If there are any services where you can archive not one page, but all pages at once? For example, there is a link to my list of open topics: Show the last topics started by this person. (https://bitcointalk.org/index.php?action=profile;threads;u=2627711;sa=showPosts) I have 24 pages there. And when I add this link to the archiving service, it only archives 1 page, and when I click on the second page, it takes me from the archive page to the forum page. Are there any ways or services that the archive was created at once for the entire list of topics or posts? What archiving services have you tried? Clicking on unarchived links on Wayback Machine (https://web.archive.org/) won't redirect you back to the original url but will open a page with the following message: https://i.imgur.com/TnxryzC.png You can then simply archive the next page by clicking the "Save this url ..." button. Although it's not exactly what you were looking for, at least it will save you some time. EDIT: You can try opening each subsequent link in a new tab to further speed up the process. Title: Re: Archive of forum pages Post by: Quickseller on November 19, 2021, 06:06:13 PM Do you need to be able to *prove* a post said something, or do you want to *know* (for yourself) that a post said something? If the former, you would have to use something like archive.md or the wayback machine. If it is the later, you can write a script to scrape the person's post history and save it somewhere for you. To my knowledge, no archival services offer API access that can be used to save a page.
Title: Re: Archive of forum pages Post by: isaac_clarke22 on November 19, 2021, 06:08:00 PM In Wayback Machine, have you tried checking the "Save Outlinks" option like this?
https://i.ibb.co/C6k8Y5K/ss.png It took quite a while for me to take a snapshot though, maybe due to number of pages. Edit: It was able to archive multiple pages, but some encounter an error like (Error! Unknown error for chrome-error://chromewebdata/ (HTTP status=0).). It might be different in your end, since I am experiencing a little bit of an internet problem right now. :D Title: Re: Archive of forum pages Post by: LoyceV on November 19, 2021, 07:59:51 PM But if I need to archive someone's post history, which consists of 300 pages or even more, then this method is extremely inconvenient. I made something similar for topics last year: LoyceV's Topic Details: highlight deleted and edited posts (forum wide) (https://bitcointalk.org/index.php?topic=5256854.0), but never extended it to post histories:My initial plan was to make this for a user's post history too, but it was much more work than anticipated, so I skipped that. If only I'd have the time (generic archiving sites can't highlight deleted or edited posts).you can write a script to scrape the person's post history and save it somewhere My one-liner:Code: userID=2627711; pages=430; mkdir $userID; echo "Downloading $pages post history pages for user $userID"; i=1; while [ $i -le $pages ]; do wget -qO $userID/$i.html "https://bitcointalk.org/index.php?action=profile;u=$userID;sa=showPosts;start=$((i*20-20))"; echo -n "."; sleep 1; ((i++)); done # Add browser cookie to include Investigations Title: Re: Archive of forum pages Post by: dkbit98 on November 20, 2021, 09:27:43 AM Ninjastic.space website (made by TryNinja) is already archiving everything in bitcointalk forum and you can browse all posts, but it's more tricky if you want to archive some other websites.
Maybe TryNinja can add some filter option (in Search params) so we can only see only topics created by specific member, excluding regular posts, for now you can see archive of all your posts: https://ninjastic.space/search?author=Ratimov Title: Re: Archive of forum pages Post by: Quickseller on November 21, 2021, 12:08:20 AM you can write a script to scrape the person's post history and save it somewhere My one-liner:Code: userID=2627711; pages=430; mkdir $userID; echo "Downloading $pages post history pages for user $userID"; i=1; while [ $i -le $pages ]; do wget -qO $userID/$i.html "https://bitcointalk.org/index.php?action=profile;u=$userID;sa=showPosts;start=$((i*20-20))"; echo -n "."; sleep 1; ((i++)); done # Add browser cookie to include Investigations Title: Re: Archive of forum pages Post by: noorman0 on November 21, 2021, 01:30:42 PM Ninjastic.space website (made by TryNinja) is already archiving everything in bitcointalk forum and you can browse all posts, but it's more tricky if you want to archive some other websites. Maybe TryNinja can add some filter option (in Search params) so we can only see only topics created by specific member, excluding regular posts, for now you can see archive of all your posts: https://ninjastic.space/search?author=Ratimov Additional information: I think nijastic.space already has complete filter parameters (perhaps you didn't know this). Simply go to the main page and select the search parameter (top right) to the left of the ID input textbox. https://i.imgur.com/7nDOy1C.jpg Suppose here I want to see the archive of a topic that has 248 pages. This is the result (https://ninjastic.space/topic/5362529). I tried to look at the topic archive which has over 400 pages and it fails to load the OP's images, sadly. Title: Re: Archive of forum pages Post by: LoyceV on November 21, 2021, 01:39:12 PM I think nijastic.space already has complete filter parameters (perhaps you didn't know this). Simply go to the main page and select the search parameter (top right) to the left of the ID input textbox. If a post was edited later on, the archive is outdated.Title: Re: Archive of forum pages Post by: dkbit98 on November 21, 2021, 04:38:27 PM I think nijastic.space already has complete filter parameters (perhaps you didn't know this). Simply go to the main page and select the search parameter (top right) to the left of the ID input textbox. I know Ninjastic website have many filters but I could not create combination of filters that gives me archive of all the topics created by specific member (excluding regular posts that member wrote).If this is possible, please write below how (example for member Ratimov). Title: Re: Archive of forum pages Post by: hosseinimr93 on November 21, 2021, 05:03:59 PM I know Ninjastic website have many filters but I could not create combination of filters that gives me archive of all the topics created by specific member (excluding regular posts that member wrote). As the replies title start with Re:, you can exclude them from the search result with adding -"Re:" to the post title.If this is possible, please write below how (example for member Ratimov). For example, to get all the topics posted by Ratimov, the parameters should be set as shown in the image below. https://i.imgur.com/RIEIkiF.jpg ninjastic.space (https://ninjastic.space/search?author=Ratimov&title=-%22Re%3A%22) Since users can remove the Re: from the post title, this method is not 100% accurate. But It may be still helpful. Title: Re: Archive of forum pages Post by: dkbit98 on November 21, 2021, 06:19:36 PM As the replies title start with Re:, you can exclude them from the search result with adding -"Re:" to the post title. Interesting approach, but this gave us result of exactly 525 posts, and looking at number of topics created in forum we see that Ratimov made exactly 217 topics (excluding some possibly deleted by moderators).For example, to get all the topics posted by Ratimov, the parameters should be set as shown in the image below. This means that accuracy is somewhere around 42%. EDIT: Correction thanks to Rizzrack, I forgot that I have some boards on ignore option so the real number of created topics is 470 currently, making accuracy percentage much higher. Title: Re: Archive of forum pages Post by: Rizzrack on November 22, 2021, 01:53:29 AM Interesting approach, ... This means that accuracy is somewhere around 42%. I built a Discord bot using TryNinja's API and seems he does not store the info if a post is a thread starter or regular post. More or less used hosseinimr93 's method And also he made much more posts than that. You must have some boards on ignore. I see 474 topics created in his post history (https://bitcointalk.org/index.php?action=profile;threads;u=2627711;sa=showPosts). Thought, to be fair, I also see a few of his deleted posts :P |