"Show All" on long topics

[Veleor]

Test: http://loyce.club/showall/5023605.html

You could have just clicked https://bitcointalk.org/index.php?topic=5023605.0;all , this topic is short enough

I know, I didn't want to load extra resources for a testing. 

[NeuroticFish]

Limitations
I scrape a maximum of 500 pages per topic (sorry Wall Observer).

If it's not too much work, maybe you can do something like http://loyce.club/show/178336.html?last=10 to help people catch up easier with the last couple of pages (it can be useful exactly for WO) without killing your scrapper or the browser?

[LoyceV]

Limitations
I scrape a maximum of 500 pages per topic (sorry Wall Observer).

If it's not too much work, maybe you can do something like http://loyce.club/show/178336.html?last=10 to help people catch up easier with the last couple of pages (it can be useful exactly for WO) without killing your scrapper or the browser?

And another 80 minutes wasted
How's this:
All posts in the Wall Observer thread in the past 1h, 24h and 7d
All posts in the past 1 hour: WallObserver.tk/1h.html (updated every 3 minutes).
All posts in the past 24 hours: WallObserver.tk (updated every 30 minutes).
All posts in the past 7 days: WallObserver.tk/7d.html (updated every 2 hours).

Domain WallObserver.tk expires a year from now, I'll see by then if anyone uses it.
All times are set to Amsterdam time.

Limitations:
Images still go through Bitcointalk's image proxy, and they don't load when there are too many on one page. In Firefox a fix is to go to the URL-bar a few times, and press Enter. Just "Reload" doesn't help.

[NeuroticFish]

And another 80 minutes wasted
How's this:
All posts in the Wall Observer thread in the past 1h, 24h and 7d
All posts in the past 1 hour: WallObserver.tk/1h.html (updated every 3 minutes).
All posts in the past 24 hours: WallObserver.tk (updated every 30 minutes).
All posts in the past 7 days: WallObserver.tk/7d.html (updated every 2 hours).

Domain WallObserver.tk expires a year from now, I'll see by then if anyone uses it.

Wow, thank you very much. I didn't expect it'll take so much time, but on the other hand you've taken quite a different (and much more optimized) approach.
At least one person will use it.


Edit 2019-10-25: and thanks for updating to a more readable font 

[CookieFactory]

Limitations
I scrape a maximum of 500 pages per topic (sorry Wall Observer).

If it's not too much work, maybe you can do something like http://loyce.club/show/178336.html?last=10 to help people catch up easier with the last couple of pages (it can be useful exactly for WO) without killing your scrapper or the browser?

And another 80 minutes wasted
How's this:
All posts in the Wall Observer thread in the past 1h, 24h and 7d
All posts in the past 1 hour: WallObserver.tk/1h.html (updated every 3 minutes).
All posts in the past 24 hours: WallObserver.tk (updated every 30 minutes).
All posts in the past 7 days: WallObserver.tk/7d.html (updated every 2 hours).

Domain WallObserver.tk expires a year from now, I'll see by then if anyone uses it.
All times are set to Amsterdam time.

Limitations:
Images still go through Bitcointalk's image proxy, and they don't load when there are too many on one page. In Firefox a fix is to go to the URL-bar a few times, and press Enter. Just "Reload" doesn't help.

This is awesome. I have a "sentiment analysis" bot that currently runs on tweets and subreddits but I'll incorporate this feed as well. Thanks!

[LoyceV]

In case there are still people who love scrolling, hate clicking, and don't yet know that I made this:

All posts in the Wall Observer thread in the past 1h, 24h and 7d
All posts in the past 1 hour: WallObserver.tk/1h.html (updated every 3 minutes).
All posts in the past 24 hours: WallObserver.tk (updated every 30 minutes).
All posts in the past 7 days: WallObserver.tk/7d.html (updated every 2 hours).

Domain WallObserver.tk expires a year from now, I'll see by then if anyone uses it.
All times are set to Amsterdam time.

I moved it to a new server, and it's back online now

[TheBeardedBaby]

A frendly bump with a request. I need a "show all" of my Club thread : http://loyce.club/showall/4720640.html
Thank yoU
As usual, didn't read the OP, link updated... I know it's too late now.

[LoyceV]

A frendly bump with a request. I need a "show all" of my Club thread : https://bitcointalk.org/index.php?topic=4720640.0

You're posting the wrong link, it should be http://loyce.club/showall/4720640.html !
I haven't tested this in a long time, but it should still work. Wait a few minutes before testing the link.

If it still works: posting a link like this doesn't have to be in this thread only, any topic will do.

[TheBeardedBaby]

A frendly bump with a request. I need a "show all" of my Club thread : https://bitcointalk.org/index.php?topic=4720640.0

You're posting the wrong link, it should be http://loyce.club/showall/4720640.html !
I haven't tested this in a long time, but it should still work. Wait a few minutes before testing the link.

If it still works: posting a link like this doesn't have to be in this thread only, any topic will do.

Thank you, can I give one suggestion, please add a link to : [overview] LoyceV's useful data on Bitcointalk somewhere on the loyce.club website? I have bookmarked it but it will be much easier for everyone to link it there.

Update:Waited over an hour.. no luck ... 404.

[blue Snow]

I am following your guide "how to use" and I getting error opened to show all thread http://loyce.club/showall/750446.html
Because I am a newbie here, I want to know about the forum in one page [Q&A] Tanya Jawab Seputar Forum Disini/Ask about this forum here!

[LoyceV]

Update:Waited over an hour.. no luck ... 404.

I'll fix it later today. That was easy: it still used old upload credentials. Everything works again.

http://loyce.club/showall/4720640.html !

I am following your guide "how to use" and I getting error opened to show all thread http://loyce.club/showall/750446.html

This one is ready now

please add a link to : [overview] LoyceV's useful data on Bitcointalk somewhere on the loyce.club website?

Done

[guigui371]

wiling to scrape this thread  (to find a message I wrote 50 pages ago :
http://loyce.club/showall/1935179.html
cheers

[KonstantinosM]

http://loyce.club/showall/130619.html

[coinlocket$]

http://loyce.club/showall/3479652.html

[bitbollo]

http://loyce.club/showall/2106360.html

[Pmalek]

@LoyceV
Is there a way for you to find out from which thread the link got scrapped from?

I tried it out a few days ago in the Croatian local forum. I wanted to scrape this: https://bitcointalk.org/index.php?topic=4265795.0
My post with the link was on page 100. I waited for quite a long time but your scrapper didn't catch it (so I think). After that I made a second post and added the link in a new thread in the Archival sub-board. That one seemed to work, or it was maybe the the one I initially posted in the Croatian local, but it needed more time.

Can you see which post got scrapped? 

[LoyceV]

Can you see which post got scrapped?

Anything in your unedited post history gets processed.
Or easier (and probably the same data): https://ninjastic.space/search?author=Pmalek&content=showall
It looks like you didn't wait long enough, scraping 100 pages takes about half an hour. Unlike my topic details, I didn't implement a place holder while processing data.

Note that posting the same link again on another board triggers a new update.

Bonus link with topic details: https://loyce.club/archive/details/topic_4265795.html

I've upgraded the format from "http" to "https".

[LoyceV]

Bump! Let's see if this still works