Bitcoin Forum

Other => Meta => Topic started by: LoyceV on January 03, 2020, 08:50:27 AM



Title: Slow forum
Post by: LoyceV on January 03, 2020, 08:50:27 AM
Part of the forum, such as my Watchlist and making a new post, are very slow. My scraper (https://bitcointalk.org/index.php?topic=5167469.0) is missing about 1% of all posts now.

Anyone else with this problem?


Title: Re: Slow forum
Post by: TheBeardedBaby on January 03, 2020, 08:54:07 AM
Part of the forum, such as my Watchlist and making a new post, are very slow. My scraper (https://bitcointalk.org/index.php?topic=5167469.0) is missing about 1% of all posts now.

Anyone else with this problem?

Yes, I'm using TOR.

Can be because of this :

The index is being rebuilt. It's taking a little longer than I remembered from last year: it might actually be tomorrow or the next day before it's done.

There's a Google custom search on the search page (https://bitcointalk.org/index.php?action=search) which is similar to site:bitcointalk.org but with some extras. The forum search is worse in some ways and better in others. If you realize that the forum search functions in terms of exact words (eg. a search of bitcoin ethereum returns posts which contain exactly the two words bitcoin and ethereum, disregarding placement and not considering related words like bitcoins), then you can use it effectively.

Edit: the search engine is still down so the index rebuilding is still in process.


Title: Re: Slow forum
Post by: NeuroticFish on January 03, 2020, 08:55:20 AM
I've noticed slowness at posting, but not at browsing.
And I've seen others in WO complaining about slowness (https://bitcointalk.org/index.php?topic=178336.msg53507322#msg53507322) or asking about DDoS (https://bitcointalk.org/index.php?topic=178336.msg53506958#msg53506958).

No ToR or proxies in my case.


Title: Re: Slow forum
Post by: UserU on January 03, 2020, 09:32:15 AM
Everything you mentioned loads normally on my end.

Is it still happening?


Title: Re: Slow forum
Post by: rhomelmabini on January 03, 2020, 01:17:42 PM
I've noticed slowness at posting, but not at browsing.

Same issue I am experiencing right now. It takes more seconds now to load or save your posts.


Title: Re: Slow forum
Post by: Murat on January 03, 2020, 01:21:41 PM
It works fine for me. Maybe Clear the cache & old site data?



Title: Re: Slow forum
Post by: pooya87 on January 03, 2020, 02:34:39 PM
~

some more functionalities other than search are down. for instance if you try to visit merit stats (something i did yesterday and again today) things blow up and you'll see a Error 524 (timeout) with Cloudflare warning saying bitcointalk.org is offline.
https://i.imgur.com/6UOsLTJ.jpg


Title: Re: Slow forum
Post by: hacker1001101001 on January 03, 2020, 06:21:09 PM
~

some more functionalities other than search are down. for instance if you try to visit merit stats (something i did yesterday and again today) things blow up and you'll see a Error 524 (timeout) with Cloudflare warning saying bitcointalk.org is offline.

I can see merit status page without any issues. Don't know what's wrong with yours one, but it could because of the above mentioned index rebuilding thing, don't know.


Title: Re: Slow forum
Post by: UserU on January 03, 2020, 06:37:04 PM

I can see merit status page without any issues. Don't know what's wrong with yours one, but it could because of the above mentioned index rebuilding thing, don't know.

For me, it just loads indefinitely if I'm logged in but leads me to the login page when tried on Incognito or another browser. Strange.


Title: Re: Slow forum
Post by: hacker1001101001 on January 03, 2020, 06:45:01 PM
I can see merit status page without any issues. Don't know what's wrong with yours one, but it could because of the above mentioned index rebuilding thing, don't know.
For me, it just loads indefinitely if I'm logged in but leads me to the login page when tried on Incognito or another browser. Strange.

To view the merit status of an user you need to be logged in into an account. Incognito would not regrasp your login if you are logged in on a normal tab in Chrome same goes with other browsers, you need to log in first.


Title: Re: Slow forum
Post by: mersal on January 03, 2020, 06:54:56 PM
For the last 24 hours I am experience little bit slow while loading pages and also while hitting post button,thought it was my internet connection issue but after reading the replies here I realized that it was due things as @iasenko said.

But when I am on my mobile I don't get any slow loading pages,which works/looks normal to me.


Title: Re: Slow forum
Post by: PrimeNumber7 on January 03, 2020, 07:08:15 PM
Part of the forum, such as my Watchlist and making a new post, are very slow. My scraper (https://bitcointalk.org/index.php?topic=5167469.0) is missing about 1% of all posts now.

Anyone else with this problem?
You can direct your script to review multiple pages of recent if it detects that all the posts it most recently scrapes are new, it can continue doing this until it reaches the last maximum recent page the forum provides.

You can also try using a different library and/or browser your scraper uses. Ditto with OS and server location, but this is less likely to have an effect on anything.


Title: Re: Slow forum
Post by: Tramirostronix on January 03, 2020, 09:04:35 PM
A little bit slower when I want to reply but not when I post.
I'm using firefox and on my phone no problem at all (using chrome)


Title: Re: Slow forum
Post by: LoyceV on January 04, 2020, 08:44:07 AM
You can direct your script to review multiple pages of recent if it detects that all the posts it most recently scrapes are new, it can continue doing this until it reaches the last maximum recent page the forum provides.
I've thought about it, but haven't had the time to add it yet.
Ideally, I should switch to scraping from another server if I miss a few posts. That way, I could even cover downtime if I reboot the server. But that's for later :)


Title: Re: Slow forum
Post by: Pmalek on January 04, 2020, 08:51:28 AM
Browsing and posting was slow for me yesterday but it seems to be back to normal today. I just tried to initiate a forum search and it is still not working.
But since I use site:bitcointalk.org TEXT when I am searching for something I don't really care.


Title: Re: Slow forum
Post by: fillippone on January 04, 2020, 09:17:50 AM
I have been a lot online lately to craft a few new threads.
If I hadn’t read your post I wouldn’t have noticed anything.
I saw search is down, but didn’t know why.
Site has always been very reliable from a moltitudine of devices and (physical) connecting points.
All functions (included external ones as for giammangiato notification bot (https://bitcointalk.org/index.php?topic=5209107.msg53330085#msg53330085)) have been functioning as expected (ban search, as explained).


Title: Re: Slow forum
Post by: PrimeNumber7 on January 04, 2020, 09:31:35 AM
You can direct your script to review multiple pages of recent if it detects that all the posts it most recently scrapes are new, it can continue doing this until it reaches the last maximum recent page the forum provides.
I've thought about it, but haven't had the time to add it yet.
Ideally, I should switch to scraping from another server if I miss a few posts. That way, I could even cover downtime if I reboot the server. But that's for later :)
If you want, you can send me your code for your scraper. Adding a counter and telling your script to check the next page is something that should be very simple (< 5 mins, including testing). If I am familiar with the programming language (or if I can read the documentation necessary to help in a short time), I can give you suggested lines of code to add.


Title: Re: Slow forum
Post by: hacker1001101001 on January 04, 2020, 01:00:38 PM
Search function is back working.

Quote from: theymos
It's back
https://bitcointalk.org/index.php?topic=5214287.msg53517113#msg53517113