Bitcoin Forum

Other => Meta => Topic started by: devvienuis on October 01, 2017, 09:27:37 AM



Title: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: devvienuis on October 01, 2017, 09:27:37 AM
action=.xml is disabled due to slowness. If you use this, write a post in Meta explaining your usage.

https://bitcointalk.org/index.php?action=.xml;type=atom;sa=news;limit=6;board=6.0

Hello, for a couple of days now I am unable to tweet any new RSS items on twitter.com/devnullius.

WHen I checked my BCT feeds, I found this message. Kindly unlock me? It's a win-win for the both of us :)

♥ Devvie
twitter.com/devnullius



Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: CoinMonsta.io on October 01, 2017, 12:54:28 PM
You are not locked. They took down the feed for everybody. There has been no update regarding if it is ever coming back.


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: devvienuis on October 02, 2017, 01:22:15 AM
You are not locked. They took down the feed for everybody. There has been no update regarding if it is ever coming back.
ah man! whom would know? I really thought I was tweeting them for a good day before being locked :/


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: TheButterZone on October 02, 2017, 06:48:19 PM
I'm subscribed in Thunderbird to subforum feeds I can possibly make money from.


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: devvienuis on October 03, 2017, 10:15:28 AM
I'm subscribed in Thunderbird to subforum feeds I can possibly make money from.

These feeds will work with THunderbird but not with other readers / parsers...?


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: TheButterZone on October 03, 2017, 10:25:27 AM
I'm subscribed in Thunderbird to subforum feeds I can possibly make money from.

These feeds will work with THunderbird but not with other readers / parsers...?

They don't. I didn't see the "action=.xml is disabled due to slowness. If you use this, write a post in Meta explaining your usage." until I poked around in Meta looking for an explanation why Thunderbird had blank feeds. My post above is explaining my usage.


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: phelix on October 11, 2017, 07:31:24 AM
> action=.xml is disabled due to slowness. If you use this, write a post in Meta explaining your usage.
I use it for my website http://blockchained.com bitcointalk top posts. Without xml parsing it won't work.

edit: the page I need to access is: https://bitcointalk.org/index.php?action=.xml;sa=recent;limit=255


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: pennywise on October 20, 2017, 08:28:54 PM
Hey, I would like to voice some support to phelixes site; I became used to monitor new topics from there and now it doesn't work anymore  :(

I hope this gets sorted out because the list of the most viewed topics was really nice.



Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: theymos on October 20, 2017, 08:56:21 PM
Alright, I'll try to enable at least some of its functionality in the near future. (The trouble is that action=.xml has a whole bunch of options, and I know that some combinations of options end up resulting in minutes of computation. I need to figure it out.)


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: redrider on October 23, 2017, 09:06:44 PM
I primarily only use bitcointalk through blockchained.com so that would be great if this could get fixed so the hot topic scraper would work.  Thanks!


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: Equilux on November 05, 2017, 05:06:55 PM
Hey, I would like to voice some support to phelixes site; I became used to monitor new topics from there and now it doesn't work anymore  :(

I hope this gets sorted out because the list of the most viewed topics was really nice.



Same here! It was such a usefull feature!


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: phelix on November 06, 2017, 08:26:29 AM
Alright, I'll try to enable at least some of its functionality in the near future. (The trouble is that action=.xml has a whole bunch of options, and I know that some combinations of options end up resulting in minutes of computation. I need to figure it out.)
Note that I only sample that page every 10 minutes with exactly these options:

https://bitcointalk.org/index.php?action=.xml;sa=recent;limit=255

If there is another way to achieve something similar (a largish number of recent posts) I might look into it as well.


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: disclaimer201 on November 11, 2017, 12:57:39 PM
Would love to see blockchained working again.


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: DoomDumas on November 13, 2017, 09:05:38 PM
> action=.xml is disabled due to slowness. If you use this, write a post in Meta explaining your usage.
I use it for my website http://blockchained.com bitcointalk top posts. Without xml parsing it won't work.

edit: the page I need to access is: https://bitcointalk.org/index.php?action=.xml;sa=recent;limit=255

Yeah, this was awesome and very usefull... Can BitcoinTalk.org enable it please ?

I like this tool to browse 'hot topics'

Thanks for all this phelix


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: DoomDumas on November 13, 2017, 09:08:26 PM
Alright, I'll try to enable at least some of its functionality in the near future. (The trouble is that action=.xml has a whole bunch of options, and I know that some combinations of options end up resulting in minutes of computation. I need to figure it out.)

Thanks theymos for your time.. phelix blockchained page was very usefull.. otherwise I wont come here in bitcointalk.org



Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: altdev on November 20, 2017, 10:19:10 PM
Alright, I'll try to enable at least some of its functionality in the near future. (The trouble is that action=.xml has a whole bunch of options, and I know that some combinations of options end up resulting in minutes of computation. I need to figure it out.)

Thanks theymos for your time.. phelix blockchained page was very usefull.. otherwise I wont come here in bitcointalk.org


I think the same goes for my followers and the about 250k / 350k daily impressions ;-)

Let us know if you figure it out!

(and how I can get my account devvienuis back ;p)

twitter.com/devnullius


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: DoomDumas on November 22, 2017, 12:27:22 AM
theymos ???


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: DoomDumas on November 28, 2017, 03:26:58 AM
houston ?


 :-\

 :'(



Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: Equilux on December 11, 2017, 10:59:59 PM
Has there been any progress with this? It's such a shame to not have this working!


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: DoomDumas on December 17, 2017, 02:19:02 PM
Has there been any progress with this? It's such a shame to not have this working!

Indeed   :'(

sounds like a quick fix to do..  quite sad !


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: vainhaver on December 24, 2017, 06:46:38 PM
Same, here. Currently you would be required to scrape the website and extract the DOM elements from the HTML. And then parse those. I am very curious if we can get an answer from somewhere. I've found nothing in meta.


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: bluefirecorp_ on December 24, 2017, 06:56:00 PM
Same, here. Currently you would be required to scrape the website and extract the DOM elements from the HTML. And then parse those. I am very curious if we can get an answer from somewhere. I've found nothing in meta.

Same. Wouldn't generating all that extra shit take more CPU / bandwidth than the xml page? ._.


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: likewhoa on December 26, 2017, 11:02:08 AM
I would suggest you spend the time figuring out the best approach to enable back the RSS syndication on the BCT website otherwise you will get a lot of actual scrapers hitting up the website causing even more load because of the nature of scraping versus an RSS feed that would only return data when it has changed. I also vote for giving back 'devnullius' her account back as I scrape her all day long and I can't go to sleep if i can't do that!  ;D

@admins take a look at http://www.simplemachines.org/community/index.php?topic=25009.0 perhaps it can give you some insight. I just found this while looking to add yet another source of information to my news bot in discord and showing latest,most views, most discussed and popular postings from BCT would be a great addition to my news bot. Thanks in advanced.


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: pit2525 on December 28, 2017, 05:07:36 PM
Would it be allowed to scrape bitcointalk? Because I think about developing a scraper for this. Doesn't make sense if it gets blocked after being recognised.

I'm happy to play this open and would love to see feedback from the admins either

a) about enabling RSS/XML option or

b) if I'm free to use a scraper and with which limits


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: DoomDumas on January 20, 2018, 05:01:24 AM
 :-[
:'(
 :-\
 ??
theymos ??


Title: Re: action=.xml is disabled due to slowness. If you use this, write a post in Meta
Post by: Mr_SeLeNiO on February 11, 2018, 11:59:00 AM
:-[
:'(
 :-\
 ??
theymos ??

 :'(