Bitcoin Forum
December 07, 2016, 08:25:08 PM *
News: To be able to use the next phase of the beta forum software, please ensure that your email address is correct/functional.
 
   Home   Help Search Donate Login Register  
Pages: « 1 ... 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 [237] 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 ... 744 »
  Print  
Author Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool  (Read 2032504 times)
Aseras
Hero Member
*****
Offline Offline

Activity: 658


View Profile
March 26, 2013, 03:20:53 AM
 #4721

Having trouble keeping it stable. P2pool keeps crashing. Will only run for an hour or so before it blows up.
It probably can't keep up with the massive hashrate. Might wanna get rid of the --fix-protocol flag.

Have to use it. Otherwise avalon won't run. it doesn't like double byte stratum. Needs to be fixed. It's a known issue.

What we need to do is get Forrest an Avalon to tinker with Cheesy

It's not speed the CPU is fine. It's on a ssd 3930k system. It's not even touching the box. It's seems more like a resource contention problem with memory. Python is running 700-800 mb. Box has 32 gb of ram. usually when it crashes it blows up python and i see tons of weird errors and then scrolls bitcoind lost connection. Restarting p2pool.py fixes it.
1481142308
Hero Member
*
Offline Offline

Posts: 1481142308

View Profile Personal Message (Offline)

Ignore
1481142308
Reply with quote  #2

1481142308
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
-ck
Moderator
Legendary
*
Offline Offline

Activity: 2002


Ruu \o/


View Profile WWW
March 26, 2013, 03:25:26 AM
 #4722

Having trouble keeping it stable. P2pool keeps crashing. Will only run for an hour or so before it blows up.
It probably can't keep up with the massive hashrate. Might wanna get rid of the --fix-protocol flag.

Have to use it. Otherwise avalon won't run. it doesn't like double byte stratum. Needs to be fixed. It's a known issue.

What we need to do is get Forrest an Avalon to tinker with Cheesy
Cause the cgminer devs aren't invited to the party  Cheesy

Primary developer/maintainer for cgminer and ckpool/ckproxy.
Pooled mine at kano.is, solo mine at solo.ckpool.org
-ck
Aseras
Hero Member
*****
Offline Offline

Activity: 658


View Profile
March 26, 2013, 03:28:58 AM
 #4723

Having trouble keeping it stable. P2pool keeps crashing. Will only run for an hour or so before it blows up.
It probably can't keep up with the massive hashrate. Might wanna get rid of the --fix-protocol flag.

Have to use it. Otherwise avalon won't run. it doesn't like double byte stratum. Needs to be fixed. It's a known issue.

What we need to do is get Forrest an Avalon to tinker with Cheesy
Cause the cgminer devs aren't invited to the party  Cheesy

You guys are invited, we love you. How about ssh to a unit? You get it happy, you keep the bitcoin it mines while you work?
-ck
Moderator
Legendary
*
Offline Offline

Activity: 2002


Ruu \o/


View Profile WWW
March 26, 2013, 03:33:11 AM
 #4724

Having trouble keeping it stable. P2pool keeps crashing. Will only run for an hour or so before it blows up.
It probably can't keep up with the massive hashrate. Might wanna get rid of the --fix-protocol flag.

Have to use it. Otherwise avalon won't run. it doesn't like double byte stratum. Needs to be fixed. It's a known issue.

What we need to do is get Forrest an Avalon to tinker with Cheesy
Cause the cgminer devs aren't invited to the party  Cheesy

You guys are invited, we love you. How about ssh to a unit? You get it happy, you keep the bitcoin it mines while you work?
Alas you can't change the software on the unit, it takes uploaded firmware, so the only thing you can do is change the settings being passed to cgminer. While I'd be happy to tell your avalons to mine for me, I can't really improve cgminer to work better on them. Like I said, we weren't invited to the party.

As an aside, use the latest p2pool from git which should at least work with stratum with them and improve their reliability. In short, though, you lose on average .7 seconds of work per longpoll with Avalons. That's a fair percentage with average 10s longpoll equivalents.

Primary developer/maintainer for cgminer and ckpool/ckproxy.
Pooled mine at kano.is, solo mine at solo.ckpool.org
-ck
Aseras
Hero Member
*****
Offline Offline

Activity: 658


View Profile
March 26, 2013, 03:57:48 AM
 #4725

I'm using the latest git pull.

What do you need?  the avalon modified cgminer source code? Need to light a fire under Yifu, zhang and xiangfu to get a real working copy. https://github.com/BitSyncom/cgminer.git

You can modify the software/firmware. I've been doing it all day. I pulled down the latest firmware and hacked the crap out of it and got rid of things I didn't want. Freed up some room. Enough to tinker and add my own scripts and such.

https://en.bitcoin.it/wiki/Avalon#How_to_Compile_Your_Own_WR703N_Firmware_for_Avalon
Aseras
Hero Member
*****
Offline Offline

Activity: 658


View Profile
March 26, 2013, 04:03:42 AM
 #4726

And p2pool crashed again... Keeps imploding and dropping connection to bitcoind. Gonna have to send Forrest some logs.

The avalons are mining fine, better since I went to U/2000+1 without diff they hammer the piss out of the server. Still 10-15% DOA, but better than 25% I started with.
kano
Legendary
*
Offline Offline

Activity: 1932


Linux since 1997 RedHat 4


View Profile
March 26, 2013, 04:06:51 AM
 #4727

And p2pool crashed again... Keeps imploding and dropping connection to bitcoind. Gonna have to send Forrest some logs.

The avalons are mining fine, better since I went to U/2000+1 without diff they hammer the piss out of the server. Still 10-15% DOA, but better than 25% I started with.
The BFLs will work fine on p2pool - get one of them ... whenever they are available Tongue

Meanwhile ... now what did I say to GitSyncom about "proper" Avalon support ... they sure aren't providing anything like that ...

Pool: https://kano.is BTC: 1KanoiBupPiZfkwqB7rfLXAzPnoTshAVmb
CKPool and CGMiner developer, IRC FreeNode #ckpool and #cgminer kanoi
Help keep Bitcoin secure by mining on pools with Stratum, the best protocol to mine Bitcoins with ASIC hardware
Aseras
Hero Member
*****
Offline Offline

Activity: 658


View Profile
March 26, 2013, 04:11:48 AM
 #4728

I wonder if I ran one of the get work to stratum proxies if it would work on p2pool?
-ck
Moderator
Legendary
*
Offline Offline

Activity: 2002


Ruu \o/


View Profile WWW
March 26, 2013, 04:13:30 AM
 #4729

I'm using the latest git pull.

What do you need?  the avalon modified cgminer source code? Need to light a fire under Yifu, zhang and xiangfu to get a real working copy. https://github.com/BitSyncom/cgminer.git

You can modify the software/firmware. I've been doing it all day. I pulled down the latest firmware and hacked the crap out of it and got rid of things I didn't want. Freed up some room. Enough to tinker and add my own scripts and such.

https://en.bitcoin.it/wiki/Avalon#How_to_Compile_Your_Own_WR703N_Firmware_for_Avalon

Well I don't know why you're taking this on yourself... I appreciate the gesture but it's not remotely trivial. Let me explain why it's now not that simple. As the avalon code was developed in secret outside of cgminer development, they worked on a codebase that is now redundant, hacking into it in a way where the only driver that works is for avalon. Cgminer's usb code and queueing has completely changed since then. To bring the avalon code into line would require large chunks of code to be rewritten to suit these changes. This is the danger of writing code out of the main tree. Now porting it to the new driver and queueing model and requires quite a bit of time effort and testing, and needs someone to support it (or not if it's abandoned). This is not in the scope of "lend me access to your mining hardware for a few hours over ssh".  Undecided I suspect Xiangfu will eventually be forced to keep his code in sync with the main cgminer git tree.

Yes I'm bitter about the whole Avalon experience, seeing them mine 10s of thousands of dollars worth of bitcoin each day with software mostly written by us, without them engaging us at all (except to get into a bunfight with Kano) or us earning a cent for our part, but it's not your fault.  Lips sealed

Primary developer/maintainer for cgminer and ckpool/ckproxy.
Pooled mine at kano.is, solo mine at solo.ckpool.org
-ck
Aseras
Hero Member
*****
Offline Offline

Activity: 658


View Profile
March 26, 2013, 04:14:57 AM
 #4730

And p2pool crashed again... Keeps imploding and dropping connection to bitcoind. Gonna have to send Forrest some logs.

The avalons are mining fine, better since I went to U/2000+1 without diff they hammer the piss out of the server. Still 10-15% DOA, but better than 25% I started with.
The BFLs will work fine on p2pool - get one of them ... whenever they are available Tongue

Meanwhile ... now what did I say to GitSyncom about "proper" Avalon support ... they sure aren't providing anything like that ...

Well it's better than anything anyone else has right now, save asicminer. And he's probably using the same thing just in bigger cards I bet.

I've had enough fun for the day. I gotta get to bed. I have to fly to Italy and go play with a lidar unit on a NATO ship. Fun fun..  Glad I got my units in before I left.
Aseras
Hero Member
*****
Offline Offline

Activity: 658


View Profile
March 26, 2013, 04:19:58 AM
 #4731

I'm using the latest git pull.

What do you need?  the avalon modified cgminer source code? Need to light a fire under Yifu, zhang and xiangfu to get a real working copy. https://github.com/BitSyncom/cgminer.git

You can modify the software/firmware. I've been doing it all day. I pulled down the latest firmware and hacked the crap out of it and got rid of things I didn't want. Freed up some room. Enough to tinker and add my own scripts and such.

https://en.bitcoin.it/wiki/Avalon#How_to_Compile_Your_Own_WR703N_Firmware_for_Avalon

Well I don't know why you're taking this on yourself... I appreciate the gesture but it's not remotely trivial. Let me explain why it's now not that simple. As the avalon code was developed in secret outside of cgminer development, they worked on a codebase that is now redundant, hacking into it in a way where the only driver that works is for avalon. Cgminer's usb code and queueing has completely changed since then. To bring the avalon code into line would require large chunks of code to be rewritten to suit these changes. This is the danger of writing code out of the main tree. Now porting it to the new driver and queueing model and requires quite a bit of time effort and testing, and needs someone to support it (or not if it's abandoned). This is not in the scope of "lend me access to your mining hardware for a few hours over ssh".  Undecided I suspect Xiangfu will eventually be forced to keep his code in sync with the main cgminer git tree.

Yes I'm bitter about the whole Avalon experience, seeing them mine 10s of thousands of dollars worth of bitcoin each day with software mostly written by us, without them engaging us at all (except to get into a bunfight with Kano) or us earning a cent for our part, but it's not your fault.  Lips sealed

Well someone's gotta do it. Ill see what I can do. I can code and tinker. I just don't like to much. I'm gonna be gone a fair bit of April. So if you want to screw with my units you can but you may have to call one of my techs to hard reset them if you bork one and can't reset it remotely.

It's an offer if you are interested in doing it right Cheesy

Ps I've probably given you 50 coins by now, over the past couple years. Keep up the good work.
PatMan
Hero Member
*****
Offline Offline

Activity: 924


Watch out for the "Neg-Rep-Dogie-Police".....


View Profile WWW
March 26, 2013, 04:30:47 AM
 #4732

Oh lordy.  Tongue

I wonder how many other people from this pool have ordered Avalons thinking they're gonna work wonders on p2pool?

Maybe p2pool will be the last bastion for gpu mining?...... Grin

"When one person is deluded it is called insanity - when many people are deluded it is called religion" - Robert M. Pirsig.  I don't want your coins, I want change.
Amazon UK BTC payment service - https://bitcointalk.org/index.php?topic=301229.0 - with FREE delivery!
http://www.ae911truth.org/ - http://rethink911.org/ - http://rememberbuilding7.org/
aspirez
Jr. Member
*
Offline Offline

Activity: 42


View Profile
March 26, 2013, 11:58:52 PM
 #4733

Hi i have question,
can i run public pool, using p2pool?
Is there some limit of the max connections?
Aseras
Hero Member
*****
Offline Offline

Activity: 658


View Profile
March 27, 2013, 12:11:08 AM
 #4734

Well I can't get it stable. I tried it under Ubuntu, under python, under windows binaries and python. Still crashes once python/p2pool eats ~1.2gb of ram it blows up and takes down bitcoind. I tried the stratum proxy, old getwork mining proxies,you name it. Nothing will run more than a few hours.

I may try baking my own firmware with some alternative builds, but for now its not working. I can mine on btcguild or slush or eloipool solo and not have any problems.

I'm going to offer a starting bounty of 10BTC for anyone who gets the avalon working properly and stable* on p2pool.

*Ill define properly as a reasonable hashrate and DOA rate ( ~25% on fix-protocol ) and stable as 1 week uptime without p2pool or bitcoind crashing. The avalon itself is buggy and restarts sometimes.
mdude77
Legendary
*
Offline Offline

Activity: 1358


View Profile
March 27, 2013, 12:47:04 AM
 #4735

Well I can't get it stable. I tried it under Ubuntu, under python, under windows binaries and python. Still crashes once python/p2pool eats ~1.2gb of ram it blows up and takes down bitcoind. I tried the stratum proxy, old getwork mining proxies,you name it. Nothing will run more than a few hours.

I may try baking my own firmware with some alternative builds, but for now its not working. I can mine on btcguild or slush or eloipool solo and not have any problems.

I'm going to offer a starting bounty of 10BTC for anyone who gets the avalon working properly and stable* on p2pool.

*Ill define properly as a reasonable hashrate and DOA rate ( ~25% on fix-protocol ) and stable as 1 week uptime without p2pool or bitcoind crashing. The avalon itself is buggy and restarts sometimes.

Why is python/p2pool using so much memory?  I thought the memory leaks were fixed?

What's different about an Avalon from a normal GPU?  The obvious thing to comes to mind is the massive increase in hash rate.  Does p2pool properly scale to keep the difficulty to the miner at a reasonable pace?  Did you try manually forcing the difficulty higher? 

According to https://en.bitcoin.it/wiki/P2Pool, I think you just add /xxxxx to your username to increase the share difficulty.  At 60gh, to get 5 shares an hour, I think it's saying use /10000.  But as many times as I've looked at this page, and the link it refers to https://bitcointalk.org/index.php?topic=18313.msg816322#msg816322, I still don't understand what it's trying to say.

M

MMinerMonitor author, monitor/auto/schedule reboots/alerts/remote/MobileMiner for Ants and Spondoolies! Latest (5.2). MPoolMonitor author, monitor stats/workers for most pools, global BTC stats (current/nxt diff/USD val/hashrate/calc)! Latest (v4.2) 
Buyer beware of Bitmain hardware and services.
-ck
Moderator
Legendary
*
Offline Offline

Activity: 2002


Ruu \o/


View Profile WWW
March 27, 2013, 01:03:14 AM
 #4736

Sounds like the problem is all in the p2pool end anyway? Can you tell if it's actually successfully connecting directly stratum because that would be essential to avoid p2pool sending a lot and higher diffs would be essential to avoid p2pool receiving a lot.

Primary developer/maintainer for cgminer and ckpool/ckproxy.
Pooled mine at kano.is, solo mine at solo.ckpool.org
-ck
Aseras
Hero Member
*****
Offline Offline

Activity: 658


View Profile
March 27, 2013, 01:26:23 AM
 #4737

Sounds like the problem is all in the p2pool end anyway? Can you tell if it's actually successfully connecting directly stratum because that would be essential to avoid p2pool sending a lot and higher diffs would be essential to avoid p2pool receiving a lot.

Avalon Cgminer without fix protocol connects on stratum but resends all work over and over. There's something wrong with the way it reads the stratum response. Someone, Jeff I think, said it has a problem with double byte responses that p2pool makes. On getwork, it just hammers the server and the DOA rate is >25%. Using a very high diff 3000-4000 helps a tiny bit. The highest p2pool would let me go is 6535. Any higher number just comes back as 6535.

Even soloing to a bitcoind alone will crash. It's too much. Hence the need to run a buffer like eloipool between it.

https://github.com/forrestv/p2pool/commit/5f061e6c6753adf93acf04b8463badef88c4106e
kano
Legendary
*
Offline Offline

Activity: 1932


Linux since 1997 RedHat 4


View Profile
March 27, 2013, 05:08:46 AM
 #4738

...
The highest p2pool would let me go is 6535. Any higher number just comes back as 6535.
...
Better get that fixed fast ...

Pool: https://kano.is BTC: 1KanoiBupPiZfkwqB7rfLXAzPnoTshAVmb
CKPool and CGMiner developer, IRC FreeNode #ckpool and #cgminer kanoi
Help keep Bitcoin secure by mining on pools with Stratum, the best protocol to mine Bitcoins with ASIC hardware
rav3n_pl
Legendary
*
Offline Offline

Activity: 1320


Don`t panic! Organize!


View Profile
March 27, 2013, 07:27:42 AM
 #4739

...
The highest p2pool would let me go is 6535. Any higher number just comes back as 6535.
...
Better get that fixed fast ...
I think it is in getwork.py:
Code:
'target': pack.IntType(256).pack(self.share_target).encode('hex'),

1Rav3nkMayCijuhzcYemMiPYsvcaiwHni  Bitcoin stuff on my OneDrive
My RPC CoinControl for any coin https://bitcointalk.org/index.php?topic=929954
My SatoshDice bot https://bitcointalk.org/index.php?topic=897685
-ck
Moderator
Legendary
*
Offline Offline

Activity: 2002


Ruu \o/


View Profile WWW
March 27, 2013, 07:42:31 AM
 #4740

Sounds like the problem is all in the p2pool end anyway? Can you tell if it's actually successfully connecting directly stratum because that would be essential to avoid p2pool sending a lot and higher diffs would be essential to avoid p2pool receiving a lot.

Avalon Cgminer without fix protocol connects on stratum but resends all work over and over. There's something wrong with the way it reads the stratum response. Someone, Jeff I think, said it has a problem with double byte responses that p2pool makes. On getwork, it just hammers the server and the DOA rate is >25%. Using a very high diff 3000-4000 helps a tiny bit. The highest p2pool would let me go is 6535. Any higher number just comes back as 6535.

Even soloing to a bitcoind alone will crash. It's too much. Hence the need to run a buffer like eloipool between it.

https://github.com/forrestv/p2pool/commit/5f061e6c6753adf93acf04b8463badef88c4106e
Well cgminer has changed a lot since the version included with Avalon with lots of bugfixes and improvements, and I can't attest to any code added to the Avalon release so... usual disclaimers apply. On the upside, Xiangfu has said to me on IRC that he will be updating the code to bring it in line with mainline cgminer. But then I'm still out of the loop and only obliged to audit his code if he wants to push it upstream to me.

Primary developer/maintainer for cgminer and ckpool/ckproxy.
Pooled mine at kano.is, solo mine at solo.ckpool.org
-ck
Pages: « 1 ... 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 [237] 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 ... 744 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!