|
Title: FPGA Development (SHA256 core) Post by: OrphanedGland on June 12, 2011, 07:34:27 AM Locked out of the FPGA development thread due to the new 50 post restriction.
I mentioned in the main FPGA development thread (by fpgaminer) that I have coded an unrolled sha256 using additional pipelining and was asked about resource usage. I am now compiling with the subscription edition Quartus II v11.0 with an evaluation license. The resource usage is around 44K LE in a Stratix IV (EP4SE530H40C2) for a single core and the clock rate achieved is 240MHz. This device should fit 4 SHA256 pairs with a hash rate approaching 1GH/s. The EP4SE820 should be capable of 2GH/s. I have found a system that uses 20 of these on a single card. Yes this would be expensive to buy (>$200K I assume) but much smaller size and less power usage / heat than a cluster of computers running 6990s, maybe as low as 1-2kW total? As for the cheaper Cyclone IV (EP4CE115F29I7), resource usage is 62K LE (38K combinational functions, 44K registers, it seems Cyclone cannot combine them effectively) and clock rate is 134MHz. A single SHA256 pair with the additional pipelining would struggle to fit in this device, however I have another version which uses just the precalculation of H + K + W to improve clock rate, which will be smaller. I have found a card with 27 Cyclone IIIs, wonder how much that would cost... Interested to hear what other people have achieved in terms of clock rate and resource usage. Title: Re: FPGA Development (SHA256 core) Post by: Jonathan Ryan Owens on June 12, 2011, 09:26:39 AM Locked out of the FPGA development thread due to the new 50 post restriction. I mentioned in the main FPGA development thread (by fpgaminer) that I have coded an unrolled sha256 using additional pipelining and was asked about resource usage. I am now compiling with the subscription edition Quartus II v11.0 with an evaluation license. The resource usage is around 44K LE in a Stratix IV (EP4SE530H40C2) for a single core and the clock rate achieved is 240MHz. This device should fit 4 SHA256 pairs with a hash rate approaching 1GH/s. The EP4SE820 should be capable of 2GH/s. I have found a system that uses 20 of these on a single card. Yes this would be expensive to buy (>$200K I assume) but much smaller size and less power usage / heat than a cluster of computers running 6990s, maybe as low as 1-2kW total? As for the cheaper Cyclone IV (EP4CE115F29I7), resource usage is 62K LE (38K combinational functions, 44K registers, it seems Cyclone cannot combine them effectively) and clock rate is 134MHz. A single SHA256 pair with the additional pipelining would struggle to fit in this device, however I have another version which uses just the precalculation of H + K + W to improve clock rate, which will be smaller. I have found a card with 27 Cyclone IIIs, wonder how much that would cost... Interested to hear what other people have achieved in terms of clock rate and resource usage. $200k for 1 GH/s? That's a deal right there.. Title: Re: FPGA Development (SHA256 core) Post by: kokjo on June 12, 2011, 09:28:07 AM Locked out of the FPGA development thread due to the new 50 post restriction. I mentioned in the main FPGA development thread (by fpgaminer) that I have coded an unrolled sha256 using additional pipelining and was asked about resource usage. I am now compiling with the subscription edition Quartus II v11.0 with an evaluation license. The resource usage is around 44K LE in a Stratix IV (EP4SE530H40C2) for a single core and the clock rate achieved is 240MHz. This device should fit 4 SHA256 pairs with a hash rate approaching 1GH/s. The EP4SE820 should be capable of 2GH/s. I have found a system that uses 20 of these on a single card. Yes this would be expensive to buy (>$200K I assume) but much smaller size and less power usage / heat than a cluster of computers running 6990s, maybe as low as 1-2kW total? As for the cheaper Cyclone IV (EP4CE115F29I7), resource usage is 62K LE (38K combinational functions, 44K registers, it seems Cyclone cannot combine them effectively) and clock rate is 134MHz. A single SHA256 pair with the additional pipelining would struggle to fit in this device, however I have another version which uses just the precalculation of H + K + W to improve clock rate, which will be smaller. I have found a card with 27 Cyclone IIIs, wonder how much that would cost... Interested to hear what other people have achieved in terms of clock rate and resource usage. $200k for 1 GH/s? That's a deal right there.. Title: Re: FPGA Development (SHA256 core) Post by: Jonathan Ryan Owens on June 12, 2011, 09:36:02 AM Locked out of the FPGA development thread due to the new 50 post restriction. I mentioned in the main FPGA development thread (by fpgaminer) that I have coded an unrolled sha256 using additional pipelining and was asked about resource usage. I am now compiling with the subscription edition Quartus II v11.0 with an evaluation license. The resource usage is around 44K LE in a Stratix IV (EP4SE530H40C2) for a single core and the clock rate achieved is 240MHz. This device should fit 4 SHA256 pairs with a hash rate approaching 1GH/s. The EP4SE820 should be capable of 2GH/s. I have found a system that uses 20 of these on a single card. Yes this would be expensive to buy (>$200K I assume) but much smaller size and less power usage / heat than a cluster of computers running 6990s, maybe as low as 1-2kW total? As for the cheaper Cyclone IV (EP4CE115F29I7), resource usage is 62K LE (38K combinational functions, 44K registers, it seems Cyclone cannot combine them effectively) and clock rate is 134MHz. A single SHA256 pair with the additional pipelining would struggle to fit in this device, however I have another version which uses just the precalculation of H + K + W to improve clock rate, which will be smaller. I have found a card with 27 Cyclone IIIs, wonder how much that would cost... Interested to hear what other people have achieved in terms of clock rate and resource usage. $200k for 1 GH/s? That's a deal right there.. So $200k for 20 GH/s.. Assuming that BTCUSD stayed above 15, it would only take a year to get your money back. Title: Re: FPGA Development (SHA256 core) Post by: kokjo on June 12, 2011, 09:45:20 AM Locked out of the FPGA development thread due to the new 50 post restriction. I mentioned in the main FPGA development thread (by fpgaminer) that I have coded an unrolled sha256 using additional pipelining and was asked about resource usage. I am now compiling with the subscription edition Quartus II v11.0 with an evaluation license. The resource usage is around 44K LE in a Stratix IV (EP4SE530H40C2) for a single core and the clock rate achieved is 240MHz. This device should fit 4 SHA256 pairs with a hash rate approaching 1GH/s. The EP4SE820 should be capable of 2GH/s. I have found a system that uses 20 of these on a single card. Yes this would be expensive to buy (>$200K I assume) but much smaller size and less power usage / heat than a cluster of computers running 6990s, maybe as low as 1-2kW total? As for the cheaper Cyclone IV (EP4CE115F29I7), resource usage is 62K LE (38K combinational functions, 44K registers, it seems Cyclone cannot combine them effectively) and clock rate is 134MHz. A single SHA256 pair with the additional pipelining would struggle to fit in this device, however I have another version which uses just the precalculation of H + K + W to improve clock rate, which will be smaller. I have found a card with 27 Cyclone IIIs, wonder how much that would cost... Interested to hear what other people have achieved in terms of clock rate and resource usage. $200k for 1 GH/s? That's a deal right there.. So $200k for 20 GH/s.. Assuming that BTCUSD stayed above 15, it would only take a year to get your money back. Title: Re: FPGA Development (SHA256 core) Post by: OrphanedGland on June 12, 2011, 09:51:26 AM Nah I am estimating $200k for 40GH/s, with capacity to make $65k month at current difficulty if btc hits $30 again.
Title: Re: FPGA Development (SHA256 core) Post by: Gregers on June 12, 2011, 09:57:13 AM The FPGA stuff sounds like a really interesting investment and in the (unlikely?) event that the bitcoin stuff doesn't pan out then I'm sure you could sell the rig to an internet security company or something. 3 months to make your investment back really doesn't sound bad, though.
Title: Re: FPGA Development (SHA256 core) Post by: makomk on June 12, 2011, 10:56:21 AM Wow - that's fairly impressive. I guess precalculating must pay off in a big way, though that's probably not really surprising if you think about it. Managed to get it submitting shares yet? (I'm also curious if you've found a clean way to handle the parts of W that can't be precomputed; it's obviously doable but the obvious ways are really messy.)
Also, you're right about the Cyclone FPGAs not being able to combine combinational functions with registers very effectively. All their registers are hard-wired to the output of the LUTs and other logic devices, which means that if you need to feed a register from somewhere else (like from the output of a register) you can't use the LUT attached to that register for anything else. I wonder if this'd fit into the EP4CE75... Title: Re: FPGA Development (SHA256 core) Post by: OrphanedGland on June 12, 2011, 02:11:38 PM Wow - that's fairly impressive. I guess precalculating must pay off in a big way, though that's probably not really surprising if you think about it. Managed to get it submitting shares yet? (I'm also curious if you've found a clean way to handle the parts of W that can't be precomputed; it's obviously doable but the obvious ways are really messy.) Also, you're right about the Cyclone FPGAs not being able to combine combinational functions with registers very effectively. All their registers are hard-wired to the output of the LUTs and other logic devices, which means that if you need to feed a register from somewhere else (like from the output of a register) you can't use the LUT attached to that register for anything else. I wonder if this'd fit into the EP4CE75... I haven't spent any time on optimizing W calcs, mainly because the worst case path delay is caused by calculation of the A parameter. The H+K+W precalc is the simplest way to improve performance as H, K, W are all known in the previous stage. I get slightly better performance gains by further pipelining the A and E equations, although this seems to benefit Cyclone more than Stratix IV, perhaps because of fast carry chains in the Stratix device? The difficulty with pipelining the unrolled loop stages is that the equations for A/E change, and special cases need to be handled for the first and last few unrolled stages. Also I haven't run this on an FPGA card yet, only simulated the core in ModelSim - still need to create a top level file similar to fpgaminers and cascade two of these SHA256 cores. A fully unrolled and pipelined design will not fit in EP4CE75, you should be going for a partially unrolled solution. Title: Re: FPGA Development (SHA256 core) Post by: OrphanedGland on June 12, 2011, 02:17:19 PM Interested to hear what other people have achieved in terms of clock rate and resource usage. This post restriction seems a little bit... Well lets start a new Newbie FPGA thread here ;) I am still struggeling with a port of TheSevens seriel miner to a Lattice ECP33, the design fits but the P&R is refusing its work, says its too compilcated, frustrating... The ECP33 seems like a slightly small device for this application. What resource usage does the synthesis tool report? Any higher than 75-80% and you are gonna be causing the fitter grief. Title: Re: FPGA Development (SHA256 core) Post by: ijuz on June 12, 2011, 02:19:05 PM The resource usage is around 44K LE in a Stratix IV (EP4SE530H40C2) for a single core and the clock rate achieved is 240MHz. Did the you reach that frequency with or without placement constraints? Title: Re: FPGA Development (SHA256 core) Post by: OrphanedGland on June 12, 2011, 02:26:31 PM The resource usage is around 44K LE in a Stratix IV (EP4SE530H40C2) for a single core and the clock rate achieved is 240MHz. Did the you reach that frequency with or without placement constraints? No placement constraints, and virtual pins defined. Clock rate will probably drop when more of these are packed in but I would still expect > 200MHz on a full device. Title: Re: FPGA Development (SHA256 core) Post by: mjoz on June 12, 2011, 02:29:57 PM Locked out of the FPGA development thread due to the new 50 post restriction. I mentioned in the main FPGA development thread (by fpgaminer) that I have coded an unrolled sha256 using additional pipelining and was asked about resource usage. I am now compiling with the subscription edition Quartus II v11.0 with an evaluation license. The resource usage is around 44K LE in a Stratix IV (EP4SE530H40C2) for a single core and the clock rate achieved is 240MHz. This device should fit 4 SHA256 pairs with a hash rate approaching 1GH/s. The EP4SE820 should be capable of 2GH/s. I have found a system that uses 20 of these on a single card. Yes this would be expensive to buy (>$200K I assume) but much smaller size and less power usage / heat than a cluster of computers running 6990s, maybe as low as 1-2kW total? As for the cheaper Cyclone IV (EP4CE115F29I7), resource usage is 62K LE (38K combinational functions, 44K registers, it seems Cyclone cannot combine them effectively) and clock rate is 134MHz. A single SHA256 pair with the additional pipelining would struggle to fit in this device, however I have another version which uses just the precalculation of H + K + W to improve clock rate, which will be smaller. I have found a card with 27 Cyclone IIIs, wonder how much that would cost... Interested to hear what other people have achieved in terms of clock rate and resource usage. $200k for 1 GH/s? That's a deal right there.. For that kind of money you can buy about 200GH/s through noisy over, power consuming, heat producing rigs. FPGA has a long way to go unless your rich and have an irrational desire to go green regardless of the expense. Title: Re: FPGA Development (SHA256 core) Post by: LCID Fire on June 12, 2011, 02:35:24 PM I would be very interested in that code and perhaps find out whether we can port it to run on GPUs as well.
That's currently the area the miners run on CPU still. Title: Re: FPGA Development (SHA256 core) Post by: ijuz on June 12, 2011, 02:36:57 PM No placement constraints, and virtual pins defined. Clock rate will probably drop when more of these are packed in but I would still expect > 200MHz on a full device. Nice, Quartus seems to be much better in this regards than ISE. I build a quarter sized pipeline (no loopback, just to see how behaves) for Virtex6 and it worked decently, a full sized pipeline took already a _very_ long buildtime and the reachable frequency was pretty bad or edatastic. Title: Re: FPGA Development (SHA256 core) Post by: ijuz on June 12, 2011, 02:38:12 PM I would be very interested in that code and perhaps find out whether we can port it to run on GPUs as well. How do you run Verilog code on an GPU? ;-) Title: Re: FPGA Development (SHA256 core) Post by: mpfrank on June 12, 2011, 02:40:45 PM Wow - that's fairly impressive. I guess precalculating must pay off in a big way, though that's probably not really surprising if you think about it. Managed to get it submitting shares yet? (I'm also curious if you've found a clean way to handle the parts of W that can't be precomputed; it's obviously doable but the obvious ways are really messy.) Also, you're right about the Cyclone FPGAs not being able to combine combinational functions with registers very effectively. All their registers are hard-wired to the output of the LUTs and other logic devices, which means that if you need to feed a register from somewhere else (like from the output of a register) you can't use the LUT attached to that register for anything else. I wonder if this'd fit into the EP4CE75... I haven't spent any time on optimizing W calcs, mainly because the worst case path delay is caused by calculation of the A parameter. The H+K+W precalc is the simplest way to improve performance as H, K, W are all known in the previous stage. I get slightly better performance gains by further pipelining the A and E equations, although this seems to benefit Cyclone more than Stratix IV, perhaps because of fast carry chains in the Stratix device? The difficulty with pipelining the unrolled loop stages is that the equations for A/E change, and special cases need to be handled for the first and last few unrolled stages. Also I haven't run this on an FPGA card yet, only simulated the core in ModelSim - still need to create a top level file similar to fpgaminers and cascade two of these SHA256 cores. A fully unrolled and pipelined design will not fit in EP4CE75, you should be going for a partially unrolled solution. Have you considered using carry-save adders to achieve faster clock speeds? Using carry-save effectively pipelines long carry chains, and usually means you can achieve an adder throughput at the limiting clock speed that is achievable for 1 combinational LUT stage between each stage of pipeline registers. I've found that the adder megafunctions included in Altera's tools cannot run as fast. Title: Re: FPGA Development (SHA256 core) Post by: phillipsjk on June 12, 2011, 03:24:42 PM For that kind of money you can buy about 200GH/s through noisy over, power consuming, heat producing rigs. FPGA has a long way to go unless your rich and have an irrational desire to go green regardless of the expense. If you are generating your own power, the start-up costs are cheaper if you can reduce power usage significantly. I did the math for solar power in this post (http://forum.bitcoin.org/index.php?topic=12518.msg178602#msg178602). Quote 12 Watts is 288 Watt-hours (1.04 MJ) per day. A 12V battery would need a capacity of at least 24 Amp-hours to supply that much load all day (6 amp-hours for a 48V battery). You will want to be able to fully charge the battery in full sun during the day. To do this, the solar panels must charge the battery within ~8 hours (preferably 6). That will take at least 36Watts (assuming 100% battery efficiency) + the 12Watts you are constantly drawing (48 Watts). Round up to a 60Watt panel. For a 60Watt load, you need to multiply all those numbers by 5 (30 amp-hour 48 Volt battery, 300 Watts of panels). For a 600 Watt load, multiply the 60 Watt load by 10: 300 amp-hour 48V battery, 3000 Watts of panels. The beauty of it is that once the infrastructure is paid off, you have "free" (but limited) power. You can still keep power hungry machines using grid power on standby in case the network hash rate drops for whatever reason. Edit: batteries would probably need replacing every 5 years. PS: Solar panels are just an example. Once bitcoin mining goes industrial, we will see the large miners building mega-projects (http://www.gizmag.com/google-invests-168-million-in-solar-power-tower/18383/). Title: Re: FPGA Development (SHA256 core) Post by: OrphanedGland on June 12, 2011, 03:43:44 PM Wow - that's fairly impressive. I guess precalculating must pay off in a big way, though that's probably not really surprising if you think about it. Managed to get it submitting shares yet? (I'm also curious if you've found a clean way to handle the parts of W that can't be precomputed; it's obviously doable but the obvious ways are really messy.) Also, you're right about the Cyclone FPGAs not being able to combine combinational functions with registers very effectively. All their registers are hard-wired to the output of the LUTs and other logic devices, which means that if you need to feed a register from somewhere else (like from the output of a register) you can't use the LUT attached to that register for anything else. I wonder if this'd fit into the EP4CE75... I haven't spent any time on optimizing W calcs, mainly because the worst case path delay is caused by calculation of the A parameter. The H+K+W precalc is the simplest way to improve performance as H, K, W are all known in the previous stage. I get slightly better performance gains by further pipelining the A and E equations, although this seems to benefit Cyclone more than Stratix IV, perhaps because of fast carry chains in the Stratix device? The difficulty with pipelining the unrolled loop stages is that the equations for A/E change, and special cases need to be handled for the first and last few unrolled stages. Also I haven't run this on an FPGA card yet, only simulated the core in ModelSim - still need to create a top level file similar to fpgaminers and cascade two of these SHA256 cores. A fully unrolled and pipelined design will not fit in EP4CE75, you should be going for a partially unrolled solution. Have you considered using carry-save adders to achieve faster clock speeds? Using carry-save effectively pipelines long carry chains, and usually means you can achieve an adder throughput at the limiting clock speed that is achievable for 1 combinational LUT stage between each stage of pipeline registers. I've found that the adder megafunctions included in Altera's tools cannot run as fast. Seems like a worthy consideration Title: Re: FPGA Development (SHA256 core) Post by: njloof on June 12, 2011, 05:52:49 PM Subscribe (don't mind me) :D Am I smoking crack or is there a "notify" button that does this same thing without the threadbump? Title: Re: FPGA Development (SHA256 core) Post by: fpgaminer on June 12, 2011, 06:13:22 PM Great work OrphanedGland :) And thank you for opening a thread in the Newbies section. It will be a pain to keep track of yet another thread, but I guess it is our only option for now.
If you want, I will happily put your code up on the public repo, if you want it available on there. Title: Re: FPGA Development (SHA256 core) Post by: LazarusLong on June 23, 2011, 10:56:31 AM Im porting the miner.py to C because I have no python on my embedded system.
Can someone explan me what this python snipped is all about: Code: self.fpga.write(struct.pack("B", 1) + job.state[::-1] + job.data[75:63:-1]b.r. LazarusLong Title: Re: FPGA Development (SHA256 core) Post by: Bloody Bell on June 23, 2011, 11:21:39 AM Im porting the miner.py to C because I have no python on my embedded system. the -1 after the second colon means reverse order, but in python the number after the first colon is not the last element of the subrange, it's the first element not included. So job.data[75:63:-1] will give you the [75th, 74th, 73rd ... 65th, 64th] elements.Can someone explan me what this python snipped is all about: Code: self.fpga.write(struct.pack("B", 1) + job.state[::-1] + job.data[75:63:-1]b.r. LazarusLong btw, do you plan to make the C version public? Title: Re: FPGA Development (SHA256 core) Post by: LazarusLong on June 23, 2011, 11:36:13 AM Ahh, thanks! I always thought python code is easy to read ;)
I will publish it when finished. Propably in about 1-2 weeks, I have not that much spare time. Title: Re: FPGA Development (SHA256 core) Post by: O_Shovah on June 25, 2011, 03:16:16 PM I have opened a new Thread specifically for the hardware development of a dedicated FPGA mining system. http://forum.bitcoin.org/index.php?topic=22426.0
I'd like to invite everybody interested in helping to plot out the hardware needed to get a prototype of a modular Mining system no matter his experience. I especially like to ask all of you who are currently developing this FPGA Miner to help us determine wich FPGA chips are needed at minium for one execution of a full unrolled Miner. Thank you for your help Title: Re: FPGA Development (SHA256 core) Post by: redhatzero on June 25, 2011, 04:41:03 PM BTW:
Can anyome recommend a nice fpga/verilog/vhdl Tutorial? I have one of these http://www.xess.com/prods/prod047.php and I'm still struggling with simple stuff like let a LED glow... ;) Title: Re: FPGA Development (SHA256 core) Post by: fpgaminer on June 25, 2011, 05:35:24 PM How about this? http://www.fpga4fun.com/ISEQuickStart.html (http://www.fpga4fun.com/ISEQuickStart.html)
And once you have that working, they have an assortment of other little projects with tutorials :) Title: Re: FPGA Development (SHA256 core) Post by: goxed on June 25, 2011, 11:09:30 PM How about this? http://www.fpga4fun.com/ISEQuickStart.html (http://www.fpga4fun.com/ISEQuickStart.html) And once you have that working, they have an assortment of other little projects with tutorials :) Nallatech produces FPGA modules for Xeon sockets. One of these could be used for building FPGA miners http://www.nallatech.com/Intel-Xeon-FSB-Socket-Fillers/fsb-expansion-module.html (http://www.nallatech.com/Intel-Xeon-FSB-Socket-Fillers/fsb-expansion-module.html) Title: Re: FPGA Development (SHA256 core) Post by: eusor on June 25, 2011, 11:14:19 PM How about this? http://www.fpga4fun.com/ISEQuickStart.html (http://www.fpga4fun.com/ISEQuickStart.html) And once you have that working, they have an assortment of other little projects with tutorials :) Nice link, quite interesting! I've done fpga in the past on an old vortex 2 pro. Could be interesting to starting playing again.. Any of you could recommend some good FPGA dev board to start up with? Something that has a good power/price ratio? Thanks ;) Title: Re: FPGA Development (SHA256 core) Post by: fpgaminer on June 25, 2011, 11:24:19 PM DE0-Nano (http://www.terasic.com.tw/cgi-bin/page/archive.pl?Language=English&CategoryNo=139&No=593) is $80 USD for a Cyclone 4 CE22. I haven't used one before, but it seems like a pretty good price point and the board is very spartan.
There are also small Xilinx boards out there that are cheap; just the chip, USB, and GPIO. I can't remember the name of it ... the FPGA mining thread (http://forum.bitcoin.org/index.php?topic=9047.0) lists it somewhere, amongst lots of other options. Title: Re: FPGA Development (SHA256 core) Post by: eusor on June 25, 2011, 11:29:44 PM DE0-Nano (http://www.terasic.com.tw/cgi-bin/page/archive.pl?Language=English&CategoryNo=139&No=593) is $80 USD for a Cyclone 4 CE22. I haven't used one before, but it seems like a pretty good price point and the board is very spartan. There are also small Xilinx boards out there that are cheap; just the chip, USB, and GPIO. I can't remember the name of it ... the FPGA mining thread (http://forum.bitcoin.org/index.php?topic=9047.0) lists it somewhere, amongst lots of other options. Thanks, I'll check that out ;D Title: Re: FPGA Development (SHA256 core) Post by: LazarusLong on July 01, 2011, 04:44:21 PM That one would rock!
http://cgi.ebay.de/Micro-Super-Computer-3-x-Altera-Stratix-III-FPGA-/130500717600 sadly its above my budget ::) Title: Re: FPGA Development (SHA256 core) Post by: tinkerer on August 28, 2011, 04:29:55 AM I've got a DE0-Nano and have been trying unsuccessfully to get the open source fpga miner to compile for it. I'm new to FPGA development and was wondering if someone already has a port running on the Nano and could give me some advice.
Thanks! |