[OS] nvOC easy-to-use Linux Nvidia Mining

[fullzero]

So I was trying to run 7 Zotac 1070 Minis with Asus Z270F using Z270A image, the most it could detect is 6 Zotacs. Someone here said that Z270F runs 7 GPUs out of the box, but not in my case. I need to try windows to verify that. Do you have Z270F and planning to post an image? Running 6 Zotacs with TB85 for now, but Minis are so tiny that 8 could fit in Rosewill easily.

Thanks.

I just got one of these mobos in yesterday.  I can get 7x cards to be detected by the system, but there is a conflict with x and the driver.  I can manually OC the first 6 cards, but the 7th has no response to OC commands.  

There is also what appears to be a TPM / Secureboot problem preventing subsequent boots into the same install.  Initially changing the bios setting for enabling above 4gb encoding is required to get 7 cards to work.  There are also some TPM / Secureboot bios changes that are needed, but I still need to isolate which.  I started with the MSI z270-A PRO image.

I will work on this more tonight.

First of all this is an awesome project. Thanks for doing this.  I will mine to your wallets or something to give monetary thanks.

Did you ever get any further on this Z270F mobo.  I can only see 6 cards. I would love to get 9 going.

cheers ever so much.

With v0015 you can use 7x GPUs with that mobo; 9x if you have 2x m2 adapters.

Edit: ensure that you make the bios changes listed for that mobo on the OP.

I followed those instructions and I am using v0015. 

Obviously it works then but I must be missing something.

It might be a hardware problem: what kind of risers are you using, and how are they powered?

What GPUs, and PSU?

7 x https://www.amazon.com/gp/product/B01N3UVJHM/ref=oh_aui_detailpage_o04_s01?ie=UTF8&psc=1
7 x https://www.neweggbusiness.com/product/product.aspx?item=9b-14-487-261
2 x https://www.neweggbusiness.com/product/product.aspx?item=9b-17-438-092
1 x https://www.neweggbusiness.com/product/product.aspx?item=9b-19-117-745
1 x https://www.neweggbusiness.com/product/product.aspx?item=9b-20-156-103

I dont have the m2 adapters yet.

only 6 cards show up in the bios which supports a hardware issue.  I have another mobo which i can test.  I tried a different riser

I have 4GPUs on one PSU and 7 on the other plus Mobo

Sometimes the gpu that isn't working; isn't the one you expect it to be. 

To ensure you know which one isn't working; mine for a little while, at least 10 mins. 

Feel the heatsink of each GPU until you find the one that isn't hot. 

Power down the rig, turn off the PSU.

Either remove that GPU and test it on another motherboard;

or remove all the other GPUs and try booting with just the problem GPU directly in the primary slot in the mobo.

This should tell you if that GPU is INOP or not.

Let me know what the result is. 

Going to sleep now.

[1713414599]

1713414599

[1713414599]

1713414599

[bibyfok]

Maybe a stupid question: how do you determine what card is what number? Are the PCI slot order from top to bottom GPU1/GPU2/GPU3 etc?

[Maxximus007]

Maybe a stupid question: how do you determine what card is what number? Are the PCI slot order from top to bottom GPU1/GPU2/GPU3 etc?

That can be quite difficult at times. Generally the 16x PCI-E slot on the motherboard is GPU0. After that one the one closest to the CPU will be GPU1, and then further down.
But the method of disabling a GPU in the miner and touch the GPU's after 10 minutes will make sure you have the numbering okay..
I personally switch the riser cable after that so it's in the right order in the rig in case of future issues.

[cvitanihc0011]

Have 2 miners on this and they seem to work fine for a few hours and then crash :

09:29:41:752   bf3e6740   watchdog - fminer thread hangs
09:29:41:752   bf3e6740   em hbt: 0, fm hbt: 130832,
09:29:41:752   bf3e6740   Miner thread hangs, need to restart miner!

Too much OC ?
Also ... the USB seems hot ... doesn't it get damaged in time ?

[cvitanihc0011]

Would it help to use a ssd instead of usb ? For me it lags each time i open something..click something ..
Even if the miner is closed. I see there are links for ssd connection

[fullzero]

Have 2 miners on this and they seem to work fine for a few hours and then crash :

09:29:41:752   bf3e6740   watchdog - fminer thread hangs
09:29:41:752   bf3e6740   em hbt: 0, fm hbt: 130832,
09:29:41:752   bf3e6740   Miner thread hangs, need to restart miner!

Too much OC ?
Also ... the USB seems hot ... doesn't it get damaged in time ?

What GPUs and OC settings are you using; also what is the ambient tempature near the rig?

Also what kind of USB key are you using?

Would it help to use a ssd instead of usb ? For me it lags each time i open something..click something ..
Even if the miner is closed. I see there are links for ssd connection

You can use an ssd if you want; see

https://bitcointalk.org/index.php?topic=1854250.msg19300078#msg19300078

https://bitcointalk.org/index.php?topic=1854250.msg19328385#msg19328385


In my experience a fast USB is reasonably responsive.  The lexar ones I recommend are fast and cheap.

If they aren't fast enough for you: these are faster HQ very high speed USB keys are around $22:

https://www.amazon.com/SanDisk-Extreme-Flash-Drive-SDCZ80-032G-GAM46/dp/B00KT7DXIU

https://www.amazon.com/dp/B00S6DBGLK

[Brucelats]

Great thread!

I seen some thread about runing Ubuntu 14.04 server, instaling nvidia CUDA8 drivers etc but thread is old, and not rly well explained. I was struggling to install stuff etc.

Here is the link https://forum.ethereum.org/discussion/7780/gtx1070-linux-installation-and-mining-clue-goodbye-amd-welcome-nvidia-for-miners/p1


But anyway ! I droped guide from this link and i'll try to set up my mining rig based on ur thread.


I have few questions - is your nvOC also using cuda8 drivers? I heard/read that using them can make mining more effective, combined with genoil Cuda miner, what you think about that?



Second - i have this motherboard - https://www.asus.com/us/Motherboards/PRIME-Z270-P/   will that one work?

And i use this GPU-s: https://www.asus.com/Graphics-Cards/DUAL-GTX1070-O8G/


If you could give some insights/feedback/opinion on what i asked would be greatly apreciated! Cheers!

[jmooney5115]

I have few questions - is your nvOC also using cuda8 drivers? I heard/read that using them can make mining more effective, combined with genoil Cuda miner, what you think about that?

Second - i have this motherboard - https://www.asus.com/us/Motherboards/PRIME-Z270-P/   will that one work?

Third - i use this GPU-s: https://www.asus.com/Graphics-Cards/DUAL-GTX1070-O8G/


If you could give some insights/feedback/opinion on what i asked would be greatly apreciated! Cheers!

This OS is definitely easier than that guide. I spent >4 hours playing with Windows before I found a 16GB flash drive to try this out. It booted up and started mining in minutes.

I can give you some insight on the hardware.

Second - I suspect that motherboard will work. This OS works with the PRIME-Z270-A. The Z270-P should work in my mind.

Third - That GPU will work. Currently I have 4x EVGA 1070 on a GIGABYTE GA-B250M-Gaming 5.

[Nexillus]

Have 2 miners on this and they seem to work fine for a few hours and then crash :

09:29:41:752   bf3e6740   watchdog - fminer thread hangs
09:29:41:752   bf3e6740   em hbt: 0, fm hbt: 130832,
09:29:41:752   bf3e6740   Miner thread hangs, need to restart miner!

Too much OC ?
Also ... the USB seems hot ... doesn't it get damaged in time ?

What GPUs and OC settings are you using; also what is the ambient tempature near the rig?

Also what kind of USB key are you using?

Would it help to use a ssd instead of usb ? For me it lags each time i open something..click something ..
Even if the miner is closed. I see there are links for ssd connection

You can use an ssd if you want; see

https://bitcointalk.org/index.php?topic=1854250.msg19300078#msg19300078

https://bitcointalk.org/index.php?topic=1854250.msg19328385#msg19328385


In my experience a fast USB is reasonably responsive.  The lexar ones I recommend are fast and cheap.

If they aren't fast enough for you: these are faster HQ very high speed USB keys are around $22:

https://www.amazon.com/SanDisk-Extreme-Flash-Drive-SDCZ80-032G-GAM46/dp/B00KT7DXIU

https://www.amazon.com/dp/B00S6DBGLK

I have several of these, they work very well.

https://www.amazon.com/gp/product/B015CH1JIW/ref=oh_aui_detailpage_o00_s00?ie=UTF8&psc=1

[UberDaemon]

Would it help to use a ssd instead of usb ? For me it lags each time i open something..click something ..
Even if the miner is closed. I see there are links for ssd connection

Yes, if your usb flash drive is slow you'll see lag.  I've noticed this not only with nvOC, but with all live OSes that run off flash memory.  Someone asked about using storage other than usb flash and OP linked a couple posts that I assume explain what you need to do to get that working.  I think it was on this page or the prior one.

or.... order/buy a faster thumb drive.  I ordered a few of the Lexars OP recommended, ETD tomorrow.  

[Brucelats]

I have few questions - is your nvOC also using cuda8 drivers? I heard/read that using them can make mining more effective, combined with genoil Cuda miner, what you think about that?

Second - i have this motherboard - https://www.asus.com/us/Motherboards/PRIME-Z270-P/   will that one work?

Third - i use this GPU-s: https://www.asus.com/Graphics-Cards/DUAL-GTX1070-O8G/


If you could give some insights/feedback/opinion on what i asked would be greatly apreciated! Cheers!

This OS is definitely easier than that guide. I spent >4 hours playing with Windows before I found a 16GB flash drive to try this out. It booted up and started mining in minutes.

I can give you some insight on the hardware.

Second - I suspect that motherboard will work. This OS works with the PRIME-Z270-A. The Z270-P should work in my mind.

Third - That GPU will work. Currently I have 4x EVGA 1070 on a GIGABYTE GA-B250M-Gaming 5.

Thanks man. I'll try get this working then i'll post if i run into some problems.


But i am curious what OP has to say about using Cuda8 from Nvidia for mining, maybe if he can implement it somehow it could boost the hashrate.

[TheCoinMine]

Would anyone have a ZEC pool and port combo they recommend? Almost through this build just need to figure out this part

[fullzero]

I have few questions - is your nvOC also using cuda8 drivers? I heard/read that using them can make mining more effective, combined with genoil Cuda miner, what you think about that?

Second - i have this motherboard - https://www.asus.com/us/Motherboards/PRIME-Z270-P/   will that one work?

Third - i use this GPU-s: https://www.asus.com/Graphics-Cards/DUAL-GTX1070-O8G/


If you could give some insights/feedback/opinion on what i asked would be greatly apreciated! Cheers!

This OS is definitely easier than that guide. I spent >4 hours playing with Windows before I found a 16GB flash drive to try this out. It booted up and started mining in minutes.

I can give you some insight on the hardware.

Second - I suspect that motherboard will work. This OS works with the PRIME-Z270-A. The Z270-P should work in my mind.

Third - That GPU will work. Currently I have 4x EVGA 1070 on a GIGABYTE GA-B250M-Gaming 5.

Thanks man. I'll try get this working then i'll post if i run into some problems.


But i am curious what OP has to say about using Cuda8 from Nvidia for mining, maybe if he can implement it somehow it could boost the hashrate.

Thanks for helping jmooney5115

Brucelats;

nvOC has the Cuda 8.0 libraries. 

In regards to using Genoil: I am not sure if it still uses the disk for the DAG; the last time I used it over a year ago it did. 

If it still does; then there isn't enough space on a 16gb USB key to fit the DAG as well. 

Maybe it now generates the DAG on the GPU memory like Claymore; and I can add it.  I will look into it.

[fullzero]

Would anyone have a ZEC pool and port combo they recommend? Almost through this build just need to figure out this part

I like nanopool and slushpool.

https://zec.nanopool.org/help

https://slushpool.com/help/get-started/getting_started_zcash

Nanopool you don't need an account for and their stats page is useful.

Slush Pool you need an account; but you get a lot of advanced features without any special effort on your part.

[fullzero]

Hi guys,

I still am not having much luck with tuning my 1070s

It is almost like the card is in autopilot mode and not responding to the bash file.  It is like it takes up the bash file but then the GPU overwrites the settings with auto pilot settings

For example on baseline settings cc100 and mem100 for ETH solo I receive approx 26 per card.

If I use the recomended settings in this thread of cc200 and mem 1600 the results do not change. ( I update and save onebash and then reload the terminal.

If I change to cc10 and mem10 still no change.

I tried changing the settings in both the global settings and then set individual clocks to yes and still no change.

When I look at my Nvidia Server screen it doesn't have the "enable performance level editing toggle switch" that the guides use http://www.phoronix.com/scan.php?px=MTY1OTM&page=news_item

Do you have to "enable" manual mode somewhere first?

Has anyone else experienced their ASUS 1070 GTX Turbos refusing to accept manual changes in Linux?

I wonder if it is a driver issue or an ASUS specific issue.

I bet the answer is right under my nose!!  (Most likely a user error issue!! )

Note : Everything else I change in Bash file works fine, such as worker address etc, it is only commands in relation to GPU that has nil effect.

I wonder if changing miners would be better?  It seems Claymore is very AMD focused.  In the Claymore help file it mentions that GPU tuning is not possible for NVidia cards.

Thanks all in advance

When you scroll to the top of the mining process do you see messages like this?



Also is your monitor connected to the primary GPU?

At any point did you connect the monitor to the motherboard, or boot with only one GPU?

[fullzero]

Hi Fullzero

I dont see any of that when I scroll up, and yes I did initially boot with one GPU ( just wanted to make sure it all worked before powering up the rig )

Sounds like this is my issue!!  How do I resolve? 

look at this post:

https://bitcointalk.org/index.php?topic=1854250.msg19449945#msg19449945

Let me know if this works.

[UberDaemon]

Added on to the rig a bit today.  Went from 5 GPUs to 7.  All Gigabyte Founders Ed. cards, on an Asus Prime Z270-A, a Celeron 3930, and a Corsair HX1200i.

220 MH/sec ETH (31.42 MH/sec avg per GPU)

Core OC: 200
Mem OC: 1600

power: 120W cap per GPU, pulling 945W at the wall.

https://i.imgur.com/GREONq2.png

I'll begin building a 2nd rig in a couple of days.  First parts rolled in today (4 EVGA 1070s).  Mobo will be another Z270-A, and I have another HX1200i.  The idea will be to have another 7-GPU rig that pulls 950W.  

[fullzero]

Hi Fullzero

I dont see any of that when I scroll up, and yes I did initially boot with one GPU ( just wanted to make sure it all worked before powering up the rig )

Sounds like this is my issue!!  How do I resolve? 

look at this post:

https://bitcointalk.org/index.php?topic=1854250.msg19449945#msg19449945

Let me know if this works.

Cheers mate.  So if my xorg file is blank I need to find the one it backed up and copy and paste that onto the current zorg file.

I have the same mainboard as that user as well so that makes sense!

use the command from that post: it will do it for you

[fullzero]

Added on to the rig a bit today.  Went from 5 GPUs to 7.  All Gigabyte Founders Ed. cards, on an Asus Prime Z270-A, a Celeron 3930, and a Corsair HX1200i.

220 MH/sec ETH (31.42 MH/sec avg per GPU)

Core OC: 200
Mem OC: 1700

power: 120W cap per GPU, pulling 945W at the wall.



I'll begin building a 2nd rig in a couple of days.  First parts rolled in today (4 EVGA 1070s).  Mobo will be another Z270-A, and I have another HX1200i.  The idea will be to have another 7-GPU rig that pulls 950W.  

This is awesome; I need to try these settings.   

[slackert]

I like nanopool and slushpool.

https://zec.nanopool.org/help

https://slushpool.com/help/get-started/getting_started_zcash

Nanopool you don't need an account for and their stats page is useful.

Slush Pool you need an account; but you get a lot of advanced features without any special effort on your part.

I noticed Nanopool charges 1% and Slush Pool 2%. Does using EWBF's CUDA through nvOC add an additional 2% to these pools?