Bitcoin Forum
December 03, 2016, 09:44:16 AM *
News: Latest stable version of Bitcoin Core: 0.13.1  [Torrent].
 
   Home   Help Search Donate Login Register  
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 [25] 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 »
  Print  
Author Topic: BAMT - Easy persistent USB key based linux for dedicated miners/mining farms  (Read 160841 times)
jamesg
VIP
Legendary
*
Offline Offline

Activity: 1330


AKA: gigavps


View Profile
October 24, 2011, 08:14:42 PM
 #481

Is there anyone who would be willing to look into what it would take to switch out the phoenix miner with cgminer in the bamt stack? Is this possible?

I am assuming the changes would need to include:

- Startup cgminer instead of phoenix at startup.
- gpumon could be replace with the cgminer interface or gpumon could read the output of cgminer.
- status reporting for mgpumon would need to read the statuses from cgminer.
- anything else i am unaware of.

I would be willing to pay a fixed price (BTC or $$$) to see this completed and working with the existing bamt toolset. It would also be nice if this could be a patch that can be run via /opt/bamt/fixer
1480758256
Hero Member
*
Offline Offline

Posts: 1480758256

View Profile Personal Message (Offline)

Ignore
1480758256
Reply with quote  #2

1480758256
Report to moderator
1480758256
Hero Member
*
Offline Offline

Posts: 1480758256

View Profile Personal Message (Offline)

Ignore
1480758256
Reply with quote  #2

1480758256
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
DeathAndTaxes
Donator
Legendary
*
Offline Offline

Activity: 1218


Gerald Davis


View Profile
October 24, 2011, 08:33:47 PM
 #482

IIRC the largest issue is that cgminer provides no mechanism to share data with other processes.  However one could potentially setup cgminer to write to log and they parse the log file.  Not sure if the log provides everything that BAMT currently provides.
kirax
Member
**
Offline Offline

Activity: 77


View Profile WWW
October 24, 2011, 08:57:37 PM
 #483

Is there anyone who would be willing to look into what it would take to switch out the phoenix miner with cgminer in the bamt stack? Is this possible?

I am assuming the changes would need to include:

- Startup cgminer instead of phoenix at startup.
- gpumon could be replace with the cgminer interface or gpumon could read the output of cgminer.
- status reporting for mgpumon would need to read the statuses from cgminer.
- anything else i am unaware of.

I would be willing to pay a fixed price (BTC or $$$) to see this completed and working with the existing bamt toolset. It would also be nice if this could be a patch that can be run via /opt/bamt/fixer

Yeah, this was discussed earlier, cg miner doesn't really output a lot of the data needed: You would need to make changes to cgminer as well, I assume.

VPS, shared, dedicated hosting at: electronstorm.ca. No bitcoin payment for that yet, but bitcoins possible for general IT, and mining/GPGPU rigs. PM for details.
lodcrappo
Hero Member
*****
Offline Offline

Activity: 588


View Profile WWW
October 24, 2011, 11:21:11 PM
 #484

IIRC the largest issue is that cgminer provides no mechanism to share data with other processes.  However one could potentially setup cgminer to write to log and they parse the log file.  Not sure if the log provides everything that BAMT currently provides.

Writing to a log constantly and parsing it will kill a USB key in no time, so that is not an option unfortunately.  Many requests have been made to the cgminer author for some more suitable mechanism, but as far as I know none of them have been answered.


If you want to support further development of BAMT (http://bamter.org/):  1PoRYaGS56ksQmK7XXLurW3B2zwCAE8PRc
DeathAndTaxes
Donator
Legendary
*
Offline Offline

Activity: 1218


Gerald Davis


View Profile
October 25, 2011, 12:21:05 AM
 #485

IIRC the largest issue is that cgminer provides no mechanism to share data with other processes.  However one could potentially setup cgminer to write to log and they parse the log file.  Not sure if the log provides everything that BAMT currently provides.

Writing to a log constantly and parsing it will kill a USB key in no time, so that is not an option unfortunately.  Many requests have been made to the cgminer author for some more suitable mechanism, but as far as I know none of them have been answered.



It would be possible to use a ramdrive and simply write and read the log from ram.  Technically linux supports memory mapped files but since cgminer doesn't support that ramdrive is a good "hackaround" as it will be seen by cgminer as a normal drive.
lodcrappo
Hero Member
*****
Offline Offline

Activity: 588


View Profile WWW
October 25, 2011, 12:24:58 AM
 #486

IIRC the largest issue is that cgminer provides no mechanism to share data with other processes.  However one could potentially setup cgminer to write to log and they parse the log file.  Not sure if the log provides everything that BAMT currently provides.

Writing to a log constantly and parsing it will kill a USB key in no time, so that is not an option unfortunately.  Many requests have been made to the cgminer author for some more suitable mechanism, but as far as I know none of them have been answered.



It would be possible to use a ramdrive and simply write and read the log from ram.  Technically linux supports memory mapped files but since cgminer doesn't support that ramdrive is a good "hackaround" as it will be seen by cgminer as a normal drive.

yeah that is a possibility.  i thought about doing that originally with phoenix but it felt like such a hack, I just put a socket in, and that turned out to be easy and work well. 

If you want to support further development of BAMT (http://bamter.org/):  1PoRYaGS56ksQmK7XXLurW3B2zwCAE8PRc
DeathAndTaxes
Donator
Legendary
*
Offline Offline

Activity: 1218


Gerald Davis


View Profile
October 25, 2011, 12:29:07 AM
 #487

IIRC the largest issue is that cgminer provides no mechanism to share data with other processes.  However one could potentially setup cgminer to write to log and they parse the log file.  Not sure if the log provides everything that BAMT currently provides.

Writing to a log constantly and parsing it will kill a USB key in no time, so that is not an option unfortunately.  Many requests have been made to the cgminer author for some more suitable mechanism, but as far as I know none of them have been answered.



It would be possible to use a ramdrive and simply write and read the log from ram.  Technically linux supports memory mapped files but since cgminer doesn't support that ramdrive is a good "hackaround" as it will be seen by cgminer as a normal drive.

yeah that is a possibility.  i thought about doing that originally with phoenix but it felt like such a hack, I just put a socket in, and that turned out to be easy and work well. 

I agree ram drive is a 100% hack (no matter what it is used for).  I just thought of it because at work we had to get data out of a legacy app that we no longer had source code for.  It runs in a Windows XP virtual machine and write to a ramdrive so it can be quickly processed by a more modern system.  Embarrassed Sometimes hacks work.  Sockets or named pipes are far superior if you can easily modified the sender.  The issue with modifying cgminer is if changes aren't incorporated into mainclient you are stuck w/ patching and rebuilding it after every version and BAMT will be unable to function without the modifed version.  A ram drive while a hack provides seemless integration between the two projects.
jamesg
VIP
Legendary
*
Offline Offline

Activity: 1330


AKA: gigavps


View Profile
October 25, 2011, 12:55:58 AM
 #488


I agree ram drive is a 100% hack (no matter what it is used for).  I just thought of it because at work we had to get data out of a legacy app that we no longer had source code for.  It runs in a Windows XP virtual machine and write to a ramdrive so it can be quickly processed by a more modern system.  Embarrassed Sometimes hacks work.  Sockets or named pipes are far superior if you can easily modified the sender.  The issue with modifying cgminer is if changes aren't incorporated into mainclient you are stuck w/ patching and rebuilding it after every version and BAMT will be unable to function without the modifed version.  A ram drive while a hack provides seemless integration between the two projects.

So, to be clear, this can be done now to incorporate cgminer without modifications to cgminer?
lodcrappo
Hero Member
*****
Offline Offline

Activity: 588


View Profile WWW
October 25, 2011, 12:59:22 AM
 #489


I agree ram drive is a 100% hack (no matter what it is used for).  I just thought of it because at work we had to get data out of a legacy app that we no longer had source code for.  It runs in a Windows XP virtual machine and write to a ramdrive so it can be quickly processed by a more modern system.  Embarrassed Sometimes hacks work.  Sockets or named pipes are far superior if you can easily modified the sender.  The issue with modifying cgminer is if changes aren't incorporated into mainclient you are stuck w/ patching and rebuilding it after every version and BAMT will be unable to function without the modifed version.  A ram drive while a hack provides seemless integration between the two projects.

So, to be clear, this can be done now to incorporate cgminer without modifications to cgminer?

it would allow a limited amount of functionality.  you would not be able to do centralized config management, but monitoring via (m)gpumon should be possible, assuming the logs provide the necessary information. 

If you want to support further development of BAMT (http://bamter.org/):  1PoRYaGS56ksQmK7XXLurW3B2zwCAE8PRc
jamesg
VIP
Legendary
*
Offline Offline

Activity: 1330


AKA: gigavps


View Profile
October 25, 2011, 11:13:31 AM
 #490


I agree ram drive is a 100% hack (no matter what it is used for).  I just thought of it because at work we had to get data out of a legacy app that we no longer had source code for.  It runs in a Windows XP virtual machine and write to a ramdrive so it can be quickly processed by a more modern system.  Embarrassed Sometimes hacks work.  Sockets or named pipes are far superior if you can easily modified the sender.  The issue with modifying cgminer is if changes aren't incorporated into mainclient you are stuck w/ patching and rebuilding it after every version and BAMT will be unable to function without the modifed version.  A ram drive while a hack provides seemless integration between the two projects.

So, to be clear, this can be done now to incorporate cgminer without modifications to cgminer?

it would allow a limited amount of functionality.  you would not be able to do centralized config management, but monitoring via (m)gpumon should be possible, assuming the logs provide the necessary information. 

Could we not start up cgminer using the bamt config? Could you have a wrapper for cgminer the way you wrap the phoenix process?

Sorry if these questions have obvious answers, I am not a rocket surgeon when it comes to linux. Wink
stryker
Full Member
***
Offline Offline

Activity: 232


View Profile
October 26, 2011, 10:26:18 AM
 #491

is there an easy way to get bamt to use the whole memory stick/storage device?

Mine keeps running out of space  Huh
lodcrappo
Hero Member
*****
Offline Offline

Activity: 588


View Profile WWW
October 27, 2011, 05:43:16 PM
 #492

is there an easy way to get bamt to use the whole memory stick/storage device?

Mine keeps running out of space  Huh

https://github.com/aaronwolfe/Big-A-Miner-Thing/wiki/Faq

If you want to support further development of BAMT (http://bamter.org/):  1PoRYaGS56ksQmK7XXLurW3B2zwCAE8PRc
Transisto
Donator
Legendary
*
Offline Offline

Activity: 1624



View Profile WWW
October 28, 2011, 02:21:01 AM
 #493

is there an easy way to get bamt to use the whole memory stick/storage device?

Mine keeps running out of space  Huh
How can you run out of space, this thing is not to download torrents.
jamesg
VIP
Legendary
*
Offline Offline

Activity: 1330


AKA: gigavps


View Profile
October 31, 2011, 02:45:06 PM
 #494

Has some got the config sync working for the pools file from dropbox with wget to where it doesn't overwrite the file if it hasn't changed? If so, what's the args you are using?
DeathAndTaxes
Donator
Legendary
*
Offline Offline

Activity: 1218


Gerald Davis


View Profile
October 31, 2011, 02:51:54 PM
 #495


I agree ram drive is a 100% hack (no matter what it is used for).  I just thought of it because at work we had to get data out of a legacy app that we no longer had source code for.  It runs in a Windows XP virtual machine and write to a ramdrive so it can be quickly processed by a more modern system.  Embarrassed Sometimes hacks work.  Sockets or named pipes are far superior if you can easily modified the sender.  The issue with modifying cgminer is if changes aren't incorporated into mainclient you are stuck w/ patching and rebuilding it after every version and BAMT will be unable to function without the modifed version.  A ram drive while a hack provides seemless integration between the two projects.

So, to be clear, this can be done now to incorporate cgminer without modifications to cgminer?

it would allow a limited amount of functionality.  you would not be able to do centralized config management, but monitoring via (m)gpumon should be possible, assuming the logs provide the necessary information. 

Could we not start up cgminer using the bamt config? Could you have a wrapper for cgminer the way you wrap the phoenix process?

Sorry if these questions have obvious answers, I am not a rocket surgeon when it comes to linux. Wink

No we could.  Just be aware without RPC you won't have control over cgminer.  So it would be clunky.  You could start it up based on a config file, have it output a log and scan the log periodically to get stats,  if you need ot make a change have web front end make a change to config and then kill the cgminer process and restart it. 

It probably would work but likely would have glitches and gotchas.  I am thinking of forking the cgminer project to implement RPC calls so the miner could be controlled by outside process or even remotely (web front end, or 3rd party app).  That is the only way I see cgminer being viable.  Then you could just use RPC calls to change fans, clocks, pools, restart, get stats, etc.
lodcrappo
Hero Member
*****
Offline Offline

Activity: 588


View Profile WWW
October 31, 2011, 03:23:27 PM
 #496

No we could.  Just be aware without RPC you won't have control over cgminer.  So it would be clunky.  You could start it up based on a config file, have it output a log and scan the log periodically to get stats,  if you need ot make a change have web front end make a change to config and then kill the cgminer process and restart it.  

It probably would work but likely would have glitches and gotchas.  I am thinking of forking the cgminer project to implement RPC calls so the miner could be controlled by outside process or even remotely (web front end, or 3rd party app).  That is the only way I see cgminer being viable.  Then you could just use RPC calls to change fans, clocks, pools, restart, get stats, etc.

This is exactly right, imho.  I came to the same conclusion and decided it wasn't worth the effort of adding rpc type interface to cgminer, since Phoenix worked fine for me.
Phoenix is so simple (a good thing, again imho) that hacking on a couple options and making a simple wrapper does the trick, but cgminer is a whole different beast.

If you want to support further development of BAMT (http://bamter.org/):  1PoRYaGS56ksQmK7XXLurW3B2zwCAE8PRc
Transisto
Donator
Legendary
*
Offline Offline

Activity: 1624



View Profile WWW
October 31, 2011, 08:34:53 PM
 #497

For those using bamt on 50+ gpu farm, One of the hurdle is using a quality router or using a proxy for distributing work. Because some pool require as much as 12 active connections per gpu, and most cheap router start to choke past 500 connections,  add to this a bittorrent client and web browsing and this figure can easily double.

Aaron had a Proxy in the making but did not release it.

I am using a well supported Hopping proxy and # of connections is ~80% less.
jamesg
VIP
Legendary
*
Offline Offline

Activity: 1330


AKA: gigavps


View Profile
October 31, 2011, 08:41:52 PM
 #498

For those using bamt on 50+ gpu farm, One of the hurdle is using a quality router or using a proxy for distributing work. Because some pool require as much as 12 active connections per gpu, and most cheap router start to choke past 500 connections,  add to this a bittorrent client and web browsing and this figure can easily double.

Aaron had a Proxy in the making but did not release it.

I am using a well supported Hopping proxy and # of connections is ~80% less.

What proxy is this? Also, do you just run the proxy on one of the rigs and point the others to it?
DeathAndTaxes
Donator
Legendary
*
Offline Offline

Activity: 1218


Gerald Davis


View Profile
October 31, 2011, 08:51:26 PM
 #499

For those using bamt on 50+ gpu farm, One of the hurdle is using a quality router or using a proxy for distributing work. Because some pool require as much as 12 active connections per gpu, and most cheap router start to choke past 500 connections,  add to this a bittorrent client and web browsing and this figure can easily double.

Aaron had a Proxy in the making but did not release it.

I am using a well supported Hopping proxy and # of connections is ~80% less.

What proxy is this? Also, do you just run the proxy on one of the rigs and point the others to it?

Or any other machine.  Depending on your setup you could have a dedicated "proxy rig".
lodcrappo
Hero Member
*****
Offline Offline

Activity: 588


View Profile WWW
October 31, 2011, 08:57:20 PM
 #500

For those using bamt on 50+ gpu farm, One of the hurdle is using a quality router or using a proxy for distributing work. Because some pool require as much as 12 active connections per gpu, and most cheap router start to choke past 500 connections,  add to this a bittorrent client and web browsing and this figure can easily double.

Aaron had a Proxy in the making but did not release it.

I am using a well supported Hopping proxy and # of connections is ~80% less.

What proxy is this? Also, do you just run the proxy on one of the rigs and point the others to it?

yes, the idea was that you run the proxy on one machine and the other nodes just pull work from it.   ideally the nodes would just find the proxy via broadcast and so could be zero configuration.

i used the proxy myself for about a month, but it has some issues that i never sorted out.  it is written in python and is very high performance, 100s of Ghash should be no problem for it.  if someone who knows python wants to take it over, i will give them what i have, but it is not suitable for public consumption at this time and i do not have the time to make it so.

you could also explore using one of the other proxies out there.. when i started the project all the proxies i could find pretty much sucked massively, but that may have changed by now.

If you want to support further development of BAMT (http://bamter.org/):  1PoRYaGS56ksQmK7XXLurW3B2zwCAE8PRc
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 [25] 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!