Building a 600 CORES - Supercomputer to mine VeriumReserve

[jacko0088]

Today got power issues. Seems like the cables going from the PSU to the input of the power distribuitors were causing a bottleneck, with consequence a voltage drop.
Miners hangs due to undervolting and simply stop working.

The lesson I want to share today is this: if you're mining, with custom things, a multimeter can literally become your best friend 
I've fixed one line, so i've not started to mine yet. I'll try to fix the rest by tomorrow, and hope to get everything up and running at sunday. Real life job takes all the time from me 

[kuroman]

Impressive, can we get along the way the cost for components and the amount of hours spent on your project and what values are you getting ?

Also I'm really interested in the rendering part, If I understood correctly these are ARM SoCs so no X64 X86 right ? so you must be running some linux distro, can CFD or other numerical simulation software run on those ?

Looking forward to the development of this project and the results

[bouldou]

WOW, impressive ! I'll follow this thread too

Man, you're a beast ! you should sell some professional rigs like this, you'll become rich

Good luck for finishing all this

[cryptovagas]

Impressive, can we get along the way the cost for components and the amount of hours spent on your project and values are you getting ?

Also I'm really interested in the rendering part, If I understood correctly these are ARM SoCs so no X64 X86 right ? so you much be running some linux distro, can CFD or other numerical simulation software run on those ?

Looking forward to the development of this project and the results

woow, too much technical points, i feel like i am a kid stuck between 2 professors of university

WOW, impressive ! I'll follow this thread too

Man, you're a beast ! you should sell some professional rigs like this, you'll become rich

Good luck for finishing all this

you are not alone buddy, in last few days, i am just coming here to see ho jacko is doing

[freelotus]

Your equipment is impressive. I think many on this forum would like to have such a set of computer equipment. You have more resources. I wish you success.

[jacko0088]

Impressive, can we get along the way the cost for components and the amount of hours spent on your project and what values are you getting ?

Should I quantify? Flashing each one takes 20 mins/each. Wiring? Tons of time. I've spent 5k on materials, but feels like i've spent 10k only in "manual work" 

[kuroman]

Should I quantify? Flashing each one takes 20 mins/each. Wiring? Tons of time. I've spent 5k on materials, but feels like i've spent 10k only in "manual work" 

Yes this is what I'm getting at, sounds, like a lot of work but if it is a hobby you are enjoying and you have the time to allocate, I think it's really worth it even if the ROI is not there this project can have many other use cases other than just mining

[cryptovagas]

Your equipment is impressive. I think many on this forum would like to have such a set of computer equipment. You have more resources. I wish you success.

"would like to have" ??

I'll die to SEE it in action

[jacko0088]

Well!
I've found out two of the 40 miners were hanging with no reason. I'm reflashing both, hoping to fix the issue. I don't want a broken board now!

So i've added some fan on the right panel. Also because, as everyone knows, RGB gives you 30% more of hashrate 

[kuroman]

Well!
I've found out two of the 40 miners were hanging with no reason. I'm reflashing both, hoping to fix the issue. I don't want a broken board now!

So i've added some fan on the right panel. Also because, as everyone knows, RGB gives you 30% more of hashrate 

Considering the frequencies you are running at, the architecture you are using you shouldn't even need those, are there any components specifically overheating ?

I mean the SoC them selfs use a Watt or two at most tree but like you said better safe than sorry also, the cooler they run the better they run and no trottling risk

[jacko0088]

Well!
I've found out two of the 40 miners were hanging with no reason. I'm reflashing both, hoping to fix the issue. I don't want a broken board now!

So i've added some fan on the right panel. Also because, as everyone knows, RGB gives you 30% more of hashrate 

Considering the frequencies you are running at, the architecture you are using you shouldn't even need those, are there any components specifically overheating ?

I mean the SoC them selfs use a Watt or two at most tree but like you said better safe than sorry also, the cooler they run the better they run and no trottling risk

PSU are warm, and pulling out hot air from a flank, it's a good idea.
Number 75 flashed! Sally will b up and running by tomorrow! 

[kuroman]

PSU are warm, and pulling out hot air from a flank, it's a good idea.
Number 75 flashed! Sally will b up and running by tomorrow! 

Oh I thought the PSUs were exhausting outside, now I understand, 75 great news, 525 to go, you are getting faster at it, I think in a couple of weeks we will see a full 600 machines results good job !

[jacko0088]

PSU are warm, and pulling out hot air from a flank, it's a good idea.
Number 75 flashed! Sally will b up and running by tomorrow! 

Oh I thought the PSUs were exhausting outside, now I understand, 75 great news, 525 to go, you are getting faster at it, I think in a couple of weeks we will see a full 600 machines results good job !

Read better! 600 cores, not machines!
Machines are 75!

[kuroman]

Read better! 600 cores, not machines!
Machines are 75!

I'm sorry when I commented I wasn't under my dose of caffeine I didn't get enough sleep in the last 72hours, Yes those are 8 cores SoCs so You are basically done, with the installation now is time for some fine tuning to get the best performance out of those core, by the way what OS/distro are you running on them right now

[jacko0088]

Read better! 600 cores, not machines!
Machines are 75!

I'm sorry when I commented I wasn't under my dose of caffeine I didn't get enough sleep in the last 72hours, Yes those are 8 cores SoCs so You are basically done, with the installation now is time for some fine tuning to get the best performance out of those core, by the way what OS/distro are you running on them right now

ubuntu minimal, i have just to wire them up tomorrow morning 

[kuroman]

ubuntu minimal, i have just to wire them up tomorrow morning 

Alright, really looking up for tomorrow and hopefully we will get some results, also if you don't mind, can you try some CFD software later on or any numerical simulation software you might have ? for the sake of benchmarking

[jacko0088]

ubuntu minimal, i have just to wire them up tomorrow morning 

Alright, really looking up for tomorrow and hopefully we will get some results, also if you don't mind, can you try some CFD software later on or any numerical simulation software you might have ? for the sake of benchmarking

I can simply create a script to calculate the prime numbers from 0 to X, run on a single one, then run in parallel. For a fast test.
Time is running low, not only for this build, but also because in some days i'll not have much time to dedicate. The goal is getting this running "on is own".

 

[kuroman]

ubuntu minimal, i have just to wire them up tomorrow morning 

Alright, really looking up for tomorrow and hopefully we will get some results, also if you don't mind, can you try some CFD software later on or any numerical simulation software you might have ? for the sake of benchmarking

I can simply create a script to calculate the prime numbers from 0 to X, run on a single one, then run in parallel. For a fast test.
Time is running low, not only for this build, but also because in some days i'll not have much time to dedicate. The goal is getting this running "on is own".

 

Yes I understand, if you can at least run a linpack benchmark or geekbench if possible, and those mining numbers It would be fun to see how those SoCs campares to your average CPU, I might be inspired by your work and do something similar and smaller scale at first and scale up afterward

[jacko0088]

It's finished. I'l post a picture tomorrow 

[btcneodev]

It is very amazing post and updates. Did you cluster all odroid into one? I was wondering clustering should save hassle in management, but wondering if it is possible to mine.