Bitcoin Forum

Bitcoin => Bitcoin Technical Support => Topic started by: Icygreen on October 27, 2019, 05:55:23 AM



Title: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on October 27, 2019, 05:55:23 AM
I'm new to full nodes and Rasberry pi but fairly competent with hardware and setup in general.  I'd like to use the raspberry pi to run the node because it'll be easy to move and won't be a process running on my main computer.
I hear there's new units out now, version 4b? Is the latest and greatest hardware preferable?
What I'd like to know is what pieces of kit do I need specifically? 
1. RP version?
2. Heat sink, fan?
3. what case?
3. memory card 256gb I think. What brand/speed is best?
4. External Hard drive. (Is a hard drive necessary, can I use a thumb drive instead to boot and run from?)
5. An old computer screen I already have.

Anything else I'm missing?

It would be great to hear from folks with plenty of experience in running nodes on RP.





Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ranochigo on October 27, 2019, 06:05:01 AM
I hear there's new units out now, version 4b? Is the latest and greatest hardware preferable?
Yes. Running Bitcoin Core would take a significant amount of ram, if you decide to have more peers.
What I'd like to know is what pieces of kit do I need specifically? 
1. RP version?
The newest RPi offers significant improvement over the previous versions in terms of ethernet speed, CPU and memory speed/space. The similar pricing would just make it a no-brainer to go for the newer version.
2. Heat sink, fan?
Passive cooling would be enough, if you choose to run it without much load. The heat sinks are relatively cheap and it wouldn't be a bad idea to get one if you plan to run it for long periods of time.
3. what case?
That's up to you. A plastic one would do, just make sure it is compatible with your heat sink.
3. memory card 256gb I think. What brand/speed is best?
256GB would be an overkill. I wouldn't recommend storing the blockchain on an SD card since the size would only increase from now unless you plan to prune it. Even if thats a non-factor, the heavy read/write cycles could potentially shorten the lifespan of your card.
4. External Hard drive. (Is a hard drive necessary, can I use a thumb drive instead to boot and run from?)
IIRC, it is possible to use a thumbdrive to boot but a simple 16GB sd card would be enough. I would recommend you to get an old HDD to store the data directory in. It would be much cheaper than a huge sd/thumbdrive and it would last a lot longer. You might need to get external power to it though.



You should pre-sync the blockchain on a desktop computer first. The synchronization time for an under-powered device like the raspberry pi would be insanely long. It would be better for you to just copy the data directory from an already synchronized full node to your raspberry pi storage.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Deathwing on October 27, 2019, 03:15:16 PM
Regarding the storage, SD Cards are very, very fragile and prone to failure. A slight overheating (consant R/W can cause this) may just brick the whole SD card forever. The blockchain is about 245 Gigabytes at the moment. If you want to host a proper full node, Raspberry Pi 4 2 GB version with a passive cooled heatsink with 8-16 GB SD Card with a 512GB SSD or 2.5" HDD connected to it via USB 3.0 should be enough.

Raspberry PI has 3 models for Model 4, 1 Gigabyte version which is 35 USD, 2 Gig 45 USD, 4 Gig 55 USD.

The best scenario for you would be:

Raspberry Pi 4 2 GB with Passive Heatsink - 8 GB of MicroSD - 512GB 2.5" SSD or HDD (you'll need a SATA > USB 3.0 adapter) - Case is not required doesn't really help with thermals unless it has a fan so it's completely up to you, it might be hard to manipulate to SSD/HDD connected so my real honest suggestion would be just tape or glue the Raspberry Pi to the storage device and throw it somewhere. No need to monitor if you know how to access through SSH.

Feel free to ask any questions you have.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: DaveF on October 27, 2019, 04:14:11 PM
Take a look here:
https://bitcointalk.org/index.php?topic=5162189.0 (https://bitcointalk.org/index.php?topic=5162189.0)

The RPi 4 gets HOT when thinking hard.
Most of the cases suck as they don't make contact with the CPU

More discussion in that thread.

-Dave


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on October 27, 2019, 06:36:09 PM
2. Heat sink, fan?
3. what case?

Case with fans or without any.

4. External Hard drive. (Is a hard drive necessary, can I use a thumb drive instead to boot and run from?)

You can, but few devices such as RPi 4 technically can't boot from USB storage. microSD still needed to point RPi 4 to boot from USB storage.
See https://www.tomshardware.com/news/boot-raspberry-pi-from-usb,39782.html (https://www.tomshardware.com/news/boot-raspberry-pi-from-usb,39782.html)



I strongly recommend you to buy good power supply (buy official ones if you're not sure), especially because you most likely will run it 24/7 with few USB device attached.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on October 28, 2019, 01:54:07 PM
You can, but few devices such as RPi 4 technically can't boot from USB storage. microSD still needed to point RPi 4 to boot from USB storage.

no, newer RPi's (4 and 3B+) can be booted from USB based storage. If you want to update the Linux kernel (which will improve the stability of the microboard over time), USB booting is the best option long term. But getting up and running booting from SD is fine, just remember that those kernel updates will (very slowly) wear out the SD card too.


I strongly recommend you to buy good power supply (buy official ones if you're not sure), especially because you most likely will run it 24/7 with few USB device attached.

...and go for a high current power supply if it's available from the vendor. Some USB devices draw a fair amount of power, the CPU & RAM need power when working hard, so best to deliver as much as the RPi is rated for to keep it stable.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on October 28, 2019, 05:46:08 PM
Thanks, I appreciate your input.
So here's what I've put together.
*RPi 4 model b 4gb
*Smraza Case for Raspberry Pi 4 B, Case with Cooling Fan, 4PCS Heatsinks, 5V 3A USB-C Power Supply
*SanDisk Ultra 32GB microSDHC UHS-I Card with Adapter - 98MB/s
*WD My Passport Ultra 2TB hard drive (I have this already)

Here's the actual components I'll run.
https://www.amazon.ca/hz/wishlist/ls/2AP9FHFTAAHX3?ref_=wl_share (https://www.amazon.ca/hz/wishlist/ls/2AP9FHFTAAHX3?ref_=wl_share)

I couldn't find a better power supply than the one included with the case. 5v 3A
Should I be looking for something better?

Is this HD going to be sufficient powered by USB? I intend to partition 500gb on this drive for this purpose.












Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on October 28, 2019, 06:18:02 PM
You can, but few devices such as RPi 4 technically can't boot from USB storage. microSD still needed to point RPi 4 to boot from USB storage.

no, newer RPi's (4 and 3B+) can be booted from USB based storage. If you want to update the Linux kernel (which will improve the stability of the microboard over time), USB booting is the best option long term. But getting up and running booting from SD is fine, just remember that those kernel updates will (very slowly) wear out the SD card too.

By any chance, do you need to update the firmware of the RPi? Discussion on other forum mention RPi 4 don't support USB booting.

Is this HD going to be sufficient powered by USB? I intend to partition 500gb on this drive for this purpose.

Yes. Based on my experience, there's no problem if there's only 1 or 2 external HDD.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Dabs on October 28, 2019, 09:02:55 PM
Does it have to be a RPi? How easy to move must it be?

I ask these questions because you can buy old server or workstation hardware that has double everything the Raspberry Pi has for about $150. Something like at least 8 GB RAM, sometimes more, dual or quad core xeon processors and of course you can stick in SSD or HDD; plus those things are designed to run 24/7.

Although the RPi can run 24/7, I don't think it was designed to do that.

Of course, rack servers, even 1U ones, are a lot bigger, maybe noisier (they can run quietly too) and consume more power (but not that much if idle.)

You can even run VMWare or Hyper-V on it and just make a virtual machine run the bitcoin core full node wallet.


But yeah, it's a choice between $35 and $150, a single board computer vs a real rack server, 1 GB to 4 GB RAM vs 4 GB or more (sometimes they sell with 32 GB to 64 GB of DDR3 ram too, depending on how old the server is.)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on October 28, 2019, 11:56:53 PM
Does it have to be a RPi? How easy to move must it be?


Well, it should fit in my laptop bag easily. It will need to travel once every few months and must be quiet.
Thanks for suggesting other hardware.  Honestly, I don't know what I'm doing at this stage and the hardware is as much a learning curve as the node.
I'm not sure how often I'll run it or for how long, mainly I want to learn about RPi and running a node and figured this would be the best entry.
By all means, please make specific suggestions.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Deathwing on October 29, 2019, 12:37:20 AM
Does it have to be a RPi? How easy to move must it be?


Well, it should fit in my laptop bag easily. It will need to travel once every few months and must be quiet.
Thanks for suggesting other hardware.  Honestly, I don't know what I'm doing at this stage and the hardware is as much a learning curve as the node.
I'm not sure how often I'll run it or for how long, mainly I want to learn about RPi and running a node and figured this would be the best entry.
By all means, please make specific suggestions.

If you are only going to use it for Bitcoin Full Node, what you listed is enough to handle it. The 4 GB version gives you plenty of leeway with your node and connection count. You should not have any problems running it 24/7 with a USB HDD attached and seeing that your case has a cooling fan. It should be near silent as the fan is probably very small. I mean I got a 120mm fan inside my server running 24/7 right beside my bed and it has never bothered me for several years. However, if you want to expand in the future and develop other projects and require 24/7 uptime on said projects OR if you want to do something that cannot utilise ARM platform. You may need something a lot beefier.

Considering you want to carry it in your laptop bag, you can check out Intel NUCs. They are expensive, however, is very worth the price in this case.

Long story short, if you just want to run a Bitcoin node. Your cart on Amazon should be all okay.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on October 29, 2019, 10:13:12 AM
no, newer RPi's (4 and 3B+) can be booted from USB based storage. If you want to update the Linux kernel (which will improve the stability of the microboard over time), USB booting is the best option long term. But getting up and running booting from SD is fine, just remember that those kernel updates will (very slowly) wear out the SD card too.

By any chance, do you need to update the firmware of the RPi? Discussion on other forum mention RPi 4 don't support USB booting.

no, the newer RPi's boot direct from USB without firmware updates. The 3B (not 3B+) needed a change to the /boot/config.txt file to specify the UUID of the disk containing the alternative root partition, but 3B+ and the 4 can pick up the /boot folder and the root partition directly from a USB based SATA disk.

Maybe this won't work with USB flash drives? But with USB attached SATA yes, the RPi 4 even has a special new disk-over-USB protocol to make SATA work better than it did with the RPi3.


I couldn't find a better power supply than the one included with the case. 5v 3A

I'm pretty sure you should be able to get a 5A rated power supply, the RPi4 definitely will want plenty of power as it's processor is more capable than the RPi3, and all the extra RAM also wants more power too.

These microboard style computers often have people talking on forums about how having the higher rated power supply helps improve stability when you're maxing it out, e.g. using the processor alot, or using alot of USB connected devices simultaneously. The RPi4 in particular has had problems with it's power consumption (and overheating) that have been mitigated by updating it's firmware since release (RPi4 is pretty new in stores, and the engineers at the Raspberry Pi co. didn't get it working optimally before it was publicly released, it's still being tweaked)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: DaveF on October 29, 2019, 12:16:27 PM
I posted this in another thread but you can get everything all ready to go in a box:
https://lightninginabox.co/product/raspiblitz-raspberry-pi-lightning-node/ (https://lightninginabox.co/product/raspiblitz-raspberry-pi-lightning-node/)

It's more then putting it together yourself and you don't get to learn about the RPi, but depending on how what you want to do it is all put together with and ready to go.
You can then start to tinker with a known working product and go from there.

Just a thought.

-Dave


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Dabs on October 29, 2019, 03:52:04 PM
Use both a higher rated power supply, as that's always good for both the board and the power supply, AND use a powered USB hub if you are connecting lots of power hungry devices. With a powered USB hub, you can connect plenty of hard drives and it won't kill the RPi. (You can also use powered USB drives, so you can work with the larger form factor drives.)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on October 29, 2019, 05:45:27 PM
Well, it should fit in my laptop bag easily. It will need to travel once every few months and must be quiet.
Thanks for suggesting other hardware.  Honestly, I don't know what I'm doing at this stage and the hardware is as much a learning curve as the node.
I'm not sure how often I'll run it or for how long, mainly I want to learn about RPi and running a node and figured this would be the best entry.
By all means, please make specific suggestions.

Since you want to learn about RPi and full node in general, then you already made good choice. Older Raspberry Pi might be more stable, but it's slower and limiting what you could do.

But if you simply need portability then regular laptop, Intel NUC/compute stick or Nvidia Jetson Nano (if you're into computer graphic) will do.

no, the newer RPi's boot direct from USB without firmware updates. The 3B (not 3B+) needed a change to the /boot/config.txt file to specify the UUID of the disk containing the alternative root partition, but 3B+ and the 4 can pick up the /boot folder and the root partition directly from a USB based SATA disk.

Maybe this won't work with USB flash drives? But with USB attached SATA yes, the RPi 4 even has a special new disk-over-USB protocol to make SATA work better than it did with the RPi3.

I just checked my history and the discussed USB storage is USB flash drive. But from cost perspective, it doesn't make sense to use SSD as boot device on SBC computer.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Deathwing on October 29, 2019, 06:57:32 PM
Well, it should fit in my laptop bag easily. It will need to travel once every few months and must be quiet.
Thanks for suggesting other hardware.  Honestly, I don't know what I'm doing at this stage and the hardware is as much a learning curve as the node.
I'm not sure how often I'll run it or for how long, mainly I want to learn about RPi and running a node and figured this would be the best entry.
By all means, please make specific suggestions.

Since you want to learn about RPi and full node in general, then you already made good choice. Older Raspberry Pi might be more stable, but it's slower and limiting what you could do.

But if you simply need portability then regular laptop, Intel NUC/compute stick or Nvidia Jetson Nano (if you're into computer graphic) will do.

no, the newer RPi's boot direct from USB without firmware updates. The 3B (not 3B+) needed a change to the /boot/config.txt file to specify the UUID of the disk containing the alternative root partition, but 3B+ and the 4 can pick up the /boot folder and the root partition directly from a USB based SATA disk.

Maybe this won't work with USB flash drives? But with USB attached SATA yes, the RPi 4 even has a special new disk-over-USB protocol to make SATA work better than it did with the RPi3.

I just checked my history and the discussed USB storage is USB flash drive. But from cost perspective, it doesn't make sense to use SSD as boot device on SBC computer.

SD cards a very prone to failure, if he wants to host a 24/7 running Bitcoin node for storage an SSD/HDD or USB is a must. SD Card suddenly burning etc. Will cause a lot of issues with the Raspbery Pi. Also Nvidia Jetson Nano is not suitable for this at all.



Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on October 30, 2019, 04:35:52 AM
I posted this in another thread but you can get everything all ready to go in a box:
https://lightninginabox.co/product/raspiblitz-raspberry-pi-lightning-node/ (https://lightninginabox.co/product/raspiblitz-raspberry-pi-lightning-node/)

It's more then putting it together yourself and you don't get to learn about the RPi, but depending on how what you want to do it is all put together with and ready to go.
You can then start to tinker with a known working product and go from there.

Just a thought.

-Dave

Thanks Dave, the build and sourcing is part of the fun.  I like that screen in your link. Wouldn't mind adding one just like it  ;)  

I don't understand the interface yet but I assume any wireless keyboard.  And mouse? or touchscreen?


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Deathwing on October 30, 2019, 05:04:24 AM
I posted this in another thread but you can get everything all ready to go in a box:
https://lightninginabox.co/product/raspiblitz-raspberry-pi-lightning-node/ (https://lightninginabox.co/product/raspiblitz-raspberry-pi-lightning-node/)

It's more then putting it together yourself and you don't get to learn about the RPi, but depending on how what you want to do it is all put together with and ready to go.
You can then start to tinker with a known working product and go from there.

Just a thought.

-Dave

Thanks Dave, the build and sourcing is part of the fun.  I like that screen in your link. Wouldn't mind adding one just like it  ;) 

I don't understand the interface yet but I assume any wireless keyboard.  And mouse?

Replying as this thread was on my watchlist. Pi screens can be linked to SSH connection or just direct HID like Keyboard and Mouse. I checked the link Dave sent and it appears to be set up so that it displays one specific screen (think of it as virtual desktop) on the well... Physical screen. There are various tutorials on how to do this on the internet if you are interested in it. However, you should know that this is additional power hog to the power supply and the Pi.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on October 30, 2019, 09:09:22 AM
I don't understand the interface yet but I assume any wireless keyboard.  And mouse?

i would resist the urge to rely on a mouse.

you will end up learning to use the command line no matter what, once you're up to speed, the mouse will become a spare part. And if you stop using a desktop, your machine will have more RAM to use for Bitcoin and Lightning (RPis share RAM between the CPU and the GPU, you can change how much the GPU uses in the file /boot/config.txt)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on October 30, 2019, 05:23:54 PM
SD cards a very prone to failure, if he wants to host a 24/7 running Bitcoin node for storage an SSD/HDD or USB is a must. SD Card suddenly burning etc. Will cause a lot of issues with the Raspbery Pi.

I doubt microSD will suddenly burning, but as long as you use decent microSD and most read/write activity happen on USB storage, microSD won't be problem when using Rasberry Pi.

Also Nvidia Jetson Nano is not suitable for this at all.

And that's why i emphasize "(if you're into computer graphic)"


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Dabs on October 30, 2019, 07:28:07 PM
There are Samsung and Sandisk branded microSD cards that are called "Pro Endurance" models....

https://www.amazon.com/Samsung-Endurance-64GB-Micro-Adapter/dp/B07B9KTLJZ/
https://www.amazon.com/SanDisk-Endurance-microSDXC-Adapter-Monitoring/dp/B07NY23WBG/

Although designed for Dash cams and surveillance security cameras, they'd probably do well in Raspberry Pis.

I'd get the biggest but most value bang for the buck size, so that's maybe the 32 or 64 GB models, for the price (it's like $5 more for the larger one). That should last a long time since you won't be recording too much, it's just the boot drive.

Then attach a cheap USB drive to host the node block chain itself. 500 GB should last at least several years, 1 TB or more should last another decade (maybe.)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Deathwing on October 31, 2019, 12:10:51 AM
SD cards a very prone to failure, if he wants to host a 24/7 running Bitcoin node for storage an SSD/HDD or USB is a must. SD Card suddenly burning etc. Will cause a lot of issues with the Raspbery Pi.

I doubt microSD will suddenly burning, but as long as you use decent microSD and most read/write activity happen on USB storage, microSD won't be problem when using Rasberry Pi.

Also Nvidia Jetson Nano is not suitable for this at all.

And that's why i emphasize "(if you're into computer graphic)"

As a person who was unlucky with the SD Cards... I must say they just suddenly pop after some writing. It results in a dead SD Card slot and a lot of lost data, sadly. So far, I've tried many things. However, almost all my SD cards ended up blowing up.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: philipma1957 on October 31, 2019, 02:01:34 AM
old mac minis are gold to run a node.

use external ssd to back up

find a 2012 with an i5


better yet use linux and run

a dell
a hp
a lenevo


use ultra small form case.

ebay search item 254385146655

it is perfect for op

an intel 3470s cpu
8gb ram
500gb hdd

no os he can load linux

 run core node

the gear is for sale well under 75 bucks
linux os is free.

frankly running the rasp pi model 4 vs the hp does not make much sense.

note i went to ebay and searched hp elite found that item number in under 15 minutes.

i have owned
rasp pi
rasp pi b
rasp pi 2
rasp pi 3
rasp pi 3+

op get the hp elite

 load linux and you will be happy.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on November 04, 2019, 10:44:51 PM
All the gear arrived today. Thanks for the suggestions on the hardware. Time to get this thing up an running.  
Questions for the absolute beginner on RP and nodes.

Should I be using a specific flavor of ubuntu or a specific .iso to load onto the SD Card?   I've only ever burned images on disk or virtual drives.
I had intended to also load kubuntu on the thumb drive for an old dell laptopr as philipma1957 mentioned in the post above. I suspect it will be a similar process.

Here's the goods. Gotta love BTC, saved 30% with purse, helped someone earn in Ghana and delivered tools to further educate. Go BTC!
https://i.ibb.co/4gyn0Sg/IMG-9742.jpg (https://ibb.co/h15JTd1)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on November 05, 2019, 10:28:47 AM
Should I be using a specific flavor of ubuntu or a specific .iso to load onto the SD Card?

dunno about "should", but I would just load a "headless" OS image. You're going to be using the terminal almost exclusively with all the lightning based stuff anyway. You'll save RAM that way too, the desktop graphics use alot of RAM. And more RAM means more Lightning channels. Get Debian or Devuan, Ubuntu is just a version of Debian with a whole load of perfume and makeup slapped onto it.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: DaveF on November 05, 2019, 01:51:20 PM
From the this is my opinion YMMV I would stick with Debian and avoid all others.

A lot (most?) of the support you may need for some odd issue possibly that you have to go back to the RPi groups / forums for will be quicker with Debian. It's just what most people use. Not saying it's better, not saying you won't get or be able to find the correct answer using a different build. Just saying that most people use it so if you are doing something and encounter an issue that you will probably be able to get more info quicker.

I have done many stupid things with my RPis over the years and I have found that when I have had an issue because I did something wrong when using Debian there was usually someone there before me who had done the exact same thing. When running UBU or the others they were there too, just not as much.

Good luck with the build

-Dave


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Dabs on November 05, 2019, 03:15:10 PM
How about Ubuntu Server? That doesn't include a bunch of make up does it? No Gui, connect by SSH? I ask only because that's my experience when running full nodes of altcoins on VPS, they usually say "install Ubuntu server" ... you know, masternodes and stuff like that, those are essentially full nodes. May need to install a couple of other apps using apt-get, but can easily follow scripts.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on November 05, 2019, 05:14:48 PM
Should I be using a specific flavor of ubuntu or a specific .iso to load onto the SD Card?

With various linux distro, it depends on what you want to do with your Raspberry Pi. Raspbian probably is best choice since it's popular (among Pi owner) and it's jack of all trade (almost can do anything, but with few limitation/trade-off).

Multi-boot is also an option if you plan using your Raspberry Pi for various kind of tasks.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on November 06, 2019, 02:39:25 AM
I have Raspbian installed on the SD now. Had no idea to look for Debian. Thanks for the tips! 
Perhaps I'll start with Rasbian and try to run the node from here. Remember, this is all a learning experiment to familiarize myself with BTC core and RPi's. 
Next questions,  I intend to sync core on my desktop before moving to the RPi. 
I'm assuming I need to first download core on my desktop? Will I need to partition my external 2TB HD in any way when I put the block chain on the HD? 


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on November 06, 2019, 12:42:32 PM
How about Ubuntu Server? That doesn't include a bunch of make up does it?

well, yeah. I'm not aware of the specifics of Ubuntu Server, but it's likely as if choosing a sex doll instead of going for the real thing. What's the point of Ubuntu's server version when...


From the this is my opinion YMMV I would stick with Debian and avoid all others.

...agreed, Debian's conservative, minimalist approach is pretty much perfect for servers. You don't want the package updates to be constantly changing the ground under your feet, you just want security updates only, and a well supported ecosystem so it's easy to find the information you need.




I'd add that if you really want a solid server, the systemd init system is a potential menace (it's ok for a laptop that doesn't need stability or security). Devuan (https://devuan.org) is a Debian fork that gives you choice of init systems, there are various well-designed init concepts to choose from (Debian packages them all, but it's hard work actually uninstalling systemd and replacing it, as the init system is such a basic part of the operating system)

On similar grounds to replacing systemd (bad design makes it insecure), I'd suggest looking at ditching OpenSSL too. It's just as difficult to remove as systemd, as it's just as fundamental to the OS's functionality (nothing works if you have no init, the machine won't boot up! Removing SSL is almost as bad...) For that reason, starting without OpenSSL is the best option, but it's also not easy. The main OS's that support the alternative SSL (LibreSSL) are Gentoo, FreeBSD and OpenBSD (i.e. the only well known Linux supporting LibreSSL is Gentoo). They're great OS's, but not for beginners.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on November 06, 2019, 05:03:19 PM
I have Raspbian installed on the SD now. Had no idea to look for Debian. Thanks for the tips! 
Perhaps I'll start with Rasbian and try to run the node from here. Remember, this is all a learning experiment to familiarize myself with BTC core and RPi's. 

Raspbian is based on Debian.

If you decide to use Debian OS or OS based on Debian, you should have easy time to adapt.

Next questions,  I intend to sync core on my desktop before moving to the RPi. 
I'm assuming I need to first download core on my desktop? Will I need to partition my external 2TB HD in any way when I put the block chain on the HD? 

Partition your external HDD is optional, since you just need to specify the path of Bitcoin folder when you run Bitcoin Core for first time.

If your external HDD use NTFS or FAT format, you might need to download few library (it's very easy) to make sure RPi can read your external HDD.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on November 07, 2019, 12:10:02 AM
I've been finding my way with some luck and tons of google searches so far but there's some concerns still about its stability.
I was unplugging the Rpi each time I wanted to turn it off. Only recently found the power off button, duh. Had to reformat a few times likely because of this. At least that's my theory now.

If the Rpi won't boot or enters a loop and retrying boot fails too many times, is reformatting and burning image to the card the only way to fix it? 





Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on November 07, 2019, 11:21:07 AM
I've been finding my way with some luck and tons of google searches so far but there's some concerns still about its stability.
I was unplugging the Rpi each time I wanted to turn it off. Only recently found the power off button, duh. Had to reformat a few times likely because of this. At least that's my theory now.

If the Rpi won't boot or enters a loop and retrying boot fails too many times, is reformatting and burning image to the card the only way to fix it?  

stability is a bitch on RPi's.

the Pi 4 is new, so stability is even bitchier. But because you're using Raspbian, the fixes will be easy to find, as it's pretty much the official OS.

In order of importance:

  • Get firmware updates
  • Get kernel updates
  • Get all other OS updates too

You can probably handle all the above using the command:

Code:
apt-get update && apt-get dist-upgrade

if you're not logged into the root account, you need to add sudo before each apt-get command (because the above is actually 2 commands, the && means "do the next command, but only if the last one worked") And your user needs to be in the wheel group, or have an entry in the /etc/sudoers file to be able to actually use sudo without Raspian telling you you tried to do something naughty.

Raspbian probably has you configured to get everything update-wise using those commands. But, the Raspberry Pi forums will tell you more. For instance, I clocked my CPU down on my Raspberry Pi 3B+, and I wouldn't have known that was a stability fix had it not been for searching/reading the RPi forums. Just updating the software didn't work, it needed tweaking somewhere else in the OS's config files.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on November 07, 2019, 04:36:52 PM
if you're not logged into the root account, you need to add sudo before each apt-get command (because the above is actually 2 commands, the && means "do the next command, but only if the last one worked") And your user needs to be in the wheel group, or have an entry in the /etc/sudoers file to be able to actually use sudo without Raspian telling you you tried to do something naughty.

By default, Raspbian will set you user 'pi' with sudoers groups where you don't need to type your account password to run sudo command.

@Icygreen you might want to configure your OS to ask password when you run command with sudo prefix. See https://raspberrypi.stackexchange.com/a/62759 (https://raspberrypi.stackexchange.com/a/62759)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on November 07, 2019, 05:14:50 PM
Thanks, I found this guide which addressed both sudo user group accounts and the updates, also disabling pi sign in.https://www.maketecheasier.com/change-raspberry-pi-password/ (https://www.maketecheasier.com/change-raspberry-pi-password/)

So I take that as a "yes" , reformatting is the correct solution when booting fails repetitively.
I guess there's no way to save configurations/accounts or anything stored on the sd card and the above account creation process will need to be repeated anytime it happens.  So far, I haven't had any more issues since using the proper power down button.
Now just waiting for core to finish syncing.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on November 08, 2019, 12:38:16 PM
By default, Raspbian will set you user 'pi' with sudoers groups where you don't need to type your account password to run sudo command.

that's not very safe


@Icygreen you might want to configure your OS to ask password when you run command with sudo prefix. See https://raspberrypi.stackexchange.com/a/62759 (https://raspberrypi.stackexchange.com/a/62759)

take this ^^ advice


So I take that as a "yes" , reformatting is the correct solution when booting fails repetitively.

it was a no

the correct solution is to research ways to make the RPi 4 stable. In particular, the premium (4B+) boards might be overclocked too much, change the CPU clock speed (or the memory controller's clock speed) and/or the amount of voltage to either, and you might find the Pi stays up.


If you keep syncing the blockchain while the board keeps crashing, there's a good chance the data in the blockchain will suffer some corruption. There's not much point in starting that job until you've figured out how to keep the RPi up. A good way to do it is find out the command for memory testing, this basically gives the CPU and RAM a workout that never ends. Leave it running like that for multiple days, then try something different to stabilize the RPi when/if it crashes. Once it stays up for a week or 2 just doing 24/7 memtesting, you've probably cracked it.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: DaveF on November 08, 2019, 01:10:30 PM
So I take that as a "yes" , reformatting is the correct solution when booting fails repetitively.

it was a no

the correct solution is to research ways to make the RPi 4 stable. In particular, the premium (4B+) boards might be overclocked too much, change the CPU clock speed (or the memory controller's clock speed) and/or the amount of voltage to either, and you might find the Pi stays up.


If you keep syncing the blockchain while the board keeps crashing, there's a good chance the data in the blockchain will suffer some corruption. There's not much point in starting that job until you've figured out how to keep the RPi up. A good way to do it is find out the command for memory testing, this basically gives the CPU and RAM a workout that never ends. Leave it running like that for multiple days, then try something different to stabilize the RPi when/if it crashes. Once it stays up for a week or 2 just doing 24/7 memtesting, you've probably cracked it.

I know I have posted it before, but I am going to post it again.
There are MANY MANY MANY cases that actually make it worse.

From another thread that I posted in and commented in this thread about:



Will try to order one or both of these 'cool'  :P cases from china. There are also options with fans but I really prefer passive cooling for something that is intended for 24/7 use.
https://www.aliexpress.com/item/4000056606252.html
https://www.aliexpress.com/item/4000095452880.html


Make sure that there is actual contact between the case and CPU in the proper area. Cheap cases suck.
Just scrapped a bunch of aluminum cases for the RPi3 that had enough space between the heatsinnk that was part of the case and the CPU itself that the thermal pad I put on the CPU was untouched on top :(

-Dave


and after he got it in:

Make sure that there is actual contact between the case and CPU in the proper area. Cheap cases suck.
Received one of the cheap cases, the one with ribs. And as DaveF suspected, there were no contact between cpu and heatsink. There were about 1mm air gap 😕.
I cut a small piece of 1mm aluminum and fitted it with heatsink compound, which turned it into an ON OK solution 🙂.
Raspiblitz running at about 50C now.

Edit: Fixed typo.

When cooling something 1mm is about the same as 1 mile, no contact = no cooling. Putting it in a case = worse cooling due to no airflow.
Bad cooling = more crashes.



Side note this is not new:
This even goes back to some old school miners that used the older RPis as controllers.
Amazing how many problems existed because they were moving a lot of air over the chips but none over the Pi that just sat there and slowly cooked.

I actually still have a stack of the 2B models sitting around for the people who have old miners that used them that want to revive them to play with because the old ones cooked.

-Dave



Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on November 08, 2019, 01:44:04 PM
yep cooling helps :D


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Dabs on November 08, 2019, 03:17:33 PM
Yeah, I think instead of a case, a heatsink that sits directly on top of the chips work better. I'm thinking the better whole metal cases would have the gap in between the halves of the shell and you'd need screws or something to tighten it. That would or should ensure contact with the chips.

Heatsinks that you stick on the chips just seem to work better. If you do anything else on the RPi that makes it cook itself, you might be better off getting other hardware (like refurb rack servers?)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: HCP on November 08, 2019, 04:56:16 PM
Heatsinks that you stick on the chips just seem to work better. If you do anything else on the RPi that makes it cook itself, you might be better off getting other hardware (like refurb rack servers?)
That would be true in the "general" case, but OP specified that the whole setup needed to be portable.

Well, it should fit in my laptop bag easily. It will need to travel once every few months and must be quiet.
So a refurb rack server isn't going to work ;) :P

But yes, you're quite correct. Pi's and cases generally just aren't a great mix in my experience... you're much better off with a bare board than an ill fitting case.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on November 08, 2019, 06:20:32 PM
Clarifying some things:

* The Rpi 4 has been 100% stable during operation so far. The issues I had were during a boot with either a loop or "no signal" message.  It appears to be solved and it was likely due to a user problem (shutting down by pulling the power, corrupted boot loader).

* I'm using heatsinks on all 4 chips and the main CPU also has a small fan over it.  I'm certain there's no heat issues yet.  I'll look for a tool to measure the heat once it's up and running the blockchain and report my findings.

* I'm syncing the blockchain from my main computer to an external HD and it'll move to the RP once it's finished.  

Again, Thanks for your help and recommendations. Much appreciated
  


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on November 08, 2019, 07:15:35 PM
ahhhh

sounds like you've thought this through, carry on :D


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Dabs on November 08, 2019, 09:53:36 PM
A laptop fits in a laptop bag. One of those small computer boxes, like mini desktops, might fit in a laptop bag. There are mini laptops can be bought used for cheap.

For running a full node, a laptop works fine, just upgrade the HDD / SSD, or use a combination laptop with SSD + external HDD. Most any laptop would generally have more processing power, more RAM, and ... some other things I'm forgetting at the moment; already comes with a screen, mouse (or equivalent) and keyboard, and can run your choice of operating system.

Yes, they'll cost more than a $35 pi, but remember with the pi you need to get other stuff as well just to make it run. Once you add 1TB for storage, might as well get an old laptop and upgrade the drive.

I see 10 or 11 inch mini laptops / notebooks for less than $200.

The rack server would sit at home or some other place semi-permanent.



Anyway ... he's got the pi up and running, so, glad to see some progress on this. Would appreciate what config and set up you did, and other details.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: klaaas on November 09, 2019, 12:10:58 AM
* I'm using heatsinks on all 4 chips and the main CPU also has a small fan over it.  I'm certain there's no heat issues yet.  I'll look for a tool to measure the heat once it's up and running the blockchain and report my findings.
Enter this command on the command line to read the cpu temp.
/opt/vc/bin/vcgencmd measure_temp

The pi as full node is only for its size and to use it headless if you would ask me.
My pick for a full node was this board (https://www.asrockind.com/overview.asp?Model=IMB-152). A bit in between.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on November 09, 2019, 01:52:14 AM
Would appreciate what config and set up you did, and other details.
Here's the consolidated efforts thus far.
I've got it set up in this case. Its quite open as far as enclosures go and it suits the form factor I had in mind.
https://i.ibb.co/YdsCQbh/smzra-case-3.jpg (https://ibb.co/rprj0vH)

RP 4, 4gb, Rasbian, updates  installed, created new super user and password, disabled pi,  I followed this tutorial exactly. https://www.maketecheasier.com/change-raspberry-pi-password/ (https://www.maketecheasier.com/change-raspberry-pi-password/)
Keyboard, mouse and the 4" screen connected, I ran /opt/vc/bin/vcgencmd measure_temp  and it idles at 46 degrees both with the screen on or off in ambient temp of ~22 degrees.
Tonight I'll try to get OpenVPN working as my first application.
 
Couple more questions while we're here if you don't mind.

*If I switch off the screen while running core, is that the same as running headless or should the screen be unplugged?

*Core is synced 45% after 2 full days, is 4-5 days typical to download and sync core?

*I noticed 2009-2015 synced rather quickly compared with later times. Is that because of increased transaction in the blocks?


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ranochigo on November 09, 2019, 02:05:26 AM
*If I switch off the screen while running core, is that the same as running headless or should the screen be unplugged?
No. Running it headless means that the Graphical User Interface (GUI) is not used and that it can only be controlled using the command line. The lack of the GUI means that it would take lesser resources to run it. Switching off the screen or unplugging it won't do anything as the GUI would still be running. You have to run it from command line.
*Core is synced 45% after 2 full days, is 4-5 days typical to download and sync core?
The synchronizing and verification process is rather tedious and it isn't uncommon for it to take a few days to synchronize. It's highly dependent on the hardware that you're synchronizing it on. You can try to speed up the process by optimizing the parameters like the dbcache etc.

*I noticed 2009-2015 synced rather quickly compared with later times. Is that because of increased transaction in the blocks?
Yes. The larger block means that there are more transactions to be validated individually. It would naturally be slower.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on November 10, 2019, 12:34:50 AM
*If I switch off the screen while running core, is that the same as running headless or should the screen be unplugged?
No. Running it headless means that the Graphical User Interface (GUI) is not used and that it can only be controlled using the command line. The lack of the GUI means that it would take lesser resources to run it. Switching off the screen or unplugging it won't do anything as the GUI would still be running. You have to run it from command line.

this is definitely a good thing if you're going to run the Pi with Lightning too, as there'll be more RAM/CPU for Lightning to use (you can have more channels and route more payments)

The drawback is if you have a problem you can't solve quickly using your command-line knowledge. If you've got experience with any command line, linux/bash or not, you'll be more comfortable. But you might want to keep the GUI around for a while so you can solve problems in a more familiar way (but truthfully, you've got way more control on the command line, if you're feeling confident just go ahead, people here can help if you get stuck)

You can compromise too, you should be able to change Raspian's boot script to not load the GUI on boot, then just take note of the command (probably the startx script in /etc/X11) that loads the GUI. Then you can make sure you know you're good on the command line, but have the option of going into the GUI still available.

Last thing: get tmux (apt-get install tmux). It's for opening multiple command line windows, splitting the windows into sections etc (tmux let's you do this in headless more when normally you'd be pressing Ctrl-Alt-F keys to get extra terminal windows, tmux is way more flexible that that way of doing it). Makes working on the command line way faster and more versatile. You can configure it to automatically open up a bunch of windows on boot showing logging for bitcoind, openvpn etc


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: klaaas on November 11, 2019, 10:36:17 AM
You can compromise too, you should be able to change Raspian's boot script to not load the GUI on boot, then just take note of the command (probably the startx script in /etc/X11) that loads the GUI. Then you can make sure you know you're good on the command line, but have the option of going into the GUI still available.
Correct, that can be managed in the raspi-config
Iirc you could also log out from the gui to the command line so a reboot is not needed.
May the node end up on a hard to reach place you could enable the build inn VNC server in the raspi-config and access the gui remotely.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on November 12, 2019, 07:42:34 PM
Core it taking its sweet time. Day 6 and 54% done. 

I'm downloading/syncing core to an external HD.

Question:
Can I stop core, remove the hard drive and continue the sync/download on another machine?


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on November 13, 2019, 03:06:53 AM
Question:
Can I stop core, remove the hard drive and continue the sync/download on another machine?

Yes, you can. In fact, other member already suggest you to sync Bitcoin's blockchain on desktop and copy it to Raspberry Pi :)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on November 13, 2019, 11:01:26 AM
Core it taking its sweet time. Day 6 and 54% done.  

usual advice applies:

  • Put the /.bitcoin/chainstate folder on your fastest available disk (/chainstate is ~ 2-3GB during sync), add a symlink to it inside /.bitcoin folder
  • Increase dbcache setting in your bitcoin.conf file (or as a cmd parameter to bitcoin executable) to a healthy proportion of available RAM
  • If you're using a disk with Linux filesystems (ext3 or 4, btrfs etc), when you mount <IcyGreens_disk_name> <IcyGreens_mountpoint>, slip in -o noatime,noreltime as an option (check man mount for full details)

so if you have e.g. 8GB RAM, smash dbcache up to 2000MB or even 4000MB. 16GB RAM, put it up to 8000MB. Big speed increases.

Also, Bitcoin Core 0.19.0.1 has improved code for syncing, translating to a ~ 5-10% speed increase (depends on how big dbcache is set). 0.19.0.1 will be out before the end of the week (probably)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on November 14, 2019, 02:17:57 AM
RPi4 Bootloader EEPROM info

https://www.raspberrypi.org/documentation/hardware/raspberrypi/booteeprom.md (https://www.raspberrypi.org/documentation/hardware/raspberrypi/booteeprom.md)


Should be possible to get this on regular Debian based images by adding the Raspian repo to your /etc/apt/sources.list file

one of the fixes resembles the problem @IcyGreen was having (intermittent boot issues)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on November 15, 2019, 01:09:13 AM
Core it taking its sweet time. Day 6 and 54% done.  

usual advice applies:

  • Put the /.bitcoin/chainstate folder on your fastest available disk (/chainstate is ~ 2-3GB during sync), add a symlink to it inside /.bitcoin folder
  • Increase dbcache setting in your bitcoin.conf file (or as a cmd parameter to bitcoin executable) to a healthy proportion of available RAM
  • If you're using a disk with Linux filesystems (ext3 or 4, btrfs etc), when you mount <IcyGreens_disk_name> <IcyGreens_mountpoint>, slip in -o noatime,noreltime as an option (check man mount for full details)

so if you have e.g. 8GB RAM, smash dbcache up to 2000MB or even 4000MB. 16GB RAM, put it up to 8000MB. Big speed increases.

Also, Bitcoin Core 0.19.0.1 has improved code for syncing, translating to a ~ 5-10% speed increase (depends on how big dbcache is set). 0.19.0.1 will be out before the end of the week (probably)

Thanks for your thoughtful response. I'm sorry, maybe I should've been more clear, I've got about 2 days experience so far with terminal on the RP and I'm afraid that much of what you've written has gone over my head.   :'(   I'm only now starting to comprehend how core downloads and syncs with the network.  
59%.....  


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on November 15, 2019, 10:48:29 AM
ok!

your Pi has a main disk (SD card usually)

The top of the tree is / (which is equivalent to C:\ on Windows)

You're always logged into a user account

That account has all it's files at /home/<IcyGreensUserName>, the name is probably the default name chosen by Raspbian

Bitcoin puts all it's config files in /home/<IcyGreensUserName>/.bitcoin

One of those folders gets read and written to constantly during syncing, and that one (.bitcoin/chainstate) can be put on a fast disk (e.g. SSD) to speed sync up massively

So that Bitcoin doesn't get confused and think the chainstate folder has died and gone to heaven, you put a link telling it where to look for it in /home/<IcyGreenUserName>/.bitcoin, cos that's where Bitcoin looks for the chainstate folder

Like this:

Code:
ln -s /<new location for chainstate folder on fast disk> /home/<IcyGreenUser>/.bitcoin/chainstate

If you do ls -lh /home/<IcyGreenUser>/.bitcoin you'll see the link file in there, and it'll also show you where the link is pointing to




Then, open a new file called bitcoin.conf in /home/<IcyGreenUser>/.bitcoin. Do  nano /home/<IcyGreenUser>/.bitcoin/bitcoin.conf

Type dbcache=2000 into the new file, then do Ctrl-o, then Y, then press Return, then Ctrl-x (Ctrl-o is save, Ctrl-x is quit)

Now when you start bitcoin, it's using dbcache=2000 as an option. You can add other options to bitcoin.conf the same way, just open it in nano, and put only one option per line.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Dabs on November 15, 2019, 05:25:03 PM
So that Bitcoin doesn't get confused and think the chainstate folder has died and gone to heaven, you put a link telling it where to look for it in /home/<IcyGreenUserName>/.bitcoin, cos that's where Bitcoin looks for the chainstate folder

What happens if this chainstate folder is deleted (or died and gone to heaven) ? Wouldn't this be perfect to place in a ramdisk if you have the hardware?

Or you copied everything from another machine to this one, except for the chainstate foder?


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on November 15, 2019, 06:46:22 PM
What happens if this chainstate folder is deleted (or died and gone to heaven) ?

Bitcoin Core will try to rebuild chainstate. Not sure if you're using pruning mode though.

Wouldn't this be perfect to place in a ramdisk if you have the hardware?

Impossible. Chainstate size is clearly too big for RPi RAM, it's about 3.9GB on my Bitcoin Core.

Even if it's possible, you need to write script which :
1. copy chainstate file to non-volatile storage before you shutdown your RPi
2. automatically load chainstate file to ramdisk when you turn on your RPi, before starting Bitcoin Core


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Dabs on November 15, 2019, 09:48:43 PM
Oh, sorry, my bad, I was talking for other hardware that have more RAM, (so other than RPi, that is). That other hardware would rarely be turned off or shut down, so if chainstate can be rebuilt upon restarting, that would be ok then? Not using pruning mode.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on November 16, 2019, 07:13:47 PM
Oh, sorry, my bad, I was talking for other hardware that have more RAM, (so other than RPi, that is).

Don't forget this topic is about full node client on Raspberry Pi

That other hardware would rarely be turned off or shut down, so if chainstate can be rebuilt upon restarting, that would be ok then? Not using pruning mode.

Chainstate can be rebuilt, but it'll take some time, which is long enough to let you sleep (depending on hardware).


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: DaveF on November 18, 2019, 05:44:34 PM
So I had a few of these cables:

http://i.imgur.com/qmE7vDJm.jpg (https://imgur.com/qmE7vDJ)




Basically you plugged a power source into the microUSB female end
The male micro USB went into the RPi
The USB went into the RPi and the other end went into an external USB drive.
The 5V from the power source was what powered the USB drive.

Very nice for doing things like this, it kept the cable mess to a minimum.
I can't find any more of them, does anybody know where I can snag a few.

Thanks,
Dave


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on November 18, 2019, 06:13:23 PM
So I had a few of these cables:

http://i.imgur.com/qmE7vDJm.jpg (https://imgur.com/qmE7vDJ)




Basically you plugged a power source into the microUSB female end
The male micro USB went into the RPi
The USB went into the RPi and the other end went into an external USB drive.
The 5V from the power source was what powered the USB drive.

Very nice for doing things like this, it kept the cable mess to a minimum.
I can't find any more of them, does anybody know where I can snag a few.

Thanks,
Dave

I have serious concern whether this cable are able to power-on Raspberry Pi (which could have up to 4 USB device) and an external drive.
Have you used the cable on Raspberry Pi and other USB device without problem (no blinking red LED on Raspberry Pi) ?

Amazon should sold cables like that, but i don't know the keyword. Example : https://www.amazon.com/Barhunkft-TM-Micro-Female-Adapter/dp/B07GGP7LSR (https://www.amazon.com/Barhunkft-TM-Micro-Female-Adapter/dp/B07GGP7LSR)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: DaveF on November 18, 2019, 06:19:38 PM
I have serious concern whether this cable are able to power-on Raspberry Pi (which could have up to 4 USB device) and an external drive.
Have you used the cable on Raspberry Pi and other USB device without problem (no blinking red LED on Raspberry Pi) ?

Yes, I have 3 of them in use now. I was going to build another one and was looking for the same cable.
The Pi in theory can only have 3 USB devices because it is taking up one. But, so long as you have enough amps coming out of the 5V wall adapter it works fine.

It's more to keep it neat. 

-Dave


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Dabs on November 19, 2019, 04:35:54 PM
I think the Pi can also be powered by connecting to the GPIO pins. I'm not sure if that's a good idea as you typically want to power the Pi "normally", and any power hungry devices should either have their own power, or just connect as few as you can directly to the Pi.

A powered hub makes sense if you're connecting several USB devices, like more than one hard drive or SSD.

The Pi is actually good to run a full node since power consumption 24/7/365 is going to be like less than $1 a month, depending on where you live. I've seen figures close to $5 to $10 per year.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on November 21, 2019, 01:52:46 AM
I moved Bitcoin core to another device at 64% and the HD is now reporting errors on two machines. Errors also on Bitcoin core asking to rebuild the database. I can still access my HD. Sigh... I guess that means either the data or HD or both are corrupt? Letting core repair just starts the sync again from the beginning.  :'(


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Deathwing on November 21, 2019, 02:49:53 AM
I moved Bitcoin core to another device at 64% and the HD is now reporting errors on two machines. Errors also on Bitcoin core asking to rebuild the database. I can still access my HD. Sigh... I guess that means either the data or HD or both are corrupt? Letting core repair just starts the sync again from the beginning.  :'(

Try reindexing the Blockchain most likely while attempting to copy there were a few block files stuck mid-download or mid-index and resulted in corruption, reindexing should help you with that. If possible, it's probably better if you just download/sync it on your computer (to make sure everything works) and then just move the files to the external SSD/HDD which you can then connect to RPI.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: KD6-3.7 on November 21, 2019, 08:43:33 AM
Hello everyone,

this is my new post on this forum and I didn't want to start a new topic. I am also looking to learn to run a Full Node and connect it to Coldcard + Wassabi (in the future) and all of this is new to me. I was researching a lot last couple of days but found the best information in this thread. So in short I just wanted to as you guys about opinion:

Since I'm new to RPi and to putting my hardware together as well as running Bitcoin Core and Linux in general (yes, I've been living under the rock..  ;D ) wouldn't it be easier for newbie like me to:

- Download Bitcoin Core to my spare laptop ( i5, 8Gb RAM, SSD drive) and set blockchain to sync on external SSD
- Learn Linux (i was planning to do a course on this anyway)
- Then wait for stable version of new RPi and buy components (I've already looked into that so I know what I need) and learn to set it up there (preferably running over TOR?)
- Set the blockchain directory on RPi to that external SSD I've downloaded it on my laptop
- Enjoy compact size Full Node running 24/7 and then learn to use command line / SSH to broadcast transactions from my ledger to a multisig guarded by Cold Card (prefferably going throu Wassabi first for annonimity)?

Interested in your opinions. If this is wrong place I'm sorry, I'll post it somewhere else.

Cheers!

(all of this is what I've learned on Twitter, I've been lurking in this space for a while but never on this forum. Forgive me if those questions are super dumb)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Deathwing on November 21, 2019, 11:32:31 AM
Hello everyone,

this is my new post on this forum and I didn't want to start a new topic. I am also looking to learn to run a Full Node and connect it to Coldcard + Wassabi (in the future) and all of this is new to me. I was researching a lot last couple of days but found the best information in this thread. So in short I just wanted to as you guys about opinion:

Since I'm new to RPi and to putting my hardware together as well as running Bitcoin Core and Linux in general (yes, I've been living under the rock..  ;D ) wouldn't it be easier for newbie like me to:

- Download Bitcoin Core to my spare laptop ( i5, 8Gb RAM, SSD drive) and set blockchain to sync on external SSD
- Learn Linux (i was planning to do a course on this anyway)
- Then wait for stable version of new RPi and buy components (I've already looked into that so I know what I need) and learn to set it up there (preferably running over TOR?)
- Set the blockchain directory on RPi to that external SSD I've downloaded it on my laptop
- Enjoy compact size Full Node running 24/7 and then learn to use command line / SSH to broadcast transactions from my ledger to a multisig guarded by Cold Card (prefferably going throu Wassabi first for annonimity)?

Interested in your opinions. If this is wrong place I'm sorry, I'll post it somewhere else.

Cheers!

(all of this is what I've learned on Twitter, I've been lurking in this space for a while but never on this forum. Forgive me if those questions are super dumb)

You are right on point. I would check the third one though. Raspberry Pi 4 was released just not too long ago. I doubt there will be a new Raspberry Pi releasing in the next few years unless there is a huge jump in ARM technology. No need to wait for a new one if you want to use your wallet.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on November 21, 2019, 09:18:07 PM
Hello everyone,

this is my new post on this forum and I didn't want to start a new topic. I am also looking to learn to run a Full Node and connect it to Coldcard + Wassabi (in the future) and all of this is new to me. I was researching a lot last couple of days but found the best information in this thread. So in short I just wanted to as you guys about opinion:

Since I'm new to RPi and to putting my hardware together as well as running Bitcoin Core and Linux in general (yes, I've been living under the rock..  ;D ) wouldn't it be easier for newbie like me to:

- Download Bitcoin Core to my spare laptop ( i5, 8Gb RAM, SSD drive) and set blockchain to sync on external SSD
- Learn Linux (i was planning to do a course on this anyway)
- Then wait for stable version of new RPi and buy components (I've already looked into that so I know what I need) and learn to set it up there (preferably running over TOR?)
- Set the blockchain directory on RPi to that external SSD I've downloaded it on my laptop
- Enjoy compact size Full Node running 24/7 and then learn to use command line / SSH to broadcast transactions from my ledger to a multisig guarded by Cold Card (prefferably going throu Wassabi first for annonimity)?

Interested in your opinions. If this is wrong place I'm sorry, I'll post it somewhere else.

Cheers!

(all of this is what I've learned on Twitter, I've been lurking in this space for a while but never on this forum. Forgive me if those questions are super dumb)

Welcome! Indeed, this is a perfect place to start. I'm in a very similar position to learning these things and would appreciate your shared experience in this.  Looking forward to hearing from you.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on November 22, 2019, 04:38:26 AM
You are right on point. I would check the third one though. Raspberry Pi 4 was released just not too long ago. I doubt there will be a new Raspberry Pi releasing in the next few years unless there is a huge jump in ARM technology. No need to wait for a new one if you want to use your wallet.

But there will be Raspberry Pi 4 with newer revision codes, especially to faulty USB-C design on Raspberry Pi 4 which makes only specific USB-c cable works.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Deathwing on November 22, 2019, 02:05:35 PM
You are right on point. I would check the third one though. Raspberry Pi 4 was released just not too long ago. I doubt there will be a new Raspberry Pi releasing in the next few years unless there is a huge jump in ARM technology. No need to wait for a new one if you want to use your wallet.

But there will be Raspberry Pi 4 with newer revision codes, especially to faulty USB-C design on Raspberry Pi 4 which makes only specific USB-c cable works.

They usually get pushed out very silently (with the newest batch) so... maybe? You got a point but it's really not that big of a chance like the first few Pi models. (B - B+ kind)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: ETFbitcoin on November 22, 2019, 06:58:33 PM
They usually get pushed out very silently (with the newest batch) so... maybe? You got a point but it's really not that big of a chance like the first few Pi models. (B - B+ kind)

But usually it's more stable (depending on what the revision) and is what @KD6-3.7 waiting for.

Additionally, it's not pushed out silently because Raspberry Pi have good documentation of all revision codes along with the changes.
The real problem is seller don't know the revision code or don't bother post the revision code.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: KD6-3.7 on November 25, 2019, 10:53:04 AM
Yeah, with wait I meant for more stable and bug fixed version 4. Thanks for advice. Will keep you updated. For now I will order 1TB SSD and sync on that spare laptop. Tomorrow I'm sitting down to Linux course. WML  ;)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on December 01, 2019, 01:41:47 AM

Had to step away for a bit due to travel and now finally getting back to the Rpi 4 full node mission.
Wow, what a difference downloading core to an internal ssd on a good computer makes! Finished in 20 hours!  Was expecting at least a few days from my previous experience.
I should have it copied to an external HD and running on the Rpi shortly.  Fingers crossed.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Icygreen on December 01, 2019, 03:51:39 PM
Can I mirror my trezor wallet on Bitcoin core? Perhaps a watch only wallet.  I'm not intending to use the synced wallet for new transactions quite yet since I'm familiar with the trezor.


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: DaveF on December 01, 2019, 04:52:08 PM
Can I mirror my trezor wallet on Bitcoin core? Perhaps a watch only wallet.  I'm not intending to use the synced wallet for new transactions quite yet since I'm familiar with the trezor.

Yes...With a but....it's not that simple.

1) Run the Trezor back end. https://github.com/trezor/blockbook  (https://github.com/trezor/blockbook)

2) Connect the back end to your Bitcoin Core node

3) Use custom back end in option in the Trezor Web Walett and connect to your backend

So...Yeah, it can be done.

-Dave


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: Carlton Banks on December 01, 2019, 05:07:29 PM
you can also use Bitcoin Core team's HWI: https://github.com/bitcoin-core/HWI

guide here: https://github.com/bitcoin-core/HWI/blob/master/docs/bitcoin-core-usage.md (https://github.com/bitcoin-core/HWI/blob/master/docs/bitcoin-core-usage.md)


There's a big change to how the wallet sub-system works that's probably going to make it into Bitcoin 0.20.0, at the moment creating a watching wallet is pretty painless (although it will take a while to scan the blockchains for tx history), but spending using Bitcoin's GUI isn't yet possible. Continuing to use the separate Trezor apps is still the only way to do it (or use the cli tools for HWI)

Ultimately though, using Trezor's web wallet as the front end is less satisfactory as a solution than using an integrated tool with Bitcoin's GUI, both for how streamlined the process and how secure/minimal the system will be. But the earliest possibility of using that is gonna be 0.20.0, and that's not scheduled for release till May 2020. The watch-wallet scanning may well receive a big performance boost with BIP157-based utxo querying. Again, that'll be in 0.20.0 at the earliest (but you can enable the filters for BIP157 now if you're using Bitcoin 0.19.0+)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: KD6-3.7 on December 08, 2019, 08:12:02 AM
Ok, so for now I did downloaded a blockchain on that spare laptop using a newly purchased 1TB Samsung SSD. It took around 26-30hs which is amazing. Re-syncing after a night off takes only several minutes which is dope. To learn how to do it I watched those tutorials:
Linux - https://www.youtube.com/watch?v=bju_FdCo42w&list=PLtK75qxsQaMLZSo7KL-PmiRarU7hrpnwK (https://www.youtube.com/watch?v=bju_FdCo42w&list=PLtK75qxsQaMLZSo7KL-PmiRarU7hrpnwK) (watched till like 34-35th video)
Full Node - https://github.com/k3tan172/ubuntu-node-box/ (https://github.com/k3tan172/ubuntu-node-box/) - only installed Core for now. Haven't setup incoming connections, TOR or anything yet since I'll do it when I migrate to RPi.

RPi is a project for this or next month so I will update you guys on specs I will decide on and on learning/progress.

Thanks for all the help :)


Title: Re: Advice on Raspberry pi hardware for running full BTC node
Post by: DaveF on December 10, 2019, 03:21:32 PM
I know it's been discussed before in the thread, but I just came back to my office from one of my clients that has an embedded device that was dead. It is nothing more then a Pi in a case in the back of their id scanner.

Cause of death...a power adapter that probably cost less the then the $0.25 I put in the parking meter in front of their office because it's raining and I didn't want to park in the free lot and walk.
Seriously, I put in a phone charger that I had in my trunk and they were back online. I cracked open the dead one and it was so poorly constructed I was surprised it ever worked.

-Dave