Full Node on Raspberry Pi 3

[DeepSpace1]

So..I am trying to run a full node on my Raspberry Pi 3. For that I followed this guide: http://www.raspberrypifullnode.com/

But I am failing at these statements:

./autogen.sh
  ./configure CPPFLAGS="-I/usr/local/BerkeleyDB.4.8/include -O2" LDFLAGS="-L/usr/local/BerkeleyDB.4.8/lib" --disable-wallet
  make
  sudo make install

When I try to run the "make" command, it fails because it says that there is no make file...hmmm.
Any help?

[LoyceV]

When I try to run the "make" command, it fails because it says that there is no make file.

Can you give the last output from ./configure, or better, the complete output from all the previous commands?

If needed, you can use script for this.

[DeepSpace1]

Thanks for the help and sorry for the late reply.

The only unknown for me is this line:

git clone -b v0.15 https://github.com/bitcoin/bitcoin.git

Because in the tutorial it says "v0.11.2" and since its old I used the recent version "v0.15". Maybe thats the problem and I use the wrong repository?


Here is the output from my command line: https://pastebin.com/Hx8NHXCd

[ranochigo]

It just means that the directory that you're in does not contain the make file. The ./configure script failed because you didn't have a dependency.

Try running this:

sudo apt-get update -y
sudo apt-get install libevent-dev -y

Try it and then run the configure command again.

[DeepSpace1]

Thx ranochigo, that helped.

But there seems to be a problem with this SD card. I tried to copy the blockchain onto my Pi and after a few Gigs it started complaining that there is not enough space, even when Linux said that more than 200gb where available...

[BTRIC]

Thx ranochigo, that helped.

But there seems to be a problem with this SD card. I tried to copy the blockchain onto my Pi and after a few Gigs it started complaining that there is not enough space, even when Linux said that more than 200gb where available...

Did you partition it? Also, you didn't buy it on eBay did you?

[DeepSpace1]

I did not partition it.

Yes, I bought it used...

[LoyceV]

I did not partition it.

Although you can create a filesystem without a partition, it's not recommended.

Yes, I bought it used...

You should start by testing the SD card it self. Write 100 GB, and see if you can read it back.

A simple test:

Code:

#!/bin/bash
mkdir ~/disktestbyLoyce
cd ~/disktestbyLoyce
wget http://ipv4.download.thinkbroadband.com/1GB.zip
i=1; while test $i -le 100
do   cp 1GB.zip 1GB.zip$i
     i=$((i+1))
done
md5sum 1GB.zip*
rm 1GB.zip*
cd; rmdir ~/disktestbyLoyce

If your SD card is okay, it will show the same checksum 101 times without errors.

[bitart]

I did not partition it.

Although you can create a filesystem without a partition, it's not recommended.

Yes, I bought it used...

You should start by testing the SD card it self. Write 100 GB, and see if you can read it back.

A simple test:

Code:

#!/bin/bash
mkdir ~/disktestbyLoyce
cd ~/disktestbyLoyce
wget http://ipv4.download.thinkbroadband.com/1GB.zip
i=1; while test $i -le 100
do   cp 1GB.zip 1GB.zip$i
     i=$((i+1))
done
md5sum 1GB.zip*
rm 1GB.zip*
cd; rmdir ~/disktestbyLoyce

If your SD card is okay, it will show the same checksum 101 times without errors.

SD with 200 GB available... used from ebay... From shop, it would cost about $200, you can buy a decent USB HDD from this price and it would not have only 256 GB space but much more.
Anyway, how much space is needed to host a full node? I'm thinking about the same, using a Raspberry PI to run a full bitcoin node and I'm thinking about what size of USB HDD I need to buy.
Does SD card is a possible solution for storage, when running a node on PI? I mean the OS is writing on the swap partition continously, so SD can reach it's write limit in no time and after you can just trash your SD?

[Jet Cash]

I ran a full node on a 256Gb SSD ( external), that was a few months ago, so I'd probably go for a 512 if I was starting now. I'm using a 2TB external drive ( Toshiba) for my new node , and that is fine, but it's a bit slow, and you probably ought to have an alternative power supply for it if you are going to use one.

[bitart]

I ran a full node on a 256Gb SSD ( external), that was a few months ago, so I'd probably go for a 512 if I was starting now. I'm using a 2TB external drive ( Toshiba) for my new node , and that is fine, but it's a bit slow, and you probably ought to have an alternative power supply for it if you are going to use one.

What do you mean about 'a bit slow'? I have already a 512 Gb external 3.5" HDD with an external power supply, external HDD enclosure with fan, so I thought it will be OK to start with. As I've read somewhere if I run the OS of the Raspberry  PI from the SD card, the OS will be relatively quick and I have to store only the blockchain on the external HDD. If the OS runs from the SD it should be as quick as an SSD? I'll give it a try as soon as the Raspberry arrives and I can start this little project. What I can do beforehand to install a node on a laptop, download the blockchain and to copy it to the external HDD.

[Jet Cash]

It was from personal observation, so I can't really quantify it. This article compares HDD and SSD though.
http://www.storagereview.com/ssd_vs_hdd

[ntoken]

Thanks for the help and sorry for the late reply.

The only unknown for me is this line:

git clone -b v0.15 https://github.com/bitcoin/bitcoin.git

Because in the tutorial it says "v0.11.2" and since its old I used the recent version "v0.15". Maybe thats the problem and I use the wrong repository?


Here is the output from my command line: https://pastebin.com/Hx8NHXCd

I faced similar issues on compiling. From the output above, there is some other dependency issues include libevent-dev. Here are the packages that I finally confirmed, may it help:

build-essential libssl-dev libdb++-dev libboost-all-dev libqrencode-dev libminiupnpc-dev
protobuf-compiler libprotobuf-dev libczmq-dev libczmq4 libevent-pthreads-2.0-5 libevent-dev  

[jackg]

SD with 200 GB available... used from ebay... From shop, it would cost about $200, you can buy a decent USB HDD from this price and it would not have only 256 GB space but much more.
Anyway, how much space is needed to host a full node? I'm thinking about the same, using a Raspberry PI to run a full bitcoin node and I'm thinking about what size of USB HDD I need to buy.
Does SD card is a possible solution for storage, when running a node on PI? I mean the OS is writing on the swap partition continously, so SD can reach it's write limit in no time and after you can just trash your SD?

SD and SSD technologies are fairly similar in the way thy function and people run core on SSDs. Even though they're obviously more stable, they're still flash storage.

@OP, what does the SD card say on it? What brand it is, what size? The only FLASH producer I'd trust personally is Kingston (Samsung, Sony and Sandisk are alright also but not as good). Bitart, Kingston and Sandisk definitely go up to 256 gb micro sd cards (not entirely sure whether a raspberry pi is capable of supporting that in such a small and dense storage medium but...)

I've been considering using a raspberry pi also for the same operation but I always got my dependencies wrong and never had enough time to go back and correct myself from all the problems to reinstall everything.

[bitart]

SD with 200 GB available... used from ebay... From shop, it would cost about $200, you can buy a decent USB HDD from this price and it would not have only 256 GB space but much more.
Anyway, how much space is needed to host a full node? I'm thinking about the same, using a Raspberry PI to run a full bitcoin node and I'm thinking about what size of USB HDD I need to buy.
Does SD card is a possible solution for storage, when running a node on PI? I mean the OS is writing on the swap partition continously, so SD can reach it's write limit in no time and after you can just trash your SD?

SD and SSD technologies are fairly similar in the way thy function and people run core on SSDs. Even though they're obviously more stable, they're still flash storage.

@OP, what does the SD card say on it? What brand it is, what size? The only FLASH producer I'd trust personally is Kingston (Samsung, Sony and Sandisk are alright also but not as good). Bitart, Kingston and Sandisk definitely go up to 256 gb micro sd cards (not entirely sure whether a raspberry pi is capable of supporting that in such a small and dense storage medium but...)

I've been considering using a raspberry pi also for the same operation but I always got my dependencies wrong and never had enough time to go back and correct myself from all the problems to reinstall everything.

Thanks for the advice. I won't think that the Raspberry Pi is able to handle the 256 Gb SD card...
My concern is the read/write cycles of the SD card, still.
I've found this thread, it's pretty old, but the problem is still valid:
https://www.raspberrypi.org/forums/viewtopic.php?t=21281
I'm not sure about the OS of Raspberry PI but if it's a linux, then it's not a good idea to run it on an SD card or USB flash drive. Or, I only need to move the swap partition to the HDD and it will solve the read/write cycle problem. Anyway, as soon as I'll have a working system (hopefully sometime this year ) I'll make a backup copy of the SD, just in case....

[jackg]

SD with 200 GB available... used from ebay... From shop, it would cost about $200, you can buy a decent USB HDD from this price and it would not have only 256 GB space but much more.
Anyway, how much space is needed to host a full node? I'm thinking about the same, using a Raspberry PI to run a full bitcoin node and I'm thinking about what size of USB HDD I need to buy.
Does SD card is a possible solution for storage, when running a node on PI? I mean the OS is writing on the swap partition continously, so SD can reach it's write limit in no time and after you can just trash your SD?

SD and SSD technologies are fairly similar in the way thy function and people run core on SSDs. Even though they're obviously more stable, they're still flash storage.

@OP, what does the SD card say on it? What brand it is, what size? The only FLASH producer I'd trust personally is Kingston (Samsung, Sony and Sandisk are alright also but not as good). Bitart, Kingston and Sandisk definitely go up to 256 gb micro sd cards (not entirely sure whether a raspberry pi is capable of supporting that in such a small and dense storage medium but...)

I've been considering using a raspberry pi also for the same operation but I always got my dependencies wrong and never had enough time to go back and correct myself from all the problems to reinstall everything.

Thanks for the advice. I won't think that the Raspberry Pi is able to handle the 256 Gb SD card...
My concern is the read/write cycles of the SD card, still.
I've found this thread, it's pretty old, but the problem is still valid:
https://www.raspberrypi.org/forums/viewtopic.php?t=21281
I'm not sure about the OS of Raspberry PI but if it's a linux, then it's not a good idea to run it on an SD card or USB flash drive. Or, I only need to move the swap partition to the HDD and it will solve the read/write cycle problem. Anyway, as soon as I'll have a working system (hopefully sometime this year ) I'll make a backup copy of the SD, just in case....

But off topic: I have a 3 year old smartphone with a class 10 32gb micro SD card that is still going strong and not dying.

Also, drives normally die when you plug in/unplug the drive, if the rpi stays on it'll probably make the SD live a bit longer.

I think the pi2 claimed it could only handle 64gb max (I'll test it with my 128gb one tomorrow if I can find them both and see if it does as that might be helpful to both you and op - though you both have the 3 and not the 2).

Pi runs a lot of popular linux and what I assume is a windows-linux hybrid for one of the operating systems.

[ranochigo]

But off topic: I have a 3 year old smartphone with a class 10 32gb micro SD card that is still going strong and not dying.

Also, drives normally die when you plug in/unplug the drive, if the rpi stays on it'll probably make the SD live a bit longer.

In most cases, the number of times that you plug in a SD card isn't the problem. I've never had a card that failed on me due to that and I remove them pretty often for various of my projects.

However, as with all non-volatile memory chips, they have a limited number of read/write cycles. SD cards and SSDs are both susceptible to this problem but I wouldn't worry too much in the case of SSDs. With SD cards, I doubt they are designed to function well under this kind of load. Bitcoin nodes are pretty resource intensive with the client fetching information ever so often. If they aren't one of the "better" ones, I wouldn't expect them to last a very long time. The SD card in your smartphone is probably fine since it didn't go through that many read/write cycles.

To the point on Raspberry Pi nodes, I feel that it is way more cost effective if you purchase a HDD to connect to it. It would be the best if you could salvage it from elsewhere. The sheer cost of a 128GB card is more than a 1TB WD HDD.

[jackg]

But off topic: I have a 3 year old smartphone with a class 10 32gb micro SD card that is still going strong and not dying.

Also, drives normally die when you plug in/unplug the drive, if the rpi stays on it'll probably make the SD live a bit longer.

In most cases, the number of times that you plug in a SD card isn't the problem. I've never had a card that failed on me due to that and I remove them pretty often for various of my projects.

However, as with all non-volatile memory chips, they have a limited number of read/write cycles. SD cards and SSDs are both susceptible to this problem but I wouldn't worry too much in the case of SSDs. With SD cards, I doubt they are designed to function well under this kind of load. Bitcoin nodes are pretty resource intensive with the client fetching information ever so often. If they aren't one of the "better" ones, I wouldn't expect them to last a very long time. The SD card in your smartphone is probably fine since it didn't go through that many read/write cycles.

To the point on Raspberry Pi nodes, I feel that it is more cost effective if you purchase a HDD to connect to it. It would be the best if you could salvage it from elsewhere. The sheer cost of a 128GB card is more than a 1TB WD HDD.

Cost per GB is definitely smaller, not actual cost in my country (though it is literally £5 difference).

I quite like Seagate for HDDs also but I guess that's just me as many like WD and others. Whenever I try to do this, I have a nice 8tb drive waiting to be used for the project. If you can salvage the drive from somewhere else then you could try to do that. I've seen companies here and regularly trying to ditch hard drives. If you're in the UK or US, they were selling 500GB internal drives for $10 second hand at CEX/webuy.com.

[jochemin]

SD with 200 GB available... used from ebay... From shop, it would cost about $200, you can buy a decent USB HDD from this price and it would not have only 256 GB space but much more.
Anyway, how much space is needed to host a full node? I'm thinking about the same, using a Raspberry PI to run a full bitcoin node and I'm thinking about what size of USB HDD I need to buy.
Does SD card is a possible solution for storage, when running a node on PI? I mean the OS is writing on the swap partition continously, so SD can reach it's write limit in no time and after you can just trash your SD?

SD and SSD technologies are fairly similar in the way thy function and people run core on SSDs. Even though they're obviously more stable, they're still flash storage.

@OP, what does the SD card say on it? What brand it is, what size? The only FLASH producer I'd trust personally is Kingston (Samsung, Sony and Sandisk are alright also but not as good). Bitart, Kingston and Sandisk definitely go up to 256 gb micro sd cards (not entirely sure whether a raspberry pi is capable of supporting that in such a small and dense storage medium but...)

I've been considering using a raspberry pi also for the same operation but I always got my dependencies wrong and never had enough time to go back and correct myself from all the problems to reinstall everything.

Thanks for the advice. I won't think that the Raspberry Pi is able to handle the 256 Gb SD card...
My concern is the read/write cycles of the SD card, still.
I've found this thread, it's pretty old, but the problem is still valid:
https://www.raspberrypi.org/forums/viewtopic.php?t=21281
I'm not sure about the OS of Raspberry PI but if it's a linux, then it's not a good idea to run it on an SD card or USB flash drive. Or, I only need to move the swap partition to the HDD and it will solve the read/write cycle problem. Anyway, as soon as I'll have a working system (hopefully sometime this year ) I'll make a backup copy of the SD, just in case....

I have a Bitcoin full node + lightning node running stable on a Raspberry Pi3. BTC blockchain is stored in an external usb drive, swap in a pendrive. Everything works fine.

[bitart]

I have a Bitcoin full node + lightning node running stable on a Raspberry Pi3. BTC blockchain is stored in an external usb drive, swap in a pendrive. Everything works fine.

Which LN node are you using? the C-lightning, the lnd or which one? The external USB drive you use to store the blockchain is an HDD with a USB connections to the PI? What is the size of the swap pendrive?
Could you please share the link you were using while you were working on the installation of the node?
Sorry for the lots of questions