Hardware requirements for running a full node with the official client

[Mad7Scientist2]

2TB SAS is $65 new, with some SAS drives included with the server caddy in the 50s, and 2TB SATA is $85 new. What's going on? Have high flash memory prices have caused desktop PC users to go mechanical?

[ABCbits]

2TB SAS is $65 new, with some SAS drives included with the server caddy in the 50s, and 2TB SATA is $85 new. What's going on? Have high flash memory prices have caused desktop PC users to go mechanical?

It's nothing new, the price slowly rising since last year. You can check price chart on https://pangoly.com/en/price-trends/hdd and https://pcpartpicker.com/trends/price/internal-hard-drive/. But FYI, AI company also use HDD. Do you know that some HDD company begin to add "AI" label to their HDD? For example, https://www.toshiba-storage.com/products/s300ai-surveillance-hard-drive/ add it on HDD that probably supposed to read and write CCTV recording.

[DaveF]

Way off on disk size. The chain is nearing 1TB and 2TB drive will only be good for around another couple of years.

You’re wrong there, 2TB is enough space for at least another 4-5 years. Based on block sizes over the last 3 years,   2TB will be enough until 2030/2031 at least.

Probably a bit past that. Figure a bit over 200 GB a year if every block is full. So 5 years for a TB which is 2031 but we are still under 1 TB so sometime in 2032 is more likely.

Not a big worry. At that point the AI bubble would have long popped and things should be back to normal in terms of drive pricing.

-Dave

[Cricktor]

Looking at 30d average values for blocksize here https://www.blockchain.com/explorer/charts/avg-block-size, full blocks rarely exceed these days (for the last two or three years) a size of 1.75MB. Therefore 52,560 blocks per year grow by about roughly 92GB, and the majority of blocks in the past few years were "full" by weight units upper limit of 4M.

[takuma sato]

If you have the money, I would invest in an SSD of around 4TB. While 2TB keeps you covered for the next 3-4 years, I would probably think that it's a good ROI to invest in 4TB, which will give you a lot of time, and due inflation itself, plus the current CAPEX seen in AI, I would argue that the current prices are maybe actually cheap compared to future prices. By 2030 when your 2TB drive no longer is able to run your full node, 4TB prices may be a lot higher. Same goes for RAM. Of course, SK Hynix and Samsung may come up with some great solutions, or the AI CAPEX may reach a bubble status and we'll see another cyclical correction, but I would at least guarantee a good number of years of running a full node smoothly because having to resync from scratch everytime you run out of space is annoying, thus try to get a future proof setup.

[DaveF]

If you have the money, I would invest in an SSD of around 4TB. While 2TB keeps you covered for the next 3-4 years, I would probably think that it's a good ROI to invest in 4TB, which will give you a lot of time, and due inflation itself, plus the current CAPEX seen in AI, I would argue that the current prices are maybe actually cheap compared to future prices. By 2030 when your 2TB drive no longer is able to run your full node, 4TB prices may be a lot higher. Same goes for RAM. Of course, SK Hynix and Samsung may come up with some great solutions, or the AI CAPEX may reach a bubble status and we'll see another cyclical correction, but I would at least guarantee a good number of years of running a full node smoothly because having to resync from scratch everytime you run out of space is annoying, thus try to get a future proof setup.

Nah,
1) It's not going to be 2030 probably 2032 or beyond.

2) Even if an AI bubble does not pop or AI investment does not slow down, just the progress of things is going to bring drive prices down. There are fabs being specked / built that are going to take some pressue off.

3) You don't have to resync as you run out of space and upgrade you just need to migrate the data to a new drive. I even do that at times when setting up new nodes so I don't have to wait a day or two for the IBD to finish.

-Dave

[Cricktor]

By 2030 when your 2TB drive no longer is able to run your full node, 4TB prices may be a lot higher.

I call out "Nonsense!" for the first part of your sentence. Currently 1TB doesn't quite fit anymore, because even a small OS needs some space, too. Do the math yourself with the educated guess of a yearly growth of around 100GiB, as I wrote before, for the Bitcoin blockchain data. Let's talk again in 2033 or 2034, shall we?

[gmaxwell]

you can drop the storage requirement by a significant amount using a filesystem with compression for the blocks...  the node software could drop it quite a bit more with a relatively small change to use a compressed serialization -- patches have even been posted. But no one actually cares about this storage requirement except forum whiners, particularly since if you don't want to store so much you can simply prune.

[ABCbits]

you can drop the storage requirement by a significant amount using a filesystem with compression for the blocks...

While i also mentioned it few times as workaround, what filesystem would you recommend? On linux. both btrfs and OpenZFS require you to enable CoW if you also want to use compression, but last time i tried, the disk performance is poor without additional tuning that i don't understand. I never tried F2FS though.

[DaveF]

you can drop the storage requirement by a significant amount using a filesystem with compression for the blocks...  the node software could drop it quite a bit more with a relatively small change to use a compressed serialization -- patches have even been posted. But no one actually cares about this storage requirement except forum whiners, particularly since if you don't want to store so much you can simply prune.

Agreed.
Not to mention with both Windows and linux you can extend drives across multiple disks so it's not even that hard to just add in a few hundred gigs from whatever drive you happen to have around so long as it fits in your case.

https://www.diskinternals.com/glossary/spanned_volumes/
https://forums.rockylinux.org/t/partitioning-hand-holding-needed/4998/4

Anyone commenting about drive / storage space is just someone with an agenda at this point. Not sure what the agenda is but it's been pointed out too many times that it's not a big deal for them to still be harping about it without some other reason.

I have posted about a few times a 10+ year old PC with limited RAM and a 1TB drive that it's only value is $0.20 / lb at the scrap yard can still run a full node.
Anything more you need a bit more storage but adding another small drive to expand storage or just getting a larger one is not that big a deal.

-Dave