NotATether (OP)
Legendary
Offline
Activity: 1708
Merit: 7176
In memory of o_e_l_e_o
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 11, 2024, 10:41:59 AM |
|
I needed to get a spare VPS to run some tests with Bitcoin Core, and this was the only one that met the disk requirements. The maxmempool and the dbcache are set to the bare minimum (5 and 6 MB respectively). Currently, there is 1.2GiB free while I am running Core. There are no other programs running on the system: total used free shared buff/cache available Mem: 1.9Gi 775Mi 113Mi 1.0Mi 1.2Gi 1.2Gi Swap: 0B 0B 0B
It is currently on around block 450,000 in the IBD. Yes, I am aware that this setup will thrash the disk a lot. However, the disk and network are in excellent condition - NVMe SSD and 1Gbps network respectively. So how long should I expect the validation to take? And will I run out of memory before it finishes?
|
|
|
|
ABCbits
Legendary
Offline
Activity: 2982
Merit: 7805
Crypto Swap Exchange
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 11, 2024, 11:01:50 AM |
|
Yes, I am aware that this setup will thrash the disk a lot.
And you probably should be concerned getting warning from the VPS provider. And will I run out of memory before it finishes?
Probably no, people used to run full node on older Raspberry Pi which have only 1GB RAM. But you probably want to read https://github.com/bitcoin/bitcoin/blob/master/doc/reduce-memory.md.
|
|
|
|
DaveF
Legendary
Offline
Activity: 3584
Merit: 6501
Crypto Swap Exchange
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 11, 2024, 11:46:32 AM |
|
... Yes, I am aware that this setup will thrash the disk a lot. However, the disk and network are in excellent condition - NVMe SSD and 1Gbps network respectively. So how long should I expect the validation to take?
Without more info the last time I tried something like this which was close to a year ago it was just about 3 weeks. And will I run out of memory before it finishes?
Memory, no. Patience perhaps. Do you have a complete fully synced node that you trust? You can just copy everything over. -Dave
|
|
|
|
NotATether (OP)
Legendary
Offline
Activity: 1708
Merit: 7176
In memory of o_e_l_e_o
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 11, 2024, 12:57:42 PM |
|
Yes, I am aware that this setup will thrash the disk a lot.
And you probably should be concerned getting warning from the VPS provider. What do you mean? @DaveF unfortunately, I do not have any other nodes elsewhere at the moment.
|
|
|
|
LoyceV
Legendary
Offline
Activity: 3416
Merit: 17265
Thick-Skinned Gang Leader and Golden Feather 2021
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 11, 2024, 01:48:59 PM Last edit: June 11, 2024, 01:59:58 PM by LoyceV |
|
You should read Sharing for Bitcoin Core download: the cheapest pay-per-hour VPS I found for my experience. I think it will work, but I wouldn't do it. I am aware that this setup will thrash the disk a lot. Disk I/O is shared and prolonged high load may get you suspended. I've used load limiting software on a VPS in the past on a VPS. I'm curious: did you get a VPS with 600+ GB NVMe and very little RAM? That's a weird combination. @DaveF unfortunately, I do not have any other nodes elsewhere at the moment. If pruning works for you, I can get you my copy of Bitcoin Core. I only have 300 GB available on the server so can't offer a full copy. I checked both my pay-per-hour VPS options, but the only ones with enough storage use HDD.
|
|
|
|
DaveF
Legendary
Offline
Activity: 3584
Merit: 6501
Crypto Swap Exchange
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 11, 2024, 03:23:04 PM |
|
Yes, I am aware that this setup will thrash the disk a lot.
And you probably should be concerned getting warning from the VPS provider. What do you mean? @DaveF unfortunately, I do not have any other nodes elsewhere at the moment. Any reason you don't run this locally? 1TB SSDs and some older i5/i7 machines are not that expensive anymore. As a few of us have discussed even NEW N95 based mini PCs with 16GB and 1TB are under $249 I know it's not an insignificant amount of money but paying every month will eventually cost you more. -Dave
|
|
|
|
NotATether (OP)
Legendary
Offline
Activity: 1708
Merit: 7176
In memory of o_e_l_e_o
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 11, 2024, 05:56:47 PM |
|
I'm curious: did you get a VPS with 600+ GB NVMe and very little RAM? That's a weird combination.
Yes, I ordered that a month ago. This server was originally for backup storage, but I have since subscribed with a seed host and moved them there. My vendor lets me configure the specs of the server so I went with 2GB to make it as cheap as possible, but I quickly regretted not making it 4GB. This is a boutique host, with crazy stuff like 10Gbps Ethernet offered. But I will take your advice to move my node somewhere else. I'm just not sure where at the moment. PS: Pruning will not work for me, as my application requires a node with -txindex. I only intend to run it for a few days to conduct some testing. Any reason you don't run this locally? 1TB SSDs and some older i5/i7 machines are not that expensive anymore. As a few of us have discussed even NEW N95 based mini PCs with 16GB and 1TB are under $249
My ISP will definitely severely throttle my internet if I attempt to do that. (I do not exactly know what the fair use policy here is, but anything above 100GB will definitely trigger it.)
|
|
|
|
LoyceV
Legendary
Offline
Activity: 3416
Merit: 17265
Thick-Skinned Gang Leader and Golden Feather 2021
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 11, 2024, 06:14:12 PM |
|
I only intend to run it for a few days to conduct some testing. Sounds perfect for a cloud provider where you pay per hour. My ISP will definitely severely throttle my internet if I attempt to do that. (I do not exactly know what the fair use policy here is, but anything above 100GB will definitely trigger it.) That sucks, which country is that? My laptop downloads 10 GB per day on average, and that's just one of many devices in our household. They never complain if I max out my connection for a few days.
|
|
|
|
Easteregg69
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 11, 2024, 06:31:07 PM Last edit: June 11, 2024, 06:43:00 PM by Easteregg69 |
|
It will constantly swap on the hard-drive unless something incremental happens. Judging from headline.
I assume your not a big fan of judges.
Like you would kill a great idea for fun. You told me it was immutable and I can go on about it all night.
How big is the file? ay. You know the Answer. Cheers. Royal Classic. Always some percentage vol.
You need top of the line hardware. Or go "tokenized". Web3. You add an "or else".
I see who wants to talk about ownership. "Come and see my car..".
|
Throw some "shit" and see what sticks.
|
|
|
NotATether (OP)
Legendary
Offline
Activity: 1708
Merit: 7176
In memory of o_e_l_e_o
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 11, 2024, 06:42:24 PM |
|
My ISP will definitely severely throttle my internet if I attempt to do that. (I do not exactly know what the fair use policy here is, but anything above 100GB will definitely trigger it.) That sucks, which country is that? My laptop downloads 10 GB per day on average, and that's just one of many devices in our household. They never complain if I max out my connection for a few days. Let's just say it's a third-world country, which generally do not have much internet resources and DC (data center) bandwidth compared to first-world countries.
|
|
|
|
Easteregg69
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 11, 2024, 06:44:38 PM |
|
My ISP will definitely severely throttle my internet if I attempt to do that. (I do not exactly know what the fair use policy here is, but anything above 100GB will definitely trigger it.) That sucks, which country is that? My laptop downloads 10 GB per day on average, and that's just one of many devices in our household. They never complain if I max out my connection for a few days. Let's just say it's a third-world country, which generally do not have much internet resources and DC (data center) bandwidth compared to first-world countries. Ownership is about paying the bills. It's the same all over the place. I stopped listening.
|
Throw some "shit" and see what sticks.
|
|
|
DaveF
Legendary
Offline
Activity: 3584
Merit: 6501
Crypto Swap Exchange
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 11, 2024, 09:16:37 PM |
|
...My ISP will definitely severely throttle my internet if I attempt to do that. (I do not exactly know what the fair use policy here is, but anything above 100GB will definitely trigger it.)...
Might be worth it in the long run if you download a bunch one month a bunch the next month and so on. Even if it takes 6+ months and some trips to someplace with free wi-fi if it exits, but in the end you would have a complete node. After that it's just copy the data to a new node when you need it and download whatever came down after you finished. Or, and I'm just putting this out there, someone here could download the blockchain for you and put it on an SSD and ship it to you. Yes, you would have to trust them but it might be worth it. -Dave
|
|
|
|
LoyceV
Legendary
Offline
Activity: 3416
Merit: 17265
Thick-Skinned Gang Leader and Golden Feather 2021
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 12, 2024, 05:36:05 AM |
|
Or, and I'm just putting this out there, someone here could download the blockchain for you and put it on an SSD and ship it to you. Yes, you would have to trust them but it might be worth it. If the internet is bad, I kinda assume the post isn't very reliable either. But it could work, and OP can just rescan the blockchain to make sure it's legit.
|
|
|
|
ABCbits
Legendary
Offline
Activity: 2982
Merit: 7805
Crypto Swap Exchange
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 12, 2024, 09:30:59 AM |
|
Yes, I am aware that this setup will thrash the disk a lot.
And you probably should be concerned getting warning from the VPS provider. What do you mean? As stated by @LoyceV, i refer to high and long disk I/O usage. Many VPS provider state it's against their ToS or acceptable usage. Here are few examples, VPS customers are expected to monitor their usage and utilize our services in a manner that is considered fair share and not abusive to the Disk I/O or CPU. If you require dedicated resources and want to max it out, we would recommend getting your own dedicated server (feel free to contact our sales team for a discounted quote).
Excessive Use of Shared System Resources
You may not use any shared System provided by DigitalOcean in a way that unnecessarily interferes with the normal operation of the shared System, or that consumes a disproportionate share of the resources of the System. For example, we may require you to repair coding abnormalities in your cloud-hosted code if it unnecessarily conflicts with other customers’ use of the Services. You agree that we may quarantine or delete any data stored on a shared System if the data is infected with a virus, or is otherwise corrupted, and has the potential to infect or corrupt the System or other customers’ data that is stored on the same system.
|
|
|
|
LoyceV
Legendary
Offline
Activity: 3416
Merit: 17265
Thick-Skinned Gang Leader and Golden Feather 2021
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 12, 2024, 09:37:36 AM |
|
Many VPS provider state it's against their ToS or acceptable usage. From what I've seen, cloud providers usually throttle your resources, so you can't (ab)use more than you're allowed. I prefer that over suspending the VPS.
|
|
|
|
NotATether (OP)
Legendary
Offline
Activity: 1708
Merit: 7176
In memory of o_e_l_e_o
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 20, 2024, 06:10:54 AM |
|
Small status update:
My node ran out of disk space (!) at around block 837,000 (!!) and aborted.
Naturally, I am disappointed, but there is nothing I can do about it. Now starting Bitcoin Core again hangs at "Opening LevelDB at /root/.bitcoin/chainstate", and AFAIK, memory is not the issue here because I've got 1.5 GB free, but it's definitely stalling at the disk.
I shall definitely go rent a dedicated server to run a proper bitcoin node on now.
No, I haven't received any notices from my host.
|
|
|
|
ABCbits
Legendary
Offline
Activity: 2982
Merit: 7805
Crypto Swap Exchange
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 20, 2024, 08:36:28 AM |
|
Small status update:
My node ran out of disk space (!) at around block 837,000 (!!) and aborted.
Naturally, I am disappointed, but there is nothing I can do about it. Now starting Bitcoin Core again hangs at "Opening LevelDB at /root/.bitcoin/chainstate", and AFAIK, memory is not the issue here because I've got 1.5 GB free, but it's definitely stalling at the disk.
I shall definitely go rent a dedicated server to run a proper bitcoin node on now.
That's a shame. Anyway, you might want to visit https://statoshi.info/d/000000009/unspent-transaction-output-set to know current UTXO/chainstate size (currently it's about 11.6GB) if you ever plan to run pruned node on device with small storage. No, I haven't received any notices from my host.
Good for you. Although based on @LoyceV experience, do you notice any resource throttling?
|
|
|
|
NotATether (OP)
Legendary
Offline
Activity: 1708
Merit: 7176
In memory of o_e_l_e_o
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 20, 2024, 08:41:06 AM |
|
No, I haven't received any notices from my host.
Good for you. Although based on @LoyceV experience, do you notice any resource throttling? No, I haven't noticed that either. These VPSes run on KVM/libvirt and it would be impossible to throttle the disk throughput or IOPS while the system is running, anyway. It has never been shut down or rebooted. Network activity definitely can though, but that is not a problem as I have generous "unlimited" bandwidth. *Well, the fair use policy says up to 20TB outgoing is allowed, before throttling, though - and I am nowhere near that.
|
|
|
|
LoyceV
Legendary
Offline
Activity: 3416
Merit: 17265
Thick-Skinned Gang Leader and Golden Feather 2021
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 20, 2024, 08:47:36 AM |
|
based on @LoyceV experience, do you notice any resource throttling? Throttling happens with cloud providers. I think VPS providers can only "steal" CPU.
|
|
|
|
dkbit98
Legendary
Offline
Activity: 2338
Merit: 7383
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
June 20, 2024, 03:57:48 PM |
|
I shall definitely go rent a dedicated server to run a proper bitcoin node on now.
Why renting a server and paying money for that to someone else when you can run your own node on any old computer at home? I saw one interesting video of a guy in UK who is living off-grid with solar panels and he is mining bitcoin all the time. You don't have to go off-grid and it's much easier to do this bitcoin nodes.
|
|
|
|
|