Yours is the first case I've heard of, but hey, it can't hurt to have additional security, right? Most people also only really protect a couple of wallets, so setting up something like that could be considered overkill.
If we had no hardware wallets on the market, that would've been the normal security measure to take but since we do have them and you can afford one, why not just get one? these devices are safe regardless whether your network/computer is safe or not.
I agree that this is the case for pretty much every other average user out there, but OP doesn't seem very average. He has stated that he has mining equipment and servers that house sensitive data, and a hardware wallet can't do much to protect those.