Honestly, things are becoming very complicated keeping our coins safe with latest developments. We initially assumed that using cold storage is safer and once you've gotten a hardware wallet, you are good and free from losing your coin but the ColdCard and now ledger is a prove that everything is now possible. The attackers are getting smarter everyday coming up with new techniques. As a holder, the stress of being sure your assets are safe is getting higher.
The coldcard and Ledger cases are unique cases. They are not things that happen often. No matter how things get, for now, hardware wallets are still the best way to protect your coins if you secure the wallet and your seed phrase well.
The coins in those wallets were not brute-forced; for Coldcard, hackers exploited a vulnerability in the wallet, while with Ledger, hackers implanted a malicious chip in the device that transmitted the seed phrase of the wallet to them. If there is no vulnerability in the wallet and the wallet is intact, and as long as you keep your seed phrase and device secured, then you have nothing to worry about.
There has not been a software that can hack a wallet or address without its seed phrase for now. No one has succesffully brute forced a Bitcoin address and transferred it to a different address.