I do have multiple backups. No worries here.
...
The idea would be to store each wallet in a different physical location such as work or a bank safety deposit box (not the seedphrase though).
...
Have you actually verified that you can successfully restore your wallet from one of your backups? Having redundant backups is good and highly recommended, but a backup is only good when you know (and verified!) you can fully restore from it completely.
To prevent physical attacks, I'd rather focus on keeping a low profile and avoiding a digital trail of crypto coin related gear purchases. If possible buy your hardware wallets in physical stores, as someone else here already suggested. It may be worth the hassle to plan a trip to a town where that's possible. You can also build decent signing devices yourself from innocent hardware parts, like a Seedsigner or similar.
I don't know if a multi-sig setup really could drive off a determined physical attacker who is in the business of cutting fingers and other body parts. I don't want to imagine any of that. It's way better to avoid exposing yourself. But data leaks can happen everywhere, including where you purchase or trade your coins. Thanks to KYC-everywhere sadly (only mildly exaggerated), potential data leaks are only a matter of time.
My (personal!) issues with N-of-M multi-sig setups are the following:
- to generate your wallet's addresses you need ALL M extended public keys, can't afford to loose a single one of them
- to sign transactions you need at least N of your sets of mnemonic recovery words
- for a redundant backup at different locations, you likely need at least two different secure storage locations per signer
- if you don't have N signers in one secure place, you always need to move around for an outgoing transaction from your wallet
- verifying restore from backups is more tedious (but frankly only needed once); lerning to securely use the multi-sig setup is more advanced; you definitely should practice it
If you don't trust a hardware wallet's entropy generation, get 10 normal dice, through them in box, shake well for every draw of ten dice samples, place the box on a table, open it and read the dice from left to right for a sample of ten dice numbers. Easy-peasy, you don't really need casino grade dice for that as long as yours aren't severely rigged which is unlikely the case for quality dice.
If you generate your own entropy by dice be sure to use the proper and well-known software in a secure offline environment (should be easy to dispose afterwards, like some Linux distro or TAILS running in RAM only) and that you understand what you're doing.