Not sure how you can "directly" purchase through a hardware wallet, but you can purchase bitcoin through a non-KYC exchange like LocalCryptos[1] for a 0.75% fee, which is a pretty reasonable fee imo; excluding the fees of the payment processor you're going to use.
[1]
https://localcryptos.com/