I don't want to try anything else without someone else's input here. Anyone else have had this problem before?
Thousands of people have many issues with ledger nono X, it's one of the worst hardware wallets in the world.
Most problems are coming from bad battery and firmware issues, but in your case I would first make to sure to have latest firmware update and Bitcoin app in ledger live.
Ledger recently released new update and they changed a bunch of things, app size increased again for some coins
(surprise, surprise).
If everything is updated I would try connecting with some alternative software wallets that support ledger, for example Sparrow wallet.