I'm not sure if you've already updated the firmware to v1.1.0 or if you're still using v1.0.4 and below firmware, but the only thing that v1.1.1 brought was giving Nano S Plus users the option to use their controversial/questionable ledger recover, so you can peacefully continue to use the previous firmware version.
Sure, you can absolutely do so--if you're so unconcerned with your privacy that continuing to use any Ledger product lets you sleep at night. That Recover debacle wasn't just about the service, remember. It was that Ledger divulged that they can gain access (or effectively
have access) to your private keys, which was previously thought to not be the case.
OP, I know you have not a small tinge of paranoia about you, so I hope you're aware of what the real story is regarding Ledger. I haven't seen you post about the Recover crap and "private key exfiltration" nightmare scenario, so if you aren't aware of what a shit company Ledger is just read through some of the Ledger-related threads here or go to their subreddit and read some of the threads from a few months back.
Ditch that Ledger for something else, that's my opinion. Dkbit98 has dropped some solid suggestions, but at this point I don't know how much I trust HW wallets anymore. But that's my own paranoia and technical ignorance speaking, both of which I have a lot of.