For most people, beyond a certain number, such as 1 or 6, it's as good as it gets. That tx is already included in a block and will likely never be reversed. The more confirmations pass, the more "secure" it is. 6 is estimated to take an hour, so think of it like a check that clears in an hour.
these numbers are not absolute. it depends on 3 things: (1) amount being transferred (2) state of the network and (3) your method of accessing the blockchain.
you already talked about (1) but not the other.
2) state of the network means if there was some sort of issue, reorg, fork,... that needed extra attention. during these times the number of confirmation required to be safer increases depending on the issue. it can even go up to 100.
3) this basically means whether you are using a full node or a light client. if for example you are using an SPV wallet then you should wait for higher number of confirmation under all circumstances which will grow more if there was an issue.