I don't think it's much of a problem: I myself only have one TOR peer despite having over 120 inbound/outbound connections.
There's probably something wrong, because I'm running a full node with
onlynet=onion, and have about 12 inbound/outbound connections.
I think if you don't get many inbound only connections it means that somewhere is able to handle them faster?
I don't think that's common on the onion network. Speed is somewhat the same to every node you connect.