Quoted from Xapo site : " Xapo does not charge network transaction fees. Sending bitcoins using Xapo to another person, whether they are
another Xapo user or not, is free regardless of the amount. "
They do charge you to buy bitcoins : " Xapo charges a fee of 1%. Also, processing fees may apply depending on the payment method. "
For obvious reasons, Xapo has to charge something for the processing of bank charges, but for that.. you have to blame the banks.
You can try
https://www.asmoney.com/ for NO or limited fees. I have used them before, without any hassles.