I believe you have lots of dust transaction within that wallet and you are moving this dust (meaning you have lots of inputs from different dust deposit to that address) making the byte size bigger than the normal transaction that have one input and one output.
It has become a normal thing for a bitcoin of the present time, large transaction fees, slow speed is what we can see from the king of all the virtual currency. I wonder that, in addition to large values, bitcoin stronger where?