I am also facing this kind of problem but now I don't use bitcoin in my coinbase wallet my fully focuse on eth.bitcoin price is very high that's why transfer fee also high so better suggestion is you can convert your btc to eth & send eth any exchange for avoid high fee.
This idea will work out. to avoid paying the extra fee, you can convert your BTC to ETH or BCH or LTC or other altcoins it will take less fee and fast transaction. But now Bitcoin confirmation fee is reduced to compare last month. You can check it once. Last month I too tired to withdraw $100 worth of bitcoin but it asked me to pay $40 fee. Now it is ok it reduced a bit.
