...Now I'm in the electrum wallet and it's telling me that to send my bitcoin to my other wallet it will be another .5 mBTC, another fifty to sixty bucks. I'm fit to be tied about this situation. I've tried several times at different times of the day, always the same.
50000 sats for a transaction seems excessive considering that mempool.space is recommending only 3 sats/vb right now. What is the fee rate that Electrum is suggesting?
Have you received bitcoin in many small amounts? Keep in mind that the fee depends on the rate and roughly the number of inputs to the transaction. The number of inputs is generally the number of incoming transactions that are needed to fund the transaction. For example, if you received your bitcoin in 100 transactions, it would cost about 100 times as much to send that bitcoin as it would if you received it all in a single transaction.
If this is the case, then you can use an advanced feature called "coin control" to exclude the small inputs from your transaction in order to lower the number of inputs.
... I tried to import my recov phrase in to phantom so I could use the crypto somewhere and the phrase doesn't work.
This is a different problem. Hopefully, @Charles-Tim is correct in that you set up your Electrum wallet wth their
default recovery phrase type, which is not compatible with BIP-39.
Regardless, the cost is probably not due to the wallet software. Often, the fee rate recommendation is a little off, but you can always set it manually if you want.