It disappeared from my wallet but the transaction is still on the mempool, naturally unconfirmed.
Is the "Remove" feature really efficient ? Or is my transaction really stuck ?
That is only available for local transactions which is not available from your selected server's mempool.
It only affects your wallet locally and not the Bitcoin network entirely so, it's not effective alone to remove a transaction from mempools.
The Bitcoin Network has many nodes with their own mempool with different settings, other nodes still keep your transaction in their mempool for various reasons like higher size setting, etc.
So, even if you removed it from your wallet, when Electrum auto-selected another server that carry your transaction or it's rebroadcasted to the server that you're using, it will re-appear in your wallet's history.
Just wondering : can I try to sweep again this private key with higher fees ? Will it replace the old tx ?
Yes you can since it should have opt-in rbf flag 'true',
But do that once you removed the transaction from your history once again because it wont let you sweep if its input is being spent.
If it's still there and you want to bump it, import the private key to a new Electrum wallet with "
Import bitcoin addresses or private keys" option;
Wait for the transaction to appear in the history, right-click on it and select "
Increase fee", then select Method: "
Decrease payment" to be able to increase its fee rate.