I can feel what you feel I'd read somewhere here on forum that he's complaining the same thing. If the recommend fee is quite high for the guy, he will just use the advance send option of blockchain.info and will simply adjust the fee to lower one. But when he is changing it to lower one, the system tells him and scares him out that it will be long time or his transaction will never be confirmed, though I'm not using their wallet.
Actually they adopted dynamic fee structure, they're selecting which feee is best for you by increase it when there are more traffic on blockchain or decrease it if the traffic is less. It's a good implementation i think however my transaction always got stucked and the worst was i have to wait untill 1 day for my transaction confirmed, i mean they choose fee for me in order to ensure my transaction confirm reliably and fastly but then reality is nothing, that's why i am not using their service anymore.