Our normal traditional ATM machines dispense cash or send cash to any specific account at anytime, whereas a Bitcoin ATM simply facilitates a trade. Knowing Bitcoin is not a physical currency like cash or coins, you can't withdraw funds using a Bitcoin ATM machine.
That is not correct. Most Bitcoin ATMs are literally designed to let you sell your BTC and walk away with physical cash in your hand. Just because the Bitcoin itself isnt a physical coin does not mean the machine cannot spit out paper bills once the trade is confirmed.
However, you can input cash to buy Bitcoin without using a bank transfer and send it to the wallet address you input, but there would be fees you must pay and am sure it would charge according to the current rate of Bitcoin at the time.
Yes. It works both ways. As for the fees, that is also true. However, they are not necessarily higher than other ways of buying crypto. It depends on the operator; sometimes there are promotions, and it is even possible to save on transaction costs.