Yes banks and organizations take the rest.
This is indeed the case according to the article I cited in the answer to @stompix. The card network fee is the biggest fee, but it is not the only "credit card fee" (there is for example also an assessment fee and possibly payment processor fee). So the Visa numbers alone do not show the whole picture.
Software platforms like Square/Mercadopago charge a flat fee which includes all these fees, that's why they charge around 2-4% (normally) and up to 8-9% (for fast processing in countries like Argentina). Then there is the volume model stompix mentioned, where you indeed can get lower fees of sometimes less than 1.5%, but you would also have to pay a monthly base fee per PoS terminal.
In Argentina at least, small shopowners often prefer the flat fee option because the monthly fee may increase the cost they have to pay even more, depending how much they depend on card payments. What they do often is to try to persuade customers to pay with debit cards (1-2% fee) or via bank transfer (no fee) instead. For a shop where card payment is common, $35 (30 €) monthly payment per PoS for a reduced fee of course is a good option and likely to reduce the total fee to about or less than 2% if you are able to get a 1.25% fee in your contract.
So in general I think smaller shops (both online and offline) and those serving a large proportion of international customers (for example, domain registrars like Dynadot where I got the discount) would be more incentived to provide discounts for bitcoin/crypto payments.