Welcome to the forum @Hopelesser
You don't have to download "their wallet" I have never seen an exchange website having their own wallet and to be honest I surely wouldn't trust the whole website.
1) You have to download your own wallet, such as "Electrum"
2) Then you go to the website and buy some bitcoins or any other altcoins, as you wich
3) Then you move the coins from the exchange to your wallet
If this is the path you want to follow, consider the transactions fees.
Thanks for the quick response.
I have looked at some exchanges but, it looks like they want you to pay in Bitcoin (or some other crypto currency), I want to pay in GBP.
I will take a look at the 'Wallet' section of the forum.
Most of the biggest exchanges (such as Bitstamp, Bitfinex, Kraken, GDAX) can be used to deposit fiat with a bank transfer (or card for some). But if i remember it's not easy to use one with having GBP
But yeah the exchange less popular have only bitcoin and altcoins for deposits/trade/withdrawals