Total supply finite or infinite do make a difference. Bitcoin for example has a finite deflationary supply and that augments it's price in the long run. We have coins with infinite supply too and they often perform poorly as compared to those with limited supply. Of course the team and their project's development makes a difference too and these are equally important points to consider when making a complete decision of investing or not.
Overall supply and inflation are important factors to count in the decision making process of investment.
There's small inflation, and then, there's too much inflation. I'd choose my coins wisely, as "not all that glitters is gold". There are so many coins with a huge supply that could end up being worthless in the long run. But that's not always the case, especially if the coin has active development and innovation. Real use cases is what matters above all else.
Consider how Dogecoin is still worth something even though there are lots of coins in circulation. New units will be created every year, leaving us with an endless supply of DOGE. Coins with a limited supply are more likely to rise in price within a short amount of time. I'm talking about coins like Bitcoin, Litecoin, Diamond (DMD), and Dash. Especially Bitcoin which is the most popular cryptocurrency in the world. Who knows how the market will change in the long run as new players join the scene? Just my thoughts
