When it reaches the maximum number of bitcoins, could we assume that the fee will be increasingly expensive?
No, that assumption would be incorrect. Naturally, because of it's deflationary nature, you would expect Bitcoins themselves to get more expensive relative to other currencies, but fees I would expect to stay low, compensating miners for their equipment and electricity costs, and a healthy profit.