Then you look for the next one in the sequence.
This is the part I don't understand. Does my seed simply signify the start of an infinite, specific sequence of addresses? Such that if I start from address 1 and generate up to address 100... I could delete my wallet and the seed would create that exact same sequence again?
Yes.
You can also independently generate all addresses with just the master public key. You will only get the addresses + public keys not their private keys so you won't be able to spend the coins sent to those addresses. But you can create a watch only wallet using the master public key.
To be more clear, is it already determined what the 500th address/key pair in my electrum wallet will be? (based on my seed)
Already determined by whom? This sounds like a philosophical question

Private keys are basically really, really large numbers so they all already exist in that sense. The security stems from the fact that finding private keys with coins in them is hard because of the large number of possible keys.
Anyway your wallet doesn't calculate the 500th key until it needs to (say because you've received coins at number 496) or you tell it to.