I would like to have a paper backup of my private key (either paper or perhaps in a text file encrypted into a zip file w/ password inside an ordinary USB flash drive). When I try to find my private key, I see there are not 1 but 26 different private keys, why? Which private key holds my coins?
You likely have already made a few transaction. The way Electrum works if that the seed can be used to derive a huge pool of addresses that can be recovered using your seed. Electrum allow the user to use a large pool of addresses and change address to ensure privacy.
If you go to the "address" tab or go to wallet>address, you should be able to see the large pool of address. The addresses that is used and empty are placed in the "used" and the addresses that is used for change is under "change". Take note of any address that has a balance in your receiving address and change. You can then go to Wallet>Private keys>Export to see your private keys.
I wouldn't recommend you doing this. Backing up the seed is sufficient.