Found the SOLUTION:
GUIMiner expects the Ufasoft executable to be named "bitcoin-miner.exe". But in the v0.39 package that I downloaded this exe is named only "coin-miner.exe".
Even if I use this name "\...\coin-miner.exe" in the "Ext. Path" field, it does not work.
One has to rename the actual file "coin-miner.exe" that comes with the ufasoft package to "bitcoin-miner.exe". Then it works fine. And don't forget the "-g no" for CPU-only mining...
That cost me some hours...