As for me, the only people worried about ASIC are GPU/GPU farm owners. ASIC will kick them off from the business. ASIC itself will replace current CPU and GPU power. It will happen sooner or later.
I belive that ASIC != The end of decentralized mining, it is the end of profitable GPU mining. There will be less miners but Bitcoin will be more protected overall.