I do not need my 24 word seed to do this correct?
No, you don't.
So i have to uninstall it from add/remove programs... then download same ledger live from the site?
You can uninstall and then re-install it using the file you've previously downloaded from the site, no need to download it again.
Could i use the chrome store to access bitcoin ledger in chrome or not? I won't use it normally though since ledger live is preferred but can we still access it through the chrome app?
You can still use the old Chrome app but it is risky. It's better to restore your access to Ledger Live (which won't harm any asset that you have).
Basically, it's like using your Ledger + Ledger Live on a new computer.