GPU drivers contain the GPU's OS, among other things, and updating an OS rarely improves the performance
of anything. Some updates hurt performance because they contain a fix workaround for some problem.
You are right, most especially those BETA drivers from Nvidia and AMD, they are always hot fixes for old drivers and I've seen whereby it add more problems to my mining rig, find a good driver and remove the auto update under the driver settings