Woah what? Damn this shit is confusing. So if I backup once a week, is that enough?
It depends.
If you generate more than 100 new addresses (including new change addresses) in a week, then you will need to backup more often.
Is it ok to backup over and delete the old backups or should I save them all?
It is okay to delete old backups, as long as you have the new backup.