How can I remove these without having to manually do it?
Well, you can write a script, but the client has no mechanism to remove them or to reinitialize.
They can't just be deleted willy nilly though. They include data necessary to recover the database if it didn't happen to get shut down properly.
So at a minimum, make sure you have exited cleanly the app and make a backup of the wallet.dat before purging the .log files.