So, I originally had my wallet encrypted with my fingerprint.
'Use Biometrics' option does not encrypt the wallet. It simply locks the app. Most Android phones these days have some sort of app locking feature built-in.
I can't seem to find a way to remove (or even edit) the password?
It looks like you have to reinstall the app in order to get rid of the password protection (which is not a perfect solution). Enabling advanced mode doesn't seem to show any new options related to that problem.