i find it odd that you cant.
some recovery services ask you to dump your hash from the wallet and the hash itself within holds the passphrase.
as mentioned by Dave here:
https://walletrecoveryservices.com/limited/if its not remotely possible, why would he ask for this?
unless OP is referring to readable ascii text.
The keys are encrypted with a randomly generated master key and the master key is encrypted with the passphrase(derived after putting it through some algorithm) that the user has provided. The service can bruteforce the master key and thus get the passphrase. The address part is probably just to verify that the passphrase is correct.