Just because they removed it from the store, doesn't mean that it's removed from your phone. It should still be on your phone if you already downloaded it. You can then transfer your coins out if you like.
^ That
Also, I think you can be pretty safe with your bitcoins on the phone. This just prevents new users. However, if you store lots of bitcoins on your phone, you might want to consider sending at least some of them away.