I loved to watch anime especially Japanese but I've never learn by just reading subs.
You may complement all the ideas given here, by re-watching those anime WITHOUT subtitles. Don't think your previous experience is a complete waste, you don't know it, but you can already catch some words just because you watched a lot with subtitles. It is funny, but you will only find out when you find yourself suddenly in a place where everyone around you only talks the language.
From abroad it is much more difficult, since you can always fall back to your native language, or native language speakers. It is true that living, say 3 months, makes a huge difference. But only if you end yourself in a place with little of your own native language, which is hard.
The good news is, Japanese people don't really speak English, unlike in Korea or Europe where you have a much higher chance of finding someone that speaks it. In case you have a Japanese community where you live, you can also try going there and just listen. Try not to think of anything, just listen.
If you want an excuse, you can go for the Olympics, but since that is very foreigner focused I'm sure they'll have plenty of information and guides in English, which is not what you want. But it could be a start, i guess.
And if you are really into anime, visit Akihabara, the anime shops, etc.
Also be ready to learn their culture, this is not easy, let me tell you. It can be very frustrating at times...