If I remember correctly, the score changes at 9:00 UTC, so it might take a while, depending on your timezone.
IIRC your activity will actually change a little less then every two weeks, it is something like every two weeks plus ~an hour or so, and as a result you would lose ~1 activity "upgrade" per year.