They can be summoned to state their reasons for leaving the flag. Probably they had other experience with same user on varying occasions and since yours was somehow related, they decided to leave their tag as well. So even if you settled with the user X and renounced your tag, their reasons may still be intact. But if they had no experience with user x but was supporting your flag, then it would be moderate to change their flag as well..though it depends.
If they have other reasons then they should have their own flag that will explain their reasons. The flag created by me should not mix with any other cases otherwise it will become confusing, won't it be?
That's true.
If they have distinct reason, they should raise their own flag and a new tag with different reference. To me, if the victim affirms case has been resolved, the case is totally dead.
Only that you removed your trust list, I would have suggested you make the neutral tag more powerful by stating that other red tags with respect to the case should be disregard.
Have you or the victim tried sending pm to the people concerned?
Meanwhile, flag should be neutralized immediately the accuser withdraws it.