True, but don't we need reasonable contingencies for unreasonable behavior?
You have to think through your example.
Suppose that bridge have access to a single village and the bridge owner decides to institute an annoying rule to annoy travelers and village people. That village will die out. The bridge will fall into disrepair and the owner will be left with a bridge that doesn't make any money.
In other words, the bridge owner have some incentive to maintain links or else he have to find another job.
Of course, if he doesn't have a profit motive, that's another matter.
However, the same thing can happen to people who put their money into a scam, or willingly sell the bridge to an evil property owner who have preferences outside of human norms.
If you institute a regulatory authority of some kind or have some kind of mob rules, the rule of laws will disappear, and the uncertainty cost will increase. This lead to less capital formation that alleviate your bridge problem.