What causes a whine when the water is turned on?

It's not exactly a cavitation sound. It's especially noticeable when taking a shower or when the fill cycle activates on the dishwasher or just turning on the faucet at the kitchen sink.