What's the bandwidth of the servo drive control loop?

I would guess if it was dithering causing the noise, the bandwidth would have to be equal or higher than the sound frequency??
I could be completely wrong.

Most servos don't have 10kHz control loop bandwidth.
Delta servos are 2.5-3.1kHz (current generation, depending on model).