You're introducing all kinds of possible issues when you move Z up and down. It's even possible you have a Z axis issue and not a table one. There is no problem with dragging the tip as long as it only drops down slightly or you carefully move it up with your finger when crossing a T-slot. The few grams of force the plunger is exerting or the tiny force on the plunger housing isn't an issue.