Router 'lifts' on x-axis when moving

I had set up to plane a new spoil board I noticed that after I aligned the cutter to just touch the high point of the spoil board. Then I double checked it by running the x axis the full length its travel. What I saw was that when moving to the right the cutter just touched the spoil boar at it highest point, just as it should. However, when I moved the x axis to left the cutter was about 0.03125 higher than it was when moving to the right.

Any ideas or thoughts on what might be causing this? I have attached some picture of the axis to give a reference of what I have.

W

Take the tool out, unplug the router, and grab the collet and push and pull hard in all directions. Somewhere, something is loose and moving.

I'll give that a try.

The pipes on the x axis are flexing quite a bit. I think the torque from the stepper may be causing the pipes to flex causing the deflection. I will need to add some supports between the pipes and anchor them to the back for support.