It's more likely to be spindle deflection.
You say you've measured deflection on each axis, but what about on the spindle nose/cutter with the spindle at cutting depth?