How much Z travel would you lose, if you bridged between the current single bolt mounting, and the end of the quill (where you currently clamp on the second spindle bracket)?
.
If you were to bridge between the two, then you should get a stable piece to then mount the ball nut to.