You'll need to remove the castellated nut, and then knock the leadscrew downwards out of the casting. The nut is what sets the preload on the two bearings that control endfloat, whereas the bearing at the opposite end is just to provide support.

You may need to remove the column, as there may not be clearance in base casting to let the ballscrew/support bearing to drop out.