You have wear in your ways close to the chuck, this kind of artefact is common in worn manual lathes.