I did something similar where i drilled the hole undersize, put a cross split on the end of the rod. Put the shaft in the end and then used a a long nut and screwed it on tight. For this a 6mm drill maybe ok as there is a bit of slop in the nut anyway?