There isn't a "nice" way to fit a 6mm shaft snugly into a 1/4" hole other than shimming or boring the 1/4" hole bigger and making some insert collars.