Smaller will give you better acceleration, and bigger higher speed.
If you know what torque you'll have, and the weight of your gantry, then you can work out your (theoretical) max acceleration. As I'm sure you'll be aware, there's no use having a high top speed if you don't have the acceleration to make use of it.