Although it would save money on collets, unless you can replace the bearings with better ones - i.e. bigger angular contact bearings, then there's not much to gain since the limiting factor will still be the bearings.