I know, they are a pain in the backside, in fact they no longer sell just the collets, you have to buy then with a nut now.
I support the nut on an old socket and tap the collet thru with an alloy drift.