I'm going to order a 3mm cutter that's the max size without tool change, then see how it pans out.

But the main problem was with nylon and that's only 2mm thick.

Yes we are talking soft materials here and taking .1 off in plastic with a dull cutter is not the technique one should use.

When cutting soft plastics the cutter needs to be razor sharp.