If the taper fits and the tool holder can seat fully there is no risk in light cuts.
Marker pen as blue on the holder, shove it in and twiddle and that will clearly show if the contact area is good.
Regards,
Nick