Does it happen when the CNC is moving with the spindle off? How about when the spindle is running but the CNC is stationary?

Are these wired keyboards and mice or wireless ones? Can you try swapping to a wireless/wired set?

Are there any EMI filters on the VFD? Might be worth spending £2 and getting one for the VFD and one for the PC's kettle lead.