I wouldn't use anything less than M6, but you don't want them to be too big as the fasteners and clamps may get in the way, so either M6 or M8. You are correct in saying to tap M6 you need to drill a 5mm hole.