I was thinking that the galvanic isolation (floating DC) is there to prevent a current path between AC live and DC, and that when using a probe you temporarily defeat it. I think also galvanic isolation prevents ground loops should a secondary piece of equipment grounded equipment like a PC be connected, not a consideration here.

But as you say you might get a tingle.