Ok well looks like the Analog speed control on this VFD isn't isolated so yes you'll use Gnd.

Just use the 5V for Pot