My Shed-PC has been connected via WiFi to the home network, and thus the Internet for any amount of time. My problems lie more in expecting the machine to do more than what it's intended for, than any influence from the net.

Of course, you need to be vigilant with what software you install.