Are you trying to access the site from the same location as you (i.e. is it in the same building)?

Or are you somewhere else?

Just seen your edit.

On my office machine, it did seem to have a fair delay between requesting the page and getting a response, but that's using a leased line, and I don't think there's anything special going on there. (I could do a TCP level packet inspection, but I don't think that'll tell me anything useful [from your perspective]).