Is this with all sites? You should do a tracert to see how long it takes, and what path you're taking, to get to different sites. For example,
(at DOS prompt)
Code:
tracert microsoft.com
You can get an internet "weather report" at:
http://www.vservers.com/weather/