Some people have reported similar issues that seem to be skin specific. Can you try other skins and see if you get the same result?
Possibly IE 6 is resolving some image or css file urls incorrectly and the result is that it must wait for the request for the bad url to timeout before it can finish rendering the page.
Hope it helps,
Joe
ps IE 6 must die!!! ;-) they already held a funeral for it