In article <(E-Mail Removed)>,
Toby <(E-Mail Removed)> wrote:
>
>Packets coming in the downstream direction can be from many sources, of
>course we cant exceed our allocation but if we did so this would create
>random packet drops across all incoming applications, this in itself would
>lead to TCP slowing down the flow to avoid the congestion or the Application
>that uses UDP namely DNS to do the same and re-transmission would ensure a
>reliable service with multiple IP streams, Now I know this sounds
>complicated but put simply these mechanisms adjust to the available
>bandwidth and delay in the network to be efficient. What they dont do is hog
>it all to one application/download.
This is supposed to happen, but it doesn't. The problem is that modern
routers (not just domestic routers but ISP-level) have so much RAM and
such large buffers that the algorithms developed when buffer sizes were
small relative to transit times are no longer working.
Added to this, some service providers have taken to just chucking out as
much data as they can at the start of the connection so as to maximise
"throughput", not realising that they are defeating the very mechanisms
which are supposed to ensure throughput is maximised for the bandwidth
actually available.
This "Bufferbloat" phenomenon was discovered and analysed by Jim
Gettys last year, and has led to projects to address it via new IP level
mechanisms as well as to raise the profile of the problem amongst software
and hardware developers and standards organisations.
See
http://www.bufferbloat.net/projects/bloat/wiki for more information
(various documents at various technical levels, take your pick).
>Without these mechanisms the Internet would just have died very early on.
The early Internet did in fact collapse on one occasion before congestion
mechanisms were added to it.
There is concern that it may be close to another collapse, with wildly
fluctuating and unreliable connections as we all observe every day due
to the fact that routers buffer up so much data that the flow control
is responding too slow, too little and too late.
Doesn't directly help in analysing the OP's DNS problems, but if his link
is maxed out much of the time then the DNS replies could indeed be stuck
in a buffer somewhere behind several minutes worth of download traffic.
Nick
--
Serendipity:
http://www.leverton.org/blosxom (last update 29th March 2010)
"The Internet, a sort of ersatz counterfeit of real life"
-- Janet Street-Porter, BBC2, 19th March 1996