> > and are you using the provider address suffixed by a
> > username or do you have a separate domain name registered?
>
> The domain name is registered to me, but of course the IP address is
> PlusNet's server, which google can easily check if they want to.
That doesn't seem to be the point.
Let's take BT's example. "Free" web space is addressed as
http://home.btconnect.com/userid/. It's suggested that the core of the
problem (with Google and only with Google) is that BrItish Telecom (and
others) returns a 404 on
http://home.btconnect.com/ rather than sending
a page saying the userid is missing with a 200 status.
It seems that the Googlebot does some kind of check on what it believes
the root directory to be, and drops crawling if it gets a 404. It's
not bright enough to recognise the situation, but as I say (see the
example upthread) the others are.
Obviously registering your own domain name and 301ing it to your free
space gets round this problem - but it also adds to DNS pollution and
it simply shouldn't be necessary.
I'm wondering what the broadband suppliers think of this.