Is there a way to stop the search engines listing a particular page?

Thanks
J

On Thu, 2 Jun 2005 22:08:43 +0100, Johny <not_today_my_good_friend@TheNet.com> wrote:
> Is there a way to stop the search engines listing a particular page?

yes, see www.robotstxt.org.

i

> Thanks
> J
>
>


--

On Thu, 02 Jun 2005 23:08:43 +0200, Johny
<not_today_my_good_friend@TheNet.com> wrote:

> Is there a way to stop the search engines listing a particular page?

robots.txt or <meta name="robots" content="noindex, nofollow">.
But better check details here

http://www.google.com/intl/en/webmasters/3.html#B3

and here

http://www.robotstxt.org/wc/exclusion.html#meta

Best,
Borek
--
http://www.chembuddy.com - chemical calculators for labs and education
BATE - Base Acid Titration and Equilibria
program for pH calculations
CASC - Concentration and Solution Calculator
program for solution preparation and concentration conversions

Johny wrote:
> Is there a way to stop the search engines listing a particular page?
>

No, there isn't, the least you could do is stop the searchengines that
obey the robots.txt.

There are however enough that don't obey them, or even take the effort
to load it befor they start reading your files.


Hidden for a searchengine, or on the internet is only that file, that
isn't on it.


--
Glas geschiedenis http://vision2form.nl/glashistorie.html
Passie en talent http://vision2form.nl/young_talent.html
Webontwerp http://vision2form.nl/webontwerp/index.html
SEO gaat zo http://vision2form.nl/webontwerp/gevonden-worden.html

Hi Johny !

"Johny" <not_today_my_good_friend@TheNet.com> skrev i en meddelelse
news:d7nsgp$ivl$1@newsg3.svr.pol.co.uk...

> Is there a way to stop the search engines listing a particular page?

A password protected page will not be seen by the searchengines, and
therefore is not indexed and shown in searhresults.


Kind Regards
--
Med venlig hilsen

Ren? L?weneck
www.lowesite.dk

"Ren? L?weneck" <rene@loweneck.dk> skrev i en meddelelse
news:429fe73b$0$755$edfadb0f@dread16.news.tele.dk. ..
>
> A password protected page will not be seen by the searchengines, and
> therefore is not indexed and shown in searhresults.

Or if you do not link to the page?

Or if you put them in a /temp/ directory?

Mikkel
--
Guide til Guatemala p? nettet:
http://lakjer.dk/mikkel/
rejser, kultur og politik

> Is there a way to stop the search engines listing a particular page?
>
> Thanks
> J

Use dirty tricks, such as hidden text, which looks like an attempt to
fool the SE. Then they'll penalize the site and more or less remove it.

Hi Mikkel !

"Mikkel M?ldrup-Lakjer" <mikkel@fabel.dk> skrev i en meddelelse
news:42a006c9$0$18648$14726298@news.sunsite.dk...

> Or if you do not link to the page?

That would do the trick too, I think.

> Or if you put them in a /temp/ directory?

I'm not sure about this, though. Because, if you host your site yourself,
you could strenghten the accesslevel for one or more directories on the
server.

But then again, this would cause the server to prompt you for an username
and a password ;-))

If you, on the other hand, use an outside webhotel as a host for your site,
I don't think that this procedure is an useable option for you.


Kind Regards

--
Med venlig hilsen

Ren? L?weneck
www.loweneck.dk

"Mikkel M?ldrup-Lakjer" <mikkel@fabel.dk> wrote in news:42a006c9$0$18648
$14726298@news.sunsite.dk:

> "Ren? L?weneck" <rene@loweneck.dk> skrev i en meddelelse
> news:429fe73b$0$755$edfadb0f@dread16.news.tele.dk. ..
>>
>> A password protected page will not be seen by the searchengines, and
>> therefore is not indexed and shown in searhresults.
>
> Or if you do not link to the page?

I'm not sure if this is still happening, but it was at one point definitely
the case that even if a page was not linked to from anywhere, it could
still be indexed if it was visited by someone using the Google toolbar. I
have tested this.

Content in a /temp/ directory can certainly be indexed, (which is when you
realise too late you had meant to stick a password on the dratted thing but
forgot).

The only completely reliable way to prevent a page being indexed is to put
it behind a password (and have the password set by the server, not by
client side coding such as Javascript in the page*).

Victoria

* actually you could put it behind a clientside password if you did it
right, but it would be more fiddly and I can't see why you would.

Victoria
--
Clare Associates Ltd
http://www.clareassoc.co.uk/
--

On Fri, 03 Jun 2005 10:57:57 +0100, Victoria Clare
<victoria@markpoles.org.uk> wrote:

>I'm not sure if this is still happening, but it was at one point definitely
>the case that even if a page was not linked to from anywhere, it could
>still be indexed if it was visited by someone using the Google toolbar. I
>have tested this.

I've been working on some new domains recently and have been accessing
them for testing purposes many times with the toolbar installed and
with Google Adsense ads on the sites.

So far not one page has been indexed until there are links. Some have
had test sites online for weeks like this with no links. This site
education-news.info has a bunch of tests on it and none are indexed.
If indexed it would be thousands of pages.

This doesn't prove conclusively that Google doesn't index via the
toolbar since it could take longer than I've waited, but does suggest
it. I'll leave some of it up for a few months to see if it ever gets
indexed.

David
--
Free Search Engine Optimization Tutorial
http://www.seo-gold.com/tutorial/