View Single Post
  #3 (permalink)  
Old 05-31-2005, 01:24 AM
Ignoramus31500
 
Posts: n/a
Re: Google stopped indexing my wikipedia mirror

On Sun, 08 May 2005 09:42:25 +0200, davidof <david.george@g-dumpthisbit-mail.com> wrote:
> Ignoramus29781 wrote:
>> I recently integrated wikipedia with my site

>
> uh huh, along with a bizzilion other folk. The problem is that Google
> does not really want to bother with all these Wikipedia mirrors so runs
> duplicate page algorithms. Maybe the indexer decided that your pages
> were just duplicates of other content and told the googlebot not to
> spider those links anymore. That would make sense to me as spidering and
> indexing pages that are of no benefit to searchers just wastes Google's
> resources.


Surely, that makes sense. Possibly, it will happen sooner or later.

I began to mirror individual wikipedia pages for math related content,
to complement the math pages that I already had. Then I decided to
mirror wikipedia in a SE friendly way, since all pieces were already
in place.

In any case, googlebot is back and is busy indexing my pages. It
varies by day.

I fully comply with the wikipedia license, giving credit, referring to
GFDL etc.

i
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote