| Re: Google stopped indexing my wikipedia mirror On Sun, 08 May 2005 09:42:25 +0200, davidof <david.george@g-dumpthisbit-mail.com> wrote:
> Ignoramus29781 wrote:
>> I recently integrated wikipedia with my site
>
> uh huh, along with a bizzilion other folk. The problem is that Google
> does not really want to bother with all these Wikipedia mirrors so runs
> duplicate page algorithms. Maybe the indexer decided that your pages
> were just duplicates of other content and told the googlebot not to
> spider those links anymore. That would make sense to me as spidering and
> indexing pages that are of no benefit to searchers just wastes Google's
> resources.
Surely, that makes sense. Possibly, it will happen sooner or later.
I began to mirror individual wikipedia pages for math related content,
to complement the math pages that I already had. Then I decided to
mirror wikipedia in a SE friendly way, since all pieces were already
in place.
In any case, googlebot is back and is busy indexing my pages. It
varies by day.
I fully comply with the wikipedia license, giving credit, referring to
GFDL etc.
i |