[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [ic] search engine indexing scan/ MM=0f73bb47ac44f4e422.....


Kevin Walsh wrote:
>     1. Recognise spiders and don't paginate the list for them.  Set
>        ml=999999, or whatever seems large enough.

This is the way we've been doing it and it seems to work very well.

However it's worth noting that if your pages end up too large (I'm not
sure what the limit is, but I think it's around 200Kb) then Googlebot
may ignore everything after a certain point. We just make sure that our
categories aren't too large and the HTML on the search results pages is
as compact as possible.

Snippet from an ActionMap:

    if ($Session->{spider})
    {
        $CGI->{mv_matchlimit} = '100';
        $CGI->{mv_max_matches} = '100';
    }
    else
    {
        $CGI->{mv_matchlimit} = '10';
    }

-- 
Jamie Neil | <suppressed> | 0870 7777 454
Versado I.T. Services Ltd. | http://versado.net/ | 0845 450 1254
_______________________________________________
interchange-users mailing list
suppressed
http://www.icdevgroup.org/mailman/listinfo/interchange-users


Mail converted by mhonarc 2.6.15
This archive provided courtesy of JSW4.NET, Internet Hosting Services for Small Business.