[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [ic] search engine indexing scan/ MM=0f73bb47ac44f4e422.....


On 06/17/2006 05:03 AM, Kevin Walsh wrote:
Another way would be to recognise spiders and reduce the size of the
HTML output.  Only showing a list of links to products (dropping all
the nice user-orientated stuff like prices and images) is one way to
do that.

Be careful about doing that. Google has been known to blacklist sites that return a different page to thier spiders than what gets shown to a regular browser.

Peter
_______________________________________________
interchange-users mailing list
suppressed
http://www.icdevgroup.org/mailman/listinfo/interchange-users


Mail converted by mhonarc 2.6.15
This archive provided courtesy of JSW4.NET, Internet Hosting Services for Small Business.