Thursday, September 18, 2008



Several pages in e-commerce and other functional sites are generated dynamically and

have “?” or “&” sign in their dynamic URLs. These signs separate the CGI variables.

While Google will crawl these pages, many other engines will not. One inconvenient

solution is to develop static equivalent of the dynamic pages and have them on your site.

Another way to avoid such dynamic URLs is to rewrite these URLs using a syntax that is

accepted by the crawler and also understood as equivalent to the dynamic URL by the

application server. The Amazon site shows dynamic URLs in such syntax. If you are

using Apache web server, you can use Apache rewrite rules to enable this conversion.