Better Indexing of Dynamically Generated Webpages

I spent half an hour with YourAmigo.com to learn just how to get dynamically-generated websites better indexed by search engine spiders. Here are the steps and two vendors you can use -- a do-it-yourself solution for $60 per quarter and a consultant-driven solution.

If your site is having trouble getting its dynamically-generated webpages fully indexed by the search engine spiders, YourAmigo.com Spider Linker provides the following kind of services:

1. Content Discovery. Spider linker spiders a client's entire website (using either the "post" or "get" methods of dynamically-created pages).
2. Table of Contents (TOC) Page Building. After spidering, it builds a number of targeted, content-rich TOC pages. These are designed to help both search engine spiders as well as human users, and designed with enough content so they don't look like link farms.
3. Search-Engine Friendly Links. Each of the links in the TOC pages are SE-friendly, that is, they omit question marks and long codes that discourage full spidering. This is done using Apache mod_rewrite and other programming methods.
4. Product Page Templates are SEO Optimized. At the same time, YourAmigo helps modify product page templates (used to generate the final dynamic pages) so that they are search-engine friendly, containing appropriate keyword-rich page titles, meta keywords, and meta descriptions so that they give abundant clues to the search engines.

The Spider Linker TOC system is usually hosted and managed on YourAmigo servers, though it can be hosted on the customer's site. YourAmigo.com is an Australian company with offices in the US and UK.

If you have someone in-house that can work on such a project, Bruce Clay Inc. provides tools that can achieve a similar result. Dynamic Site Mapping is designed to identify and spider popular pages in a dynamic environment. It includes a robust feature list including a private "your site only" dynamic content search engine as well as several spider reports that facilitate search engine indexing for all crawler-based search engines. Cost for this tool is $60 per quarter per website. http://www.bruceclay.com/web_dsm.htm?wwtc=07dsm