Creating Spider Friendly Sites

Ensure that you do not have any HTML errors on your page, especially your indexpage. HTML errors, even minor one, can prevent the spiders from spidering your wholesite. Even though your page displays great you may still have errors. Use an HTMLvalidation tool to check your important pages.

Include all your pages on a text based sitemap so that your pages can be easilyfound by the search engine robots.

Avoid very big pages. Generally, the pages should not exceed 150kb.
Move Javascript code to a separate file, or to the end of the HTML document afteryour closing BODY or HTML tag. If you move the JavaScript code to a separate file then add the following in the heading:

The separate JavaScript file reduces your HTML file size, and therefore your downloadtime. It allows you to reuse the code on future web pages/sites.