Crawl Page Generator

Crawl Page generator is word press plugin that will build a crawl page for your blog site that will include links to your home page, all of your posts, static pages, categories, and archives. Just install it, activate it, and link to the crawl page that is built. The crawl page will automatically be recreated when posts or pages are created, edited, or deleted.

The crawl page is a simple page of links designed to be search engine friendly. Normally when a search engine crawls your blog, it might have to crawl several levels deep or more to hit all the posts and pages. With a crawl page, all of the posts and pages, etc are linked to on a single page without any fancy css, tables, or other extraneous html for the search engine to parse through.

Example output:
http://www.makemoneyblogginghowto.com/crawlpage.html

Download:
( Download Zip )

Requirements:
Wordpress 1.5 or greater.

Installation:
1. Upload the full directory into your wp-content/plugins directory
2. Make your blog directory writeable OR create a file called crawlpage.html make it writeable via CHMOD In most cases, your blog directory is already writeable. The crawlpage.html file MUST be writeable.
2. Activate it in the Plugin options
3. Edit or publish a post or click on Rebuild Crawl Page on the Crawl Page Administration Interface
4. Add a link somewhere on your pages (especially your home page) to your crawlpage.html file. I have mine at the bottom of all my pages (defined in the theme).

License and Warranty:
This plugin is licensed under the GPL. Because the plugin is licensed free of charge, I do not accept any responsibility for any damages, direct or indirect, that may arise from using the plugin. This software is provided “AS IS” without warranty of any kind. Please refer to the full version of the GPL for more details.

Frequently Asked Questions
Do I always have to click on “Rebuild Crawl Page” if I modified a post?
A: No! If you edit/publish/delete a post, your crawl page gets regenerated!

Works it with all WordPress versions?
A: I have used it with various versions of Wordpress starting with 1.5.

I get an fopen error and / or permission denied
A: If you get permission errors make sure that the script has writing rights in your blog directory. Try to create the crawlpage.html manually and upload them with a ftp program and set the rights with CHMOD. Then restart crawl page generation on the administration page. A good tutorial for changing file permissions can be found on the WordPress Codex.

Which MySQL Versions are supported?
A: MySQL 3 and newer

Do I really need to use this plugin?
No, but I have found crawl pages helpful for getting well indexed in some search engines

Posted by Rob in Uncategorized on June 1st, 2009 | No Comments