Robots.txt Do or don't?

[rocknblogger]

Hi All:

I have a question that's been nagging me for a while now. Since I only want Google or any search engine for that matter to index my content(articles and pictures if applicable) then should I create a robots.txt file to prevent the indexing and crawling of all sub-directories. I'm specifically referring to a Wordpress site, so directories like wp-admin, wp-content, wp-includes and others that I may add like downloads, should I stop these from being crawled? And what about all of the files in the root that belong to Wordpress?
And what if I install a forum into a sub-directory should I specifically point the robots into that directory?

And of course would I then want to have a robots.txt file in the root of the forum directory to control what gets crawled there?

Thanks in advance,

rocknblogger

[billmcintosh]

Here's a good article on how to prevent bots from crawling & indexing your WordPress admin pages:

Prevent GoogleBot & other spiders from indexing your Wordpress admin pages