Comments on: Files of utter importance – robots.txt and .htaccess http://www.seotops.co.uk/files-of-utter-importance-robotstxt-and-htaccess_101/ Dive Into the World of Search Thu, 09 Feb 2012 10:15:00 +0000 hourly 1 By: Jansie Blom http://www.seotops.co.uk/files-of-utter-importance-robotstxt-and-htaccess_101/comment-page-1/#comment-114 Jansie Blom Fri, 23 May 2008 21:52:57 +0000 http://www.seotops.com/?p=101#comment-114 I've only recently started paying attention to robots.txt and .htaccess. very hard to find good info on how to create a good htaccess file for your site. i think one reason is cos cms's differ so vastly. one specific problem, and i'm not too sure about this, is the canonicalisation issue. thing is, it's easy to sort the front page. example: getting a single url, http://yoursite.com, or http://www.yoursite.com, is easy. however, how do you set up htaccess to re-direct other pages on the site? so, if you want to re-direct from the non-www url to the www url, doing the home page is easy. home page: www.yoursite.com other page: yoursite.com/other-page.whatever see the problem? I’ve only recently started paying attention to robots.txt and .htaccess. very hard to find good info on how to create a good htaccess file for your site. i think one reason is cos cms’s differ so vastly.

one specific problem, and i’m not too sure about this, is the canonicalisation issue. thing is, it’s easy to sort the front page.

example:

getting a single url, http://yoursite.com, or http://www.yoursite.com, is easy.

however, how do you set up htaccess to re-direct other pages on the site?

so, if you want to re-direct from the non-www url to the www url, doing the home page is easy.

home page:
http://www.yoursite.com

other page:
yoursite.com/other-page.whatever

see the problem?

]]>