In my earlier post i had posted about robots.txt and robots meta tag.
Following are the Search engine optiomization(SEO) checklist  related to robots.txt -
1. robots.txt http status code
Search bot (eg: googlebot) before crawling the website it will always requests robots.txt and understands the definition robots.txt and crawls the website locations which is allowed. […]