How to Add Custom Robots.txt File In Blogger

In this post, we will discuss one of the most important features of the blogger. It might possible you already known about that but how to add custom robots.txt file in blogger?

Now, we are going to enable a custom Robots.Txt file in Blogger which will help you to faster indexing of your blog in Google Search and it will also make your blog more search engine friendly. Robots.Txt file is used in most of the websites and in bloggers but in the past with old Blogger interface we're unable to add that file in blogs but now in the new interface of the blogger we can enable that file. Before going to enable custom tobots.txt, you have to know about robots.txt. So first of all we will discuss about robots.txt.

Robots.txt is a simple text file in which the website or blogger owner use that file to write the commands for the search engine's crawler. Indirectly we can say that it instructs the search engine's crawler that we are the part of our site can be indexed or not. That commands are written in different coding which is only for search engine's crawler. Robots.txt should be always on root directory. So that if you want to check that file you can use following urls :

http://www.yourdomain.com/robots.txt 

You can disallow any area of your blog. If you disallow those areas then your blog will be more search engine friendly.

Enable Custom Robots.txt File In Blogger

To enable custom robots.txt follow the simple steps as given below :

Go To Blogger >> Settings >> Search Preferences

Look For Custom Robots.Txt Section In The Bottom and Edit It.

Now a radio button will appear tick mark "Yes"

Now, a box will appear where you have to write the robots.txt file.

I am giving some lines of code So if you want to use that file then copy the code below and paste it in that box.

            User-agent: Mediapartners-Google
            User-agent: *
            Disallow: /search?q=*
            Disallow: /*?updated-max=*
            Allow: /
            Sitemap: http://www.yourdmomain.com/feeds/posts/default?orderby=updated
        

Note : The first line "User-agent: Mediapartners-Google" is for Google AdSense. So if you are using Google AdSense in your blog then remain it same otherwise remove it.

Click "Save Changes".

For explanations about commands of robots.txt please visit Explanations About Commands of Robots.txt For Blogger.

Conclusion :

I hope that this article would have helped you in understanding steps of adding custom robots.txt in the blogger. Please share your knowledge if you know more about this attribute. Your feedback and constructive contributions are always welcome.