SEO Tips on | How To Add Custom Robots.txt File in Blogger.

In This Video I Will Tell you how to add “Robots.txt” file to blogger. And how it is important for blog SEO

This means  robots.txt file is a file that tells the Google crawler how to show or index something. What else is to block , Some coding is written in this file, which allows the crawler to understand what things you want to index or show.

Code :- 

User-agent: Mediapartners-Google

Disallow:

Disallow: /search

Disallow:

User-agent: *

Allow: /Sitemap: https://www.technicaltricksworld.com/feeds/posts/default?orderby=UPDATED

·   User-agent: Mediapartners-Google

This code tells Google Adsense that what you are searching for is the same type of ad show.

Either your are using google adsense or not on your blog , Simple leave as it is.

• Disallow: /search

This code tells the crawler that what has been “search” is to be rejected

This mean link having Keyword “Search” in URL of our blog will restricted by web crawler

• User-agent:  This code for all robots marked with asterisk (*). In default settings our blog's labels links( labels links that are connected to our blog) are restricted to indexed by web crawlers that means the web crawlers will not index our labels page links because of above code.

• Allow: /Sitemap:https://www.technicaltricksworld.com/feeds/posts/default?orderby=UPDATED

This code tells the crawler that what has been “Sitemap or related To URL Keword” is to be Allow to index or crawler.

This mean link having Keyword “sitemap” in URL of our blog will allow to index by web crawler.

Eg:- if have an URL www.technicaltricksworld.com

If you want to index this URL , Then Use

Allow: / technicaltricksworld

If you  want to restrict this URL , then use

Disallow:/ technical;tricksworld

How to add robots.txt  file to blogger.

• Go to your blogger blog.

• Navigate to Settings >> Search Preferences ›› Crawlers and indexing ›› Custom robots.txt ›› Edit ›› Yes

Add caption

• Now paste your robots.txt file code in the box.
• Click on Save Changes button.
• You are done

How to Check your robots.txt file

•  you just open your site URL like https://www.technicaltricksworld.com
•  And type this code just after your website “robots.txt”

 URL https://www.technicaltricksworld.com/robots.txt