Blogger

Best use Robots.txt file in Blogger Blogspot Blog 2021

Blogger Blogspot blog robots.txt file for advanced SEO, How to add pages and posts sitemap in it.

Edit robots.txt file in Blogger
Edit robots.txt file in Blogger
  1. Go to Blogger.com
  2. Sign in to your blogger account
  3. Go to Setting
  4. Click on Search Preference.
  5. Click on custom robots.txt and edit it
  6. Input desired robots.txt file.
Blogger SEO settings robots.txt file step 1
Blogger Step to edit robots.txt
Blogger SEO settings robots.txt file step 2, 3
Provide custom robots.txt for blogger

Default Blogger robots.txt file

User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow: /search
Allow: /

Sitemap: https://site.blogspot.com/sitemap.xml

Replace the above file with the new file that also include pages sitemap in it i.e.

User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow: /search
Allow: /

Sitemap: https://site.blogspot.com/sitemap.xml
Sitemap: https://site.blogspot.com/sitemap-pages.xml

This blogger robots.txt file allows search engine bot to crawl your whole website but it denies access pages that start from /search, this is very useful for SEO. But you can also use the advanced robots.txt setting here.

I hope you like this article if any doubt or questions regarding blogger or WordPress SEO you can comment below.

Ashok Kumar

Love Coding, Love Blogging what else to explain :).

Related Articles

One Comment

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Back to top button