Blogger Blogspot blog robots.txt file for advanced SEO, How to add pages and posts sitemap in it.
- Go to Blogger.com
- Sign in to your blogger account
- Go to Setting
- Click on Search Preference.
- Click on custom robots.txt and edit it
- Input desired robots.txt file.
Default Blogger robots.txt file
User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Allow: / Sitemap: https://site.blogspot.com/sitemap.xml
Replace the above file with the new file that also include pages sitemap in it i.e.
User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Allow: / Sitemap: https://site.blogspot.com/sitemap.xml Sitemap: https://site.blogspot.com/sitemap-pages.xml
This blogger robots.txt file allows search engine bot to crawl your whole website but it denies access pages that start from /search, this is very useful for SEO. But you can also use the advanced robots.txt setting here.
I hope you like this article if any doubt or questions regarding blogger or WordPress SEO you can comment below.