Earn free 0.15 BTC daily and withdraw it to your wallet address everyday (hurry while it last!!)

How to add custom robots header tag to your blog and increase crawling rate (blogger)

What is custom robots header tag?

Custom robots header tags tells search engines such as (Google, bing, yandex etc) how you want your blog posts to be presented on the web. 

Custom robots header tags also gives insight to search engines on which pages to indexed.

Why do we need to set custom robots header tags?

We set custom robots header tags for fast crawling.
To be honest setting custom robots header tags is essential for all bloggers, that want their blog posts to appears faster on search engines. 

Note: if custom robots header tags are not set by you, then you are giving search engines extra work, because everything on your site will be displays as defaults settings and that may result to slow in crawling rate. 

I can still remembered i face this challenge when i created my second blog. Could you believe i submitted my blog sitemap to Google search console for about 3 solid weeks, it was only 1 page Google have indexed so far from 5 posts i have on my blog. 

So i was worried and i began to wonder why is it like that, because my first blog posts started appearing on google search engine 2 days after submitting the sitemap to Google search console.

I was left with no clue to fixed it, but something within me, tells me to compare the both "settings" with each other. Which i did. it from there i discovered that i set up custom robots header tags for the first blog, which i did not set for the second blog.

So am convinced to tell you that it necessary to set up custom robots header tags for your blog.

To set custom robots header tags is as simple as 123, just follow the below steps.

Blogger only!!!

How to set custom robots header tags on blogger

1). Goto blogger.com from the dashboard select *settings* and click on *search preferences*
2). Locate *custom robots header tags* and select *yes*

3). Under the "Homepage" thick *all* and *noodp*.
4). Under "Archive and search pages" thick *noindex*
5). Under "Default for posts and pages" thick *all* and save the settings.

Note: the reason why we thick *noindex* under "Archive and search pages" is because, we did not want our blog contents to be saved on search engine drive folder after it as been displays to the users across the internet.
Don't thick it because if you do, everything about crawling your blog will became slow.

Was this helpful? If yes please don't forget to comment and share!!!

Post a Comment


  1. Honestly I have been looking for this info for a very long time, am happy i found this here.

  2. great website. lot of learn seo this page and got some idea .thanks for share it.


Drop your comment