Crawlers and indexing

Now a day everyone is creating blogs, and if we Google it, we will all will come on best result as blogger.com. It is a part of Google and it gives it best possible ways to express our self to blog. But after we created our blog, how everyone can see these on different search engines. Even Google gave option for the same….

Crawlers and indexing:-

This is one of the great features for search engine visibility by Google. With help of Crawlers and indexing we all can visible our blog in search engine with few tricks and techniques. Let’s find out how,



To enable this feature please login to your bloggers.com account. Then go to Settings > Search Preferences, now click Edit link which is next to "Custom robots.txt"

            

and select Yes to enable “Enable custom robots.txt content”. After this selection text box will be visible to give to enter your crawler code for your site.

Now type below mentioned code in that text box

Now in sitemap put your blog link,

“http://www.your blog link/feeds/posts/default?orderby=updated”

Here, User-agent: Mediapartners-Google is a robot from Google Adsense, so please leave as it is because your samller mistake can change to serve ads in improper way.

The next line is for all the robots and marked with an asterisk (*). On the default configuration, it is clear that the label of our blog is not indexed Disallow: /search.

Now please see all the options properly, because incorrect code may not display your blog on any of the search engine.

There is one option to enable “Crawlers and indexing”.

Custom robots header tags

We can enable the same feature by selecting this option too.

Again to edit link

    

you can see more check box and all. Now select the check boxes as shown in below image And click on save changes.

Please Share your comments,

Thanks….