If you make mistake in this Crawlers and indexing then your URL blocked then google don't know your article URL so your Website doesn't rank in google and if already ranked then ranking is definitely does down
I'm Akki Tech and in this Akki Service article I provide some best SEO setting for Crawlers and indexing so you blogger don't block by google
Crawlers and indexing Setting
This Crawlers and indexing Setting is very sensitive which is directly related to your ranking no matter how good and pro-level SEO is applied such as on-page SEO and off-page SEO but if your Crawlers and indexing Setting is wrong or blocked then do not rank your articles in any search engine like not rank in Google, Bing and other browsers
- This Below image setting you will find in your blogger setting
Now let's start seeing section
Enable custom robots.txt
Custom Robots.txt is helped any search engine like google to see and identify your article available on your website so that they can easily manage read and index your website on the internet
If you, do not enable this setting then your URL is not blocked but google bot only read and crawls only top some URLs and that is based on your crawling budget which is only managed by google as per your article publishing number
Akki Service suggest enabling and helping google to read and crawls your business website
- Just enable Custom robots.txt and end your custom robots.txt code just below the custom robots.txt section which is available after enabling it
Don't know which code you should enter. Don't worry Akki Service provide Robots.txt Generator Tool by which you can generate your Robots.txt for blogger website and WordPress website also
Now come to the second and main setting which is custom robots header tags which is responsible for ranking
Enable Custom Robots Header Tags
On the internet, lots of people give their setting on it but I strongly recommended following only experienced person
The below setting also help you to avoid duplicate page and content
Custom Robot tags for Home page
Just enable only some settings which provides in below
Only enable "all" and "noodp" in this section
Archive and Search Page Tags
Custom robot tags for archive and search pages
Only enable "noindex" and "noodp" in this section
Post and page tags
Custom robot tags for posts and pages
Only enable "all" and "noodp" in this section
