Best Custom Robots Txt for Blogger
Are You Looking For Best Custom Robots Txt For Blogger?
If yes then you have come to righ place
Because Today in this article We Will One of best Custom Robots.txt For Blogger So you Can Index your Blogger Site in Search English. So Lets Dive in.
What is robots.txt?
The robots.txt file tells search engine crawlers which pages or files on your website should or should not be crawled and indexed. This plain text file contains a set of rules for bots to follow when crawling your site.
It consists of two sections - User-agent and Disallow.
The User-agent specifies which bot the rules apply to. This is usually the name of the search engine crawler such as Googlebot for Google or Bingbot for Bing.
The Disallow line tells bots not to crawl or index the listed pages or directories.
For example:
User-agent: Googlebot
Disallow: /privatepages/
This tells Googlebot not to crawl or index any pages in the /privatepages/ directory.
How to Add a Robots.txt File in Blogger
- Step 01: First Of All Generate Robots.txt From Generator
- Step 02: Login to your Blogger account and Go to Setting
- Step 03: Scroll Down and Go to Crawlers and indexing Section
- Step 04: Enable custom robots.txt & Paste Generated Txt
- Step 05: Enable custom robots.txt & Paste Generated Txt
Join the conversation