Robots.txt generator
Search Engines are using robots to crawl your pages. The robots.txt file is a text file that defines which parts of a domain can be crawled by a robot
In Sort robots.txt file defined rules and restriction of your blog/site
In addition, the robots.txt file can include a link to the XML-sitemap
Website Url
Same as below example
Copy Your Page