Your robots.txt file tells web crawlers if they are allowed to crawl your website or not. Learn How to Test Your Robots.txt File →