Your site is currently in development mode (which may decrease performance). When you've finished changing your settings, remember to return to production mode.
The robots.txt file is a text file that tells web robots (most often search engines) which pages on your site to crawl or not to crawl. From here, you can enter which part of website cannot access by search engine crawlers.