Robots.txt Analyzer to analyse your robots.txt file in order to ensure that Google and other search engines are crawling and indexing your site correctly. You can enter any competing URL to gain access to its organic and paid search performance history.