oerliRobots.txt Tester
Test which paths are allowed or blocked by a site's robots.txt.