Robots.txt

Overview The Robot Exclusion Standard, Robots Exclusion Protocol or robots.txt protocol is a suggestion for "honest" browsers which should prevent web crawlers from accessing the parts of a website listed in the roboos.txt file. Discovery Methodology Browse to the robots.txt file in Mutillidae Exploitation Follow the paths in the robots.txt file Example Robots.txt is located at localhost/mutillidae/robots.txt