Categories

Check whether a website has robots.txt. After configuration, this extension can detect whether other paths exist.

The purpose of this extension is to automatically detect if there is a specified path for each website being viewed. By default only robots.txt is detected. If it does, an icon appears in the address bar to prompt the user.