1) create a robots.txt file https://en.ryte.com/free-tools/robots-txt-generator/ 2) place it in your home directory 3) make sure it is visible from your base directory