# Tells Scanning Robots Where They Are And Are Not Welcome # # User-agent: can also specify by name; "*" is for everyone # Disallow: disallow if this matches first part of requested path User-agent: * Disallow: /send Disallow: /bogrim Disallow: /bogrim/yeshiva.xls Disallow: /bogrim/yeshiva1.xls Disallow: /wiki2