# Tells Scanning Robots Where They Are And Are Not Welcome # # User-agent: can also specify by name; "*" is for everyone # Disallow: disallow if this matches first part of requested path # # For now disallow all we can modify this as needed to allow certain crawlers. # User-agent: * Disallow: /fkn//blauwput/gastenboek/ Disallow: /fkn/blauwput/databases/ Disallow: /fkn/bovenlo/gastenboek/ Disallow: /fkn/bovenlo/databases/ Disallow: /fkn/linden/gastenboek/ Disallow: /fkn/linden/databases/ Disallow: /fkn/vlierbeek/gastenboek/ Disallow: /fkn/vlierbeek/databases/ Disallow: /private/