# Robots.txt file # For domain: http://www.prodjfinder.com # All robots will spider the domain # Disallow directory /sign up/ User-agent: * Disallow: /sign up/ # Disallow User-agent: * Disallow: /gigfinder/ # User-Agent: Gigablast Disallow: /