In the project properties , i found a option along with "checking for robots.txt", the option is to set " Proxy settting".
should i make any changes in it , if i disable the option for " checking the robots.txt "?
You shouldn't need to change that becaue of the robots.txt option. The two are not related. Only use the proxy settings if you need to use a proxy to reach your target web server.
I prefer 'maliciously mischevious'.
TDAdmin of Evil