I have a Perl based web testing tool. You interact with it by setting up your test cases in XML files. It is a good place to start and you only need to get into programming if you want to extend the functionality of the tool, or to write plugins for post processing. Have a look, its free: www.webinject.org
If you dig under the hood at all, you will see it is built using Perl's LWP library. If you are doing web testing at the protocol level, you can also use LWP directly to write your own scripts and tools.