| || |
Are errors returned when running silk from the commandline?
Hi everybody, question for you:
I have integrated silk functional testing with my companies build process. During the build process I have an ant task that will call silk from the command line, to run functional tests. My ant task is setup to capture an error returned by the silk run. However, Iíve notice that silk always succeeds and the build process is never stopped (even when silk has a failure). It seems that running silk from the command line returns no errors. To verify this I did a simple test.
I wrote a silk script that contained two testcases. One of the testcases was setup to pass the other to always fail. I ran both from the command line (in windows) and did and echo %ERRORLEVEL%. Both testcase runs returned an error level of 0. Figuring that silk, was just not reporting the results of my testcase back to the command line after it finished, but rather whether or not it had successfully run, i force a compilation error in silk and ran it from the command line. Interestingly this also resulted in an error level of 0.
Has anybody had any luck with running silk from the command line and capturing errors returned by silk runs via the command line? This is important to me because if silk tests don't pass I want to fail my build process.
Thanks for you help in advance.
SIDE NOTE: Iím new to this board but have searched thoroughly for something like this but haven't found anything. My apologies if it is an old topic.
Re: Are errors returned when running silk from the commandline?
I have one solution for this. Use all your dos commands in a batch file. Like "ant build.xml" in "a.bat". Make sure that everything is a proper directory. Then using SYS_Execute("start c\:a.bat"). Then it runs the build and you can see the status on your result file. I hope this will work out for you.