I have many testscripts and in each testscript i have a main function, I call all the testcases within that testscript from that main function. Now I have a testplan in which I call the main function for a testscript. I have 1 testplan for 1 testscript, I then make a master testplan in which I call all the "normal" testplans.
This works well in the sense that ALL my testcases are executed in sequence and all i have to do is run one master plan file per project.
Now I have two issues with that, 1) I loose a certain amount of detail such as the amount of testcases executed, passed failed and error/warning text (the text is only an issue for when I do a CSV export)
2) I want to link up the master_testplans for each project under a new project which i can run over night. however I am afraid that the result files output will be even more obscure.
>>1)I loose a certain amount of detail such as the amount of testcases executed, passed failed and error/warning text.
Each time if you are running all the test cases defined in a script file, you can create a suite file(.s) with all the test scripts and run the single suite file. With this approach you can get correct number of pass and fail and warning count for each script file.
you say you have a testplan which then calls the main function and that these testplans are then called by the master testplan.
why don't you remove the main function and instead you call all the tests that you have called from the main function from your first level testplan? you can then use the master testplan to still called the other testplan. if you execute your testcases not from the main method but from the first level testplan you will get all the information about executed methods that you are looking for.