aboutsummaryrefslogtreecommitdiffstats
path: root/plugins/agl_test_base.py
AgeCommit message (Collapse)AuthorFilesLines
2022-12-08agl-test-framework: add "XPASS" and "XFAIL" statesduerpei1-1/+0
Adjust the test framework , add "XPASS" and "XFAIL" states for the result of test case, and delete useless code by the way. Bug-AGL: SPEC-4345 Signed-off-by: duerpei <duep.fnst@fujitsu.com> Change-Id: I5763dc27caef956fb6632fcb59d9f95d671f4766
2022-12-02agl-test-framework: add test 'crashme'yanxk1-0/+3
'agl-test' modified, now, usr would not run dangerous tests like this 'crashme' unless they do self selection by '-m' pytest option. Set default to 'not dangerous'. a new marker 'dangerous' has been add to the pytest.ini. add new method into the agl_test_base.py, to help get path of the 'spec.json', this file help stress tests like 'crashme' to run under different stress levels. for run_tests.py, modifications focus on how to run 'crashme' under that different levels. new marker 'order' would always ensure this 'crashme' test to be placed as the so called 'last' test of all. Bug-AGL: SPEC-4345 Signed-off-by: yanxk <yanxk.fnst@fujitsu.com> Change-Id: Icb36d7c5c52430d89787f4373a2852b1b03ec8a6
2022-07-24Add precheck() funQiu Tingting1-0/+2
Checking env before run testsuite is necessary. 1. Add common check in agl_test_base.py. It is currently an empty function. If necessary, common check sould be added. 2. Add ptest common check in agl_test_ptest_base.py. For ptest testsuite, check whether ptest-runner and run-ptest script exist. 3. Add special check in run_tests.py. For aio-stress testsuite, check whether compiled aio-stress script exists For bzip2 testsuite, check whether bzip2 cmd exists. Bug-AGL: SPEC-4345 Signed-off-by: Qiu Tingting <qiutt@fujitsu.com> Change-Id: Id7841c0337465266dd607403ecb3e1c4377c6198
2022-09-30agl-test-framework: add test set of aio-stressduerpei1-0/+3
Add the script file that calls the test set 'aiostress'. Bug-AGL: SPEC-4345 Signed-off-by: duerpei <duep.fnst@fujitsu.com> Change-Id: Ib3906fed1f85031d3554342a5555aa3a046b8c09
2022-05-26agl-test-framework: add AGLBaseTest classQiu Tingting1-0/+106
Add AGLBaseTest class for existing test suites which has own test scripts. It package the default operations, like as log processing and file saving. In test suite, please create a child class based onAGLBaseTest. Then it is easy to init, run tests, check results and make a repoter. Bug-AGL: SPEC-4345 Signed-off-by: Qiu Tingting <qiutt@fujitsu.com> Change-Id: I9dbc01db59df16eb5718b19b3223ad95da0afb11