Age | Commit message (Collapse) | Author | Files | Lines |
|
add new options: "default", "slim", "clear".
users can use export LOG_MODE="" to control how the
framework would delete all its temp files or folders.
"default": no influence, nothing would be removed.
"slim": test self-owned temp files and folders removed.
"clear": clean up each and every temp files and folders.
Bug-AGL: SPEC-4733
Signed-off-by: Yan <yanxk.fnst@fujitsu.com>
Change-Id: Ia3d8c2a971bbf97749448f732e848d9d15193459
|
|
Fixed problems:
1.When all the executed test suites are skipped, no new summary-
report is generated.
2.When there is test suite successfully executed, the generated
summary-report will contain the test suites which have logs
in the "/tmp-log" directory, rather than just the test suites
which has just executed.
Correction method:
1.Move the function in "conftest.py" to "agl_test_report.py"
and call it in the "agl-test" script to ensure that the
function will be executed.
2.Set the timestamp to record the information of each executed
test suite or skipped test suite to the file of
"test_list_timestamp". And generate a summar-report according
to the above file.
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: I47bfd09706e37ce6bdc13f3f9f266bc62f74f777
|
|
Replace "-" with "_" in the name of the directory to
solve the following errors when running agl-test:
import file mismatch:
imported module 'run_tests' has this __file__ attribute:
/usr/AGL/agl-test/tests/aio-stress/run_tests.py
which is not the same as the test file we want to collect:
/usr/AGL/agl-test/tests/gdk-pixbuf/run_tests.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename
for your test file modules
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: Id8028dfbda618a9b7858602d3832bf2eb7f7ef5e
|
|
Adjust the test framework , add "XPASS" and "XFAIL" states for the
result of test case, and delete useless code by the way.
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: I5763dc27caef956fb6632fcb59d9f95d671f4766
|
|
'agl-test' modified, now, usr would not run dangerous
tests like this 'crashme' unless they do self selection
by '-m' pytest option. Set default to 'not dangerous'.
a new marker 'dangerous' has been add to the pytest.ini.
add new method into the agl_test_base.py, to help get path
of the 'spec.json', this file help stress tests like 'crashme'
to run under different stress levels.
for run_tests.py, modifications focus on how to run 'crashme'
under that different levels.
new marker 'order' would always ensure this 'crashme' test to
be placed as the so called 'last' test of all.
Bug-AGL: SPEC-4345
Signed-off-by: yanxk <yanxk.fnst@fujitsu.com>
Change-Id: Icb36d7c5c52430d89787f4373a2852b1b03ec8a6
|
|
Checking env before run testsuite is necessary.
1. Add common check in agl_test_base.py.
It is currently an empty function.
If necessary, common check sould be added.
2. Add ptest common check in agl_test_ptest_base.py.
For ptest testsuite, check whether ptest-runner and run-ptest script exist.
3. Add special check in run_tests.py.
For aio-stress testsuite, check whether compiled aio-stress script exists
For bzip2 testsuite, check whether bzip2 cmd exists.
Bug-AGL: SPEC-4345
Signed-off-by: Qiu Tingting <qiutt@fujitsu.com>
Change-Id: Id7841c0337465266dd607403ecb3e1c4377c6198
|
|
Add the script file that calls the test set 'aiostress'.
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: Ib3906fed1f85031d3554342a5555aa3a046b8c09
|
|
Add AGLBaseTest class for existing test suites which has own test scripts.
It package the default operations, like as log processing and file saving.
In test suite, please create a child class based onAGLBaseTest.
Then it is easy to init, run tests, check results and make a repoter.
Bug-AGL: SPEC-4345
Signed-off-by: Qiu Tingting <qiutt@fujitsu.com>
Change-Id: I9dbc01db59df16eb5718b19b3223ad95da0afb11
|