| Age | Commit message (Collapse) | Author | Files | Lines |
|---|
|
format was spelled incorrectly
Bug-AGL: SPEC-4753
Change-Id: I0851c534ce2b81e0e9ea7a13c52395e2f52ad78b
Signed-off-by: zhuwenqing <zhuwq.jy@fujitsu.com>
|
|
Add ptest diffutils in agl-test-framework.
Testing costs 10s.
Bug-AGL: SPEC-4753
Signed-off-by: Qiu Tingting <qiutt@fujitsu.com>
Change-Id: I9a3323ccbe151a72330aa725321dfbbbd0328532
|
|
Add new commone function log_process_gnu for the following tests：
acl
attr
bash
bc
bluez5
busybox
cpio
libpam
libxml2
zlib
SPEC-4758
Signed-off-by: Qiu Tingting <qiutt@fujitsu.com>
Change-Id: I92de3b781badac9cb6d55acd5cc0c601dc4a7c65
|
|
Add ptest acl in agl-test-framework.
Testing costs 1m46s.
Bug-AGL: SPEC-4753
Signed-off-by: Qiu Tingting <qiutt@fujitsu.com>
Change-Id: Id43d68b85f560625407971f01322a45aef9a53cf
|
|
add new options: "default", "slim", "clear".
users can use export LOG_MODE="" to control how the
framework would delete all its temp files or folders.
"default": no influence, nothing would be removed.
"slim": test self-owned temp files and folders removed.
"clear": clean up each and every temp files and folders.
Bug-AGL: SPEC-4733
Signed-off-by: Yan <yanxk.fnst@fujitsu.com>
Change-Id: Ia3d8c2a971bbf97749448f732e848d9d15193459
|
|
Fixed problems:
1.When all the executed test suites are skipped, no new summary-
report is generated.
2.When there is test suite successfully executed, the generated
summary-report will contain the test suites which have logs
in the "/tmp-log" directory, rather than just the test suites
which has just executed.
Correction method:
1.Move the function in "conftest.py" to "agl_test_report.py"
and call it in the "agl-test" script to ensure that the
function will be executed.
2.Set the timestamp to record the information of each executed
test suite or skipped test suite to the file of
"test_list_timestamp". And generate a summar-report according
to the above file.
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: I47bfd09706e37ce6bdc13f3f9f266bc62f74f777
|
|
Replace "-" with "_" in the name of the directory to
solve the following errors when running agl-test:
import file mismatch:
imported module 'run_tests' has this __file__ attribute:
/usr/AGL/agl-test/tests/aio-stress/run_tests.py
which is not the same as the test file we want to collect:
/usr/AGL/agl-test/tests/gdk-pixbuf/run_tests.py
HINT: remove __pycache__ / .pyc files and/or use a unique basename
for your test file modules
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: Id8028dfbda618a9b7858602d3832bf2eb7f7ef5e
|
|
Optimize the generated html report, make its format more beautiful
and readable.
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: I0b779e0998ded00b348e23f2c1ac5b8acf5b8fd8
|
|
Adjust the test framework , add "XPASS" and "XFAIL" states for the
result of test case, and delete useless code by the way.
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: I5763dc27caef956fb6632fcb59d9f95d671f4766
|
|
'agl-test' modified, now, usr would not run dangerous
tests like this 'crashme' unless they do self selection
by '-m' pytest option. Set default to 'not dangerous'.
a new marker 'dangerous' has been add to the pytest.ini.
add new method into the agl_test_base.py, to help get path
of the 'spec.json', this file help stress tests like 'crashme'
to run under different stress levels.
for run_tests.py, modifications focus on how to run 'crashme'
under that different levels.
new marker 'order' would always ensure this 'crashme' test to
be placed as the so called 'last' test of all.
Bug-AGL: SPEC-4345
Signed-off-by: yanxk <yanxk.fnst@fujitsu.com>
Change-Id: Icb36d7c5c52430d89787f4373a2852b1b03ec8a6
|
|
This new method is named 'run_ptest', which means it runs the ptest
and does the log process, it is a common method that all ptest cases
would require.
Bug-AGL: SPEC-4345
Signed-off-by: yanxk <yanxk.fnst@fujitsu.com>
Change-Id: Ifb2ae53ca3aad941216dae94ac5e07d28eca55b7
|
|
Checking env before run testsuite is necessary.
1. Add common check in agl_test_base.py.
It is currently an empty function.
If necessary, common check sould be added.
2. Add ptest common check in agl_test_ptest_base.py.
For ptest testsuite, check whether ptest-runner and run-ptest script exist.
3. Add special check in run_tests.py.
For aio-stress testsuite, check whether compiled aio-stress script exists
For bzip2 testsuite, check whether bzip2 cmd exists.
Bug-AGL: SPEC-4345
Signed-off-by: Qiu Tingting <qiutt@fujitsu.com>
Change-Id: Id7841c0337465266dd607403ecb3e1c4377c6198
|
|
Add the script file that calls the test set 'aiostress'.
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: Ib3906fed1f85031d3554342a5555aa3a046b8c09
|
|
Since no 'date' information was written into the JSON file,
the name of the function should be 'write_data_to_json'.
Bug-AGL: SPEC-4345
Signed-off-by: yanxk <yanxk.fnst@fujitsu.com>
Change-Id: I61043c28d36a6c208b729b7c755da4b97970ae97
|
|
Move the "run_tests" script of glib2 under "qa-test-misc"
to "agl-test-framework", this is more reasonable.
And modify the script file run_tests under glib2, make it
use PTESTBaseTest class.
Later, I will delete the "run_tests" scripts under "qa-test-misc"
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: Id055b829954bf8bdf75a90ff5b417baae0c4d5fb
|
|
Add PTESTBaseTest class for test sets called from ptest.
It inherits from AGLBaseTest class.
It contains two common functions used to run the ptest test set.
In test suite, please create a child class based on PTESTBaseTest.
Then it is easy to init, run tests, check results and make a repoter.
By the way, delete the useless code in agl_test_report.py
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: Ief99073e4f63a44bde387b8c42d029c47fbf0943
|
|
Add AGLBaseTest class for existing test suites which has own test scripts.
It package the default operations, like as log processing and file saving.
In test suite, please create a child class based onAGLBaseTest.
Then it is easy to init, run tests, check results and make a repoter.
Bug-AGL: SPEC-4345
Signed-off-by: Qiu Tingting <qiutt@fujitsu.com>
Change-Id: I9dbc01db59df16eb5718b19b3223ad95da0afb11
|
|
fix a bug for get_html_filename methond in agl_test_report.py
Bug-AGL: SPEC-4345
Signed-off-by: Qiu Tingting <qiutt@fujitsu.com>
Change-Id: Iea7dd4d09ab70189f59325fc0200486ae142f584
|
|
Add get method for agl-test-conf.py
get_tmp_log_dir
get_tpl_dir
get_default_html_tpl
get_json_filename
get_html_filename
get_log_dir
Bug-AGL: SPEC-4345
Signed-off-by: Qiu Tingting <qiutt@fujitsu.com>
Change-Id: I6f63447a32df752033945ff77ad577dd46f0733a
|
|
Signed-off-by: Qiu Tingting <qiutt@fujitsu.com>
Change-Id: Ia5cb70ac5ada8be10c0be530a24fb5d6537f7cf6
|
|
Submit the demo code of agl-test-framework
The "agl-test framework" encapsulates pytest,which aims to provide a
unified test set execution entrance. It supports to run various test sets,
even these test sets come from different test frameworks, processing these
test logs uniformly, and generating complete test report.
In this way, it is convenient to test as many targets as possible,
in a wide range, so that the test covers a wider range of objects,
and is more comprehensive.
At present, we plan to support the following test sets in "agl-test":
1. Transplant test sets under Fuego and AGL-JTA
2. Retain the test set under pyagl and agl-ptest
(so will depend on "agl-ptest")
3. Migrate new test sets (with upstream)
4. Append new test sets (without upstream)
The output of test run is summarized by levels.
The first level is the summary of all test sets, and the second level is
the summary of a single test set. Now, they are displayed in HTML format,
and other formats also can be considered later.
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: I25dfedcf8cdd373544c4fae677330defb5d21840
|
zhuwenqing
Qiu Tingting
Yan
duerpei