| Age | Commit message (Collapse) | Author | Files | Lines |
|---|
|
Fixed problems:
1.When all the executed test suites are skipped, no new summary-
report is generated.
2.When there is test suite successfully executed, the generated
summary-report will contain the test suites which have logs
in the "/tmp-log" directory, rather than just the test suites
which has just executed.
Correction method:
1.Move the function in "conftest.py" to "agl_test_report.py"
and call it in the "agl-test" script to ensure that the
function will be executed.
2.Set the timestamp to record the information of each executed
test suite or skipped test suite to the file of
"test_list_timestamp". And generate a summar-report according
to the above file.
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: I47bfd09706e37ce6bdc13f3f9f266bc62f74f777
|
|
Optimize the generated html report, make its format more beautiful
and readable.
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: I0b779e0998ded00b348e23f2c1ac5b8acf5b8fd8
|
|
Adjust the test framework , add "XPASS" and "XFAIL" states for the
result of test case, and delete useless code by the way.
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: I5763dc27caef956fb6632fcb59d9f95d671f4766
|
|
Since no 'date' information was written into the JSON file,
the name of the function should be 'write_data_to_json'.
Bug-AGL: SPEC-4345
Signed-off-by: yanxk <yanxk.fnst@fujitsu.com>
Change-Id: I61043c28d36a6c208b729b7c755da4b97970ae97
|
|
Add PTESTBaseTest class for test sets called from ptest.
It inherits from AGLBaseTest class.
It contains two common functions used to run the ptest test set.
In test suite, please create a child class based on PTESTBaseTest.
Then it is easy to init, run tests, check results and make a repoter.
By the way, delete the useless code in agl_test_report.py
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: Ief99073e4f63a44bde387b8c42d029c47fbf0943
|
|
Add AGLBaseTest class for existing test suites which has own test scripts.
It package the default operations, like as log processing and file saving.
In test suite, please create a child class based onAGLBaseTest.
Then it is easy to init, run tests, check results and make a repoter.
Bug-AGL: SPEC-4345
Signed-off-by: Qiu Tingting <qiutt@fujitsu.com>
Change-Id: I9dbc01db59df16eb5718b19b3223ad95da0afb11
|
|
Signed-off-by: Qiu Tingting <qiutt@fujitsu.com>
Change-Id: Ia5cb70ac5ada8be10c0be530a24fb5d6537f7cf6
|
|
Submit the demo code of agl-test-framework
The "agl-test framework" encapsulates pytest,which aims to provide a
unified test set execution entrance. It supports to run various test sets,
even these test sets come from different test frameworks, processing these
test logs uniformly, and generating complete test report.
In this way, it is convenient to test as many targets as possible,
in a wide range, so that the test covers a wider range of objects,
and is more comprehensive.
At present, we plan to support the following test sets in "agl-test":
1. Transplant test sets under Fuego and AGL-JTA
2. Retain the test set under pyagl and agl-ptest
(so will depend on "agl-ptest")
3. Migrate new test sets (with upstream)
4. Append new test sets (without upstream)
The output of test run is summarized by levels.
The first level is the summary of all test sets, and the second level is
the summary of a single test set. Now, they are displayed in HTML format,
and other formats also can be considered later.
Bug-AGL: SPEC-4345
Signed-off-by: duerpei <duep.fnst@fujitsu.com>
Change-Id: I25dfedcf8cdd373544c4fae677330defb5d21840
|
duerpei
yanxk
Qiu Tingting