summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-09-15Wait for screenshot until display is upJan-Simon Möller1-0/+3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Ie74175ab892f12a4eca439350bdd043bb282f931
2021-09-15Extend the waiting time for emulated platformslamprey_12.1.9lamprey_12.1.8lamprey_12.1.7lamprey_12.1.6lamprey_12.1.5lamprey_12.1.4lamprey_12.1.3lamprey_12.1.20lamprey_12.1.2lamprey_12.1.19lamprey_12.1.18lamprey_12.1.17lamprey_12.1.16lamprey_12.1.15lamprey_12.1.14lamprey_12.1.13lamprey_12.1.12lamprey_12.1.11lamprey_12.1.10lamprey_12.1.1lamprey_12.1.0lamprey/12.1.9lamprey/12.1.8lamprey/12.1.7lamprey/12.1.6lamprey/12.1.5lamprey/12.1.4lamprey/12.1.3lamprey/12.1.20lamprey/12.1.2lamprey/12.1.19lamprey/12.1.18lamprey/12.1.17lamprey/12.1.16lamprey/12.1.15lamprey/12.1.14lamprey/12.1.13lamprey/12.1.12lamprey/12.1.11lamprey/12.1.10lamprey/12.1.1lamprey/12.1.012.1.912.1.812.1.712.1.612.1.512.1.412.1.312.1.2012.1.212.1.1912.1.1812.1.1712.1.1612.1.1512.1.1412.1.1312.1.1212.1.1112.1.1012.1.112.1.0lampreyJan-Simon Möller1-2/+10
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I3d8cf2dd5227edabf8dc39eb50f5fa0560a5d221
2021-07-04Merge "SPEC-4003: Use pyartiproxy for uploading a file to artyfactory"lamprey_12.0.1lamprey_12.0.0lamprey/12.0.1lamprey/12.0.012.0.112.0.0Jan-Simon Moeller2-0/+49
2021-06-30SPEC-4003: Use pyartiproxy for uploading a file to artyfactoryCorentin LABBE2-0/+49
Dumpjournal will now dump to artyfactory by default. Bug-AGL: SPEC-4003 Change-Id: I2ae89be507062bceb84a6a7cbd054dcce09b6874 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2021-05-12Add skiplist for bbemarlin_12.90.0marlin/12.90.0lamprey_11.92.0lamprey_11.91.0lamprey/11.92.0lamprey/11.91.012.90.011.92.011.91.0Jan-Simon Möller1-0/+8
bbe has no sound. skip sound tests. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Ief9254c5c856b19df063985bce3b2de7d4b6ac87
2021-05-10Extend wait time for compositor restartJan-Simon Möller1-0/+6
This fixes slow (e.g. mesa) startup. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I10ef1e14ca97370c59984b5d848b90e6cbb9d40b
2021-02-17application-lifecycle: replace continue by returnCorentin LABBE1-15/+15
Lot of code was moved in do_release_test(), but since it is not in a loop anymore, continue are noop. Replace them by returns. Fixes: 1aee04806027c9496f5860a0dfcdbd4aafde148d ("SPEC-3484: create new application tests using new wgt types") Change-Id: I1dcd7b389dd859d8aadb3608c6e5255d13a470b8 Bug-AGL: SPEC-3808 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2021-01-20Merge "SPEC-3764: add screenshoot test"koi_10.93.0koi/10.93.010.93.0Jan-Simon Moeller3-0/+109
2021-01-20SPEC-3764: add screenshoot testCorentin LABBE3-0/+109
Add basic screenshooter test. Change-Id: I8be9c6b4f621dc757c7e8ab846384c0fb32561df Bug-AGL: SPEC-3764 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2021-01-15Add AGL_CAN_INTERFACE=vcan0 to application-lifecyclekoi_10.92.0koi/10.92.010.92.0Jan-Simon Moeller1-0/+1
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ic0b2e75122835786899aae2979feb8d29edefd5c
2021-01-13Update pyagl testdefinition to set AGL_CAN_INTERFACEJan-Simon Möller1-0/+1
We need to use vcan0 for the canreplay. Bug-AGL: SPEC-3756 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I8e3e8c7d6eadf081014e129cfd59ad217004f46d
2020-11-27Disable colors in journal dumpkoi_10.91.0koi/10.91.010.91.0Jan-Simon Möller1-1/+1
Avoid escaping characters. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I50b1895cc148b43a73e8730f76a39c29382973cb
2020-11-25Do not require tests that enforce internet to be available in CIJan-Simon Möller2-2/+2
Do not enforce tests that require the internet connection to be up. This is the case for geoclue and weather. We might be able to revert this in the future after fixes to the systemd dependencies and lab setup. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I1f53e6bfda5be7c9f9613b485efb4f2e25839a63
2020-10-22Flip order in veth setupJan-Simon Möller1-2/+3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I2da141b438122eee2768582c5a31054cb8a68964
2020-10-21SPEC-3597: prevent conman to break routesCorentin LABBE1-0/+2
conman break routes after adding veth, prevent this. Change-Id: Ic674a8ad609783950ac2ca95a9176d427c59b6ad Bug-AGL: SPEC-3597 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-10-19Merge "Extend skiplists and fix typo in export"Jan-Simon Moeller7-2/+8
2020-10-19Extend skiplists and fix typo in exportJan-Simon Möller7-2/+8
We the can test 1_pyagl-tests.can_write_wo_auth can easily fail on the 2nd invocation. Work this around until fixed. Bug-AGL: SPEC-3648 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I25af2c86604672f2e439fef19b400c83fff358d9
2020-10-14SPEC-3631: Add veth testCorentin LABBE1-0/+10
Add veth test which adds an extra virtual network card for testing. Change-Id: I4e6fef99009830cd016b2124b45b6815192b5ced Bug-AGL: SPEC-3631 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-10-13Add AGL_AVAILABLE_INTERFACES to application testJan-Simon Möller1-0/+3
The standalone run did have it defined, but the application test did mit the setting of AGL_AVAILABLE_INTERFACES=ethernet. If necessary it has to be redefined in the test for bluetooth and wifi per board. Bug-AGL: SPEC-3597 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I0772f9a6cc449406785fb167f575d6ca65e6267c
2020-10-07Disable afm-test executionJan-Simon Moeller1-21/+24
agl-service-homescreen crashes when a testwgt is executed. Until resolved, disable the test wgt execution. Bug-AGL: SPEC-3608 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I415b2fe80338f4090ef037c77d61af8205fbb77e
2020-10-06SPEC-3484: Use the new gcovr-wrapperCorentin LABBE1-14/+11
For using gcov, a new gcovr-wrapper was created. Let's use it, capture its output ang generate some metrics. Bug-AGL: SPEC-3484 Change-Id: Idbd9aa34d37d31414d18341b035440e28df5dc83 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-14Merge "SPEC-3484: install and basicly test coverage package"Jan-Simon Moeller1-1/+14
2020-09-14Merge "Change regular pyagl invocation to nohw"Jan-Simon Moeller4-21/+21
2020-09-14Change regular pyagl invocation to nohwJan-Simon Moeller4-21/+21
In CI we will execute the 'not hwrequired' flag. Make this the default case in the test-suites. Bug-AGL: SPEC-3572 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I370bb3c12953d7455a1a4c06c573cbc10ee17bda
2020-09-14SPEC-3484: install and basicly test coverage packageCorentin LABBE1-1/+14
Install and test coverage the same way than normal package. Handling coverage generated files will be handled later. Bug-AGL: SPEC-3484 Change-Id: I02d4ea1aa77954a7c85317accb6b565ece8676c0 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-14SPEC-3550: fix parsing of idCorentin LABBE1-1/+1
The id could be not the first element, and so the parsing is wrong. Change-Id: I325aac6de4733a166c7be8e3515b85e9edff4365 Bug-AGL: SPEC-3550 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-10SPEC-3550: name could be in uppercasejellyfish_9.99.4jellyfish/9.99.49.99.4Corentin LABBE1-1/+1
In config.xml, name could be in uppercase, so let's use id which is lowercase. Change-Id: Ibc3e9e145692c7773f70a1308c7ff0de27e9f0bd Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-09Add not hwrequired to regular script caseJan-Simon Moeller1-1/+1
Qemu by default has no hardware attached. Limit the run to not execut hardware-specific tests. Bug-AGL: SPEC-3572 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I3305d0c34737cf026989e2bde197d8ce3d96db19
2020-09-09Add test definitions for pyaglJan-Simon Moeller3-0/+26
We can now call pytest using the pyagl/tests module. These expose -k regular and -k hwrequired, thus create two caller scripts. Also create a sample testsuite entry using the regular variant with limited AGL_AVAILABLE_INTERFACES. Bug-AGL: SPEC-3572 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ic6b977da959f946ca88348715d5249748c70f736
2020-08-28SPEC-3550: handle package with service name different than their filenameCorentin LABBE1-5/+15
Some package has their service name different than their filename. This patch handle this situation Bug-AGL: SPEC-3550 Change-Id: I99c102f411ce5a0636fa14528cd2890694d986c6 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-08-13SPEC-3484: create new application tests using new wgt typesjellyfish_9.99.3jellyfish/9.99.39.99.3Corentin LABBE1-32/+122
The wgt-test and wgt-coverage needs to be handled differently. This patchs splits the application tests to handle all files encountered. First we download all files, then we use them in a specific order. Change-Id: Idc71ecfe36496db314b288f2b8ca7c2d61887de7 Bug-AGL: SPEC-3484 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-08-12SPEC-3482: handle new package nameCorentin LABBE1-1/+1
Now we build all package type, we need to handle coverage/test packages. Bug-AGL: SPEC-3482 Change-Id: Idb6dc2d453f26183094d6679dcc5c1f553780a16 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-08-10Print the syslog when the application does not startJan-Simon Moeller1-0/+2
Dump the journal when the app does not start. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ia886e87599721deca57dd8664c6637c3cd1f9b3f
2020-08-10SPEC-3533: unzip wgt files in a dedicated directoryCorentin LABBE1-1/+7
For finding wgtname, we download an index.html and the WGT archive could contains a file with the same name and unzip complain about replacing a file. The solution is to unzip in an empty dedicated directory. Change-Id: I9680eb8909256e749a2b5177ed1d942add841af5 BUG-AGL: SPEC-3533 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-07-16SPEC-3495: fix greping of systemd unitsjellyfish_9.99.2jellyfish/9.99.29.99.2Corentin LABBE1-4/+4
The grep pattern for systemd units is not enough restrictive. So let's made grep a little more restrictive. Change-Id: If0f75919a89c39da63e5375e3b3cdd020c6ea324 Bug-AGL: SPEC-3495 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-07-13SPEC-3495: handle better all package nameCorentin LABBE1-3/+7
Package could have -debug in their filename, but their service name is without it. Some package could exists with a basename-extension, so we need to grep better to not catch them all. Example: agl-service-bluetooth catch agl-service-bluetooth-map. Change-Id: Ibc750e7893a8cbe3fc22a0d8f13a32c28a898bd1 Bug-AGL: SPEC-3495 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-07-03SPEC-3427: check if RID is nullCorentin LABBE1-1/+33
RID could be null if process failed to start. In that case, we will retry to start it. On a second fail, we will not continue the test suite and fail. In th same time add a second status check, but after a delay to be sure the service is still working. Bug-AGL: SPEC-3427 Change-Id: I566f1aefa06cbb791674373340ce87be220b18a2 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-06-01Make the script runnable locally and adapt ps calljellyfish_9.99.1jellyfish/9.99.19.99.1Jan-Simon Moeller1-16/+23
The script can be run for testing locally now and afm-util ps needs to start as the target user. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ief0f785a46439531d4257c2eef9ced15be1b20fb
2020-05-28Remove versioning of wgts from testJan-Simon Möller1-2/+2
This was removed thus there is no '@?.?' . Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2020-03-24Update skiplists.Jan-Simon Moeller4-0/+4
lava-read-feedback fail on qemu due to a sequence issues. This is merely a timing issue on the lava side that we mask here. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I19070931704e7b9bf0a27e9370fdffd5adb899ba
2019-12-21Disable the can module unload/load testicefish_8.99.5icefish/8.99.58.99.5Jan-Simon Möller2-4/+4
And also fix a logic bug in the test_can_modules. The test can stay disabled. There is no need to unload the modules. Bug-AGL: SPEC-3070 . Change-Id: Ic94d5bb9cad3d6cdcbc6534cfc4003213ad82aaa Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-12-20SPEC-3064: handle removal of can_bcmicefish_8.99.4icefish/8.99.48.99.4Corentin LABBE1-0/+12
The test removing can module fail on DRA7 due to can_bcm using it. This patchs handle this case. Bug-AGL: SPEC-3064 Change-Id: I272e0ea62786fb43c4ea68601f2fb12864a279b6 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-12-10Merge "Skip the can test"icefish_8.99.3icefish/8.99.38.99.3Jan-Simon Moeller1-1/+1
2019-12-10SPEC-2970: Do not fail ofone and bluetooth services if bluetooth tag is non ↵Corentin LABBE2-0/+20
present When no bluetooth dongle is present, there is a timing issue which let the service fail. So if no bluetooth tag is present, skip the service test instead of failling. Bug-AGL: SPEC-2907 Change-Id: I10755ec698ab632ffcf0eec18ebe6bc41b1b5ec1 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-12-09Skip the can testKhouloud Touil1-1/+1
As the behaviour of the test not determined, to avoid the fail of the test, we will skip it if the value of no_transmission not found. AGL-bug: SPEC-3025 Change-Id: If24e512f2cc83ee7018a4309cb64434cf3a2b938 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-12-04SPEC-2970: Add bluetooth and ofono on qemu ARM/ARM64 skiplistsicefish_8.99.2icefish/8.99.28.99.2Corentin LABBE2-0/+4
Since bluetooth is still failling on qemu ARM and ARM64 (and bring down ofono by dependency), let's add them to the skiplist. Change-Id: I1ac3485f339763f16d49e7527faa74f6efe71b30 Bug-AGL: SPEC-2970 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-28Also call kill in the right contextJan-Simon Moeller1-1/+1
depending on the app. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I7208497e81fb3fcb2636bf7559b27ff2b5ce7676
2019-11-28Call info ps and status in the context of the app userJan-Simon Moeller1-4/+4
We need to call the info and status call under the context of user under which the app runs. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I25abff89db22c5effb6addfbc59ec30575aae2ed
2019-11-28Merge "SPEC-2996: handle rcar_can"Jan-Simon Moeller1-1/+13
2019-11-28SPEC-2996: handle rcar_canCorentin LABBE1-1/+13
The test remove can_dv module fail on H3 due to rcar_can using it. This patchs handle this case. Change-Id: I452a61813567ad09f3f819ce73c1c11753326514 Bug-AGL: SPEC-2996 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>