aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2023-01-20Update skiplists in qa-testdefinitionsJan-Simon Moeller7-26/+1
This updates the skiplists. Only pi4 does currently skip the screenshooter. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I12d276b4268d80392dee3464e4ec5280c2e950ea
2023-01-16For master do not check connman.serviceJan-Simon Moeller2-2/+2
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Id05a2e1e78bad13b53edd77feff5c10068ba3208
2022-08-06qa-testdefinitions: add yaml and script for agl extend testduerpei2-0/+52
In qa-testdefinitions, add lava testdefinition (yaml+script) for agl extend test Bug-AGL: SPEC-4345 Signed-off-by: duerpei <duep.fnst@fujitsu.com> Change-Id: I2df480b5e880c62868c17192c827e8f7ccc2a749
2022-09-26The launcher is no longer needed for window activationJan-Simon Moeller1-1/+0
Instead we rely now on the homescreen. So remove the launcher. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I77d8adea7080e19fb3bffe63a029632c4f4d195a
2022-05-24agl-screenshot-test.sh: Save the contents of the screenshooterneedlefish_13.93.0needlefish/13.93.013.93.0Marius Vlad1-6/+4
We're getting a checksum error when comparing the reference image against the one done at boot, so let's have to store it, for later retrieval and investigation. Signed-off-by: Marius Vlad <marius.vlad@collabora.com> Change-Id: I7a532d78fc840064d74c6f385ddbf2537390b1ad
2022-05-24agl-screenshot-test.sh: Redo the compositor restartMarius Vlad1-3/+7
Stopping services and the client shell before restarting the compositor, would avoid some large delays until the new compositor instance is brought up. With this approach, were we stop explicitly the client shell and the launcher, we're basically have a hard stop, and should avoid those huge delays for qemu-arm. Until we can confirm this is the case, we still maintain that delay. Signed-off-by: Marius Vlad <marius.vlad@collabora.com> Change-Id: Ifa067ac40de162291d7d6cfb70035e87add07220
2022-02-15Fix screenshot test and user sessionmarlin_12.93.0marlin/12.93.012.93.0Jan-Simon Moeller1-1/+2
The user session has its own daemon that needs to be reloaded separately. Thus execute a separate reload call. Bug-AGL: SPEC-4165 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ie58423dfb29002660eea69462623d3f37614079f
2021-12-21Adapt screenshot test to new frameworkmarlin_12.92.0marlin_12.91.0marlin/12.92.0marlin/12.91.012.92.012.91.0Jan-Simon Moeller1-7/+24
Update the restart command and adapt to the user session. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I92ee001ded6d49e83078ce13e31e29cebe69d967
2021-12-06Extend delay before taking screenshotJan-Simon Möller1-1/+1
On slow emulated targets, we do need more time to spin up. Extend the timeout. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I90231ad23846e77191626ccaebd657b53ee4b897
2021-12-03screenshot-test: Extend startup delay and use no pagerJan-Simon Moeller1-2/+2
We need more time on e.g. qemuarm to finish processing and also have no pager enabled. Bug-AGL: SPEC-4165 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I1f1d4adcc2b9b702b09e33005559d2d061f7472f
2021-11-24Update agl-screenshot-test for masterJan-Simon Möller1-26/+35
The latest changes on the master branch require an update to the screenshot test. The script has been changed to use the journal and use the new settings file locations. Bug-AGL: SPEC-4150 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: If321c62940bb1809e38585c7dcdb08b273af8221
2021-11-09Limit service check after appfw reworkJan-Simon Möller2-4/+4
These services are disabled now and will re-enter as part of the appfw rework. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I716a1c437c0d50f1756bb0a058b5b1036ca95430
2021-09-22Ignore screenshot on arm 32 - known flakeymarlin_12.90.1marlin/12.90.112.90.1Jan-Simon Moeller1-0/+1
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I4a16b8f0449fb7413777f08bbc569d5cd76527e0
2021-09-15Wait for screenshot until display is upJan-Simon Möller1-0/+3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Ie74175ab892f12a4eca439350bdd043bb282f931
2021-09-15Extend the waiting time for emulated platformslamprey_12.1.9lamprey_12.1.8lamprey_12.1.7lamprey_12.1.6lamprey_12.1.5lamprey_12.1.4lamprey_12.1.3lamprey_12.1.20lamprey_12.1.2lamprey_12.1.19lamprey_12.1.18lamprey_12.1.17lamprey_12.1.16lamprey_12.1.15lamprey_12.1.14lamprey_12.1.13lamprey_12.1.12lamprey_12.1.11lamprey_12.1.10lamprey_12.1.1lamprey_12.1.0lamprey/12.1.9lamprey/12.1.8lamprey/12.1.7lamprey/12.1.6lamprey/12.1.5lamprey/12.1.4lamprey/12.1.3lamprey/12.1.20lamprey/12.1.2lamprey/12.1.19lamprey/12.1.18lamprey/12.1.17lamprey/12.1.16lamprey/12.1.15lamprey/12.1.14lamprey/12.1.13lamprey/12.1.12lamprey/12.1.11lamprey/12.1.10lamprey/12.1.1lamprey/12.1.012.1.912.1.812.1.712.1.612.1.512.1.412.1.312.1.2012.1.212.1.1912.1.1812.1.1712.1.1612.1.1512.1.1412.1.1312.1.1212.1.1112.1.1012.1.112.1.0lampreyJan-Simon Möller1-2/+10
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I3d8cf2dd5227edabf8dc39eb50f5fa0560a5d221
2021-07-04Merge "SPEC-4003: Use pyartiproxy for uploading a file to artyfactory"lamprey_12.0.1lamprey_12.0.0lamprey/12.0.1lamprey/12.0.012.0.112.0.0Jan-Simon Moeller2-0/+49
2021-06-30SPEC-4003: Use pyartiproxy for uploading a file to artyfactoryCorentin LABBE2-0/+49
Dumpjournal will now dump to artyfactory by default. Bug-AGL: SPEC-4003 Change-Id: I2ae89be507062bceb84a6a7cbd054dcce09b6874 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2021-05-12Add skiplist for bbemarlin_12.90.0marlin/12.90.0lamprey_11.92.0lamprey_11.91.0lamprey/11.92.0lamprey/11.91.012.90.011.92.011.91.0Jan-Simon Möller1-0/+8
bbe has no sound. skip sound tests. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Ief9254c5c856b19df063985bce3b2de7d4b6ac87
2021-05-10Extend wait time for compositor restartJan-Simon Möller1-0/+6
This fixes slow (e.g. mesa) startup. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I10ef1e14ca97370c59984b5d848b90e6cbb9d40b
2021-02-17application-lifecycle: replace continue by returnCorentin LABBE1-15/+15
Lot of code was moved in do_release_test(), but since it is not in a loop anymore, continue are noop. Replace them by returns. Fixes: 1aee04806027c9496f5860a0dfcdbd4aafde148d ("SPEC-3484: create new application tests using new wgt types") Change-Id: I1dcd7b389dd859d8aadb3608c6e5255d13a470b8 Bug-AGL: SPEC-3808 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2021-01-20Merge "SPEC-3764: add screenshoot test"koi_10.93.0koi/10.93.010.93.0Jan-Simon Moeller3-0/+109
2021-01-20SPEC-3764: add screenshoot testCorentin LABBE3-0/+109
Add basic screenshooter test. Change-Id: I8be9c6b4f621dc757c7e8ab846384c0fb32561df Bug-AGL: SPEC-3764 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2021-01-15Add AGL_CAN_INTERFACE=vcan0 to application-lifecyclekoi_10.92.0koi/10.92.010.92.0Jan-Simon Moeller1-0/+1
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ic0b2e75122835786899aae2979feb8d29edefd5c
2021-01-13Update pyagl testdefinition to set AGL_CAN_INTERFACEJan-Simon Möller1-0/+1
We need to use vcan0 for the canreplay. Bug-AGL: SPEC-3756 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I8e3e8c7d6eadf081014e129cfd59ad217004f46d
2020-11-27Disable colors in journal dumpkoi_10.91.0koi/10.91.010.91.0Jan-Simon Möller1-1/+1
Avoid escaping characters. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I50b1895cc148b43a73e8730f76a39c29382973cb
2020-11-25Do not require tests that enforce internet to be available in CIJan-Simon Möller2-2/+2
Do not enforce tests that require the internet connection to be up. This is the case for geoclue and weather. We might be able to revert this in the future after fixes to the systemd dependencies and lab setup. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I1f53e6bfda5be7c9f9613b485efb4f2e25839a63
2020-10-22Flip order in veth setupJan-Simon Möller1-2/+3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I2da141b438122eee2768582c5a31054cb8a68964
2020-10-21SPEC-3597: prevent conman to break routesCorentin LABBE1-0/+2
conman break routes after adding veth, prevent this. Change-Id: Ic674a8ad609783950ac2ca95a9176d427c59b6ad Bug-AGL: SPEC-3597 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-10-19Merge "Extend skiplists and fix typo in export"Jan-Simon Moeller7-2/+8
2020-10-19Extend skiplists and fix typo in exportJan-Simon Möller7-2/+8
We the can test 1_pyagl-tests.can_write_wo_auth can easily fail on the 2nd invocation. Work this around until fixed. Bug-AGL: SPEC-3648 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I25af2c86604672f2e439fef19b400c83fff358d9
2020-10-14SPEC-3631: Add veth testCorentin LABBE1-0/+10
Add veth test which adds an extra virtual network card for testing. Change-Id: I4e6fef99009830cd016b2124b45b6815192b5ced Bug-AGL: SPEC-3631 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-10-13Add AGL_AVAILABLE_INTERFACES to application testJan-Simon Möller1-0/+3
The standalone run did have it defined, but the application test did mit the setting of AGL_AVAILABLE_INTERFACES=ethernet. If necessary it has to be redefined in the test for bluetooth and wifi per board. Bug-AGL: SPEC-3597 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I0772f9a6cc449406785fb167f575d6ca65e6267c
2020-10-07Disable afm-test executionJan-Simon Moeller1-21/+24
agl-service-homescreen crashes when a testwgt is executed. Until resolved, disable the test wgt execution. Bug-AGL: SPEC-3608 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I415b2fe80338f4090ef037c77d61af8205fbb77e
2020-10-06SPEC-3484: Use the new gcovr-wrapperCorentin LABBE1-14/+11
For using gcov, a new gcovr-wrapper was created. Let's use it, capture its output ang generate some metrics. Bug-AGL: SPEC-3484 Change-Id: Idbd9aa34d37d31414d18341b035440e28df5dc83 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-14Merge "SPEC-3484: install and basicly test coverage package"Jan-Simon Moeller1-1/+14
2020-09-14Merge "Change regular pyagl invocation to nohw"Jan-Simon Moeller4-21/+21
2020-09-14Change regular pyagl invocation to nohwJan-Simon Moeller4-21/+21
In CI we will execute the 'not hwrequired' flag. Make this the default case in the test-suites. Bug-AGL: SPEC-3572 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I370bb3c12953d7455a1a4c06c573cbc10ee17bda
2020-09-14SPEC-3484: install and basicly test coverage packageCorentin LABBE1-1/+14
Install and test coverage the same way than normal package. Handling coverage generated files will be handled later. Bug-AGL: SPEC-3484 Change-Id: I02d4ea1aa77954a7c85317accb6b565ece8676c0 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-14SPEC-3550: fix parsing of idCorentin LABBE1-1/+1
The id could be not the first element, and so the parsing is wrong. Change-Id: I325aac6de4733a166c7be8e3515b85e9edff4365 Bug-AGL: SPEC-3550 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-10SPEC-3550: name could be in uppercasejellyfish_9.99.4jellyfish/9.99.49.99.4Corentin LABBE1-1/+1
In config.xml, name could be in uppercase, so let's use id which is lowercase. Change-Id: Ibc3e9e145692c7773f70a1308c7ff0de27e9f0bd Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-09Add not hwrequired to regular script caseJan-Simon Moeller1-1/+1
Qemu by default has no hardware attached. Limit the run to not execut hardware-specific tests. Bug-AGL: SPEC-3572 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I3305d0c34737cf026989e2bde197d8ce3d96db19
2020-09-09Add test definitions for pyaglJan-Simon Moeller3-0/+26
We can now call pytest using the pyagl/tests module. These expose -k regular and -k hwrequired, thus create two caller scripts. Also create a sample testsuite entry using the regular variant with limited AGL_AVAILABLE_INTERFACES. Bug-AGL: SPEC-3572 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ic6b977da959f946ca88348715d5249748c70f736
2020-08-28SPEC-3550: handle package with service name different than their filenameCorentin LABBE1-5/+15
Some package has their service name different than their filename. This patch handle this situation Bug-AGL: SPEC-3550 Change-Id: I99c102f411ce5a0636fa14528cd2890694d986c6 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-08-13SPEC-3484: create new application tests using new wgt typesjellyfish_9.99.3jellyfish/9.99.39.99.3Corentin LABBE1-32/+122
The wgt-test and wgt-coverage needs to be handled differently. This patchs splits the application tests to handle all files encountered. First we download all files, then we use them in a specific order. Change-Id: Idc71ecfe36496db314b288f2b8ca7c2d61887de7 Bug-AGL: SPEC-3484 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-08-12SPEC-3482: handle new package nameCorentin LABBE1-1/+1
Now we build all package type, we need to handle coverage/test packages. Bug-AGL: SPEC-3482 Change-Id: Idb6dc2d453f26183094d6679dcc5c1f553780a16 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-08-10Print the syslog when the application does not startJan-Simon Moeller1-0/+2
Dump the journal when the app does not start. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ia886e87599721deca57dd8664c6637c3cd1f9b3f
2020-08-10SPEC-3533: unzip wgt files in a dedicated directoryCorentin LABBE1-1/+7
For finding wgtname, we download an index.html and the WGT archive could contains a file with the same name and unzip complain about replacing a file. The solution is to unzip in an empty dedicated directory. Change-Id: I9680eb8909256e749a2b5177ed1d942add841af5 BUG-AGL: SPEC-3533 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-07-16SPEC-3495: fix greping of systemd unitsjellyfish_9.99.2jellyfish/9.99.29.99.2Corentin LABBE1-4/+4
The grep pattern for systemd units is not enough restrictive. So let's made grep a little more restrictive. Change-Id: If0f75919a89c39da63e5375e3b3cdd020c6ea324 Bug-AGL: SPEC-3495 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-07-13SPEC-3495: handle better all package nameCorentin LABBE1-3/+7
Package could have -debug in their filename, but their service name is without it. Some package could exists with a basename-extension, so we need to grep better to not catch them all. Example: agl-service-bluetooth catch agl-service-bluetooth-map. Change-Id: Ibc750e7893a8cbe3fc22a0d8f13a32c28a898bd1 Bug-AGL: SPEC-3495 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-07-03SPEC-3427: check if RID is nullCorentin LABBE1-1/+33
RID could be null if process failed to start. In that case, we will retry to start it. On a second fail, we will not continue the test suite and fail. In th same time add a second status check, but after a delay to be sure the service is still working. Bug-AGL: SPEC-3427 Change-Id: I566f1aefa06cbb791674373340ce87be220b18a2 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>