aboutsummaryrefslogtreecommitdiffstats
path: root/common
AgeCommit message (Collapse)AuthorFilesLines
2023-06-13Adapt screenshot tests after session removalJan-Simon Moeller1-8/+9
Adapt the scripts. Bug-AGL: SPEC-4813 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ief1ca6d35ed4f891082660500c0ab08b307e7674
2023-06-04Use full path to reference imageJan-Simon Moeller1-2/+7
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I664757283777cc79f3b40bc043b07294a724b785
2023-06-04Work in /home/agl-driverJan-Simon Moeller1-3/+6
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I364ee1531fbd6444166b3404e3402d5321b1afa9
2023-06-02Update screenshot test for multiple images.Jan-Simon Moeller1-20/+28
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ifa5952e05b463fecf50d9e6a4f84a324cb0f8f76
2023-05-31Disable color output in pytestJan-Simon Moeller1-1/+7
Disable the color output to avoid escape sequences in LAVA logs. Bug-AGL: SPEC-4817 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Iff38a79b72952416792c4c66d1e482736d308544
2023-05-31SPEC-4816: Fix upload in agl-extend-test.shCorentin LABBE3-2/+23
agl-extend-test.sh fail to upload a zip file, since it give the directory instead of the file to upload. While fixing this, add some extra test and debug around upload of files. Bug-AGL: SPEC-4816 Fixes: 2e5067e302bc ("qa-testdefinitions: add yaml and script for agl extend test") Change-Id: Ieeefa239398a82b2156391dfe8f58f654a6a29b3 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2023-05-10Enable multi-screen and list screensJan-Simon Möller1-2/+7
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I315657ac59d0a2aee20974215e426810b412985c
2023-05-05debugJan-Simon Moeller1-0/+3
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Icc2938efb7568ff65630a316a624b3372409d4d6
2023-05-05Add image upload to qa-testdefinition.Jan-Simon Moeller1-2/+2
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Id5902477f8b946757427d344f47082b673031ce0
2023-04-20Use fallback IPs for pyartiproxy.Jan-Simon Moeller1-5/+15
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ia31e5a29e46ee4fca45b4d8ddd8e8cd8e7347133
2023-01-20Revert "For master do not check connman.service"Jan-Simon Moeller2-2/+2
With systemd-network-generator masked, we can start up connman again. This reverts commit bd2c66954f5f0139cfd7610aeb3989965f4b3f7d. Change-Id: I80edf1a036c1fd418375f8e4cb9b8a77fd354ca8
2023-01-16For master do not check connman.serviceJan-Simon Moeller2-2/+2
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Id05a2e1e78bad13b53edd77feff5c10068ba3208
2022-08-06qa-testdefinitions: add yaml and script for agl extend testduerpei1-0/+35
In qa-testdefinitions, add lava testdefinition (yaml+script) for agl extend test Bug-AGL: SPEC-4345 Signed-off-by: duerpei <duep.fnst@fujitsu.com> Change-Id: I2df480b5e880c62868c17192c827e8f7ccc2a749
2022-09-26The launcher is no longer needed for window activationJan-Simon Moeller1-1/+0
Instead we rely now on the homescreen. So remove the launcher. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I77d8adea7080e19fb3bffe63a029632c4f4d195a
2022-05-24agl-screenshot-test.sh: Save the contents of the screenshooterneedlefish_13.93.0needlefish/13.93.013.93.0Marius Vlad1-6/+4
We're getting a checksum error when comparing the reference image against the one done at boot, so let's have to store it, for later retrieval and investigation. Signed-off-by: Marius Vlad <marius.vlad@collabora.com> Change-Id: I7a532d78fc840064d74c6f385ddbf2537390b1ad
2022-05-24agl-screenshot-test.sh: Redo the compositor restartMarius Vlad1-3/+7
Stopping services and the client shell before restarting the compositor, would avoid some large delays until the new compositor instance is brought up. With this approach, were we stop explicitly the client shell and the launcher, we're basically have a hard stop, and should avoid those huge delays for qemu-arm. Until we can confirm this is the case, we still maintain that delay. Signed-off-by: Marius Vlad <marius.vlad@collabora.com> Change-Id: Ifa067ac40de162291d7d6cfb70035e87add07220
2022-02-15Fix screenshot test and user sessionmarlin_12.93.0marlin/12.93.012.93.0Jan-Simon Moeller1-1/+2
The user session has its own daemon that needs to be reloaded separately. Thus execute a separate reload call. Bug-AGL: SPEC-4165 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ie58423dfb29002660eea69462623d3f37614079f
2021-12-21Adapt screenshot test to new frameworkmarlin_12.92.0marlin_12.91.0marlin/12.92.0marlin/12.91.012.92.012.91.0Jan-Simon Moeller1-7/+24
Update the restart command and adapt to the user session. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I92ee001ded6d49e83078ce13e31e29cebe69d967
2021-12-06Extend delay before taking screenshotJan-Simon Möller1-1/+1
On slow emulated targets, we do need more time to spin up. Extend the timeout. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I90231ad23846e77191626ccaebd657b53ee4b897
2021-12-03screenshot-test: Extend startup delay and use no pagerJan-Simon Moeller1-2/+2
We need more time on e.g. qemuarm to finish processing and also have no pager enabled. Bug-AGL: SPEC-4165 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I1f1d4adcc2b9b702b09e33005559d2d061f7472f
2021-11-24Update agl-screenshot-test for masterJan-Simon Möller1-26/+35
The latest changes on the master branch require an update to the screenshot test. The script has been changed to use the journal and use the new settings file locations. Bug-AGL: SPEC-4150 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: If321c62940bb1809e38585c7dcdb08b273af8221
2021-11-09Limit service check after appfw reworkJan-Simon Möller2-4/+4
These services are disabled now and will re-enter as part of the appfw rework. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I716a1c437c0d50f1756bb0a058b5b1036ca95430
2021-09-15Wait for screenshot until display is upJan-Simon Möller1-0/+3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Ie74175ab892f12a4eca439350bdd043bb282f931
2021-09-15Extend the waiting time for emulated platformslamprey_12.1.9lamprey_12.1.8lamprey_12.1.7lamprey_12.1.6lamprey_12.1.5lamprey_12.1.4lamprey_12.1.3lamprey_12.1.20lamprey_12.1.2lamprey_12.1.19lamprey_12.1.18lamprey_12.1.17lamprey_12.1.16lamprey_12.1.15lamprey_12.1.14lamprey_12.1.13lamprey_12.1.12lamprey_12.1.11lamprey_12.1.10lamprey_12.1.1lamprey_12.1.0lamprey/12.1.9lamprey/12.1.8lamprey/12.1.7lamprey/12.1.6lamprey/12.1.5lamprey/12.1.4lamprey/12.1.3lamprey/12.1.20lamprey/12.1.2lamprey/12.1.19lamprey/12.1.18lamprey/12.1.17lamprey/12.1.16lamprey/12.1.15lamprey/12.1.14lamprey/12.1.13lamprey/12.1.12lamprey/12.1.11lamprey/12.1.10lamprey/12.1.1lamprey/12.1.012.1.912.1.812.1.712.1.612.1.512.1.412.1.312.1.2012.1.212.1.1912.1.1812.1.1712.1.1612.1.1512.1.1412.1.1312.1.1212.1.1112.1.1012.1.112.1.0lampreyJan-Simon Möller1-2/+10
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I3d8cf2dd5227edabf8dc39eb50f5fa0560a5d221
2021-06-30SPEC-4003: Use pyartiproxy for uploading a file to artyfactoryCorentin LABBE2-0/+49
Dumpjournal will now dump to artyfactory by default. Bug-AGL: SPEC-4003 Change-Id: I2ae89be507062bceb84a6a7cbd054dcce09b6874 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2021-05-10Extend wait time for compositor restartJan-Simon Möller1-0/+6
This fixes slow (e.g. mesa) startup. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I10ef1e14ca97370c59984b5d848b90e6cbb9d40b
2021-02-17application-lifecycle: replace continue by returnCorentin LABBE1-15/+15
Lot of code was moved in do_release_test(), but since it is not in a loop anymore, continue are noop. Replace them by returns. Fixes: 1aee04806027c9496f5860a0dfcdbd4aafde148d ("SPEC-3484: create new application tests using new wgt types") Change-Id: I1dcd7b389dd859d8aadb3608c6e5255d13a470b8 Bug-AGL: SPEC-3808 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2021-01-20Merge "SPEC-3764: add screenshoot test"koi_10.93.0koi/10.93.010.93.0Jan-Simon Moeller1-0/+100
2021-01-20SPEC-3764: add screenshoot testCorentin LABBE1-0/+100
Add basic screenshooter test. Change-Id: I8be9c6b4f621dc757c7e8ab846384c0fb32561df Bug-AGL: SPEC-3764 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2021-01-15Add AGL_CAN_INTERFACE=vcan0 to application-lifecyclekoi_10.92.0koi/10.92.010.92.0Jan-Simon Moeller1-0/+1
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ic0b2e75122835786899aae2979feb8d29edefd5c
2021-01-13Update pyagl testdefinition to set AGL_CAN_INTERFACEJan-Simon Möller1-0/+1
We need to use vcan0 for the canreplay. Bug-AGL: SPEC-3756 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I8e3e8c7d6eadf081014e129cfd59ad217004f46d
2020-11-27Disable colors in journal dumpkoi_10.91.0koi/10.91.010.91.0Jan-Simon Möller1-1/+1
Avoid escaping characters. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I50b1895cc148b43a73e8730f76a39c29382973cb
2020-11-25Do not require tests that enforce internet to be available in CIJan-Simon Möller2-2/+2
Do not enforce tests that require the internet connection to be up. This is the case for geoclue and weather. We might be able to revert this in the future after fixes to the systemd dependencies and lab setup. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I1f53e6bfda5be7c9f9613b485efb4f2e25839a63
2020-10-19Extend skiplists and fix typo in exportJan-Simon Möller1-2/+2
We the can test 1_pyagl-tests.can_write_wo_auth can easily fail on the 2nd invocation. Work this around until fixed. Bug-AGL: SPEC-3648 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I25af2c86604672f2e439fef19b400c83fff358d9
2020-10-13Add AGL_AVAILABLE_INTERFACES to application testJan-Simon Möller1-0/+3
The standalone run did have it defined, but the application test did mit the setting of AGL_AVAILABLE_INTERFACES=ethernet. If necessary it has to be redefined in the test for bluetooth and wifi per board. Bug-AGL: SPEC-3597 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I0772f9a6cc449406785fb167f575d6ca65e6267c
2020-10-07Disable afm-test executionJan-Simon Moeller1-21/+24
agl-service-homescreen crashes when a testwgt is executed. Until resolved, disable the test wgt execution. Bug-AGL: SPEC-3608 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I415b2fe80338f4090ef037c77d61af8205fbb77e
2020-10-06SPEC-3484: Use the new gcovr-wrapperCorentin LABBE1-14/+11
For using gcov, a new gcovr-wrapper was created. Let's use it, capture its output ang generate some metrics. Bug-AGL: SPEC-3484 Change-Id: Idbd9aa34d37d31414d18341b035440e28df5dc83 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-14Merge "SPEC-3484: install and basicly test coverage package"Jan-Simon Moeller1-1/+14
2020-09-14Merge "Change regular pyagl invocation to nohw"Jan-Simon Moeller2-7/+7
2020-09-14Change regular pyagl invocation to nohwJan-Simon Moeller2-7/+7
In CI we will execute the 'not hwrequired' flag. Make this the default case in the test-suites. Bug-AGL: SPEC-3572 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I370bb3c12953d7455a1a4c06c573cbc10ee17bda
2020-09-14SPEC-3484: install and basicly test coverage packageCorentin LABBE1-1/+14
Install and test coverage the same way than normal package. Handling coverage generated files will be handled later. Bug-AGL: SPEC-3484 Change-Id: I02d4ea1aa77954a7c85317accb6b565ece8676c0 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-14SPEC-3550: fix parsing of idCorentin LABBE1-1/+1
The id could be not the first element, and so the parsing is wrong. Change-Id: I325aac6de4733a166c7be8e3515b85e9edff4365 Bug-AGL: SPEC-3550 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-10SPEC-3550: name could be in uppercasejellyfish_9.99.4jellyfish/9.99.49.99.4Corentin LABBE1-1/+1
In config.xml, name could be in uppercase, so let's use id which is lowercase. Change-Id: Ibc3e9e145692c7773f70a1308c7ff0de27e9f0bd Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-09Add not hwrequired to regular script caseJan-Simon Moeller1-1/+1
Qemu by default has no hardware attached. Limit the run to not execut hardware-specific tests. Bug-AGL: SPEC-3572 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I3305d0c34737cf026989e2bde197d8ce3d96db19
2020-09-09Add test definitions for pyaglJan-Simon Moeller2-0/+12
We can now call pytest using the pyagl/tests module. These expose -k regular and -k hwrequired, thus create two caller scripts. Also create a sample testsuite entry using the regular variant with limited AGL_AVAILABLE_INTERFACES. Bug-AGL: SPEC-3572 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ic6b977da959f946ca88348715d5249748c70f736
2020-08-28SPEC-3550: handle package with service name different than their filenameCorentin LABBE1-5/+15
Some package has their service name different than their filename. This patch handle this situation Bug-AGL: SPEC-3550 Change-Id: I99c102f411ce5a0636fa14528cd2890694d986c6 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-08-13SPEC-3484: create new application tests using new wgt typesjellyfish_9.99.3jellyfish/9.99.39.99.3Corentin LABBE1-32/+122
The wgt-test and wgt-coverage needs to be handled differently. This patchs splits the application tests to handle all files encountered. First we download all files, then we use them in a specific order. Change-Id: Idc71ecfe36496db314b288f2b8ca7c2d61887de7 Bug-AGL: SPEC-3484 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-08-12SPEC-3482: handle new package nameCorentin LABBE1-1/+1
Now we build all package type, we need to handle coverage/test packages. Bug-AGL: SPEC-3482 Change-Id: Idb6dc2d453f26183094d6679dcc5c1f553780a16 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-08-10Print the syslog when the application does not startJan-Simon Moeller1-0/+2
Dump the journal when the app does not start. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ia886e87599721deca57dd8664c6637c3cd1f9b3f
2020-08-10SPEC-3533: unzip wgt files in a dedicated directoryCorentin LABBE1-1/+7
For finding wgtname, we download an index.html and the WGT archive could contains a file with the same name and unzip complain about replacing a file. The solution is to unzip in an empty dedicated directory. Change-Id: I9680eb8909256e749a2b5177ed1d942add841af5 BUG-AGL: SPEC-3533 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>