summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2023-06-02Update screenshot test for multiple images.Jan-Simon Moeller1-20/+28
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ifa5952e05b463fecf50d9e6a4f84a324cb0f8f76
2023-05-31Disable color output in pytestJan-Simon Moeller1-1/+7
Disable the color output to avoid escape sequences in LAVA logs. Bug-AGL: SPEC-4817 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Iff38a79b72952416792c4c66d1e482736d308544
2023-05-31SPEC-4816: Fix upload in agl-extend-test.shCorentin LABBE3-2/+23
agl-extend-test.sh fail to upload a zip file, since it give the directory instead of the file to upload. While fixing this, add some extra test and debug around upload of files. Bug-AGL: SPEC-4816 Fixes: 2e5067e302bc ("qa-testdefinitions: add yaml and script for agl extend test") Change-Id: Ieeefa239398a82b2156391dfe8f58f654a6a29b3 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2023-05-10Enable multi-screen and list screensJan-Simon Möller1-2/+7
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I315657ac59d0a2aee20974215e426810b412985c
2023-05-05Adapt pathJan-Simon Moeller1-1/+2
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ib9d15959a4ac1de4642ea2070f325dd6cd02ac08
2023-05-05debugJan-Simon Moeller1-0/+3
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Icc2938efb7568ff65630a316a624b3372409d4d6
2023-05-05Add image upload to qa-testdefinition.Jan-Simon Moeller1-2/+2
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Id5902477f8b946757427d344f47082b673031ce0
2023-04-20Use fallback IPs for pyartiproxy.Jan-Simon Moeller1-5/+15
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ia31e5a29e46ee4fca45b4d8ddd8e8cd8e7347133
2023-01-25Add extended test with redirectJan-Simon Moeller1-0/+18
try with a logfile Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ia6124760784614e9965770ea688bcc87eee5c5f2
2023-01-20Revert "For master do not check connman.service"Jan-Simon Moeller2-2/+2
With systemd-network-generator masked, we can start up connman again. This reverts commit bd2c66954f5f0139cfd7610aeb3989965f4b3f7d. Change-Id: I80edf1a036c1fd418375f8e4cb9b8a77fd354ca8
2023-01-20Update skiplists in qa-testdefinitionsJan-Simon Moeller7-26/+1
This updates the skiplists. Only pi4 does currently skip the screenshooter. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I12d276b4268d80392dee3464e4ec5280c2e950ea
2023-01-16For master do not check connman.serviceJan-Simon Moeller2-2/+2
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Id05a2e1e78bad13b53edd77feff5c10068ba3208
2022-08-06qa-testdefinitions: add yaml and script for agl extend testduerpei2-0/+52
In qa-testdefinitions, add lava testdefinition (yaml+script) for agl extend test Bug-AGL: SPEC-4345 Signed-off-by: duerpei <duep.fnst@fujitsu.com> Change-Id: I2df480b5e880c62868c17192c827e8f7ccc2a749
2022-09-26The launcher is no longer needed for window activationJan-Simon Moeller1-1/+0
Instead we rely now on the homescreen. So remove the launcher. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I77d8adea7080e19fb3bffe63a029632c4f4d195a
2022-05-24agl-screenshot-test.sh: Save the contents of the screenshooterneedlefish_13.93.0needlefish/13.93.013.93.0Marius Vlad1-6/+4
We're getting a checksum error when comparing the reference image against the one done at boot, so let's have to store it, for later retrieval and investigation. Signed-off-by: Marius Vlad <marius.vlad@collabora.com> Change-Id: I7a532d78fc840064d74c6f385ddbf2537390b1ad
2022-05-24agl-screenshot-test.sh: Redo the compositor restartMarius Vlad1-3/+7
Stopping services and the client shell before restarting the compositor, would avoid some large delays until the new compositor instance is brought up. With this approach, were we stop explicitly the client shell and the launcher, we're basically have a hard stop, and should avoid those huge delays for qemu-arm. Until we can confirm this is the case, we still maintain that delay. Signed-off-by: Marius Vlad <marius.vlad@collabora.com> Change-Id: Ifa067ac40de162291d7d6cfb70035e87add07220
2022-02-15Fix screenshot test and user sessionmarlin_12.93.0marlin/12.93.012.93.0Jan-Simon Moeller1-1/+2
The user session has its own daemon that needs to be reloaded separately. Thus execute a separate reload call. Bug-AGL: SPEC-4165 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ie58423dfb29002660eea69462623d3f37614079f
2021-12-21Adapt screenshot test to new frameworkmarlin_12.92.0marlin_12.91.0marlin/12.92.0marlin/12.91.012.92.012.91.0Jan-Simon Moeller1-7/+24
Update the restart command and adapt to the user session. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I92ee001ded6d49e83078ce13e31e29cebe69d967
2021-12-06Extend delay before taking screenshotJan-Simon Möller1-1/+1
On slow emulated targets, we do need more time to spin up. Extend the timeout. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I90231ad23846e77191626ccaebd657b53ee4b897
2021-12-03screenshot-test: Extend startup delay and use no pagerJan-Simon Moeller1-2/+2
We need more time on e.g. qemuarm to finish processing and also have no pager enabled. Bug-AGL: SPEC-4165 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I1f1d4adcc2b9b702b09e33005559d2d061f7472f
2021-11-24Update agl-screenshot-test for masterJan-Simon Möller1-26/+35
The latest changes on the master branch require an update to the screenshot test. The script has been changed to use the journal and use the new settings file locations. Bug-AGL: SPEC-4150 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: If321c62940bb1809e38585c7dcdb08b273af8221
2021-11-09Limit service check after appfw reworkJan-Simon Möller2-4/+4
These services are disabled now and will re-enter as part of the appfw rework. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I716a1c437c0d50f1756bb0a058b5b1036ca95430
2021-09-22Ignore screenshot on arm 32 - known flakeymarlin_12.90.1marlin/12.90.112.90.1Jan-Simon Moeller1-0/+1
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I4a16b8f0449fb7413777f08bbc569d5cd76527e0
2021-09-15Wait for screenshot until display is upJan-Simon Möller1-0/+3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Ie74175ab892f12a4eca439350bdd043bb282f931
2021-09-15Extend the waiting time for emulated platformslamprey_12.1.9lamprey_12.1.8lamprey_12.1.7lamprey_12.1.6lamprey_12.1.5lamprey_12.1.4lamprey_12.1.3lamprey_12.1.20lamprey_12.1.2lamprey_12.1.19lamprey_12.1.18lamprey_12.1.17lamprey_12.1.16lamprey_12.1.15lamprey_12.1.14lamprey_12.1.13lamprey_12.1.12lamprey_12.1.11lamprey_12.1.10lamprey_12.1.1lamprey_12.1.0lamprey/12.1.9lamprey/12.1.8lamprey/12.1.7lamprey/12.1.6lamprey/12.1.5lamprey/12.1.4lamprey/12.1.3lamprey/12.1.20lamprey/12.1.2lamprey/12.1.19lamprey/12.1.18lamprey/12.1.17lamprey/12.1.16lamprey/12.1.15lamprey/12.1.14lamprey/12.1.13lamprey/12.1.12lamprey/12.1.11lamprey/12.1.10lamprey/12.1.1lamprey/12.1.012.1.912.1.812.1.712.1.612.1.512.1.412.1.312.1.2012.1.212.1.1912.1.1812.1.1712.1.1612.1.1512.1.1412.1.1312.1.1212.1.1112.1.1012.1.112.1.0lampreyJan-Simon Möller1-2/+10
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I3d8cf2dd5227edabf8dc39eb50f5fa0560a5d221
2021-07-04Merge "SPEC-4003: Use pyartiproxy for uploading a file to artyfactory"lamprey_12.0.1lamprey_12.0.0lamprey/12.0.1lamprey/12.0.012.0.112.0.0Jan-Simon Moeller2-0/+49
2021-06-30SPEC-4003: Use pyartiproxy for uploading a file to artyfactoryCorentin LABBE2-0/+49
Dumpjournal will now dump to artyfactory by default. Bug-AGL: SPEC-4003 Change-Id: I2ae89be507062bceb84a6a7cbd054dcce09b6874 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2021-05-12Add skiplist for bbemarlin_12.90.0marlin/12.90.0lamprey_11.92.0lamprey_11.91.0lamprey/11.92.0lamprey/11.91.012.90.011.92.011.91.0Jan-Simon Möller1-0/+8
bbe has no sound. skip sound tests. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Ief9254c5c856b19df063985bce3b2de7d4b6ac87
2021-05-10Extend wait time for compositor restartJan-Simon Möller1-0/+6
This fixes slow (e.g. mesa) startup. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I10ef1e14ca97370c59984b5d848b90e6cbb9d40b
2021-02-17application-lifecycle: replace continue by returnCorentin LABBE1-15/+15
Lot of code was moved in do_release_test(), but since it is not in a loop anymore, continue are noop. Replace them by returns. Fixes: 1aee04806027c9496f5860a0dfcdbd4aafde148d ("SPEC-3484: create new application tests using new wgt types") Change-Id: I1dcd7b389dd859d8aadb3608c6e5255d13a470b8 Bug-AGL: SPEC-3808 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2021-01-20Merge "SPEC-3764: add screenshoot test"koi_10.93.0koi/10.93.010.93.0Jan-Simon Moeller3-0/+109
2021-01-20SPEC-3764: add screenshoot testCorentin LABBE3-0/+109
Add basic screenshooter test. Change-Id: I8be9c6b4f621dc757c7e8ab846384c0fb32561df Bug-AGL: SPEC-3764 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2021-01-15Add AGL_CAN_INTERFACE=vcan0 to application-lifecyclekoi_10.92.0koi/10.92.010.92.0Jan-Simon Moeller1-0/+1
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ic0b2e75122835786899aae2979feb8d29edefd5c
2021-01-13Update pyagl testdefinition to set AGL_CAN_INTERFACEJan-Simon Möller1-0/+1
We need to use vcan0 for the canreplay. Bug-AGL: SPEC-3756 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I8e3e8c7d6eadf081014e129cfd59ad217004f46d
2020-11-27Disable colors in journal dumpkoi_10.91.0koi/10.91.010.91.0Jan-Simon Möller1-1/+1
Avoid escaping characters. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I50b1895cc148b43a73e8730f76a39c29382973cb
2020-11-25Do not require tests that enforce internet to be available in CIJan-Simon Möller2-2/+2
Do not enforce tests that require the internet connection to be up. This is the case for geoclue and weather. We might be able to revert this in the future after fixes to the systemd dependencies and lab setup. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I1f53e6bfda5be7c9f9613b485efb4f2e25839a63
2020-10-22Flip order in veth setupJan-Simon Möller1-2/+3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I2da141b438122eee2768582c5a31054cb8a68964
2020-10-21SPEC-3597: prevent conman to break routesCorentin LABBE1-0/+2
conman break routes after adding veth, prevent this. Change-Id: Ic674a8ad609783950ac2ca95a9176d427c59b6ad Bug-AGL: SPEC-3597 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-10-19Merge "Extend skiplists and fix typo in export"Jan-Simon Moeller7-2/+8
2020-10-19Extend skiplists and fix typo in exportJan-Simon Möller7-2/+8
We the can test 1_pyagl-tests.can_write_wo_auth can easily fail on the 2nd invocation. Work this around until fixed. Bug-AGL: SPEC-3648 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I25af2c86604672f2e439fef19b400c83fff358d9
2020-10-14SPEC-3631: Add veth testCorentin LABBE1-0/+10
Add veth test which adds an extra virtual network card for testing. Change-Id: I4e6fef99009830cd016b2124b45b6815192b5ced Bug-AGL: SPEC-3631 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-10-13Add AGL_AVAILABLE_INTERFACES to application testJan-Simon Möller1-0/+3
The standalone run did have it defined, but the application test did mit the setting of AGL_AVAILABLE_INTERFACES=ethernet. If necessary it has to be redefined in the test for bluetooth and wifi per board. Bug-AGL: SPEC-3597 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I0772f9a6cc449406785fb167f575d6ca65e6267c
2020-10-07Disable afm-test executionJan-Simon Moeller1-21/+24
agl-service-homescreen crashes when a testwgt is executed. Until resolved, disable the test wgt execution. Bug-AGL: SPEC-3608 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I415b2fe80338f4090ef037c77d61af8205fbb77e
2020-10-06SPEC-3484: Use the new gcovr-wrapperCorentin LABBE1-14/+11
For using gcov, a new gcovr-wrapper was created. Let's use it, capture its output ang generate some metrics. Bug-AGL: SPEC-3484 Change-Id: Idbd9aa34d37d31414d18341b035440e28df5dc83 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-14Merge "SPEC-3484: install and basicly test coverage package"Jan-Simon Moeller1-1/+14
2020-09-14Merge "Change regular pyagl invocation to nohw"Jan-Simon Moeller4-21/+21
2020-09-14Change regular pyagl invocation to nohwJan-Simon Moeller4-21/+21
In CI we will execute the 'not hwrequired' flag. Make this the default case in the test-suites. Bug-AGL: SPEC-3572 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I370bb3c12953d7455a1a4c06c573cbc10ee17bda
2020-09-14SPEC-3484: install and basicly test coverage packageCorentin LABBE1-1/+14
Install and test coverage the same way than normal package. Handling coverage generated files will be handled later. Bug-AGL: SPEC-3484 Change-Id: I02d4ea1aa77954a7c85317accb6b565ece8676c0 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-14SPEC-3550: fix parsing of idCorentin LABBE1-1/+1
The id could be not the first element, and so the parsing is wrong. Change-Id: I325aac6de4733a166c7be8e3515b85e9edff4365 Bug-AGL: SPEC-3550 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-10SPEC-3550: name could be in uppercasejellyfish_9.99.4jellyfish/9.99.49.99.4Corentin LABBE1-1/+1
In config.xml, name could be in uppercase, so let's use id which is lowercase. Change-Id: Ibc3e9e145692c7773f70a1308c7ff0de27e9f0bd Signed-off-by: Corentin LABBE <clabbe@baylibre.com>