summaryrefslogtreecommitdiffstats
path: root/templates/tests
AgeCommit message (Collapse)AuthorFilesLines
2022-01-12Adapt ptest time and scopeJan-Simon Möller2-4/+4
exclude acl, attr and coreutils. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Iced249d0baa18adf280fe1adde237fbb2bbaebf8
2021-12-24Fix name of glib ptestJan-Simon Moeller2-2/+2
glib is known to ptest-runner as glib-2.0 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ib354dd359ef22caca3c3ce40ad1e92d0fd381b72
2021-12-22Remove gstreamer from ptest runmarlin_12.91.0marlin/12.91.012.91.0Jan-Simon Moeller2-2/+2
We need to investigate a runtime issue. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I6af1baf0eaae17c4f52f048a7f22516c60ef098c
2021-12-21Update ptest executed testsJan-Simon Moeller2-2/+2
We no longer need xmlsec1, remove it. We do now rely on dbus, so add dbus-test. Add basic system infra as well. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I99d2f36a4f253bbc809ab53dbe7691544722ec90
2021-12-21Adapt watchdog fix to new agl-compositor.serviceJan-Simon Moeller1-4/+3
The user session has a dedicated service file. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I4d459ca9359f68a866b4dc0850da498426bc8cee
2021-12-10Further bump watchdogJan-Simon Möller1-2/+3
and also restart homescreen.service Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Ic9f94a136250d780dee8ea1ab6207b4d4f507bac
2021-12-06Add workaround for weston watchdog for emulation in CIJan-Simon Möller1-0/+19
The emulated workers are slower than real hardware, thus extend the timeout. Bug-AGL: SPEC-4165 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I4113d1ad28964efb31a55121ff3dbb1a29893a6f
2021-11-25Update timeout of screenshooter testJan-Simon Moeller1-1/+1
some platforms are slow in emulation to bring-up the screens. Bug-AGL: SPEC-4150 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ice053e68b57fe46c948679b89de2b56c957404ac
2021-11-04Prepare CI on master for new framework integrationJan-Simon Moeller3-43/+0
During the last workshop the transition to the new framework was presented. This change essentially deprecates the SMACK-based application framework. To prepare the integration of it, we remove the deprecated components: - skip application framework related tests on master branch Bug-AGL: SPEC-4121 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I6f8de8b6ddb76b5fc1a229f0ae78ebedc0a7220f
2021-03-30Update templates for screenshot testsJan-Simon Möller1-1/+1
- qemu needs the mem= kernel parameter to work nicely - pyagl needs a larger timeout - pi4 needs an adapted rfs_image for snapshot builds Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Ida3ac188008c72d941dbe30203e5b8700ee8a304
2021-03-16Stop weather and geoclue before restartingJan-Simon Möller1-0/+6
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: I48ecf0a1ce708a13f1dc6501a2ccdd129fae729c
2021-01-21SPEC-3764: Enable screenshooter testCorentin LABBE1-0/+8
This patch enable screenhooter test. The qemuarm need more memory for working with this test. Change-Id: I1aae32688efb4bb8264e3d85bd3c439b7b9f6764 Bug-AGL: SPEC-3764 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-11-27Dump the journal at the end of a jobJan-Simon Möller2-0/+20
For debugging purposes, dump the journal at the very end. Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Ib31764edb57827fbf2deb6ef5705da8783d17c30
2020-11-10SPEC-3655: Start weather/geoclue services (hack)Corentin LABBE1-0/+21
For H3 and RPI4, we need to start weather/geoclue services until a proper solution to SPEC-3655 is found. Change-Id: I6cfd3ef5cad789e93e039a57d571a44c3e30594f Bug-AGL: SPEC-3655 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-10-21SPEC-3597: move can tests at the endCorentin LABBE2-8/+8
CAN tests can interfere with pyagl, so move them at the end of the run. Change-Id: Ied6ef3f08a997ca7f06a7f0756041008a7001245 Bug-AGL: SPEC-3597 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-10-14SPEC-3631: Add veth testCorentin LABBE1-0/+8
Add veth test which adds an extra virtual network card for testing. Change-Id: Iad5499ad653b4511fd7bd21f57d1b42ef4decb22 Bug-AGL: SPEC-3631 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-19SPEC-3572: Enable pyagl testCorentin LABBE1-1/+1
This patch enable pyagl tests for all CI jobs (ci/daily/release/tc...) Bug-AGL: SPEC-3572 Change-Id: I26900a81c04731b02ab7b07aeb8fe2b36c6c1aad Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-16SPEC-3572: add pyagl test templateCorentin LABBE1-0/+8
This patch adds testdefinitions for pyagl. Change-Id: I1ed3fb3a953a2f0400ad0c8c2f8f4372da2d64b4 Bug-AGL: SPEC-3572 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-06-02Add prerelease type to generatorjellyfish_9.99.1jellyfish/9.99.19.99.1Jan-Simon Moeller2-8/+8
Allow the tool to generate jobs against the prerelease location. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I7f00ee52ad85b2aecc52679da4e98857a5dd59cb
2019-10-16releng-scripts: split can tests to avoid failuresKhouloud Touil3-4/+16
Split the can tests in two, one for basic tests that doesn't need the two can interfaces to be related, and the other one is for a board with two related interfaces. Added a tag for Baylibre board "can_if_hw_connection" to notice the difference. AGL-bug: SPEC-2878 Signed-off-by: Khouloud Touil <ktouil@baylibre.com> Change-Id: I1350098709de05ba50faf719bbb13f9a59f7eac0
2019-08-08Add/use the new arguemnt --build-tagsKhouloud Touil2-2/+2
Add new argument --build-tags to be used in the job template and to be passed to the tests to be run along with using --device-tags. Bug-AGL: SPEC-2721 Signed-off-by: Khouloud Touil <ktouil@baylibre.com> Change-Id: I2fb4c3d0cb8cd1d0e3c36c1df55185cb4dde43c3
2019-05-30add tags: section, ensure tags are always lowercaseKevin Hilman1-2/+5
Whenever --device-tags are passed, a "tags:" section is added to the job with all of the tags passed on the command-line. To facilitate this, the device_tags list is passed directly from python to the jinja templates, and iteration is done in jinja instead of a string created in python. Also, while here, ensure that tags are always passed lower-cased. IMPORTANT: this implies that any tags in LAVA labs that are upper-case will *never* be used. Change-Id: I8f274098a69e34c32c5ed2d1c430eca0d364bcc5 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2019-05-15SPEC-1850: permit to override master branch for appfwCorentin LABBE1-1/+1
I have assumed that only master is used for appfw but it is false. Some app review are done against non-master branch. This patch adds a way to change the branch used via --app-branch. Bug-AGL: SPEC-1850 Change-Id: I10c8ad0e5a08158f9c2295692e4b3c266b97b14e Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-03SPEC-1850: do not include appfw without --test application-lifecycleCorentin LABBE2-8/+0
We should not include application-lifecycle tests based on APPURL, but on the presence of the --test application-lifecycle parameter. Bug-AGL: SPEC-1850 Change-Id: Idda5d9011f54cd7eb1710e15254ab358ef7b99b1 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-03utils/agljobtemplate.py: Fix APPURL generationCorentin LABBE1-0/+4
The generated APPURL was invalid: - it needed to be always using ci - it missed branch and arches path This patch move the generation of the application url in the jinja file for accessing the new sdk_arch Bug-AGL: SPEC-1850 Change-Id: Ie3ffff5f6181fdc89c3ebbd41078e4d60a06992b Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-04-11Implement SPEC-1850: Add application-lifecycleCorentin LABBE3-0/+19
This patch adds a new parameter application_url which permit to adds a location where to download apps and test them. The applications_url could also be generated via app-changeid/app-patchset. Change-Id: I88d91b5e6e30b5ab5d72e8181b15b0f561bea72d Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-02-27Change "can" to "CAN"Khouloud Touil1-1/+1
Actually the lava tag is "CAN", so "can" in lowercase won't work, so this patch fix this issue. Change-Id: Iabfbc17bf59bd5a2152accb347e147836db51fd3 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-02-07Update CI test planKhouloud Touil1-0/+3
Update the CI test plan to add the CAN tests for devices with tag "can". Change-Id: I8f0a583787b60d9f3f2a4c21848da43f1891f612 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-01-30Remove attr/aclKhouloud Touil2-2/+2
The attr and acl parameters are causing jobs failure each time, so for now we are removing them from the ci.jinja2 and release.jinja2 files Change-Id: I7ef6f5cb8143fb1687aa955a88a913146940af58 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-01-24templates/tests: add DEVICE_TAGS parameterKhouloud Touil2-0/+4
Insert the board tags dynamically as parameters in the release.jinja2 and the ci.jinja2 files while generating the test template. Change-Id: Ic89323b673fa99a28266a2ac89382fd3f7d9899f Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2018-12-19templates/tests: switch ptest wrapperguppy_6.99.3guppy/6.99.36.99.3Kevin Hilman2-6/+20
Switch from custom AGL ptest wrapper to Linaro ptest wrapper which is more maintained and is more actively used and developed. Note that for now, both CI and release templates are doing a subset of ptests, which are now listed in the test definition, and not in a separate script. Change-Id: Ibfaa72443b19c35152db69223df709269d2b668f Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-18templates/tests/can: increase timeout for CAN testsCorentin LABBE1-1/+1
3 minutes are too short for CAN tests, upgrade timeout to 10. Fixes: SPEC-1842 Change-Id: Ieb60f706959ea154301a5f6a332abc6671211f5d Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2018-12-05templates/test: add starter release test planKevin Hilman1-0/+25
This is the testplan that will be used whenever --build-type=release. For starters, this is the same as the ci test plan. Change-Id: Ic7a83d683c6df8e2b3eb3b1db94d25ef906dbf48 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-03templates/tests: increase timeout for ptestsKevin Hilman1-0/+2
Change-Id: Ia91512e66e89a05e0b52482b47d07539a444c378 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-03templates/tests: move to standard test plansKevin Hilman2-23/+0
Remove specific test-plan templates, and migrate to the build-specific templates: ci, snapshot, release. Note that the contents of smoke and yocto-ptest are now part of the "ci" template. Change-Id: I982529ecafddd903db5954af03af15ac8d4f871a Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-03templates/tests: add test template for CI jobsKevin Hilman1-0/+23
Rather than specifing the list of test suites on the command-line, instead use a new "ci" template for all the test-suites to run for CI jobs. For starters, it combines what is currently in "smoke" and "yocto-ptest" While at it, add the "history: False" property so that the .git directory is not included in the overlay tarball that is downloaded by the target device. Change-Id: Ibf53dfb035d306cf2f40b73b3c7fc15dc6e78b58 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-11-16Disable full ptest run due to failuresJan-Simon Möller1-8/+0
All available ptests currently will fail to run. We need to select. Change-Id: I9aa6d4b233aa9e78163cfb80235386288c0b47b3 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-10-12Increase timeout for ptestsJan-Simon Möller1-1/+1
the emulated runs (qemu*) take quite some time. Extend the timeout. Change-Id: I9fc924930655d11902fa3e7b224f5239af58d594 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-10-09Add full ptest run for all installed ptestsJan-Simon Möller1-0/+8
Change-Id: I2c22cfc01e1f0da1c0891a886ea505cfb4bff4ce Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-10-06tests/yocto-ptest: increase timeout to 30mKevin Hilman1-1/+1
Change-Id: I67c8b924a367dec280b3b1acdb72522d0c2e7845 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-10-04templates/tests: remove health-testKevin Hilman1-21/+0
This test suite is no longer useful as the smoke tests are now serving this purpose. Change-Id: I3c7165f34a9e5f4db2ec0010da13a793cf5dfdda Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-09-28Extend timeouts, add callback and gitignoreJan-Simon Möller1-0/+2
Change-Id: Ib28d25e1efd0033458fa9ae787610a8de9f5d275 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-07-16tests/health-test: remove always-failflounder_5.99.4flounder_5.99.3flounder_5.99.2flounder/5.99.4flounder/5.99.3flounder/5.99.25.99.45.99.35.99.2Kevin Hilman1-4/+1
Remove the always-fail test as it just creates false fail noise in the test results. Change-Id: I0389f8305fc97a6f9cc3d81c62ad31f8da496f0d Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-07-03Test template for CAN interfaceskhouloud touil1-0/+9
Add new test template for CAN bus interfaces Change-Id: I9ef213afd2bbb3bd2115735821b15ac599f50bca Signed-off-by: khouloud touil <ktouil@baylibre.com>
2017-10-20Add the yocto-ptest definitionlollivier1-0/+6
Add the yocto-ptest definition to the pool of scripts. Depends on https://gerrit.automotivelinux.org/gerrit/#/c/11407/ Bug-AGL: SPEC-911 Change-Id: I7fe474ae7d3a06851ed4052151f68a566963edc9 Signed-off-by: lollivier <lollivier@baylibre.com>
2017-10-05Merge health tests into oneLoys Ollivier3-43/+24
Merge the two health tests into one unique. Change-Id: I59f55d282338eee507d490e5d70d96c9b5023d37 Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-09-22[Test] Add service test definitionLoys Ollivier1-1/+4
Add a new test definition. This test checks wether a list of services is running on the platform and reports the result for each service. Change-Id: I433da8387edd7c066296e1b4966ba867da58d239 Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-09-01initial snapshot: LAVA job creation based on templatesKevin Hilman3-0/+55
Change-Id: I5d545d3531f4c4190453724738076bd4eddfc4d6 Signed-off-by: Jerome Brunet <jbrunet@baylibre.com> Signed-off-by: Loys Ollivier <lollivier@baylibre.com> Signed-off-by: Kevin Hilman <khilman@baylibre.com>