aboutsummaryrefslogtreecommitdiffstats
path: root/templates/tests
AgeCommit message (Collapse)AuthorFilesLines
2019-10-16releng-scripts: split can tests to avoid failuresKhouloud Touil3-4/+16
Split the can tests in two, one for basic tests that doesn't need the two can interfaces to be related, and the other one is for a board with two related interfaces. Added a tag for Baylibre board "can_if_hw_connection" to notice the difference. AGL-bug: SPEC-2878 Signed-off-by: Khouloud Touil <ktouil@baylibre.com> Change-Id: I1350098709de05ba50faf719bbb13f9a59f7eac0
2019-08-08Add/use the new arguemnt --build-tagsKhouloud Touil2-2/+2
Add new argument --build-tags to be used in the job template and to be passed to the tests to be run along with using --device-tags. Bug-AGL: SPEC-2721 Signed-off-by: Khouloud Touil <ktouil@baylibre.com> Change-Id: I2fb4c3d0cb8cd1d0e3c36c1df55185cb4dde43c3
2019-05-30add tags: section, ensure tags are always lowercaseKevin Hilman1-2/+5
Whenever --device-tags are passed, a "tags:" section is added to the job with all of the tags passed on the command-line. To facilitate this, the device_tags list is passed directly from python to the jinja templates, and iteration is done in jinja instead of a string created in python. Also, while here, ensure that tags are always passed lower-cased. IMPORTANT: this implies that any tags in LAVA labs that are upper-case will *never* be used. Change-Id: I8f274098a69e34c32c5ed2d1c430eca0d364bcc5 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2019-05-15SPEC-1850: permit to override master branch for appfwCorentin LABBE1-1/+1
I have assumed that only master is used for appfw but it is false. Some app review are done against non-master branch. This patch adds a way to change the branch used via --app-branch. Bug-AGL: SPEC-1850 Change-Id: I10c8ad0e5a08158f9c2295692e4b3c266b97b14e Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-03SPEC-1850: do not include appfw without --test application-lifecycleCorentin LABBE2-8/+0
We should not include application-lifecycle tests based on APPURL, but on the presence of the --test application-lifecycle parameter. Bug-AGL: SPEC-1850 Change-Id: Idda5d9011f54cd7eb1710e15254ab358ef7b99b1 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-03utils/agljobtemplate.py: Fix APPURL generationCorentin LABBE1-0/+4
The generated APPURL was invalid: - it needed to be always using ci - it missed branch and arches path This patch move the generation of the application url in the jinja file for accessing the new sdk_arch Bug-AGL: SPEC-1850 Change-Id: Ie3ffff5f6181fdc89c3ebbd41078e4d60a06992b Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-04-11Implement SPEC-1850: Add application-lifecycleCorentin LABBE3-0/+19
This patch adds a new parameter application_url which permit to adds a location where to download apps and test them. The applications_url could also be generated via app-changeid/app-patchset. Change-Id: I88d91b5e6e30b5ab5d72e8181b15b0f561bea72d Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-02-27Change "can" to "CAN"Khouloud Touil1-1/+1
Actually the lava tag is "CAN", so "can" in lowercase won't work, so this patch fix this issue. Change-Id: Iabfbc17bf59bd5a2152accb347e147836db51fd3 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-02-07Update CI test planKhouloud Touil1-0/+3
Update the CI test plan to add the CAN tests for devices with tag "can". Change-Id: I8f0a583787b60d9f3f2a4c21848da43f1891f612 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-01-30Remove attr/aclKhouloud Touil2-2/+2
The attr and acl parameters are causing jobs failure each time, so for now we are removing them from the ci.jinja2 and release.jinja2 files Change-Id: I7ef6f5cb8143fb1687aa955a88a913146940af58 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-01-24templates/tests: add DEVICE_TAGS parameterKhouloud Touil2-0/+4
Insert the board tags dynamically as parameters in the release.jinja2 and the ci.jinja2 files while generating the test template. Change-Id: Ic89323b673fa99a28266a2ac89382fd3f7d9899f Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2018-12-19templates/tests: switch ptest wrapperguppy_6.99.3guppy/6.99.36.99.3Kevin Hilman2-6/+20
Switch from custom AGL ptest wrapper to Linaro ptest wrapper which is more maintained and is more actively used and developed. Note that for now, both CI and release templates are doing a subset of ptests, which are now listed in the test definition, and not in a separate script. Change-Id: Ibfaa72443b19c35152db69223df709269d2b668f Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-18templates/tests/can: increase timeout for CAN testsCorentin LABBE1-1/+1
3 minutes are too short for CAN tests, upgrade timeout to 10. Fixes: SPEC-1842 Change-Id: Ieb60f706959ea154301a5f6a332abc6671211f5d Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2018-12-05templates/test: add starter release test planKevin Hilman1-0/+25
This is the testplan that will be used whenever --build-type=release. For starters, this is the same as the ci test plan. Change-Id: Ic7a83d683c6df8e2b3eb3b1db94d25ef906dbf48 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-03templates/tests: increase timeout for ptestsKevin Hilman1-0/+2
Change-Id: Ia91512e66e89a05e0b52482b47d07539a444c378 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-03templates/tests: move to standard test plansKevin Hilman2-23/+0
Remove specific test-plan templates, and migrate to the build-specific templates: ci, snapshot, release. Note that the contents of smoke and yocto-ptest are now part of the "ci" template. Change-Id: I982529ecafddd903db5954af03af15ac8d4f871a Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-03templates/tests: add test template for CI jobsKevin Hilman1-0/+23
Rather than specifing the list of test suites on the command-line, instead use a new "ci" template for all the test-suites to run for CI jobs. For starters, it combines what is currently in "smoke" and "yocto-ptest" While at it, add the "history: False" property so that the .git directory is not included in the overlay tarball that is downloaded by the target device. Change-Id: Ibf53dfb035d306cf2f40b73b3c7fc15dc6e78b58 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-11-16Disable full ptest run due to failuresJan-Simon Möller1-8/+0
All available ptests currently will fail to run. We need to select. Change-Id: I9aa6d4b233aa9e78163cfb80235386288c0b47b3 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-10-12Increase timeout for ptestsJan-Simon Möller1-1/+1
the emulated runs (qemu*) take quite some time. Extend the timeout. Change-Id: I9fc924930655d11902fa3e7b224f5239af58d594 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-10-09Add full ptest run for all installed ptestsJan-Simon Möller1-0/+8
Change-Id: I2c22cfc01e1f0da1c0891a886ea505cfb4bff4ce Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-10-06tests/yocto-ptest: increase timeout to 30mKevin Hilman1-1/+1
Change-Id: I67c8b924a367dec280b3b1acdb72522d0c2e7845 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-10-04templates/tests: remove health-testKevin Hilman1-21/+0
This test suite is no longer useful as the smoke tests are now serving this purpose. Change-Id: I3c7165f34a9e5f4db2ec0010da13a793cf5dfdda Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-09-28Extend timeouts, add callback and gitignoreJan-Simon Möller1-0/+2
Change-Id: Ib28d25e1efd0033458fa9ae787610a8de9f5d275 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-07-16tests/health-test: remove always-failflounder_5.99.4flounder_5.99.3flounder_5.99.2flounder/5.99.4flounder/5.99.3flounder/5.99.25.99.45.99.35.99.2Kevin Hilman1-4/+1
Remove the always-fail test as it just creates false fail noise in the test results. Change-Id: I0389f8305fc97a6f9cc3d81c62ad31f8da496f0d Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-07-03Test template for CAN interfaceskhouloud touil1-0/+9
Add new test template for CAN bus interfaces Change-Id: I9ef213afd2bbb3bd2115735821b15ac599f50bca Signed-off-by: khouloud touil <ktouil@baylibre.com>
2017-10-20Add the yocto-ptest definitionlollivier1-0/+6
Add the yocto-ptest definition to the pool of scripts. Depends on https://gerrit.automotivelinux.org/gerrit/#/c/11407/ Bug-AGL: SPEC-911 Change-Id: I7fe474ae7d3a06851ed4052151f68a566963edc9 Signed-off-by: lollivier <lollivier@baylibre.com>
2017-10-05Merge health tests into oneLoys Ollivier3-43/+24
Merge the two health tests into one unique. Change-Id: I59f55d282338eee507d490e5d70d96c9b5023d37 Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-09-22[Test] Add service test definitionLoys Ollivier1-1/+4
Add a new test definition. This test checks wether a list of services is running on the platform and reports the result for each service. Change-Id: I433da8387edd7c066296e1b4966ba867da58d239 Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-09-01initial snapshot: LAVA job creation based on templatesKevin Hilman3-0/+55
Change-Id: I5d545d3531f4c4190453724738076bd4eddfc4d6 Signed-off-by: Jerome Brunet <jbrunet@baylibre.com> Signed-off-by: Loys Ollivier <lollivier@baylibre.com> Signed-off-by: Kevin Hilman <khilman@baylibre.com>