summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-09-16SPEC-3572: add pyagl test templateCorentin LABBE1-0/+8
This patch adds testdefinitions for pyagl. Change-Id: I1ed3fb3a953a2f0400ad0c8c2f8f4372da2d64b4 Bug-AGL: SPEC-3572 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-07-22SPEC-3414: add tests used for testing releng-scriptsjellyfish_9.99.4jellyfish_9.99.3jellyfish_9.99.2jellyfish/9.99.4jellyfish/9.99.3jellyfish/9.99.29.99.49.99.39.99.2Corentin LABBE2-0/+115
When working on SPEC-3414, I did some test tool for releng-scripts. This patchs adds them. - test.sh scan artefacts and try to generated jobs with them - checkjobs.py check all ran jobs and try to detect if there was apps jobs and if they has errors. Change-Id: Iab21573741ab4fa3cdfc29fd0d7aab33c904d838 Bug-AGL: SPEC-3414 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-07-16SPEC-3414: add new metadata for kernelCICorentin LABBE2-0/+25
Recent kernelCI expects to have more metadata in LAVA job definition. This patchs add them. Change-Id: I936947ee2ea799c28220f25a587392b7d94d488e Bug-AGL: SPEC-3414 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-06-11SPEC-3408: convert releng-scripts to python3Corentin LABBE4-16/+19
This patch convert releng-scripts to python3. While at it, let's creating requirements.txt for specifying depencies yaml and jinja2. Change-Id: Iba7b45b10fd7e1336bf1e4a73e0e6275392e373c Bug-AGL: SPEC-3408 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-06-02Add prerelease type to generatorjellyfish_9.99.1jellyfish/9.99.19.99.1Jan-Simon Moeller13-20/+30
Allow the tool to generate jobs against the prerelease location. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I7f00ee52ad85b2aecc52679da4e98857a5dd59cb
2020-05-12Support the rewitten rpi4 machine file layoutJan-Simon Moeller3-2/+9
The reworked rpi4 board support will build with MACHINE = raspberrypi4-64 to match upstream. This leads to some paths being different on the download server. Thus we need to adapt the scripts. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Iac1e2bb8c80bb751138969653a5548c6133a665a
2020-05-04SPEC-3210: use the new rootfs name for qemuCorentin LABBE1-1/+1
When changing the name of the rootfs of qemu from ramdisk to rootvd, utils/job-prereq.py was not handled. This patch fix it. Bug-AGL: SPEC-3210 Change-Id: I17c5c52d4b5f605fc043deb96694f7935b5dc9f8 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-05-04SPEC-3210: qemu do not use ramdiskCorentin LABBE5-6/+8
On 2020.02, qemu jobs fail to mount the rootfs. This is due to LAVA ignore now compression for ramdisk and the AGL image is in xz. But AGL qemu jobs in fact does not use a ramdisk but a virtio disk. Renaming the ramdisk definition entry to rootvd handle this issue. Furthermore, let's introduce a new rootfs type rootvd. Change-Id: I71ef6dee0d859c6aa0b29f1d47ac14dd4db900d8 Bug-AGL: SPEC-3210 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-05-04qemu-arm: fix the qemu virt versionCorentin LABBE1-1/+1
With recent qemu, the ARM virt machine hit: pci-host-generic 4010000000.pcie: can't claim ECAM area [mem 0x10000000-0x1fffffff]: address conflict with pcie@10000000 [mem 0x10000000-0x3efeffff] pci-host-generic: probe of 4010000000.pcie failed with error -16 Without the PCI working, the storage for tests cannot work. So let's fix to the last version of the vmachine which work without kernel hacking. This patch should not be merged until LAVA 2020.02 since stretch qemu does not support virt-2.11 Change-Id: Ifbb352a491cf917c45d48e0f88af20c146ca5422 Bug-AGL: SPEC-3210 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-05-04SPEC-3210: handle the deprecation of actions: boot: type:Corentin LABBE3-4/+3
Specifying the kernel type in "actions: boot:" is deprecated. It should now be set in "deploy: kernel:". So this patch set unconditonaly the type: in the deploy section (before it was only for ramdisk method) and remove the type: from the deprecated place. But due to a bug in LAVA, NBD jobs rely on type: to be in the deprecated place until 2020.02 (2020.02 has the fix). So this patch must be applied only after LAVA 2020.02 was deployed. Change-Id: Ida30092d2abe14b05d5e37f651f91ab33876e4f5 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-05-01Fix comment style for jinja2Jan-Simon Moeller1-1/+1
{# ... #} is the proper comment style, otherwise we still assign. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I5b3f318d758825c30e6ec208d2eeaab51ba211ea
2020-04-28Use plain H3 on master until BSP is readyJan-Simon Moeller1-1/+3
Use the plain h3ulcb dtb until the BSP for Kingfisher is back. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ieedf385a28ab3371c6d0f9d5fbd3d92999db90e3
2020-04-16SPEC-3210: qemu x86 need no_timer_checkCorentin LABBE1-1/+1
After upgraded our lab to 2020.02 and so upgraded to buster, the qemu version has increased. With this new version, the qemu x86 jobs fail with a kernel panic about IO APIC timer. This is a know issue and the simpliest fix is to add no_timer_check to the kernel cmdline. Change-Id: I75c2427e683690bfe961f482ad5267d1d957c36f Bug-AGL: SPEC-3210 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-04-08Use qemu artefacts in the upsquare templatereleasenextJan-Simon Möller1-3/+3
Change-Id: Ia6050d0ec9d35cae442dc0979b4ea75f95e6e70b Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2020-04-07Add initial machine_branch declarationCorentin LABBE1-0/+1
CI fail with: UnboundLocalError: local variable 'machine_branch' referenced before assignment (See https://build.automotivelinux.org/job/ci-platform-meta-agl-verify-CIBT-qemuarm/568/console) This patch add an initial declaration for it Change-Id: I7fa7b836e1546f65cf6678c8527698208fc5581a Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-04-06Fix case when vcs_branch is not setJan-Simon Moeller1-3/+2
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I9d6f5cb51501b1cdfd9a643c28af96c48323704f
2020-03-18Update timeouts based on job profileJan-Simon Moeller2-6/+6
The current job workload can take more than 15 minutes to boot on e.g. qemuarm during firstboot. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: If913db0a5984b1d4403cfb759797809a860bac6f
2020-03-13raspberrypi4: set boot_type to bootiCorentin LABBE1-0/+1
The raspberrypi4 should use booti for booting Image. Bug-AGL: SPEC-3004 Change-Id: Ie241194eb4177f004b2f5c378a63db88e3293669 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-03-05SPEC-3210: Set the interface for the test deviceCorentin LABBE3-0/+5
By default LAVA set the test device on IDE. Stretch version of qemu doesnt care about this setting and was always using virtio. But buster qemu care now about this and fail with: machine type does not support if=ide,bus=0,unit=0 This patch adds the necessary to restore the use of virtio. Change-Id: If34194d82b6104b9b5be7118a5194bd3b61fc090 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-03-04Add kernel config option to mount rootfs rwJan-Simon Moeller3-3/+3
This is needed if we do not let systemd remount it. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I6f3ddbbc45844bff2a4adb423c7ecb8b57c0c0fd
2020-03-04Add fstab=no option in case of netbootJan-Simon Moeller3-3/+3
to avoid systemd fstab generator to mount partitions that do not exist in the netboot case. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I4c08bd50690062202590d7aae8f6508798f29997
2020-03-02SPEC-3004: Add support for raspberrypi4flounderCorentin LABBE1-0/+23
This patch add the template for raspberrypi4. Like rpi3, the job need some custom parameters like console_device and extra_kernel_args. Unlike rpi3, we use directly extra_kernel_args as the device_type will permit to override it. Bug-AGL: SPEC-3004 Change-Id: Iac88f04e0954f77bc2e3a3daf0baf43aec3fa7c7 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-01-24SPEC-3132: upsquare does not have dtbicefish_8.99.5icefish/8.99.58.99.5Corentin LABBE1-1/+1
Asking dtb for upsquare lead to utils/job-prereq.py crash since x86 machines does not have dtb. This patch made upsquare to use FILE_MAP_X86 Bug-AGL: SPEC-3132 Change-Id: I4d33b61719c0d5e3afd83e5d8bb8dc468e26e259 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-01-22Revert "Add a new metadata field for the job_base_url"Khouloud Touil2-2/+0
This reverts commit b0eeec805136c097873dac29a1dfdbc5de545e98. Reason for revert: This patch should be reverted because the changes related to this patch not accepted yet in KernleCI backend, so there will be no job accepted in the backend with this new metadata field. Change-Id: If6045e437275d7d10ae354f39aeb2e2caaec9f47 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2020-01-17Add a new metadata field for the job_base_urlKhouloud Touil2-0/+2
It's a field that is going to be used later in the email report to provied the link of each faild test case of a test job. This metadata will provid the link of the lava web interface. AGL-bug: SPEC-3020 Signed-off-by: Khouloud Touil <ktouil@baylibre.com> Change-Id: If4d90e0c992dc3c07972cdb053f2ef25e934450f
2019-11-21Revert "SPEC-2921: AGL use only M3 with KingFisher"icefish_8.99.4icefish_8.99.3icefish_8.99.2icefish/8.99.4icefish/8.99.3icefish/8.99.2halibut_8.0.5halibut/8.0.58.99.48.99.38.99.28.0.5Corentin LABBE1-1/+1
The plan is to have: H3 with KF, M3 without KF. So let's revert to the right DTB for single M3. If we need later M3+KF the right releng templates are already present for it. This reverts commit 8a349e865441c277498a008ac4fd9f13893b5527. Change-Id: I2d2bcf0f3658804d98e06ca7f094aff8efaf2adf Bug-AGL: SPEC-2921 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-20SPEC-2921: fix prompt for h3ulcb-kficefish_8.99.1icefish/8.99.18.99.1Corentin LABBE1-0/+1
The prompt for h3ulcb-kf is h3ulcb, so yocto_machine need to be set to it. Bug-AGL: SPEC-2921 Change-Id: I73b9606b7c9de5142619f531d6cced402763bb85 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-20SPEC-2921: Use the right build_name for h3ulcb-kfCorentin LABBE1-0/+4
The build name for h3ulcb-kf is h3ulcb-nogfx. This patch adds the same hack than for m3ulcb. Bug-AGL: SPEC-2921 Change-Id: Ib687449e911ec0533cac811b648dd02cc8ae286f Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-20SPEC-2921: add initrd path for h3ulcb-kfCorentin LABBE1-0/+2
The initrd path for h3ulcb-kf is the same as h3ulcb. Bug-AGL: SPEC-2921 Change-Id: Ieb6812bcb121d2334c94027e9049c45fdb536733 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-14SPEC-2921: adds M3/H3 with KingFisherCorentin LABBE2-0/+20
This patch adds M3ULCB+KF and H3ULCB+KF support to releng-scripts Change-Id: I97ef1d63f330f4aaf669ad33f770d4527c00a271 Bug-AGL: SPEC-2921 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-10-24SPEC-2921: AGL use only M3 with KingFisherCorentin LABBE1-1/+1
Since AGL use only M3 with KingFisher, let's use the right DTB. Change-Id: I89bfe021b13f69f786d091b630f44f77ed20a3a0 Bug-AGL: SPEC-2921 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-10-16releng-scripts: split can tests to avoid failuresKhouloud Touil3-4/+16
Split the can tests in two, one for basic tests that doesn't need the two can interfaces to be related, and the other one is for a board with two related interfaces. Added a tag for Baylibre board "can_if_hw_connection" to notice the difference. AGL-bug: SPEC-2878 Signed-off-by: Khouloud Touil <ktouil@baylibre.com> Change-Id: I1350098709de05ba50faf719bbb13f9a59f7eac0
2019-09-26Add virtio-rng-pci device on qemux86-64Jan-Simon Möller1-1/+1
To fix the xmlsec ptest in https://gerrit.automotivelinux.org/gerrit/#/c/AGL/releng-scripts/+/22510/ we added the virtio-rng-pci to the qemuarm and qemuarm64 targets. Do this also to the x86-64 target. Change-Id: I3ab0a08371656137621120d7eb5356ba993c8b2b Bug-AGL: SPEC-2739 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-09-26SPEC-2739: Fix xmlsec1 ptest which timeoutCorentin LABBE2-2/+2
ptest-runner fail on xmlsec1 on ARM/ARM64. This is due to lack of randomness as the first test in doing a RSA signature. This patch adds a virtio-rng-pci device on qemuarm and qemuarm64 which adds enough randomness to permit this test to pass. Bug-AGL: SPEC-2739 Change-Id: I98dddd421572cecf2027793aad62a12853e07c59 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-08-15templates/base: remove build-tags section in jobKevin Hilman1-6/+0
build-tags: is not a valid LAVA keyword/section so is causing LAVA jobs to be refused. Only "tags:" is a valid keyword/section. However, build-tags are not needed for selecting a correct LAVA device. This is what 'device-tags' are for. The build-tags are only propogated to the test-scripts. So, to fix, just remove the entire build-tags section. Bug-AGL: SPEC-2751 Change-Id: Ic24bf9c0caf1f4bc2dacd8065eb0edbace7937b1 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2019-08-08Add/use the new arguemnt --build-tagsKhouloud Touil5-4/+13
Add new argument --build-tags to be used in the job template and to be passed to the tests to be run along with using --device-tags. Bug-AGL: SPEC-2721 Signed-off-by: Khouloud Touil <ktouil@baylibre.com> Change-Id: I2fb4c3d0cb8cd1d0e3c36c1df55185cb4dde43c3
2019-07-23Remove debug from qemu cmdlinehalibut_8.0.4halibut_8.0.3halibut_8.0.2halibut_8.0.1halibut_8.0.0halibut/8.0.4halibut/8.0.3halibut/8.0.2halibut/8.0.1halibut/8.0.08.0.48.0.38.0.28.0.18.0.0Jan-Simon Möller3-3/+3
This silences a lot of useless systemd messages. Change-Id: Icacd3bb09125ff4a16b57764490e570a1fc9258b Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-06-19utils/job-prereq.py: Use yaml safe_loadhalibut_7.99.3halibut_7.99.2halibut/7.99.3halibut/7.99.27.99.37.99.2Corentin LABBE1-1/+1
On my gentoo, using yaml.load now give: Traceback (most recent call last): File "./utils/job-prereq.py", line 81, in <module> main() File "./utils/job-prereq.py", line 66, in main job_yaml = yaml.load(job) File "/usr/lib64/python2.7/site-packages/yaml/__init__.py", line 109, in load raise RuntimeError("Unsafe load() call disabled by Gentoo. See bug #659348") RuntimeError: Unsafe load() call disabled by Gentoo. See bug #659348 Note that on recent ubuntu, a warning appears also. (like on AGL jenkins) /w/workspace/ci-platform-meta-agl-demo-verify-CIBT-qemuarm64/repoclone/releng-scripts/utils/job-prereq.py:66: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. job_yaml = yaml.load(job) This is due to a security risk of using yaml.load() Since releng-script does not rely on any behavour provided by load(), let's convert the call to safe_load(). This will also clean/reduce the output of jenkins logs Change-Id: I6158dcc21c0f7ec4645fb7b16acfaf1a6963cb26 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-06-19Fix create-jobs for snapshot/daily/weekly build-typeKhouloud Touil1-0/+4
This patch take care of the snapshot/daily/weekly build-types if they are requested without mentioning the branch and version args. Bug-AGL: SPEC-2471 Change-Id: I86e5465162cc20be82b33feedcbed7f78300053d Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-06-17SPEC-2376: add qemu arm templateCorentin LABBE1-0/+19
This patch adds a template for qemuarm Bug-AGL: SPEC-2376 Change-Id: Ib0b9f44d96fc7f365f7da17ce3ce3461d0a3c6c0 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-06-06agljobtemplate: fix url generation for m3ulcbCorentin LABBE1-2/+4
When adding support for upsquare the URL generation for m3ulcb was broken. This patchs fix the generation by adding a new variable for the build name. Fixes: 32b88dfd726b ("SPEC-2075: fix URL generation for upsquare non-CI build") Bug-AGL: SPEC-2470 Signed-off-by: Corentin LABBE <clabbe@baylibre.com> Change-Id: I84bc2d8bbcbc49b048bbd95f84a531bde9ac6aba
2019-06-06Add support for qemuarm/qemuarm64 in utils/job-prereq.pyCorentin LABBE1-1/+1
This patchs permits utils/job-prereq.py to work with qemuarm/qemuarm64 Bug-AGL: SPEC-2376 Signed-off-by: Corentin LABBE <clabbe@baylibre.com> Change-Id: Ie8615a9ab4d1f0053afc098db508814e6aad1bf7
2019-05-31Extend the timeouts for CIBT jobs in the templateshalibut_7.99.1halibut/7.99.17.99.1build.automotivelinux.org1-4/+4
This mitigates slower downloads. Change-Id: I4e18f133097e8a3c32889fcc30a076ad24b882f9 Signed-off-by: build.automotivelinux.org <jenkins@automotivelinux.org>
2019-05-30add tags: section, ensure tags are always lowercaseKevin Hilman3-3/+12
Whenever --device-tags are passed, a "tags:" section is added to the job with all of the tags passed on the command-line. To facilitate this, the device_tags list is passed directly from python to the jinja templates, and iteration is done in jinja instead of a string created in python. Also, while here, ensure that tags are always passed lower-cased. IMPORTANT: this implies that any tags in LAVA labs that are upper-case will *never* be used. Change-Id: I8f274098a69e34c32c5ed2d1c430eca0d364bcc5 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2019-05-29templates: fix valid kCI metadata keysKevin Hilman1-1/+1
The kernelci-backend is now more strict about enforcing valid and required keys in the metadata. The field `vcs.url` was already a duplicate of `git.url` but now `vcs.url` is no longer considered valid, and using it causes callbacks to be refused by the backend. Fix it by using git.url instead. Change-Id: I768229f3fabc8d127f68f4c33bd6ae22c1f654c4 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2019-05-24SPEC-2376: add qemu arm64 templateCorentin LABBE1-0/+19
This patch adds a template for qemuarm64 Bug-AGL: SPEC-2376 Change-Id: I2f8a5fbd1625df8fcb03ba4798c2d8329889408b Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-24generic-qemu-tmpfs: add qemu_cpu and qemu_machineCorentin LABBE1-0/+9
LAVA expect machine, memory and cpu to be passed as argument in context and not via extra args. This patchs introduce qemu_cpu, qemu_memory and qemu_machine as jinja variables. Change-Id: I8893943947a046f90be388febccfc29c7923d5b4 Bug-AGL: SPEC-2376 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-23Fix rootfs for upsquare on CI buildJan-Simon Möller1-1/+5
See the qemu case. Bug-AGL: SPEC-2449 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Ib23bd4897e89d3eca1eaba33a37c256c932e2d36
2019-05-22SPEC-2075: fix URL generation for upsquare non-CI buildCorentin LABBE1-1/+1
When adding support for upsquare, I have added a new machine_frag_url which contains the machine to use in url. It works for CI build type, but for other I miss to convert one machine to machine_frag_url Bug-AGL: SPEC-2075 Change-Id: Ieaaf71b62425cf73fb9582b84666640c4e9d6cae Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-15SPEC-1850: permit to override master branch for appfwCorentin LABBE3-3/+6
I have assumed that only master is used for appfw but it is false. Some app review are done against non-master branch. This patch adds a way to change the branch used via --app-branch. Bug-AGL: SPEC-1850 Change-Id: I10c8ad0e5a08158f9c2295692e4b3c266b97b14e Signed-off-by: Corentin LABBE <clabbe@baylibre.com>