summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-11-10SPEC-3655: Start weather/geoclue services (hack)Corentin LABBE2-0/+24
For H3 and RPI4, we need to start weather/geoclue services until a proper solution to SPEC-3655 is found. Change-Id: I6cfd3ef5cad789e93e039a57d571a44c3e30594f Bug-AGL: SPEC-3655 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-10-21SPEC-3597: move can tests at the endCorentin LABBE3-12/+12
CAN tests can interfere with pyagl, so move them at the end of the run. Change-Id: Ied6ef3f08a997ca7f06a7f0756041008a7001245 Bug-AGL: SPEC-3597 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-10-14SPEC-3631: Add veth testCorentin LABBE2-0/+11
Add veth test which adds an extra virtual network card for testing. Change-Id: Iad5499ad653b4511fd7bd21f57d1b42ef4decb22 Bug-AGL: SPEC-3631 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-10-13SPEC-3631: Add network to qemuCorentin LABBE4-0/+6
qemu machines does not have a network card by default. So let's add one. Change-Id: I6ea5d5625ee5c24b5ee49652f1aa838580a6f952 Bug-AGL: SPEC-3631 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-30SPEC-3597: Add video device to qemu arm/arm64Corentin LABBE3-3/+3
We need to add video device to qemu ARM/ARM64. Both arm and arm64 use the virt qemu machine which dont have any video device. But since they have both a PCI bus, we could add a VGA device. Along with the VGA device, let's add some input peripheral for all qemu. Bug-AGL: SPEC-3597 Change-Id: Ic2cee663145abf0b668ca166f40f46318e526bc7 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-25Update qemu machine to use q35 on x86Jan-Simon Moeller1-2/+2
This fits what we do when calling runqemu. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ic5ffa2f2a65b5b55c820063300171cc31d3d878c
2020-09-23Simplify uniqidJan-Simon Moeller1-5/+1
Just use a random number. Fixes: Traceback (most recent call last): File /w/workspace/ci-apps-agl-service-bluetooth-verify-master-CIBT-x86-64/repoclone/releng-scripts/utils/create-jobs.py, line 126, in <module> main() File /w/workspace/ci-apps-agl-service-bluetooth-verify-master-CIBT-x86-64/repoclone/releng-scripts/utils/create-jobs.py, line 110, in main app_changeid=args.app_changeid, app_patchset=args.app_patchset, app_branch=args.app_branch) File /w/workspace/ci-apps-agl-service-bluetooth-verify-master-CIBT-x86-64/repoclone/releng-scripts/utils/agljobtemplate.py, line 113, in render_job job[uniqid] = AGL-%s-%s-%s-%d % (machine, branch, version, random.randint(1, 999999)) Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ifef2d5831b37e69bef30f1d32730736dfafc5a57
2020-09-23SPEC-3597: add a virtual display device via vncCorentin LABBE3-3/+8
We need to add a virtual display device for testing homescreen. Let's add a vnc to do this. But we need to avoid VNC to open a network port, so we will use an unix socket. For handling the fact that two job could run in parallel, each unix patch need to be unique. We will generate an unique path with gerrit id, branch, and a random int. The vnc is added for all qemu since it seems to not hurt ARM/ARM64. We also add a virtio display device on x86_64 since apps are tested only on x86_64. Change-Id: I22412df75cad16f151f73d0d93b0e38ae386ef4d Bug-AGL: SPEC-3597 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-19SPEC-3572: Enable pyagl testCorentin LABBE2-5/+5
This patch enable pyagl tests for all CI jobs (ci/daily/release/tc...) Bug-AGL: SPEC-3572 Change-Id: I26900a81c04731b02ab7b07aeb8fe2b36c6c1aad Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-09-16SPEC-3572: add pyagl test templateCorentin LABBE1-0/+8
This patch adds testdefinitions for pyagl. Change-Id: I1ed3fb3a953a2f0400ad0c8c2f8f4372da2d64b4 Bug-AGL: SPEC-3572 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-07-22SPEC-3414: add tests used for testing releng-scriptsjellyfish_9.99.4jellyfish_9.99.3jellyfish_9.99.2jellyfish/9.99.4jellyfish/9.99.3jellyfish/9.99.29.99.49.99.39.99.2Corentin LABBE2-0/+115
When working on SPEC-3414, I did some test tool for releng-scripts. This patchs adds them. - test.sh scan artefacts and try to generated jobs with them - checkjobs.py check all ran jobs and try to detect if there was apps jobs and if they has errors. Change-Id: Iab21573741ab4fa3cdfc29fd0d7aab33c904d838 Bug-AGL: SPEC-3414 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-07-16SPEC-3414: add new metadata for kernelCICorentin LABBE2-0/+25
Recent kernelCI expects to have more metadata in LAVA job definition. This patchs add them. Change-Id: I936947ee2ea799c28220f25a587392b7d94d488e Bug-AGL: SPEC-3414 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-06-11SPEC-3408: convert releng-scripts to python3Corentin LABBE4-16/+19
This patch convert releng-scripts to python3. While at it, let's creating requirements.txt for specifying depencies yaml and jinja2. Change-Id: Iba7b45b10fd7e1336bf1e4a73e0e6275392e373c Bug-AGL: SPEC-3408 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-06-02Add prerelease type to generatorjellyfish_9.99.1jellyfish/9.99.19.99.1Jan-Simon Moeller13-20/+30
Allow the tool to generate jobs against the prerelease location. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I7f00ee52ad85b2aecc52679da4e98857a5dd59cb
2020-05-12Support the rewitten rpi4 machine file layoutJan-Simon Moeller3-2/+9
The reworked rpi4 board support will build with MACHINE = raspberrypi4-64 to match upstream. This leads to some paths being different on the download server. Thus we need to adapt the scripts. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Iac1e2bb8c80bb751138969653a5548c6133a665a
2020-05-04SPEC-3210: use the new rootfs name for qemuCorentin LABBE1-1/+1
When changing the name of the rootfs of qemu from ramdisk to rootvd, utils/job-prereq.py was not handled. This patch fix it. Bug-AGL: SPEC-3210 Change-Id: I17c5c52d4b5f605fc043deb96694f7935b5dc9f8 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-05-04SPEC-3210: qemu do not use ramdiskCorentin LABBE5-6/+8
On 2020.02, qemu jobs fail to mount the rootfs. This is due to LAVA ignore now compression for ramdisk and the AGL image is in xz. But AGL qemu jobs in fact does not use a ramdisk but a virtio disk. Renaming the ramdisk definition entry to rootvd handle this issue. Furthermore, let's introduce a new rootfs type rootvd. Change-Id: I71ef6dee0d859c6aa0b29f1d47ac14dd4db900d8 Bug-AGL: SPEC-3210 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-05-04qemu-arm: fix the qemu virt versionCorentin LABBE1-1/+1
With recent qemu, the ARM virt machine hit: pci-host-generic 4010000000.pcie: can't claim ECAM area [mem 0x10000000-0x1fffffff]: address conflict with pcie@10000000 [mem 0x10000000-0x3efeffff] pci-host-generic: probe of 4010000000.pcie failed with error -16 Without the PCI working, the storage for tests cannot work. So let's fix to the last version of the vmachine which work without kernel hacking. This patch should not be merged until LAVA 2020.02 since stretch qemu does not support virt-2.11 Change-Id: Ifbb352a491cf917c45d48e0f88af20c146ca5422 Bug-AGL: SPEC-3210 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-05-04SPEC-3210: handle the deprecation of actions: boot: type:Corentin LABBE3-4/+3
Specifying the kernel type in "actions: boot:" is deprecated. It should now be set in "deploy: kernel:". So this patch set unconditonaly the type: in the deploy section (before it was only for ramdisk method) and remove the type: from the deprecated place. But due to a bug in LAVA, NBD jobs rely on type: to be in the deprecated place until 2020.02 (2020.02 has the fix). So this patch must be applied only after LAVA 2020.02 was deployed. Change-Id: Ida30092d2abe14b05d5e37f651f91ab33876e4f5 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-05-01Fix comment style for jinja2Jan-Simon Moeller1-1/+1
{# ... #} is the proper comment style, otherwise we still assign. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I5b3f318d758825c30e6ec208d2eeaab51ba211ea
2020-04-28Use plain H3 on master until BSP is readyJan-Simon Moeller1-1/+3
Use the plain h3ulcb dtb until the BSP for Kingfisher is back. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ieedf385a28ab3371c6d0f9d5fbd3d92999db90e3
2020-04-16SPEC-3210: qemu x86 need no_timer_checkCorentin LABBE1-1/+1
After upgraded our lab to 2020.02 and so upgraded to buster, the qemu version has increased. With this new version, the qemu x86 jobs fail with a kernel panic about IO APIC timer. This is a know issue and the simpliest fix is to add no_timer_check to the kernel cmdline. Change-Id: I75c2427e683690bfe961f482ad5267d1d957c36f Bug-AGL: SPEC-3210 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-04-08Use qemu artefacts in the upsquare templatereleasenextJan-Simon Möller1-3/+3
Change-Id: Ia6050d0ec9d35cae442dc0979b4ea75f95e6e70b Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2020-04-07Add initial machine_branch declarationCorentin LABBE1-0/+1
CI fail with: UnboundLocalError: local variable 'machine_branch' referenced before assignment (See https://build.automotivelinux.org/job/ci-platform-meta-agl-verify-CIBT-qemuarm/568/console) This patch add an initial declaration for it Change-Id: I7fa7b836e1546f65cf6678c8527698208fc5581a Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-04-06Fix case when vcs_branch is not setJan-Simon Moeller1-3/+2
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I9d6f5cb51501b1cdfd9a643c28af96c48323704f
2020-03-18Update timeouts based on job profileJan-Simon Moeller2-6/+6
The current job workload can take more than 15 minutes to boot on e.g. qemuarm during firstboot. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: If913db0a5984b1d4403cfb759797809a860bac6f
2020-03-13raspberrypi4: set boot_type to bootiCorentin LABBE1-0/+1
The raspberrypi4 should use booti for booting Image. Bug-AGL: SPEC-3004 Change-Id: Ie241194eb4177f004b2f5c378a63db88e3293669 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-03-05SPEC-3210: Set the interface for the test deviceCorentin LABBE3-0/+5
By default LAVA set the test device on IDE. Stretch version of qemu doesnt care about this setting and was always using virtio. But buster qemu care now about this and fail with: machine type does not support if=ide,bus=0,unit=0 This patch adds the necessary to restore the use of virtio. Change-Id: If34194d82b6104b9b5be7118a5194bd3b61fc090 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-03-04Add kernel config option to mount rootfs rwJan-Simon Moeller3-3/+3
This is needed if we do not let systemd remount it. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I6f3ddbbc45844bff2a4adb423c7ecb8b57c0c0fd
2020-03-04Add fstab=no option in case of netbootJan-Simon Moeller3-3/+3
to avoid systemd fstab generator to mount partitions that do not exist in the netboot case. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I4c08bd50690062202590d7aae8f6508798f29997
2020-03-02SPEC-3004: Add support for raspberrypi4flounderCorentin LABBE1-0/+23
This patch add the template for raspberrypi4. Like rpi3, the job need some custom parameters like console_device and extra_kernel_args. Unlike rpi3, we use directly extra_kernel_args as the device_type will permit to override it. Bug-AGL: SPEC-3004 Change-Id: Iac88f04e0954f77bc2e3a3daf0baf43aec3fa7c7 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-01-24SPEC-3132: upsquare does not have dtbicefish_8.99.5icefish/8.99.58.99.5Corentin LABBE1-1/+1
Asking dtb for upsquare lead to utils/job-prereq.py crash since x86 machines does not have dtb. This patch made upsquare to use FILE_MAP_X86 Bug-AGL: SPEC-3132 Change-Id: I4d33b61719c0d5e3afd83e5d8bb8dc468e26e259 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-01-22Revert "Add a new metadata field for the job_base_url"Khouloud Touil2-2/+0
This reverts commit b0eeec805136c097873dac29a1dfdbc5de545e98. Reason for revert: This patch should be reverted because the changes related to this patch not accepted yet in KernleCI backend, so there will be no job accepted in the backend with this new metadata field. Change-Id: If6045e437275d7d10ae354f39aeb2e2caaec9f47 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2020-01-17Add a new metadata field for the job_base_urlKhouloud Touil2-0/+2
It's a field that is going to be used later in the email report to provied the link of each faild test case of a test job. This metadata will provid the link of the lava web interface. AGL-bug: SPEC-3020 Signed-off-by: Khouloud Touil <ktouil@baylibre.com> Change-Id: If4d90e0c992dc3c07972cdb053f2ef25e934450f
2019-11-21Revert "SPEC-2921: AGL use only M3 with KingFisher"icefish_8.99.4icefish_8.99.3icefish_8.99.2icefish/8.99.4icefish/8.99.3icefish/8.99.2halibut_8.0.5halibut/8.0.58.99.48.99.38.99.28.0.5Corentin LABBE1-1/+1
The plan is to have: H3 with KF, M3 without KF. So let's revert to the right DTB for single M3. If we need later M3+KF the right releng templates are already present for it. This reverts commit 8a349e865441c277498a008ac4fd9f13893b5527. Change-Id: I2d2bcf0f3658804d98e06ca7f094aff8efaf2adf Bug-AGL: SPEC-2921 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-20SPEC-2921: fix prompt for h3ulcb-kficefish_8.99.1icefish/8.99.18.99.1Corentin LABBE1-0/+1
The prompt for h3ulcb-kf is h3ulcb, so yocto_machine need to be set to it. Bug-AGL: SPEC-2921 Change-Id: I73b9606b7c9de5142619f531d6cced402763bb85 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-20SPEC-2921: Use the right build_name for h3ulcb-kfCorentin LABBE1-0/+4
The build name for h3ulcb-kf is h3ulcb-nogfx. This patch adds the same hack than for m3ulcb. Bug-AGL: SPEC-2921 Change-Id: Ib687449e911ec0533cac811b648dd02cc8ae286f Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-20SPEC-2921: add initrd path for h3ulcb-kfCorentin LABBE1-0/+2
The initrd path for h3ulcb-kf is the same as h3ulcb. Bug-AGL: SPEC-2921 Change-Id: Ieb6812bcb121d2334c94027e9049c45fdb536733 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-14SPEC-2921: adds M3/H3 with KingFisherCorentin LABBE2-0/+20
This patch adds M3ULCB+KF and H3ULCB+KF support to releng-scripts Change-Id: I97ef1d63f330f4aaf669ad33f770d4527c00a271 Bug-AGL: SPEC-2921 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-10-24SPEC-2921: AGL use only M3 with KingFisherCorentin LABBE1-1/+1
Since AGL use only M3 with KingFisher, let's use the right DTB. Change-Id: I89bfe021b13f69f786d091b630f44f77ed20a3a0 Bug-AGL: SPEC-2921 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-10-16releng-scripts: split can tests to avoid failuresKhouloud Touil3-4/+16
Split the can tests in two, one for basic tests that doesn't need the two can interfaces to be related, and the other one is for a board with two related interfaces. Added a tag for Baylibre board "can_if_hw_connection" to notice the difference. AGL-bug: SPEC-2878 Signed-off-by: Khouloud Touil <ktouil@baylibre.com> Change-Id: I1350098709de05ba50faf719bbb13f9a59f7eac0
2019-09-26Add virtio-rng-pci device on qemux86-64Jan-Simon Möller1-1/+1
To fix the xmlsec ptest in https://gerrit.automotivelinux.org/gerrit/#/c/AGL/releng-scripts/+/22510/ we added the virtio-rng-pci to the qemuarm and qemuarm64 targets. Do this also to the x86-64 target. Change-Id: I3ab0a08371656137621120d7eb5356ba993c8b2b Bug-AGL: SPEC-2739 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-09-26SPEC-2739: Fix xmlsec1 ptest which timeoutCorentin LABBE2-2/+2
ptest-runner fail on xmlsec1 on ARM/ARM64. This is due to lack of randomness as the first test in doing a RSA signature. This patch adds a virtio-rng-pci device on qemuarm and qemuarm64 which adds enough randomness to permit this test to pass. Bug-AGL: SPEC-2739 Change-Id: I98dddd421572cecf2027793aad62a12853e07c59 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-08-15templates/base: remove build-tags section in jobKevin Hilman1-6/+0
build-tags: is not a valid LAVA keyword/section so is causing LAVA jobs to be refused. Only "tags:" is a valid keyword/section. However, build-tags are not needed for selecting a correct LAVA device. This is what 'device-tags' are for. The build-tags are only propogated to the test-scripts. So, to fix, just remove the entire build-tags section. Bug-AGL: SPEC-2751 Change-Id: Ic24bf9c0caf1f4bc2dacd8065eb0edbace7937b1 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2019-08-08Add/use the new arguemnt --build-tagsKhouloud Touil5-4/+13
Add new argument --build-tags to be used in the job template and to be passed to the tests to be run along with using --device-tags. Bug-AGL: SPEC-2721 Signed-off-by: Khouloud Touil <ktouil@baylibre.com> Change-Id: I2fb4c3d0cb8cd1d0e3c36c1df55185cb4dde43c3
2019-07-23Remove debug from qemu cmdlinehalibut_8.0.4halibut_8.0.3halibut_8.0.2halibut_8.0.1halibut_8.0.0halibut/8.0.4halibut/8.0.3halibut/8.0.2halibut/8.0.1halibut/8.0.08.0.48.0.38.0.28.0.18.0.0Jan-Simon Möller3-3/+3
This silences a lot of useless systemd messages. Change-Id: Icacd3bb09125ff4a16b57764490e570a1fc9258b Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-06-19utils/job-prereq.py: Use yaml safe_loadhalibut_7.99.3halibut_7.99.2halibut/7.99.3halibut/7.99.27.99.37.99.2Corentin LABBE1-1/+1
On my gentoo, using yaml.load now give: Traceback (most recent call last): File "./utils/job-prereq.py", line 81, in <module> main() File "./utils/job-prereq.py", line 66, in main job_yaml = yaml.load(job) File "/usr/lib64/python2.7/site-packages/yaml/__init__.py", line 109, in load raise RuntimeError("Unsafe load() call disabled by Gentoo. See bug #659348") RuntimeError: Unsafe load() call disabled by Gentoo. See bug #659348 Note that on recent ubuntu, a warning appears also. (like on AGL jenkins) /w/workspace/ci-platform-meta-agl-demo-verify-CIBT-qemuarm64/repoclone/releng-scripts/utils/job-prereq.py:66: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. job_yaml = yaml.load(job) This is due to a security risk of using yaml.load() Since releng-script does not rely on any behavour provided by load(), let's convert the call to safe_load(). This will also clean/reduce the output of jenkins logs Change-Id: I6158dcc21c0f7ec4645fb7b16acfaf1a6963cb26 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-06-19Fix create-jobs for snapshot/daily/weekly build-typeKhouloud Touil1-0/+4
This patch take care of the snapshot/daily/weekly build-types if they are requested without mentioning the branch and version args. Bug-AGL: SPEC-2471 Change-Id: I86e5465162cc20be82b33feedcbed7f78300053d Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-06-17SPEC-2376: add qemu arm templateCorentin LABBE1-0/+19
This patch adds a template for qemuarm Bug-AGL: SPEC-2376 Change-Id: Ib0b9f44d96fc7f365f7da17ce3ce3461d0a3c6c0 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-06-06agljobtemplate: fix url generation for m3ulcbCorentin LABBE1-2/+4
When adding support for upsquare the URL generation for m3ulcb was broken. This patchs fix the generation by adding a new variable for the build name. Fixes: 32b88dfd726b ("SPEC-2075: fix URL generation for upsquare non-CI build") Bug-AGL: SPEC-2470 Signed-off-by: Corentin LABBE <clabbe@baylibre.com> Change-Id: I84bc2d8bbcbc49b048bbd95f84a531bde9ac6aba