summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-06-19utils/job-prereq.py: Use yaml safe_loadhalibut_7.99.3halibut_7.99.2halibut/7.99.3halibut/7.99.27.99.37.99.2Corentin LABBE1-1/+1
On my gentoo, using yaml.load now give: Traceback (most recent call last): File "./utils/job-prereq.py", line 81, in <module> main() File "./utils/job-prereq.py", line 66, in main job_yaml = yaml.load(job) File "/usr/lib64/python2.7/site-packages/yaml/__init__.py", line 109, in load raise RuntimeError("Unsafe load() call disabled by Gentoo. See bug #659348") RuntimeError: Unsafe load() call disabled by Gentoo. See bug #659348 Note that on recent ubuntu, a warning appears also. (like on AGL jenkins) /w/workspace/ci-platform-meta-agl-demo-verify-CIBT-qemuarm64/repoclone/releng-scripts/utils/job-prereq.py:66: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. job_yaml = yaml.load(job) This is due to a security risk of using yaml.load() Since releng-script does not rely on any behavour provided by load(), let's convert the call to safe_load(). This will also clean/reduce the output of jenkins logs Change-Id: I6158dcc21c0f7ec4645fb7b16acfaf1a6963cb26 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-06-19Fix create-jobs for snapshot/daily/weekly build-typeKhouloud Touil1-0/+4
This patch take care of the snapshot/daily/weekly build-types if they are requested without mentioning the branch and version args. Bug-AGL: SPEC-2471 Change-Id: I86e5465162cc20be82b33feedcbed7f78300053d Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-06-17SPEC-2376: add qemu arm templateCorentin LABBE1-0/+19
This patch adds a template for qemuarm Bug-AGL: SPEC-2376 Change-Id: Ib0b9f44d96fc7f365f7da17ce3ce3461d0a3c6c0 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-06-06agljobtemplate: fix url generation for m3ulcbCorentin LABBE1-2/+4
When adding support for upsquare the URL generation for m3ulcb was broken. This patchs fix the generation by adding a new variable for the build name. Fixes: 32b88dfd726b ("SPEC-2075: fix URL generation for upsquare non-CI build") Bug-AGL: SPEC-2470 Signed-off-by: Corentin LABBE <clabbe@baylibre.com> Change-Id: I84bc2d8bbcbc49b048bbd95f84a531bde9ac6aba
2019-06-06Add support for qemuarm/qemuarm64 in utils/job-prereq.pyCorentin LABBE1-1/+1
This patchs permits utils/job-prereq.py to work with qemuarm/qemuarm64 Bug-AGL: SPEC-2376 Signed-off-by: Corentin LABBE <clabbe@baylibre.com> Change-Id: Ie8615a9ab4d1f0053afc098db508814e6aad1bf7
2019-05-31Extend the timeouts for CIBT jobs in the templateshalibut_7.99.1halibut/7.99.17.99.1build.automotivelinux.org1-4/+4
This mitigates slower downloads. Change-Id: I4e18f133097e8a3c32889fcc30a076ad24b882f9 Signed-off-by: build.automotivelinux.org <jenkins@automotivelinux.org>
2019-05-30add tags: section, ensure tags are always lowercaseKevin Hilman3-3/+12
Whenever --device-tags are passed, a "tags:" section is added to the job with all of the tags passed on the command-line. To facilitate this, the device_tags list is passed directly from python to the jinja templates, and iteration is done in jinja instead of a string created in python. Also, while here, ensure that tags are always passed lower-cased. IMPORTANT: this implies that any tags in LAVA labs that are upper-case will *never* be used. Change-Id: I8f274098a69e34c32c5ed2d1c430eca0d364bcc5 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2019-05-29templates: fix valid kCI metadata keysKevin Hilman1-1/+1
The kernelci-backend is now more strict about enforcing valid and required keys in the metadata. The field `vcs.url` was already a duplicate of `git.url` but now `vcs.url` is no longer considered valid, and using it causes callbacks to be refused by the backend. Fix it by using git.url instead. Change-Id: I768229f3fabc8d127f68f4c33bd6ae22c1f654c4 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2019-05-24SPEC-2376: add qemu arm64 templateCorentin LABBE1-0/+19
This patch adds a template for qemuarm64 Bug-AGL: SPEC-2376 Change-Id: I2f8a5fbd1625df8fcb03ba4798c2d8329889408b Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-24generic-qemu-tmpfs: add qemu_cpu and qemu_machineCorentin LABBE1-0/+9
LAVA expect machine, memory and cpu to be passed as argument in context and not via extra args. This patchs introduce qemu_cpu, qemu_memory and qemu_machine as jinja variables. Change-Id: I8893943947a046f90be388febccfc29c7923d5b4 Bug-AGL: SPEC-2376 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-23Fix rootfs for upsquare on CI buildJan-Simon Möller1-1/+5
See the qemu case. Bug-AGL: SPEC-2449 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org> Change-Id: Ib23bd4897e89d3eca1eaba33a37c256c932e2d36
2019-05-22SPEC-2075: fix URL generation for upsquare non-CI buildCorentin LABBE1-1/+1
When adding support for upsquare, I have added a new machine_frag_url which contains the machine to use in url. It works for CI build type, but for other I miss to convert one machine to machine_frag_url Bug-AGL: SPEC-2075 Change-Id: Ieaaf71b62425cf73fb9582b84666640c4e9d6cae Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-15SPEC-1850: permit to override master branch for appfwCorentin LABBE3-3/+6
I have assumed that only master is used for appfw but it is false. Some app review are done against non-master branch. This patch adds a way to change the branch used via --app-branch. Bug-AGL: SPEC-1850 Change-Id: I10c8ad0e5a08158f9c2295692e4b3c266b97b14e Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-03SPEC-1850: do not include appfw without --test application-lifecycleCorentin LABBE2-8/+0
We should not include application-lifecycle tests based on APPURL, but on the presence of the --test application-lifecycle parameter. Bug-AGL: SPEC-1850 Change-Id: Idda5d9011f54cd7eb1710e15254ab358ef7b99b1 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-03utils/agljobtemplate.py: Fix APPURL generationCorentin LABBE8-8/+19
The generated APPURL was invalid: - it needed to be always using ci - it missed branch and arches path This patch move the generation of the application url in the jinja file for accessing the new sdk_arch Bug-AGL: SPEC-1850 Change-Id: Ie3ffff5f6181fdc89c3ebbd41078e4d60a06992b Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-05-03Remove porterCorentin LABBE3-11/+3
As asked by JSM on review 21232, this patch removes the porter machine. Bug-AGL: SPEC-2375 Change-Id: Iaa8083a271bb61ee1f9208f671d617fc15a00028 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-04-30Fix rfs_image for qemux86-64Jan-Simon Möller1-1/+1
Change-Id: Ieadfc20e9abbc01a272faf16f59d88ff0f1a3ff5 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-04-18Permit to generate jobs for the upsquareCorentin LABBE3-3/+59
This patch adds suppport for the upsquare. Upsquare use a GRUB boot method, so we needed to add a new generic-grub-tftp boot template. Since all x86_64 use the same yocto generated build name, we add a new upsquare machine, but tweaked a bit utils/agljobtemplate.py to keep intel-corei7-64 everywhere (except for the LAVA device-type). Bug-AGL: SPEC-2075 Change-Id: I15c850fada53efbcda4fd58527d7b7414865f89d Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-04-16Modify the releng-scripts to deal with branches and dtb namesKhouloud Touil2-5/+14
This patch takes the branch and machine arguments and decide which is the dtb name to be used. Change-Id: I09bd67de51920c81780a77be396906a15d8247f5 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-04-16Add new files 'machine-branch.jinja2'Khouloud Touil9-0/+18
In order to take care with the old dtb names and to keep it as flexible as possible we create a file for each board and branch with the name that matches with each branch. Change-Id: I223588aa794e4af6428b2ddcd13a1f8d396152a8 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-04-16Change dtb file names to match the new convention namesKhouloud Touil4-4/+4
As we are upgrading to a new branch we had to change dtb file names to match the new convention names. Change-Id: I6cda162056e6074c730d3ec64aa0e37b3eb8642f Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-04-14Change default timeoutsJan-Simon Möller1-2/+2
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-04-11Implement SPEC-1850: Add application-lifecycleCorentin LABBE5-2/+44
This patch adds a new parameter application_url which permit to adds a location where to download apps and test them. The applications_url could also be generated via app-changeid/app-patchset. Change-Id: I88d91b5e6e30b5ab5d72e8181b15b0f561bea72d Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-04-11Fix the use of the --build-type argumentKhouloud Touil1-1/+1
This patch fixes the use of the --build-type to take only the first part of it, which is the build type. Change-Id: Ic2f631a639babbd075bb005b2d33415e4ca916ab Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-04-10Fix for change in vayu dtb nameJan-Simon Möller1-1/+1
Actually our 'lcd-lg' was removed. FWIW the board is not usable now with screen. Change-Id: Ie1f551e1e60d61ad50a977b6d2538fe16e9917f1 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-03-22Fix the job parametersKhouloud Touil1-2/+8
This patch fixes the job parameters, if the build type is ci the parameters will be parsed as changeid and patchset otherwise it will be parsed as branch and version. Change-Id: I3f9abfd91a1b551974dd82ea82dc97a2e0a11d95 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-03-15create-jobs: fix the error checkKhouloud Touil1-2/+2
This patch fixes the error check to permit the job creation when inserting only the --url arguement and not the branch/version or the changeid/patchsetm, to grant the job creation with a custom url. Change-Id: I625e13cacee8da6df569ab90038318c0994ec1c6 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-03-15Fix the README.mdKhouloud Touil1-3/+5
This patch fixes the README.md file after the last changes to clarify the use of arguments. Change-Id: Id9fc69d54aaa6bde51392f3327e9f9e404bef29b Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-03-07job-prereq: fix use of render_job after updatesKevin Hilman1-2/+2
Change-Id: I094220e829686f9acd362339fea93f947f5bfa57 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2019-02-28Modify the url_fragmentKhouloud Touil1-1/+3
Following all the modification and to keep things correct, this patch modify the url_fragment to gave a correct url following the build type if it is 'ci' or 'release' or other. Change-Id: I7122d5c4c31e37337ca68af3d86313d36e5b8f5b Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-02-28Add new metadata git.urlKhouloud Touil2-0/+7
This patch adds a new metadata field git.url, this is a link back to the AGL gerrit. Change-Id: I7f7b5fff79198fac7814004ab99b3687cf92125c Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-02-28Add new --build-id argumentKhouloud Touil2-2/+7
This patch adds a new build-id arguement that will fill the 'kernel_defconfig' in the metadata field with the build id extracted from the build-info file. Change-Id: I77bcc253a41d67d97afd7db32b8c8560d4309145 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-02-28Reuse the build_version to fill the kernel_versionKhouloud Touil1-17/+4
The build_version will fill the kernel_version with the right value, this value will be the 'DISTRO_VERSION' extracted from the build-info file. Change-Id: Iecfdfd587dc15d53ea872d45b1916d33f6e382bf Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-02-28Use the --branch argument differentlyKhouloud Touil2-11/+5
Change the use of the --branch argument to display in the vsc_branch metadata field the AGL branch used in the build and get ride of the hard coded value "agl-branch". Change-Id: I9ff371248569c40ab9980347da14110e5227e1db Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-02-28Add new vcs_commit argumentKhouloud Touil2-2/+7
Add new vcs_commit arguement that will display in the metadeta field the build hash information. Change-Id: I079dfb8efda2ce82677e867804b3937d5a1f13c2 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-02-28Separate --branch/--changeid --version/--patchsetKhouloud Touil2-11/+19
This patch separates the --branch/--changeid and --version/--patchset arguments to use each one of them differently. As well it renames url_branch to changeid and url_version patchset. It modifies also the error check to follow the other changes and be sure that the needed arguments are well inserted. Change-Id: If64ae3620b1519fc391e79d954247938cffcb491 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-02-27Change "can" to "CAN"Khouloud Touil1-1/+1
Actually the lava tag is "CAN", so "can" in lowercase won't work, so this patch fix this issue. Change-Id: Iabfbc17bf59bd5a2152accb347e147836db51fd3 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-02-07Add gitreview filehalibut_7.90.0halibut/7.90.07.90.0Jan-Simon Möller1-0/+5
Change-Id: I777d4f88d1cc031628be3c3297c78af69d2fe020 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-02-07Update CI test planKhouloud Touil1-0/+3
Update the CI test plan to add the CAN tests for devices with tag "can". Change-Id: I8f0a583787b60d9f3f2a4c21848da43f1891f612 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-02-05templates/base: add job.build_environment keyKevin Hilman1-0/+1
Upstream kernelci backend has a new required metadata field: job.build_environment. Eventually, we can use this to describe the yocto environment. For now, let's just use our "AGL-yocto" default string. Change-Id: If4b39c8f0cda49d9ced866eb6fc24fe56b203442 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2019-01-30Remove attr/aclKhouloud Touil2-2/+2
The attr and acl parameters are causing jobs failure each time, so for now we are removing them from the ci.jinja2 and release.jinja2 files Change-Id: I7ef6f5cb8143fb1687aa955a88a913146940af58 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-01-24Add new device-tags featureKhouloud Touil2-3/+7
utils/create-jobs: Add the --device-tags argument Add new --device-tags arguement to create a job that contain the device tags as parameters. utils/agljobtemplate: Add the device_tags to the job Add the device_tags to the job in order to be used later in the test scripts to determine which test case should be runned or not. Change-Id: If22fb40b2ddf1a7c0496a59d4318e633028495b9 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-01-24templates/tests: add DEVICE_TAGS parameterKhouloud Touil2-0/+4
Insert the board tags dynamically as parameters in the release.jinja2 and the ci.jinja2 files while generating the test template. Change-Id: Ic89323b673fa99a28266a2ac89382fd3f7d9899f Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-01-15templates/base: add new metadata fieldsguppy_6.99.4guppy/6.99.46.99.4Kevin Hilman2-0/+5
To aid with better reporting, recent versions of the kernelci-backend require a few more metadatata fields for test results. The new required fields are test.plan, device.type and git.commit. Change-Id: I89cbddee019ae1e8b91b54a2d174aac4feaf769e Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-19templates/tests: switch ptest wrapperguppy_6.99.3guppy/6.99.36.99.3Kevin Hilman2-6/+20
Switch from custom AGL ptest wrapper to Linaro ptest wrapper which is more maintained and is more actively used and developed. Note that for now, both CI and release templates are doing a subset of ptests, which are now listed in the test definition, and not in a separate script. Change-Id: Ibfaa72443b19c35152db69223df709269d2b668f Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-18templates/tests/can: increase timeout for CAN testsCorentin LABBE1-1/+1
3 minutes are too short for CAN tests, upgrade timeout to 10. Fixes: SPEC-1842 Change-Id: Ieb60f706959ea154301a5f6a332abc6671211f5d Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2018-12-06templates: rpi3: update custom command-line argsKevin Hilman1-1/+1
Update kernel command-line args to match what is set when booting from SD card. Change-Id: I36e6e50efee83aa99f2e56d84893c6ec774c2e68 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-05templates/test: add starter release test planKevin Hilman1-0/+25
This is the testplan that will be used whenever --build-type=release. For starters, this is the same as the ci test plan. Change-Id: Ic7a83d683c6df8e2b3eb3b1db94d25ef906dbf48 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-05tempalates/callback: send to both backendsKevin Hilman1-1/+1
Now that we support multiple callbacks, change the default so that callbacks are sent to both AGL and BayLibre kernelCI backends. Change-Id: I56777d3ffc21c7df57d0d8cca8f532ab920450a1 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-12-05templates: callbacks: support multiple callback targetsLoys Ollivier6-17/+22
LAVA jobs can now submit multiple callbacks per job. Update the create-jobs tool and its underlying templates to support this feature. - Callback templates are now split in two file and follow LAVA specification: 'section' and 'subsection'. - create-jobs tool supports multiple arguments for the '--callback-to' option. - Default configuration for callback targets can now be a list of targets. Change-Id: I36c502c0bb5b54010ce32a53ba78a6be5e6a1642 Signed-off-by: Loys Ollivier <lollivier@baylibre.com>