aboutsummaryrefslogtreecommitdiffstats
path: root/jjb/common/include-agl-lava-jobs-submit.sh
AgeCommit message (Collapse)AuthorFilesLines
2019-10-24SPEC-2903: define GERRIT_HOSTCorentin LABBE1-0/+3
If GERRIT_HOST is empty fallback to gerrit.automotivelinux.org Bug-AGL: SPEC-2903 Change-Id: Iced5435293c9fc0c3d260e3e27b2f15e03d9ea89 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-10-15Rework the messaging back to gerrit and improve escapingJan-Simon Moeller1-3/+25
This will allow to post more detailed messages back to gerrit. Note the double quotes used and the eval before the ssh to enforce the expansion. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I1c0d618796ef1cb697529575f7b9925ae4926a97
2019-10-15Always run the result parsingJan-Simon Möller1-1/+5
This fixes the application builds where we have no skiplist for most. Before this we bailed out on return 0 and did never parse the result. Now the result parsing is it's own function and always being called. Bug-AGL: SPEC-2882 . Change-Id: I58c05fa48dd9121e0eeb494975513dcc88290dc5 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-10-14Fix escaping for report back to gerritJan-Simon Möller1-2/+3
Bug-AGL: SPEC-2703 Change-Id: I223a4242942ac9e751f0b6dd3caab0309f2a566a Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-10-11SPEC-2703: print a link to the job logCorentin LABBE1-2/+4
This patchs adds a link to the console logs when sending result. Bug-AGL: SPEC-2703 Signed-off-by: Corentin LABBE <clabbe@baylibre.com> Change-Id: Idb95e5cdf80072c4cfdce95ecc4facabffb43caf
2019-09-23SPEC-2703: fix a typo on TESTNAMECorentin LABBE1-2/+2
TESTNAME was mispelled in the debug output. Change-Id: I068da47c52626672f6e307349e95e03d3b7b20c3 Bug-AGL: SPEC-2703 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-09-18SPEC-2703: fix parsing of the testnameCorentin LABBE1-1/+1
The raw testline contains an * which breaks the parsing of the testname. This patchs adds quote to prevent that. Change-Id: I8f11b3d9ee5444983dd886954a5e2712025a7314 Bug-AGL: SPEC-2703 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-09-17SPEC-2703: fix a typoCorentin LABBE1-1/+1
The existence test is inverted, fix it. Change-Id: Ida3104e34b3475c80b206091464b1e9a88d8be49 Bug-AGL: SPEC-2703 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-09-17SPEC-2703: use lavacli identityCorentin LABBE1-3/+8
The lavacli results does not provide the identity argument and so does not work. This patch adds the missing "-i $lab" for made it works. While at it, this patch converts two hardcoded "-i agl" call to use the correct lab variable. As asked during the meeting, let's add a sanity check that this lab variable is set. Bug-AGL: SPEC-2703 Change-Id: I9432f8b27aa7157e08b48f5caeb905a18152fa6a Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-09-16Merge "SPEC-2703: do not fail with set -xe"Jan-Simon Moeller1-12/+11
2019-09-13SPEC-2703: do not fail with set -xeCorentin LABBE1-12/+11
This patch move the grepping test inside the if for not failling due to set -xe For the same reason, harden the code checking if git clone was successfull. Change-Id: Idb0619c4e90c9a3a0654a024fbd2166e49df98c6 Bug-AGL: SPEC-2703 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-09-12Include MACHINE name in message.Jan-Simon Möller1-2/+2
Change-Id: I1ec20a66dfc4a427642806011f6de8d4e7c75408 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-09-11SPEC-2703: Fix remaining problems in skiplistCorentin LABBE1-4/+5
This patch fix the following problems: - {{GERRIT_CHANGE_NUMBER}},${{GERRIT_PATCHSET_NUMBER}}: bad substitution A copy paste from jenkins commands, but I forgot to remove the double {} - missing grep -v '\*', removed by ec3e1dc57d7a6a454f9ed1f0210b07b8270a1fbb ("Follow up fix") - for apps, no dedicated skipdir as asked in SPEC-2703 Change-Id: I8dfdc6ff4d03fc946e0b8ad35f092e217afd685b Bug-AGL: SPEC-2703: Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-09-10Follow-up fixJan-Simon Möller1-1/+1
Change-Id: I13c0e82a53a19d4343eb2659d1c86eea399d94c3 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-09-10Fix error in CIBT scripting and harden pipelineJan-Simon Möller1-2/+3
do not fail on CIBT result evaluation. Change-Id: I91e84cc9e30a149f8e56c218b1f97375c76c3d95 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-09-10SPEC-2703: Permit to have a per-machine skiplistCorentin LABBE1-2/+12
The service weston does not start on qemu/qemuarm64. for having this service check skipped only for thoses two machine, we need to have a per-machine skiplist. In the process, we add the possibiity to have a per GERRIT_PROJECT skiplist. Furthermore, I "migrate" the skiplist for apps in a skiplists directory. Change-Id: I989b2bdf2463272ee1f407a933be49a2f4219d5f Bug-AGL: SPEC-2703 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-09-09SPEC-2703: pass/fail criteria for lava jobsCorentin LABBE1-0/+66
This patchs implement pass/fail analysis of job tests. All failling test are compared to a skiplist for removing known failling tests. If it exists any remaining failling test after the skiplist phase, the job is set as fail in gerrit. Bug-AGL: SPEC-2703 Change-Id: I4af8f54caaeef616c529b626ca8010e7159d8206 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-07-26Manage the polling with lavacliKhouloud Touil1-39/+7
Instead of using a timeout to manage the polling part, this patch replace it with a lavacli command which is 'lavacli jobs wait'that will wait for the job to finish, but after 2 hours the 'job wait' will be stopped even the job if not finished, we are estimating after a 2 hours of waiting, a problem is occurring in the job. Signed-off-by: Khouloud Touil <ktouil@baylibre.com> Change-Id: Ic81a635b0cc2dc5dda3028aefb78f88be0d79a31
2019-07-08Also react on lava jobs that were canceled in jenkinsJan-Simon Möller1-0/+5
This is needed to avoid jenkins polling until the timeout when a job was aborted. Change-Id: Ibcf0fffaeaac86a1198e4f0411e784ff74ab9f5b Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-07-08Be less verbose in CIBT jobsJan-Simon Möller1-2/+6
Remove the set -x and print JOB_URL prominently. Change-Id: I81b2283557e5b2ca5ca7815adb43f4e930250357 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-06-19Remove the send email report part when submitting the jobKhouloud Touil1-25/+0
After managing to send the email test report after all the job have been finished, this patch remove the part to send email when submitting the job. Bug-AGL: SPEC-2177 Signed-off-by: Khouloud Touil <ktouil@baylibre.com> Change-Id: I477ae5513cc1d9c5dcba9b2b71bb6bc38cbbbb99
2019-05-30jjb/common: lava-jobs-submit: fix email recipientsKevin Hilman1-1/+1
Remove the leading space from the email recipient when requesting an email report. The leading space was causing the SMTP handling on the backend to reject the request. Change-Id: Id176728a7c6eea8f54128d74cf658b13b6be81cb Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2019-05-06Fix the KCI_API linkKhouloud Touil1-1/+1
This patch fixes the KCI_API link, it should be an 'http' not 'httpis'. Change-Id: Iad52da5de124289ac15563b3bf10d652ef76bbe1 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-05-03jjb/common: lava-jobs-submit: fix email token checkKevin Hilman1-1/+4
Fix the logic to check if the email auth token is present. While at it, make output more verbose for easier debug. Signed-off-by: Kevin Hilman <khilman@baylibre.com> (cherry picked from commit b9f7f8928ab26f15f0950d00a7f2417ffa204755) Change-Id: Iceb00e5617cbfb787353c7caf05e5d00e9512d70
2019-05-02Avoid failing the job when sending the email reportKhouloud Touil1-1/+3
This patch avoid to fail the job if the sending email report section is not working well. Change-Id: I9bc192e1ac8f3937fc06be15233b0a697d16ff15 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-05-02Fix the URL to send the email reportKhouloud Touil1-8/+11
The 'LAVA_MASTER_URI' used is wrong, this patch fixes the url. It adds also a check on the output of lavacli command before to send the test email report. Signed-off-by: Khouloud Touil <ktouil@baylibre.com> (cherry picked from commit d891414424913e7bcf2845740cd5c532a858877e) Change-Id: Iff4b984593abb5ccb495764246826bcf173e6e6e
2019-05-01Merge "Fix the status problem of lavacli"Jan-Simon Moeller1-1/+1
2019-05-01Add test scripts for CIBT casesJan-Simon Möller1-1/+6
and adapt the common job to not use '' . Change-Id: I15b4fa1a4ab181c55c53885fb746cfd56403c698 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-05-01Fix the status problem of lavacliKhouloud Touil1-1/+1
When using --yaml option to show the job information the 'Health' is no longer with capital 'H'. This patch change the 'Health" to 'health'. Change-Id: Ifd463b4aee9ca90bbaa017e2f409a5105cec3e93 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-05-01Do not fail job on CIBT unil sequence worksJan-Simon Möller1-1/+3
Change-Id: I10c292096dae34936b8dcbfbc8d383a21ed02bfd Bug-AGL: SPEC-2267 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-04-30This section needs special handlingJan-Simon Möller1-0/+6
TODO: rewrite to run under set -e ! Change-Id: I4f26d8e5de03d2a16a6b8c8825ce7bc9df8da5d4 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-04-30jjb/common/include-agl-lava-jobs-submit.sh: add a missing thenCorentin LABBE1-1/+1
this patch adds a missing "then" Change-Id: Iaddfc12597864e3ba35a12baa6b0716660d969b3 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-04-29Replace lava-tool with lavacliKhouloud Touil1-13/+37
In order to move totally to lavacli, this patch: - Apply changes to submit jobs using lavacli. As the blocking call (--block) no longer exists with lavacli, so had to replace that with a polling loop. - Replace lava-tool with lavacli in the polling part in the labs-prepare file, which checks the device status and availability. Different changes tested at Baylibre. Change-Id: I25b1ad4b47ae09a158e1e1cf42e30da5e6aa8b57 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-02-13Enable the request of test report emailKhouloud Touil1-0/+17
Add new feature to the ci-managmenet that will request to send test report email to the specified email addresses in the automotive- testreports list after a certain delay (1 hour=3600 sec). This commit is accomplished based on the work of Corentin Labbe <clabbe@baylibre.com>. Change-Id: I14350b13b5b6cf2550303999ced56055a392212b Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2018-02-05jjb/common: lava-jobs-submit: fix device_type replacementKevin Hilman1-1/+1
Fix "raspberrypi3-uboot" -> "raspberrypi3-uboot-uboot" type of substitutions. Ensure that the full string (up to EOL) is matched before trying to replace. Change-Id: I2026beb964b12aff1f60441257ceec82b706bab7 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2017-12-15Merge "jjb/common: if any, display lava error msg in jenkins log"Jan-Simon Moeller1-0/+1
2017-12-15jjb/common: if any, display lava error msg in jenkins logLoys Ollivier1-0/+1
Do a second grep on the lava log to include lava error message if there was any. This is usefull in case a job fails. The error can be read directly out of the jenkins log. JIRA: SPEC-1178 Change-Id: Id3333df9c56dd67f5d664ae0d234e33e3300c366 Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-12-15jjb/common: Fix race condition when using grep and trLoys Ollivier1-1/+2
when using grep + tr to find board availability, status, a race condition happens sometimes. When it happens the job is stuck and timeout fails. Fix it by calling sequentially grep then tr and not piping. Change-Id: Ib1322e280900b62abdd827992b42183024cd094c Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-12-13jjb/common: Fix query of lava log in jenkins logLoys Ollivier1-1/+1
Fix the query of the log in jenkins log. Use the lava website url and not the lava API url. JIRA: SPEC-1178 Change-Id: I9ddc48b13e91a91aa2e53c768aa02f2ae12e5a99 Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-11-15jjb/common: lava-jobs-submitLoys Ollivier1-6/+1
lava-tool submit-jobs go back to --block as wait-for-jobs isn't working as expected. Revert the change until wait-for-jobs works. But keep this version of the tool to have a link to the lava-job posted in the log when using submit-job. Change-Id: Ie7d045d198b00b19d198404fc67b2bcfe992e9a6 Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-11-15jjb/common: lava-jobs: create device name aliasesLoys Ollivier1-57/+39
The previous version would fail to find some boards if the device names were different between lava, AGL, releng. This version creates a device alias table. And uses this table with the correct name for each component (AGL, lava, releng). Change-Id: Ief064c5ff9edb2d824e80549148ee0ab40ebcddf Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-11-15jjb/common: lava-jobs-submit: remove timeoutLoys Ollivier1-2/+2
Remove the timeout from lava submit jobs. The previous version would timeout after 5 minutes but this is not enough if the job is qeued. Let Jenkins handle the timeout and remove that one. Change-Id: I501a539020174b2c9e030716717f1d3d0b06e539 Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-11-10jjb/common: lava-jobs-submit: fixup wait for jobLoys Ollivier1-35/+16
REQUIRES: lava-tool version >= 0.19 The previous version using submit-job with "--block" would never timeout and remain blocked even if there was an issue during the LAVA job execution. This patch fixes the issue by using wait-job-events with a tiemout. Parsing has been updated to follow these commands as well. Change-Id: If090d278cb58c1c1b902793bf0ca40daceb2fd97 Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-11-10jjb/common: lava-jobs-submit: fixup device-list failureKevin Hilman1-12/+0
The previous reordering of lava lab selection result in a failure the second time through the devices list. This patch fixes the failure enough to get things working again, but the ordering needs to be fixed so that there is only one pass through the devices-list. Change-Id: I1131b380cb5a8a8235cbf1f838574726d6ef11a6 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2017-11-08CIBT improve lava lab searching and coding styleLoys Ollivier1-9/+9
Fix coding style, indentation. Improve the lab search, if a lab has the device do not search in others as it won't be used. Change-Id: I7471511ff7af3d2f6d8708943b42099a450ef770 Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-11-07CIBT find the LAVA lab before calling relengLoys Ollivier1-19/+17
Add some logic to lava-labs-prepare: - Search for the machine in the list of labs - export the lab name if found Call releng with the corresponding lab name in run-test-short Send the job directly to the corresponding lab in lava-jobs-submit. Keep the 'checking for device' in this script as well, just to make sure the device is still available and can run the job. Otherwise the script could be blocked there if the device status changes. Change-Id: I50646b7fdb607cb9245a1d31e644eee45a2a2356 Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-11-07Lava jobs update raspberrypi3 device_type nameLoys Ollivier1-1/+2
For the raspberrypi3, update the device_type name to the LAVA names for the rpi3 32bit: - raspberrypi3-uboot - bcm2837-rpi-3-b-32b Change-Id: Icc654e47fd03b437165fb9c9aac5efdac490ef5c Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
2017-08-04jjb/common: LAVA submit: : support device-type alternate namesKevin Hilman1-3/+18
The LAVA device types used in AGL lab are different than the standard LAVA device-type names (which tend to follow naming conventions from the upstream linux kernel device-tree names.) This patch enables a way to have a table of alternate names, using the rpi3 as an example. Change-Id: Ic52d124047ef1c831c992c5671b1ad4b7d5f51ab Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2017-07-23ci-platform-jjb: try LAVA job in multiple labsKevin Hilman1-0/+99
Currently, LAVA jobs are only submitted to a single lab. This patch adds the ability look for a matching device-type in a list of available labs, and submit the job to the first lab with an available device type. To accomplish this, the job submission part is removed from run-test-short.sh, which now only generates the LAVA YAML job. A new lava-jobs-submit.sh script is added which looks for an available device-type in a list of LAVA labs, and submits the job there. NOTES: - run-test-short.sh should probably be renamed, but was left for now to limit the diff Change-Id: I95086d89a95f39e2b59fec8a8afada70806c52e5 Signed-off-by: Kevin Hilman <khilman@baylibre.com>