summaryrefslogtreecommitdiffstats
path: root/common
AgeCommit message (Collapse)AuthorFilesLines
2020-07-03SPEC-3427: check if RID is nullCorentin LABBE1-1/+33
RID could be null if process failed to start. In that case, we will retry to start it. On a second fail, we will not continue the test suite and fail. In th same time add a second status check, but after a delay to be sure the service is still working. Bug-AGL: SPEC-3427 Change-Id: I566f1aefa06cbb791674373340ce87be220b18a2 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2020-06-01Make the script runnable locally and adapt ps calljellyfish_9.99.1jellyfish/9.99.19.99.1Jan-Simon Moeller1-16/+23
The script can be run for testing locally now and afm-util ps needs to start as the target user. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ief0f785a46439531d4257c2eef9ced15be1b20fb
2020-05-28Remove versioning of wgts from testJan-Simon Möller1-2/+2
This was removed thus there is no '@?.?' . Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-12-21Disable the can module unload/load testicefish_8.99.5icefish/8.99.58.99.5Jan-Simon Möller1-1/+1
And also fix a logic bug in the test_can_modules. The test can stay disabled. There is no need to unload the modules. Bug-AGL: SPEC-3070 . Change-Id: Ic94d5bb9cad3d6cdcbc6534cfc4003213ad82aaa Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-12-20SPEC-3064: handle removal of can_bcmicefish_8.99.4icefish/8.99.48.99.4Corentin LABBE1-0/+12
The test removing can module fail on DRA7 due to can_bcm using it. This patchs handle this case. Bug-AGL: SPEC-3064 Change-Id: I272e0ea62786fb43c4ea68601f2fb12864a279b6 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-12-10Merge "Skip the can test"icefish_8.99.3icefish/8.99.38.99.3Jan-Simon Moeller1-1/+1
2019-12-10SPEC-2970: Do not fail ofone and bluetooth services if bluetooth tag is non ↵Corentin LABBE2-0/+20
present When no bluetooth dongle is present, there is a timing issue which let the service fail. So if no bluetooth tag is present, skip the service test instead of failling. Bug-AGL: SPEC-2907 Change-Id: I10755ec698ab632ffcf0eec18ebe6bc41b1b5ec1 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-12-09Skip the can testKhouloud Touil1-1/+1
As the behaviour of the test not determined, to avoid the fail of the test, we will skip it if the value of no_transmission not found. AGL-bug: SPEC-3025 Change-Id: If24e512f2cc83ee7018a4309cb64434cf3a2b938 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-11-28Also call kill in the right contextJan-Simon Moeller1-1/+1
depending on the app. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I7208497e81fb3fcb2636bf7559b27ff2b5ce7676
2019-11-28Call info ps and status in the context of the app userJan-Simon Moeller1-4/+4
We need to call the info and status call under the context of user under which the app runs. Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I25abff89db22c5effb6addfbc59ec30575aae2ed
2019-11-28Merge "SPEC-2996: handle rcar_can"Jan-Simon Moeller1-1/+13
2019-11-28SPEC-2996: handle rcar_canCorentin LABBE1-1/+13
The test remove can_dv module fail on H3 due to rcar_can using it. This patchs handle this case. Change-Id: I452a61813567ad09f3f819ce73c1c11753326514 Bug-AGL: SPEC-2996 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-28SPEC-2996: Fix ip checkCorentin LABBE2-4/+5
BusyBox ip print its version stderr, so we need to redirect it to stdin. Furthermore, using set -x reset the error code, we need to store it before. Bug-AGL: SPEC-2996 Change-Id: I4b80475b0f9291fc55e661362a981ac14dbdb9b0 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-27SPEC-2996: rework the CAN modules testsCorentin LABBE1-89/+55
The CAN modules tests have lots of redundant code, let's add some function for probing/removing modules. Furthermore, some tests cannot work with busybox ip, I adds some tests for it. When reworking the tests, I have removed the "lsmod |grep can" tests which was of no value. I have also removed all sleep which was undocumented(probably for some log flushing), if something need them I will re-add it with comment. Bug-AGL: SPEC-2996 Change-Id: I2e8a109d799c58726d848814fd4c21a9fbd2eef5 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-26Verbose outputJan-Simon Möller1-2/+3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2019-11-26Merge "test_can_loopback_mode: Add ip util version check"Jan-Simon Moeller1-1/+13
2019-11-26test_can_loopback_mode: Add ip util version checkCorentin LABBE1-1/+13
CAN tests fail on M3 and H3 because their build includes busybox version of ip (and not iproute one). This patchs adds a test for detecting if the right ip util is installed. Change-Id: I5909bc0af23271626dec9c1ed7003bdfc9129041 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-26SPEC-2970: Improove logging sizeCorentin LABBE3-0/+3
When TERM is dump, the width of logging is cropped at 80columns which made debugging harder. This patchs increase columns size to 1000. Bug-AGL: SPEC-2970 Change-Id: Ia70136b6aa6242362b1286631ae4b00ab567ae2e Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-11-07Cynagora: Replace cynara with cynagoraicefish_8.99.1icefish/8.99.18.99.1Jose Bollo3-5/+5
Currently we disable ptests/socket tests to be enabled in SPEC-2940 and SPEC-2941. Shift from the permission database cynara to cynagora permission database with a compatibility library. Bug-AGL: SPEC-2844 Bug-AGL: SPEC-2941 Signed-off-by: Jose Bollo <jose.bollo@iot.bzh> Change-Id: I673e47ae237a83926f15d003dd2d2623a08eefb5
2019-10-23remove debuging information of do_afm_utilCorentin LABBE1-2/+0
This printing breaks 'rid' parsing, remove it. Bug-AGL: SPEC-2903 Bug-AGL: SPEC-2925 Change-Id: I505ab9d2994f983de53849fce25d87c8af44362d Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-10-22SPEC-2903: fix the grep test methodCorentin LABBE1-2/+6
While inspecting if application test is working with our latest SPEC-2903 changes I see in job 8845 the following errors: + grep urn:AGL:widget:provided-api config.xml + '<feature' 'name=\"urn:AGL:widget:provided-api\">' ./common/scripts/application-lifecycle.sh: line 74: <feature: command not found So let's change the grep method. Furthermore, add a debug for the do_afm_util for being sure it work as needed. Bug-AGL: SPEC-2903 Change-Id: I5a8a6d98cd9dc6c1b2d1626fc6841eb2c2b16d53 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-10-21SPEC-2903: Use a wrapper instead of constructing a commandCorentin LABBE1-23/+19
This patch change the way we ran afm-util commands by using a simple wrapper. Furthermore, since we are in a loop, let's reset all variable (SERVICE_PLATFORM/etc..) to 0 at the beginning of the loop. Extra-furthermore: restore the unzip error code test, but in non-fatal way, since busybox unzip seems to dont like our CRC. Bug-AGL: SPEC-2903 Change-Id: I5d7357fd74307ed69a6675beac57d8601fdcdb52 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-10-19Improve lifecycle testJan-Simon Moeller1-7/+9
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I9076278096e15829b4bca52f6b5ef9e9a3b39e9e
2019-10-17Merge "Differ platform and user scope in service and application"Jan-Simon Moeller1-2/+38
2019-10-17Differ platform and user scope in service and applicationJan-Simon Moeller1-2/+38
When executing the lifecycle test, we need to take into account if the service or app runs in platform or user scope. Bug-AGL: SPEC-2903 . Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I49a53a5a2b14666757b65b0f8203eb73ed2c7b45
2019-10-15Inverse the fail/pass logicKhouloud Touil1-2/+2
This test should be failing, so it should be set to pass when it fails, and should be set to fail when it passes. AGL-bug: SPEC-2878 Change-Id: I43921717eea77d654921eca4691c936bb2901e54 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-10-15qa-testdefinitions: Split can tests to avoid failuresKhouloud Touil1-19/+0
Split the can tests in two, one for basic tests that doesn't need the two can interfaces to be related, and the other one is for a board with two related interfaces. Modify the test_can_modules to be run on a board with only one can if at least. AGL-bug: SPEC-2878 Change-Id: I6f761458c3e191aa8000d19cb05b0592566cb6c9 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-10-03Avoid some test cases failuresKhouloud Touil3-0/+15
To make sure that the can interface could be configured, we have to make it dowm each time before the start of the config step. Change-Id: I7bebea65072ffd822ee30241c68a0a89123b1576 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-09-06Use the new arg --build-tags and the arg --device-tagsKhouloud Touil1-6/+28
Use the new arg --build-tags along with the arg --device-tags to decide the tests to be run and the tests to be skiped. The test to be tested in this patch is for the weston service. Bug-AGL: SPEC-2721 Change-Id: Ia34680c5e60e27dfe286626fedc5775efff87ba3 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-03-27Merge "Add application-lifecycle test"halibut_8.0.6halibut_8.0.5halibut_8.0.4halibut_8.0.3halibut_8.0.2halibut_8.0.1halibut_8.0.0halibut_7.99.3halibut_7.99.2halibut_7.99.1halibut/8.0.6halibut/8.0.5halibut/8.0.4halibut/8.0.3halibut/8.0.2halibut/8.0.1halibut/8.0.0halibut/7.99.3halibut/7.99.2halibut/7.99.18.0.68.0.58.0.48.0.38.0.28.0.18.0.07.99.37.99.27.99.1halibutJan-Simon Moeller1-0/+211
2019-03-26Add application-lifecycle testCorentin LABBE1-0/+211
This patch adds basic Application Lifecycle Workflow Test (fetch, uninstall, install, start) Bug-AGL: SPEC-1850 Change-Id: Ie65648e043b7909aecb2fe64dfbf2b2bba8f1f37 Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
2019-03-14Fix the nomenclatur of LAVA test casesKhouloud Touil1-20/+20
This patch fixes the problem of the naming issue. Test cases that have the same name will end up overwriting previous test cases when storing the results in the data base. So this patch is to changes the test cases names and to be more understandable. Change-Id: Iab3aaf62aefb120b7a04d21bd83aabf7034e72f4 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-03-14Fix: delete the temporary fileKhouloud Touil1-0/+1
Before breaking the loop, the temporary file should be deleted. Change-Id: I3d2abb49b78cdf08e77ce4007d24e40dd4a93ea5 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-03-14Fix the for loopKhouloud Touil1-1/+1
To avoid looping several times through the same test case the 'break' should be moved to the right position. Change-Id: I8a4d5e73b1f2ef39f8593209b928323a1770dedf Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2019-03-14test_can_bitrate: fix indentationKhouloud Touil1-22/+22
This patch fixes indentation in the 'test_can_bitrate.sh' file. Change-Id: I1968e9e7e39429e3900b845c1f72ff393f741d16 Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
2018-11-26ptest wrapper: disable smackhalibut_7.90.0halibut/7.90.0guppy_6.99.4guppy_6.99.3guppy_6.99.2guppy/6.99.4guppy/6.99.3guppy/6.99.27.90.06.99.46.99.36.99.2Kevin Hilman1-1/+1
All the smack ptest does is generate a bunch of random files, which fills up the filesystem and then fails. Disable it. Change-Id: I859f683105ee89b1d5082e7477f76f127c99da67 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-11-26ptest wrapper: add ptest-installed PASSKevin Hilman2-0/+3
Add a "ptest-installed" test-case in the successful case also, so that there is always "ptest-installed" test case when ptests are attempted. Change-Id: I277ad66bf51a8b7e65fdea4cf77b6e1d862811c0 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-11-26ptest wrapper: use new LAVA modeKevin Hilman2-44/+3
ptest-runner now has a new LAVA mode (enabled with -L) that will automatically output the LAVA_SIGNAL messages needed for LAVA to automatically parse/collect test results. Re-work this wrapper script to that it just uses the new LAVA mode. Change-Id: I310f1188f65de5f86e8179c12aedce6a92932e9a Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-11-16Tune down on selection of ptests and ramp-up one-by-oneguppy_6.99.1guppy/6.99.16.99.1Jan-Simon Möller1-3/+6
E.g. the systemd ptest will break network which is bad in a network env. So start with less and add more after checking manually. Change-Id: Iff199dfb6e42475495e036330b0962739e2f74f4 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-10-08Merge "yocto-ptest: fix ptest-runner failure case"Jan-Simon Moeller1-1/+1
2018-10-06yocto-ptest: fix ptest-runner failure caseKevin Hilman1-1/+1
lava-test-case only takes one argument for TEST_CASE_ID Change-Id: Ic6e2f93a4f8829c8307528661fd3f9f6db4b6d88 Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-10-06yocto-ptest: fix bash syntax errorKevin Hilman2-2/+2
Change-Id: I7bacce4d52f2ab15c2b855ca853e5b64e13c887d Signed-off-by: Kevin Hilman <khilman@baylibre.com>
2018-10-02Fix typo in wrapperJan-Simon Möller1-1/+3
Change-Id: I89c02dcdc2bb283cf83442daf0bd78edd208ff42 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-10-02Add the long ptest job and enhance the short jobJan-Simon Möller2-2/+40
Change-Id: I42dd644656a47fd9ba3b35a25e848535f61ca0a9 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-10-01Add test to dump the systemd journalJan-Simon Möller1-0/+24
Change-Id: I2ad02f6828e165a898fb4a739ab3c893267d4c53 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-10-01Add job to delay shutdown for manual inspectionJan-Simon Möller3-0/+50
Change-Id: Ib7e3495a03256e6dcaafda529db99bad805ace03 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-09-28Update units to test with ptestJan-Simon Möller1-1/+1
Change-Id: Iaae973d8240d8754eac2c49010728c42157674b3 Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-09-26Remove deprecated service checkJan-Simon Möller1-2/+2
homescreen.service is no longer supported. Change-Id: Icc0595e9aac9522e0b55fb9e524066187cd0efeb Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
2018-07-16Fix the CAN bus testsguppy_6.90.0guppy/6.90.0flounder_5.99.6flounder_5.99.5flounder_5.99.4flounder_5.99.3flounder_5.99.2flounder/5.99.6flounder/5.99.5flounder/5.99.4flounder/5.99.3flounder/5.99.26.90.05.99.65.99.55.99.45.99.35.99.2khouloud touil4-49/+48
At first to be able to configure the can interfaces, we had to use the libsocketcan, but this lib should be used with canutils utilities, but a conflict happened between the canutils and the can-utils, so I had to fix the tests to be able to use only the can-utils utilities. This link for a LAVA test job for these tests: http://lava.baylibre.com:10080/scheduler/job/10883 Change-Id: I7b988496d6977d6d9d82f8f82b58520444dbc7d6 Signed-off-by: khouloud touil <ktouil@baylibre.com>
2018-07-02CAN bus testskhouloud touil5-0/+501
This commit for testing CAN modules, sending and receiving frames, showing stats and and testing suitable bitrates for transmission. The "test_can_loopback_mode" test can be run on a board with one interface. This test will fail gracfully if the board dosen't have any CAN interface. The other tests needs to be run on a board with two CAN interfaces (e.g. dra7 with external transceiver.) These tests requires two interfaces on the same board to send frames with the first interface and to receive them with the other one These tests will fail gracfully by skiping all test cases if the board doesn't have two interfaces. This link for the DRA7xx-EVM job : http://lava.baylibre.com:10080/scheduler/job/2860 This link for the AM335X-BONEBLACK (no CAN interface) : http://lava.baylibre.com:10080/scheduler/job/2862 Change-Id: I7d4c69f7817adbea8281d264cbbb7fa55571584e Signed-off-by: khouloud touil <ktouil@baylibre.com>