aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2024-02-13Add gitreview file for Quirky Quillback branchquillbackJan-Simon Moeller1-1/+1
Update the .gitreview file. Bug-AGL: SPEC-5071 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: Ic24eebf909db9cac3c2152d84f7b33410ec5135d
2021-12-14Update pyagl documents and correct spellingneedlefish_13.93.0needlefish/13.93.0marlin_12.93.0marlin/12.93.013.93.012.93.0Wang Qi1-2/+2
Bug-AGL: SPEC-4167 Signed-off-by: wangqi <wangq.fnst@cn.fujitsu.com> Change-Id: I25483202be34aa9ded7f0d85e5f07a80b5a98044
2021-09-26Add testcase of agl-service-telephonymarlin_12.91.0marlin_12.90.1marlin/12.91.0marlin/12.90.112.91.012.90.1Wang Qi3-0/+200
Bug-AGL: SPEC-4062 Signed-off-by: wangqi <wangq.fnst@cn.fujitsu.com> Change-Id: I33202a87cc3f9f2a516c12145999ed7a3be06752
2021-09-15Add test cases of scan for agl-service-geofenceQiu Tingting3-0/+175
Bug-AGL: SPEC-4078 Signed-off-by: Qiu Tingting <qiutt@fujitsu.com> Change-Id: Ida7bb07ca142c2ac61cc2e2776e3126f91bc5e7b
2021-09-10Add testcase of agl-service-navigationWang Qi3-0/+126
Bug-AGL: SPEC-4068 Signed-off-by: Wang Qi <wangq.fnst@cn.fujitsu.com> Change-Id: I34f1730427b3823a69041a4298700221b2adbd70
2021-09-09Add test cases for agl-service-platform-infoQiu Tingting3-0/+145
Add test cases of get,subscribe,unsubscribe for agl-service-platform-info Bug-AGL: SPEC-4070 Signed-off-by: Qiu Tingting <qiutt@fujitsu.com> Change-Id: I14cbf06374aa1743520198c735573905139b5710
2021-04-03Add testcase of agl-service-mediaplayerwangqi2-0/+71
Bug-AGL: SPEC-4042 Signed-off-by: wangqi <wangq.fnst@cn.fujitsu.com> Change-Id: I1a4f10a24fee0fc3d7d2e221c4a64c9bbe21c08e
2021-08-31Delete redundant mark for each test cases in audiomixerQiu Tingting1-8/+0
Because there is a definition of pytest.mark.audiomixer at the top, this mark is not needed for each test case. Bug-AGL: SPEC-4061 Signed-off-by: Qiu Tingting <qiutt@fujitsu.com> Change-Id: I362f6c64ca9c13505ccb365d2e4a228f8821bfee
2021-08-23Add testcases to agl-service-homescreen module.du erpei2-5/+60
Bug-AGL: SPEC-4055 Signed-off-by: du erpei <duep.fnst@fujitsu.com> Change-Id: I6404c54260aec058de4f37370b1a160e1861a09e
2021-08-20Add testcase of get api to hvac service module.du erpei1-0/+32
Bug-AGL: SPEC-4043 Signed-off-by: du erpei <duep.fnst@fujitsu.com> Change-Id: I1fd89f020d6f9456a70b676428f40ef4764478d7
2021-08-20Adding agl-service-audiomixer tests for un/subscription.wangqi2-2/+20
Bug-AGL: SPEC-4053 Signed-off-by: wangqi <wangq.fnst@cn.fujitsu.com> Change-Id: If600c334666cad7e6a15fee88633185aca001d05
2021-08-20modifying agl-service-nfc tests for un/subscription.wangqi2-6/+8
Bug-AGL: SPEC-4054 Signed-off-by: wangqi <wangq.fnst@cn.fujitsu.com> Change-Id: I65633edb07cc55a32e29c701a20db2db69155f99
2021-08-19Add testcase of get_extra_info and kill_process api to taskmanager service ↵Qiu Tingting2-0/+44
module. Bug-AGL: SPEC-3946 Signed-off-by: Qiu Tingting <qiutt@fujitsu.com> Change-Id: Id9cb3e3df6f6c13c95acfa0875f708ed98fb29f6
2021-07-07Add CLI functionality for radioQiu Tingting1-6/+59
Bug-AGL: SPEC-3946 Signed-off-by: Qiu Tingting <qiutt@fujitsu.com> Change-Id: I48a042f65a8274f069e8ee01dc8a06f7487c5777
2021-06-11Adding CLI functionality for bluetoothmarlin_12.90.0marlin/12.90.0lamprey_11.92.0lamprey/11.92.012.90.011.92.0shi ce1-6/+67
Bug-AGL: SPEC-3946 Signed-off-by: shi ce <shic.fnst@fujitsu.com> Change-Id: I5d8fac98bd2b1024da774e7108586083b207864e
2021-06-08resolve the test api for audiomixer service moduleliuyahui1-1/+1
Bug-AGL: SPEC-3974 Signed-off-by: liuyahui <liuyh.fnst@fujitsu.com> Change-Id: I74393366c2136304d61b32f802c6a02243d49f30
2021-06-04Add main function to taskmanager service moduleliuyahui3-0/+102
and add pytest python script to taskmanager service module Bug-AGL: SPEC-3946 Signed-off-by: liuyahui <liuyh.fnst@fujitsu.com> Change-Id: I403c7004d87bc4f3171363a678a8d50a5fa50aca
2021-06-04fix print statement in mediascanner unsubscribeEdi Feschiyan1-1/+1
single line touch-up for print statement in main() unsubscribe Bug-AGL: SPEC-3946 Signed-off-by: Edi Feschiyan <edi.feschiyan@konsulko.com> Change-Id: I2834c76b1f510b17c6bcd7221861e56ec5f51903
2021-06-03resolve unsubscribe api bug of the mediascanner service module from pyaglliuyahui1-2/+2
Bug-AGL: SPEC-3946 Signed-off-by: liuyahui <liuyh.fnst@fujitsu.com> Change-Id: Ia67a2cba88ce724fc02880b7506c7e7955487508
2021-06-02Add main function to network service moduleliuyahui1-0/+26
Bug-AGL: SPEC-3946 Signed-off-by: liuyahui <liuyh.fnst@fujitsu.com> Change-Id: I0abd85dee152817974ca5e77b074d471037a8cf3
2021-06-02add functionality to can serviceshi ce1-0/+6
Bug-AGL: SPEC-3946 Signed-off-by: shi ce <shic.fnst@fujitsu.com> Change-Id: I8a10a53ea826973a982f35443134d623af92643a
2021-06-02update bluetooth_pbap binding and testsshi ce2-7/+20
Add the search interface tests and modified the 'super().subscribe' to 'super().unsubscribe'. in addition, fix the import_contacts interface tests failed when run by pytest test_bluetooth_pbap.py Bug-AGL: SPEC-3919 Signed-off-by: shi ce <shic.fnst@fujitsu.com> Change-Id: I2d658b90820d9d5bcf6f222633804aa801910f37
2021-05-05Update audiomixer binding default controllamprey_11.91.0lamprey/11.91.0Edi Feschiyan1-3/+3
The latest uprev to pipewire changes the default control name from "Master" to "Playback Master". This change fixes that so CI and tests pass. Bug-AGL: SPEC-3907 Signed-off-by: Edi Feschiyan <edi.feschiyan@konsulko.com> Change-Id: If6c0a482a4c6fd7f64f1c7a8bb3f70fddd9a5332
2021-01-13Support specifying CAN interface for testskoi_10.93.0koi_10.92.0koi/10.93.0koi/10.92.010.93.010.92.0Scott Murray2-0/+6
Add AGL_CAN_INTERFACE environment variable hook to allow specifying the CAN interface to be used in the CAN tests. This is required when using an interface other than the default of "can0", since the specific interface is needed for playback of CAN data to test binding behavior. The switch in AGL CI to using vcan0 on all test boards will require this hook. Bug-AGL: SPEC-3756 Signed-off-by: Scott Murray <scott.murray@konsulko.com> Change-Id: If84731ae39fd65f8fa88d24ddc0370da63ca5489
2021-01-11Mark CAN J1939 tests as xfail for nowScott Murray1-0/+17
Since CI builds of the CAN binding widget are done standalone with the SDK, J1939 support ends up not being enabled, and the associated tests fail when run by CIAT for builds of agl-service-can-low-level repo changes. For now, mark the tests as xfail to avoid blocking CIAT. This should be reverted once the issue is resolved, e.g. by enabling J1939 support by default (see SPEC-3766). Bug-AGL: SPEC-3765 Signed-off-by: Scott Murray <scott.murray@konsulko.com> Change-Id: I74eca93cf746aba2dddfa87bd2b8546714d5e0c0
2020-12-03Add HVAC bindings and testskoi_10.91.0koi/10.91.010.91.0Edi Feschiyan2-0/+176
The current implementation of agl-service-hvac does not have test widgets implemented as reference point so these tests are new. Writing to verbs related to changing LED brightness results in I2C errors and therefore the tests are marked as hwrequired and xfail, as no hardware demo units are available to test with. The markers will stay until it is decided whether it is enough for testing or mock tests should be implemented. Bug-AGL: SPEC-3660 Signed-off-by: Edi Feschiyan <edi.feschiyan@konsulko.com> Change-Id: Ibc051c6b4a06e0d126be9f8a0e0efe5876244671
2020-11-11Add marks for Internet requiring testsScott Murray3-0/+7
Add "internet" mark to geoclue and weather binding tests to allow skipping them with the pytest keyword option. Bug-AGL: SPEC-3685 Signed-off-by: Scott Murray <scott.murray@konsulko.com> Change-Id: I330666ff57f044f04f42d1e89d0768e1a61406ae
2020-11-11Add simple wrapper scriptScott Murray1-0/+3
Add simple "pyagl" script that wraps running pytest. Bug-AGL: SPEC-3684 Signed-off-by: Scott Murray <scott.murray@konsulko.com> Change-Id: Ibdd71359fbdd82f10a277903a86bca5f92d8d9be
2020-11-10Add CAN value testsEdi Feschiyan1-0/+89
Porting CAN value tests from lua test widgets to complete the CAN testing suite. Bug-AGL: SPEC-3660 Signed-off-by: Edi Feschiyan <edi.feschiyan@konsulko.com> Change-Id: I1f977e00fd69c3dac5a34746e514c262647461f5
2020-10-19Allow pyagl CAN test test_write_wo_auth to xfailJan-Simon Moeller1-1/+1
Until the root cause can be traced down, xfail the write_wo_auth test. Reason: we do execute pyagl multiple times and this will always fail on the 2nd invocation. This is a bug in the appfw and is tracked in Bug-AGL: SPEC-3648 Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org> Change-Id: I9d5e6058c8ab9dd2efec461c551c884230d1bb4b
2020-10-06Add radio binding testsScott Murray3-2/+741
Initial implementation of a radio binding wrapper and associated tests. There are some known test limitations with respect to scanning and RDS, and while assumptions about hardware behavior have been avoided so that the tests should work on both the null and hardware backend implementations, it is possible that something has been missed, as testing has been with the null implementation. See the comment header in test_radio.py for more information. Additionally, the trimming of pytest parameters from test names for LAVA's TEST_CASE_ID value has been removed, as the new radio tests do use parameterization to run multiple instances of the same test. It is currently believed that LAVA will be okay with the brace characters in the parameterized names, this will need to be verified. Note that the invalid frequency offset test passing is dependent on a fix to the radio binding behavior with respect to error replies that will be submitted separately. Bug-AGL: SPEC-3585 Signed-off-by: Scott Murray <scott.murray@konsulko.com> Change-Id: I001b046c705b9e18cd317b5ac26ef2b7d2cb722e
2020-10-01Fix CAN test data installationScott Murray1-1/+2
Update MANIFEST.in so the new CAN test data does actually get installed, not quite sure how it looked like it was working in my testing. Bug-AGL: SPEC-3585 Signed-off-by: Scott Murray <scott.murray@konsulko.com> Change-Id: I6ae35e5b5d57b6324bff0a9c5952556b7ffc9a94
2020-09-30Skip signal composer tests by defaultScott Murray2-3/+13
Fix signal composer test markings (there were accidentally marked as can_low_level), and add logic to skip them by default for now due to SPEC-3615. They can be enabled by passing --run-signal-composer to pytest. Once SPEC-3615 is resolved, this can be removed or the default changed to not skipping. Bug-AGL: SPEC-3585 Signed-off-by: Scott Murray <scott.murray@konsulko.com> Change-Id: Ie64d2868d90bdd242b762c7ad35cac1be11677e6
2020-09-30CAN test rework to improve robustnessScott Murray14-106/+1471
Changes: - Rework CAN test CAN data playing with canplayer to fix racing against listening for the binding events the data will result in. The previous use of a fixture to drive canplayer has been replaced with a small wrapper class that is inline in the test code to ensure the correct order of operations. - Copy required CAN test CAN data files used in the afb-test widget into pyagl/tests/data/can to remove dependency on test widget presence and contents. The previous prepare_replay_files fixture has been changed into a per-test fixture that scp's the file into /tmp on the target if running remotely. When running on target, they are used directly out of the pyagl install. - Improve test_Filter_Test_01_Step_2 using the updated canreplay file copied from agl-service-can-low-level, there are now several messages that test the filter range. - Add a tweak to cut the fixture parameter(s) off the test names when generating LAVA output. - Reordered test_auth to be after the write without authorization test to avoid spurious failures. Also removed the duplicate test in the J1939 tests and replaced it with an appropriate dependency. - Replace xfail marks on J1939 tests with logic to detect J1939 kernel support and mark them dynamically. - Add missing can_j1939 marking to the test test_low_can_subscribe_j1939_event. - Use known_hosts=None in asyncssh.connect calls to ensure remote testing is not affected by local SSH known_hosts configuration. - Tweak - Update some comment formatting to improve readability. - Simplify logic a bit in AGLBaseService.listener function. Bug-AGL: SPEC-3585 Signed-off-by: Scott Murray <scott.murray@konsulko.com> Change-Id: I4ef660c175468ef57873c03a33cb5ec7e6f16568
2020-09-30Remove "regular" test markingScott Murray15-108/+13
Remove the "regular" test marking to simplify things. At the moment it provides no real separation from the set of tests proscribed by "not hwrequired", and things like J1939 need to be dynamically skipped based on platform support instead of requiring manual mark specification. Bug-AGL: SPEC-3585 Signed-off-by: Scott Murray <scott.murray@konsulko.com> Change-Id: Ic21cb84c499af9b63c83d145f3ffefaae4fda357
2020-09-23Add CANService testsEdi Feschiyan4-9/+491
Porting most of the lua tests for agl-service-can-low to pyagl Handle None in AGLBaseService.afbresponse() and AFBResponse class for timeouts Add new can_j1939 marker for J1939 CAN tests, also xfail marked until a way to determine if J1939 kernel support is available signal-composer verb queries tend to crash/choke after service startup right after boot, but when the service is restarted, tests run fine - so adding a timeout handling on verb queries in tests Bug-AGL: SPEC-3585 Signed-off-by: Edi Feschiyan <edi.feschiyan@konsulko.com> Change-Id: Ib1fc259f2b28fb11c5f89b61df0b066d2c02045e
2020-09-23Add timeout ability to AGLBaseService.listener()Edi Feschiyan1-6/+17
When doing subscription and event testing, there are cases which need to test lack of emitted events, changing the .listener() async generator to be able to return None. Set to None by default which would use self.timeout Adding extra data on ERROR response from afb if it is available Changing AFBResponse to raise TypeError instead return Bug-AGL: SPEC-3585 Signed-off-by: Edi Feschiyan <edi.feschiyan@konsulko.com> Change-Id: I09a62c559a1e8ca4bebe6f696167ca61ffb82b59
2020-09-17Fix signalcomposer testEdi Feschiyan1-1/+15
Add a test to test all available signals reported by list verb Bug-AGL: SPEC-3585 Signed-off-by: Edi Feschiyan <edi.feschiyan@konsulko.com> Change-Id: I73f4cb75ef24b38948756b2c81bc4e3552d7eb3c
2020-09-17Override un/subscribe methods in CANServiceEdi Feschiyan1-0/+5
All agl-services use 'value' keyword in JSON request for subscription which is set as the default behavior for base.py, however agl-service-can-low uses 'event'. Bug-AGL: SPEC-3585 Signed-off-by: Edi Feschiyan <edi.feschiyan@konsulko.com> Change-Id: Id93cf1bfdbb5c60614e3e5eca3814d5d16b907a9
2020-09-17Fix AGLBaseService.afbresponse() for EVENT dataEdi Feschiyan1-1/+1
afbresponse() in base.py does wrong assignment at the end which effectively makes it work only for responses and discards EVENT data because there is no 'response' key in the json emitted for the event Bug-AGL: SPEC-3585 Signed-off-by: Edi Feschiyan <edi.feschiyan@konsulko.com> Change-Id: I69b15127ca386148687d83b3a231c3aa53e789b7
2020-09-16Update tox.ini and requirements.txtEdi Feschiyan2-2/+3
Update requirements.txt to match AsyncSSH with newer 2.3.0 version Update tox.ini with proper path to run in CI and set AGL_AVAILABLE_INTERFACES to "ethernet" by default Bug-AGL: SPEC-3583 Signed-off-by: Edi Feschiyan <edi.feschiyan@konsulko.com> Change-Id: If5f000b2dd17354cb97aeddd882bf7978b3ddb97
2020-09-10Remove hwrequired marking of audiomixer testsjellyfish_9.99.4jellyfish/9.99.49.99.4Scott Murray1-6/+0
Since CI runs qemu with a soundcard enabled, and it is easy to do so with runqemu with the "audio" option, remove the "hwrequired" markers on the audiomixer tests that have them. Bug-AGL: SPEC-3572 Signed-off-by: Scott Murray <scott.murray@konsulko.com> Change-Id: I290845e802168116f4769dd011c84875d2e4b5ac
2020-09-10Improve LAVA outputScott Murray2-14/+110
Changes: - Disable progress and verbose output when in LAVA output mode to clean up output. - Disable color output in LAVA output mode. - Removed STARTTC and ENDTC lines for passed/skipped tests to reduce output volume, they are still printed around the output of failed tests. - Tweaked error output in LAVA output mode so it will be usefully parsed out by LAVA and show up in results. - Fixed skipped test output in LAVA output mode, the logic needed tweaking to get a TESTCASE line output for them. Also, tweaked the LAVA result to 'skip' instead of 'pass' for skipped tests, as LAVA understands 'skip'. - By request, add 0.25 second delay after each test in LAVA output mode to slow down serial output. - Updated documentation to add some invocation examples. Bug-AGL: SPEC-3572 Signed-off-by: Scott Murray <scott.murray@konsulko.com> Change-Id: I2e2b213dba2a9751210512d698afb67f7543cbe1
2020-09-02Add .gitreviewScott Murray1-0/+5
Add .gitreview file for AGL Gerrit usage. Signed-off-by: Scott Murray <scott.murray@konsulko.com>
2020-09-02Merge branch 'smurray/fixes' into 'master'Edi Feschiyan13-22/+29
Updates to prepare for AGL CI use See merge request konsulko/internal/pyagl!2
2020-09-01Add timeout for binding responsesScott Murray2-1/+8
To ensure automated use of the tests cannot get hung, add a timeout on waiting for binding responses. The default value is 5 seconds, it may be over-riden by setting the AGL_TEST_TIMEOUT environment variable. Signed-off-by: Scott Murray <scott.murray@konsulko.com>
2020-09-01audiomixer and mediascanner bindings do not need to be startedScott Murray4-5/+6
The changes in AGL for SPECs 3557 and 3558 mean that the audiomixer and mediascanner bindings do not need to be started before running tests, disable doing so. Signed-off-by: Scott Murray <scott.murray@konsulko.com>
2020-09-01Rework per-binding test markingScott Murray6-9/+10
Rework the test marking to allow deriving the test mark name for a given binding from the binding name, i.e. agl-service-X. Due to dashes not being valid in pytest marks, underscores have been used instead, i.e. agl-service-can-low-level -> can_low_level. The intent is to allow CI tooling to easily work up a pytest -k option to run the tests for a specific binding. Signed-off-by: Scott Murray <scott.murray@konsulko.com>
2020-09-01Assume network connectivityScott Murray2-7/+5
Revert the xfail changes to the geoclue and weather tests, as it's been clarified that network connectivity is assumed present in AGL CI. Signed-off-by: Scott Murray <scott.murray@konsulko.com>
2020-09-01Adding author to license heading in filesEdi Feschiyan33-30/+103