Mirrors/esp-idf
1
0
Fork 0
mirror of https://github.com/espressif/esp-idf.git synced 2026-10-02 11:10:54 +03:00
Code Issues Packages Projects Releases Wiki Activity
49,047 Commits 25 Branches 192 Tags
6bf4f440e6331d2ab51928126ecdf43fc81b1fb1
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
He Yin Ling e5548b12e0 CI: add esp32s3 SSC build jobs 2021-10-21 11:23:24 +08:00
He Yin Ling 2849f3bf44 Merge branch 'test/add_ethernet_iperf_example_test_case' into 'master' 
Test: add ethernet iperf example test case

Closes TCI-463

See merge request espressif/esp-idf!13696
 2021-07-28 01:39:12 +00:00
He Yin Ling 35f8caf1cb Merge branch 'bugfix/ttfw_fix_flush_index_error' into 'master' 
test: TTFW fix flush index error

See merge request espressif/esp-idf!14217
 2021-07-22 12:55:27 +00:00
He Yin Ling fe6133cfc7 Merge branch 'ci/rename_test_log_path' into 'master' 
CI: rename log path of IT jobs

See merge request espressif/esp-idf!14451
 2021-07-22 12:37:45 +00:00
He Yin Ling bf65e3c679 Merge branch 'test/update_ble_mesh_console_files' into 'master' 
test: fix ble mesh send problem

See merge request espressif/esp-idf!11053
 2021-07-21 07:51:44 +00:00
He Yin Ling 9f8f929e25 CI: rename log path of IT jobs 2021-07-21 10:02:52 +08:00
He Yin Ling 1708febe48 ttfw: fix incorrect length when flush data cache after expect: 
data cache is unicode. while we use bytes in RegEx expect. The index of
matched pattern is calculated with bytes, could be different from
unicode. Now we fix this issue by using unicode in expect.
 2021-07-13 13:07:08 +08:00
He Yin Ling b79778d273 ttfw: full_stdout should not return data after pattern in expect 2021-07-13 13:07:08 +08:00
He Yin Ling 0f2052ca36 Merge branch 'bugfix/ttfw_dut_check_function_called_after_case_finished' into 'master' 
ttfw: fix DUT check functions are called after case finished:

Closes IDFCI-672

See merge request espressif/esp-idf!13990
 2021-06-21 02:54:39 +00:00
He Yin Ling 31773b8ed2 ttfw: fix DUT check functions are called after case finished: 
DUT check functions are executed in receive thread. If we put data to
data cache before execute the check functions, the main thread could
handle the data cache first and mark test case finished. We will execute
check functions first to make sure it's executed before case finished.
 2021-06-18 09:58:19 +08:00
He Yin Ling 97a09e51ce example: set example wifi scan method to all channel: 
in CI example test we could have runners with same SSID in the same lab.
Use scan on all channel will let DUT connect to the AP with best RSSI.
 2021-06-09 10:01:17 +08:00
He Yin Ling 0ea9ae2920 Merge branch 'ci/asio_example_test_connect_fail' into 'master' 
CI: fix connection failures in asio example tests

Closes IDFCI-509

See merge request espressif/esp-idf!13697
 2021-06-08 08:56:08 +00:00
He Yin Ling 1a9abeda6b example: set PMF capable to connect to PMF required APs 2021-06-03 20:03:59 +08:00
He Yin Ling 201018da43 Merge branch 'ci/shorter_performance_test_log' into 'master' 
ci: optimize performance test log

See merge request espressif/esp-idf!13607
 2021-05-21 06:48:16 +00:00
He Yin Ling 79cd45fdee Merge branch 'test/support_multiple_targets_for_iperf_example_test' into 'master' 
test: support multiple targets for iperf example test

Closes TCI-656

See merge request espressif/esp-idf!13527
 2021-05-21 06:43:21 +00:00
He Yin Ling b513834ee9 Merge branch 'ci/ttfw_fix_dut_exception_not_added_to_junit_report' into 'master' 
ttfw: fix DUT exception not added to junit report

Closes IDFCI-375

See merge request espressif/esp-idf!11927
 2021-05-21 02:43:29 +00:00
He Yin Ling 016a37c8ad ci: save built binaries could be tested locally: 
we have some test cases not executed in CI. we need to save those
binaries as artifacts so we can test locally.
 2021-05-20 16:58:39 +08:00
He Yin Ling 8cc4cd775e test: support multiple targets for iperf example test 2021-05-20 16:58:38 +08:00
He Yin Ling 8434c0c731 ttfw: fix DUT exception not added to junit report 2021-05-20 16:28:20 +08:00
He Yin Ling d1ab7fbd5a Merge branch 'bugfix/ttfw_idf_port_detecting_hang' into 'master' 
fix: running ttfw tests locally hang forever while detecting ports

See merge request espressif/esp-idf!13048
 2021-04-15 02:27:36 +00:00
He Yin Ling e165c950bc Merge branch 'ci/increase_job_count' into 'master' 
ci: increase target test job num

See merge request espressif/esp-idf!12294
 2021-02-05 17:05:08 +08:00
He Yin Ling 3a732f1e52 Merge branch 'ci/build_ssc_on_esp32c3' into 'master' 
CI: add build ESP32C3 SSC jobs

See merge request espressif/esp-idf!12000
 2021-01-21 13:34:16 +08:00
He Yin Ling b036f6c06d CI: add build ESP32C3 SSC jobs 2021-01-21 03:00:44 +00:00
He Yin Ling 5befaac4be ttfw: fix get dut failed when dut port is set as env variable 2021-01-14 17:22:11 +08:00
He Yin Ling 49322be893 Merge branch 'bugfix/update_iperf_example_test_case' into 'master' 
test: update iperf example test

Closes IDFCI-355

See merge request espressif/esp-idf!11245
 2021-01-08 11:35:38 +08:00
Yinling He d74eaadd56 test: add softap iperf test 2021-01-07 17:10:41 +08:00
He Yin Ling 97220af848 test: use pyecharts to replace matplotlib in iperf test 2021-01-07 17:10:41 +08:00
He Yin Ling 5197716d5d test: modify bad point check logic of Wi-Fi iperf test 2021-01-07 17:10:41 +08:00
He Yin Ling 4e82540730 ttfw: save console log to file 2021-01-07 17:10:40 +08:00
He Yin Ling 16a488c405 test: fix iperf example errors: 
1. fix TypeError when running with python3
2. fix throughput chart x/y axis label error
3. make test case compatibile with iperf bin on earlier release branches
 2021-01-07 17:10:40 +08:00
He Yin Ling faeaddbd22 Merge branch 'bugfix/ci_socket_tests' into 'master' 
ci: Made socket example tests more robust

Closes IDFCI-325

See merge request espressif/esp-idf!11733
 2020-12-30 09:52:25 +08:00
He Yin Ling a4fab9c67f test: fix some unit test results not uploaded to Jira: 
`UnitTestParser.py` will strip unit case config name when generate test
ID. But in `unit_test.py` we didn't do this. It makes the test ID in 2
stages are different. Now we will add this step to `unit_test.py`.
 2020-12-15 21:36:27 +00:00
He Yin Ling 6e545215c1 ci: enable ESP32S2 unit test by default 2020-11-30 11:34:51 +08:00
He Yin Ling a908174c06 test: remove fake binary size check in example test: 
the binary size check in example test was removed long time ago. Now we
have updated ttfw_idf to raise exception when performance standard is
not found. These fake performance check will be regarded as error.
Remove them now.
 2020-11-24 17:53:33 +08:00
He Yin Ling e568daf213 ttfw: fix idf performance check doesn't work 2020-11-12 09:49:44 +00:00
He Yin Ling d7b125a87b Merge branch 'bugfix/auto_test_script_only_use_given_branch' into 'master' 
CI: limit switching branches for auto_test_script

See merge request espressif/esp-idf!11052
 2020-11-03 17:42:28 +08:00
He Yin Ling 653fa702b4 Merge branch 'test/move_auto_test_script_to_new_repo' into 'master' 
ci: move auto_test_script to new repo

See merge request espressif/esp-idf!10471
 2020-10-24 09:21:18 +08:00
He Yin Ling 0f8d1cbf1b CI: get git describe from annotated tags: 
we should only parse IDF version from annotated tags
 2020-09-30 11:28:59 +08:00
He Yin Ling 685c3fc70c Merge branch 'test/merge_ble_mesh_node_and_provioner_in_console' into 'master' 
Test:merge ble mesh node and provioner in console

See merge request espressif/esp-idf!8897
 2020-08-21 11:01:37 +08:00
He Yin Ling f22862f28d Merge branch 'bugfix/remove_auto_conn_case' into 'master' 
test: remove auto conn case because we do not support this anymore

See merge request espressif/esp-idf!9938
 2020-08-17 09:01:40 +08:00
He Yin Ling 4c32c71db9 Merge branch 'feature/support_python3_autotest' into 'master' 
test: run IT jobs with python3

See merge request espressif/esp-idf!9673
 2020-07-23 16:07:43 +08:00
He Yin Ling fef621435d test: sync test app cases to Jira 2020-07-20 20:09:19 +08:00
He Yin Ling ff6ef11603 CI: do not run cases likely to fail 2020-07-19 06:32:12 +00:00
He Yin Ling cd478edeae CI: disable cases with test env SSC_T5_1 2020-07-19 06:32:12 +00:00
He Yin Ling 1378337c52 CI: temp allow mesh job to fail as runner is not stable 2020-07-19 06:32:12 +00:00
He Yin Ling b7ae8d0670 CI: remove incorrect MTU related cases 2020-07-19 06:32:12 +00:00
He Yin Ling 23801b3517 Merge branch 'bugfix/ci_debug_backend_import' into 'master' 
CI: Ignore error if py_debug_backend is not installed

See merge request espressif/esp-idf!9269
 2020-06-24 14:44:44 +08:00
He Yin Ling c2e068f0e4 Merge branch 'bugfix/ci_partition_table_detection' into 'master' 
CI: Fix partition table detection if "partition" is in the project name

See merge request espressif/esp-idf!8223
 2020-04-22 15:10:11 +08:00
He Yin Ling 650a51366e Merge branch 'bugfix/modify_ble_mesh_command' into 'master' 
ble mesh: update ble mesh console example

See merge request espressif/esp-idf!7927
 2020-03-22 18:34:40 +08:00
He Yin Ling 739affb5b0 ci: add find job id argument job status: 
if we retry failed job, we will have 2 jobs with same name in one pipeline. we need to use status to find the retried job instead of failed job.
 2020-01-22 10:04:54 +08:00
He Yin Ling 21a7580dc1 test: update SSC bin path of nvs compatible test 2020-01-10 14:14:51 +08:00
He Yin Ling bb442bd015 test: add build ssc job for esp32s2beta 2020-01-10 14:14:51 +08:00
He Yin Ling 269af21ce6 test: fix multiple devices cases fail on python3 2019-12-30 20:21:00 +08:00
He Yin Ling 07f186a6a5 CI: reduce number of unit test jobs 2019-12-30 20:21:00 +08:00
He Yin Ling f63e91b950 test: let unit test jobs use python3 2019-12-30 20:20:14 +08:00
He Yin Ling 8df08de486 ttfw: fix incorrect relative import for python3 2019-12-30 20:20:14 +08:00
He Yin Ling 486f1a05b3 test: fix incorrect error type in xunit result 2019-12-10 13:50:32 +08:00
He Yin Ling fe521c9d12 ci: fix fetch submodule error on python3 2019-12-10 09:38:31 +08:00
He Yin Ling ca0ce7171d CI: reduce number of test jobs 2019-12-08 20:32:11 +08:00
He Yin Ling 164e8ba21f test: support loadable elf test cases: 
loadable elf example is different for 2 reasons:

1. loadable elf binary don't have flasher_args.json, so we can't use normal
to get from CI artifacts
2. it don't have binary and don't need to downloaded binary to DUT. Some
related functions can be ignored
 2019-12-08 20:32:11 +08:00
He Yin Ling cca08b3d2b CI: remove not exist file from executable-list.txt 2019-12-08 20:32:10 +08:00
He Yin Ling a11b15b92b CI: build system do not check submodule for CI 2019-12-08 20:32:10 +08:00
He Yin Ling b4863551a9 CI: modify fetch submodule method: 
download archive for submodules instead of clone
 2019-12-08 20:32:10 +08:00
He Yin Ling 5d1be3bb8b CI: raise import error instead of exit for ble tools 2019-12-07 10:34:54 +08:00
He Yin Ling 89f8e19850 CI: support only download artifacts by request: 
use CI dependencies could waste a lot bandwidth for target test jobs, as
example binary artifacts are very large. Now we will parse required
artifacts first, then use API to download required files in artifacts.
 2019-12-07 10:34:54 +08:00
He Yin Ling c906e2afee test: update example and unit tests with new import roles: 
tiny_test_fw is a python package now. import it using normal way.
 2019-12-07 10:34:54 +08:00
He Yin Ling 4d45932c5e CI: add utility gitlab_api 2019-12-07 10:34:54 +08:00
He Yin Ling d621d0e88e tiny-test-fw: move to tools/esp_python_packages: 
make `tiny_test_fw` as a package and move to root path of idf python
packages
 2019-12-06 17:29:47 +08:00
He Yin Ling 5ba70e713a Merge branch 'test/http_server_advanced_tests' into 'master' 
test: Refactor http_server advanced_tests to use regular import method

See merge request espressif/esp-idf!6803
 2019-11-28 19:25:52 +08:00
He Yin Ling 6b6b42a0b5 ci: reduce the number of UT jobs 2019-11-28 10:44:31 +08:00
He Yin Ling d839f39ed8 Merge branch 'feature/ci_optimize_assign_test' into 'master' 
CI: optimize assign test

See merge request espressif/esp-idf!6785
 2019-11-24 19:22:41 +08:00
He Yin Ling 857d10a926 unit-test-app: print config name in test script 2019-11-23 20:40:23 +08:00
He Yin Ling 3c99de352c tiny-test-fw: only load module from the same file one time: 
we should only load one module once.
if we load one module twice, python will regard the same object loaded in the first time and second time as different objects.
it will lead to strange errors like `isinstance(object, type_of_this_object)` return False
 2019-11-23 20:40:23 +08:00
He Yin Ling 9665c6ef66 unit-test-app: fix test script error when handling multiple unit test configs in one config file: 
If we have multiple configs, we need to flash DUT with different binaries. But if we don't close DUT before apply new config, the old DUT will be reused, so new config name will not be applied.
 2019-11-23 20:40:23 +08:00
He Yin Ling 1c65f1aed3 ci: reduce the number of unit test jobs 2019-11-23 20:40:23 +08:00
He Yin Ling cb4c25bc67 ci: use more flexible assign for unit test cases 2019-11-23 20:39:19 +08:00
He Yin Ling 757e2d021e tiny-test-fw: print useful debug info when assign test: 
* total requirements (number of required jobs vs tags)
* unused CI jobs
* missing jobs (number of missing jobs vs tags)
 2019-11-23 20:39:19 +08:00
He Yin Ling b12a8bce5f ci: optimize unit test assignment: 
Currently we use config and test function as filter when assign cases to one CI job. It's not necessary as the runner can run test with different configs / test functions. Now we will try to assign as many cases to a job as possible, to reduce the amount of jobs required.
 2019-11-23 20:39:19 +08:00
He Yin Ling 74ca3fc571 tiny-test-fw: revise unit test job config file: 
`overwrite` should be included by each case config
 2019-11-23 20:39:19 +08:00
He Yin Ling bcf1f992ff Merge branch 'ci/fix_iperf_example_test_failure' into 'master' 
ci: fix iperf example test and LEDC unit test error

See merge request espressif/esp-idf!6754
 2019-11-20 10:34:41 +08:00
He Yin Ling ca217e04ec ci: reduce the required num of jobs for ESP32S2 beta LEDC cases 2019-11-19 11:51:26 +08:00
He Yin Ling 613b9b613d ci: fetch all submodules for iperf example test 2019-11-19 11:18:59 +08:00
He Yin Ling 954a23be37 test: fix nvs compatible case error: 
nvs compatible test case uses new test env and app. update test config
file.
 2019-08-25 20:35:49 +08:00
He Yin Ling 663ed11509 unit-test-app: use stripped config name in test case ID: 
We could split cases of same config into multiple binaries as we have limited rom space. So we should regard those configs like `default` and `default_2` as the same config.
 2019-07-11 10:01:05 +08:00
He Yin Ling a626061f3c tools: fix exception in checkout ref script: 
decode bytes before searching with RegEx
 2019-07-04 16:31:35 +08:00
He Yin Ling 9ecd0436f5 tools: fix idf_tools.py exception with python3 
use `subprocess.Popen` when catch TypeError:

```
Traceback (most recent call last):
  File "tools/idf_tools.py", line 1249, in <module>
    main(sys.argv[1:])
  File "tools/idf_tools.py", line 1245, in main
    action_func(args)
  File "tools/idf_tools.py", line 1038, in action_install
    tool_obj.find_installed_versions()
  File "tools/idf_tools.py", line 468, in find_installed_versions
    ver_str = self.check_version()
  File "tools/idf_tools.py", line 426, in check_version
    version_cmd_result = run_cmd_check_output(cmd, None, extra_paths)
  File "tools/idf_tools.py", line 176, in run_cmd_check_output
    result = subprocess.run(cmd, capture_output=True, check=True, input=input_text)
  File "/opt/pyenv/pyenv-1.2.6/versions/3.5.5/lib/python3.5/subprocess.py", line 383, in run
    with Popen(*popenargs, **kwargs) as process:
TypeError: __init__() got an unexpected keyword argument 'capture_output'
```
 2019-07-04 15:06:00 +08:00
He Yin Ling e390dd3eab CI: use include to split large CI config file 2019-07-03 16:59:50 +08:00
He Yin Ling 6eca80a989 CI: try to use the correct branch of other projects used in CI: 
1. revision defined in bot message
2. branch name (or tag name) of current IDF
3. CI_MERGE_REQUEST_TARGET_BRANCH_NAME
4. branch name parsed from `git describe`
5. default branch
 2019-07-03 16:53:34 +08:00
He Yin Ling 81dd9d4e27 CI: use parallel attribute in CI config file 2019-07-03 16:53:34 +08:00
He Yin Ling beaefd3359 Merge branch 'feature/add_nimble_ssc' into 'master' 
test: modify test cases for bluedroid

See merge request idf/esp-idf!5208
 2019-06-25 23:14:32 +08:00
He Yin Ling 53fd406f53 Merge branch 'test/fix_some_error_wifi_cases' into 'master' 
test: fix some wifi case issues

See merge request idf/esp-idf!5226
 2019-06-20 22:05:16 +08:00
He Yin Ling 304e7119ce ci: fix random unit test CI failure: 
we use `-` command to check if DUT reset pass. If we input `-` command
during DUT bootup, DUT could only receive `\n` and print test cases.
Print test cases could take long time and lead to reset check timeout.
Now we will add delay after reset, and enlarge reset check timeout to
solve this problem.
 2019-06-18 12:22:00 +08:00
He Yin Ling 2deb267be5 test: fix some wifi case issues: 
* remove heap size check cases as we have bg tasks allocate memory
* fix wifi connect to open ap issue
 2019-06-13 11:14:39 +08:00
He Yin Ling 50ecd6c3b6 CI: always deploy test result to Jira on master 2019-04-21 13:14:28 +08:00
He Yin Ling 7ca556a3ca Merge branch 'feature/jira_test_management' into 'master' 
test: jira test management

See merge request idf/esp-idf!4751
 2019-04-21 10:37:01 +08:00
He Yin Ling 9549ae4c12 test: sync integration test cases 2019-04-19 16:44:00 +08:00
He Yin Ling af4daf6a22 test: include chip in test case ID 2019-04-19 14:39:44 +08:00
He Yin Ling b7d26ddfe3 CI: add job to sync test to Jira 2019-04-19 14:39:44 +08:00
He Yin Ling 4b526ec0c4 test: let CI import integration test report 2019-04-19 14:39:44 +08:00
He Yin Ling ad0d8a4767 test: save throughput result to junit report 2019-04-19 14:39:44 +08:00