Commit Graph
100 Commits
Author SHA1 Message Date
Fu Hanxi 142a3c8a7a ci: fix idf_relpath issue while searching the apps
Now `PytestCase`, collect_app_info file, are all using relpath to idf
instead
2024-01-29 20:45:00 +08:00
Fu Hanxi 2d094ab9d3 test: remove succeeded temp projects
also rename `tmp_path` to `work_dirpath` since it's defined in pytest
2024-01-29 20:45:00 +08:00
Fu Hanxi 94433614dc Merge branch 'ci/fix_missing_artifacts_with_dependencies_and_needs_set' into 'master'
ci: lint yaml files that use `dependencies: []` together with `needs`

See merge request espressif/esp-idf!28707
2024-01-26 14:13:43 +08:00
Fu Hanxi fc802da68c ci: lint yaml files that use dependencies: [] together with needs 2024-01-25 14:47:53 +01:00
Fu Hanxi c44cb5d5c6 Merge branch 'ci/add_missing_gitlab_requirements_for_pytest' into 'master'
ci: add missing python-gitlab requirement for pytest

See merge request espressif/esp-idf!28703
2024-01-25 19:58:27 +08:00
Fu Hanxi 9fb3a5c1ef ci: add missing python-gitlab requirement for pytest
this lib is to download the artifacts from gitlab locally
2024-01-25 10:12:59 +01:00
Fu Hanxi cba1665639 Merge branch 'ci/fix_artifacts_object_name' into 'master'
ci: fix job name sanitizer

See merge request espressif/esp-idf!28676
2024-01-24 23:08:50 +08:00
Fu Hanxi 87fc492fa6 ci: fix job name sanitizer 2024-01-24 10:49:40 +01:00
Fu Hanxi 9bb28ba5e3 Merge branch 'ci/fix_requires_elf_or_map' into 'master'
ci: fix app.requires_elf_or_map. Use absolute paths

See merge request espressif/esp-idf!28603
2024-01-23 17:44:34 +08:00
Fu Hanxi 2ddb0fb3f6 ci: fix app.requires_elf_or_map. Use absolute paths 2024-01-22 11:14:03 +01:00
Fu Hanxi 813dbe5526 Merge branch 'ci/fix_truncated_backet_names_in_artefact_uploader' into 'master'
ci: fix truncated job name in artifact path

See merge request espressif/esp-idf!28558
2024-01-18 20:25:52 +08:00
Fu Hanxi 6d23026437 ci: add IDF_TARGET env var while building
usually we don't need it, but some sdkconfig files may want to expand
this env var.
2024-01-17 13:48:16 +01:00
Fu Hanxi c1ee790341 Merge branch 'ci/add_download_custom_apps_fixture' into 'master'
test: fix custom additional app for multicore test cases

Closes IDFCI-1948

See merge request espressif/esp-idf!28507
2024-01-17 16:44:17 +08:00
Fu Hanxi 23c339e231 ci: raise RuntimeError instead of SystemExit to avoid kill the process
otherwise the pytest process will be killed immediately
2024-01-16 20:21:40 +01:00
Fu Hanxi 4afb86fce3 test: fix custom additional app for multicore test cases 2024-01-16 20:20:42 +01:00
Fu Hanxi b0af857d50 Merge branch 'ci/fix_search_multi_dut_with_markers' into 'master'
ci: fix collect multi-dut test case with markers issue

Closes IDFCI-1945

See merge request espressif/esp-idf!28448
2024-01-16 22:48:09 +08:00
Fu Hanxi 61aafd1e89 ci: fix download with multi-dut test cases with markers only 2024-01-15 22:36:09 +01:00
Fu Hanxi c8dffc9378 ci: fix collect multi-dut test case with markers issue
While collecting, we stop registering the new plugin.
Otherwise the new created plugin will override the one we passed

also run the tests inside idf. the behavior is different.
2024-01-15 22:36:09 +01:00
Fu Hanxi 9d3abb8686 Merge branch 'ci/fix_no_junit_report_for_failed_target_test_jobs' into 'master'
ci: always upload junit report

See merge request espressif/esp-idf!28435
2024-01-15 16:40:06 +08:00
Fu Hanxi 7be04869d2 Merge branch 'ci/respect_build_only_label_while_generating_test_jobs' into 'master'
ci: support build only label again in dynamic pipeline

See merge request espressif/esp-idf!28434
2024-01-15 16:15:05 +08:00
Fu Hanxi b581d81fc1 ci: support build only label 2024-01-14 21:18:20 +01:00
Fu Hanxi 5a17bf83ff Merge branch 'ci/fix_get_binaries_from_pipeline_via_build_report' into 'master'
ci: fix get binaries from pipeline via the build report

See merge request espressif/esp-idf!28432
2024-01-12 17:25:04 +08:00
Fu Hanxi 055f943028 ci: always upload junit report 2024-01-12 09:15:48 +01:00
Fu Hanxi 19efb30536 ci: print report url
master/release pipelines does not have a mr comment, print it here
2024-01-12 08:57:26 +01:00
Fu Hanxi 25e3e3b384 docs: update pipeline_id description 2024-01-12 08:52:55 +01:00
Fu Hanxi edf735a458 ci: fix get binaries from pipeline via the build report
should extract to IDF_PATH, not the current workdir
2024-01-12 08:43:20 +01:00
Fu Hanxi 58fb179845 Merge branch 'ci/update_requirements_txt' into 'master'
ci: update idf-build-apps in requirement txt files

See merge request espressif/esp-idf!28416
2024-01-11 23:19:11 +08:00
Fu Hanxi f0209338de ci: update idf-build-apps in requirement txt files 2024-01-11 12:57:23 +01:00
Fu Hanxi 72a1f68e76 Merge branch 'ci/fix_build_clang_test' into 'master'
Ci/fix build clang test

See merge request espressif/esp-idf!28397
2024-01-11 16:34:41 +08:00
Fu Hanxi a5ece00737 ci: make build_child_pipeline optionally need fast_template_app 2024-01-11 07:21:50 +01:00
Fu Hanxi dc426ecebd ci: fix MR_MODIFIED_COMPONENTS missing doublequotes for empty string 2024-01-11 07:21:50 +01:00
Fu Hanxi 37a4c2ea01 Merge branch 'ci/nested_dynamic_pipeline' into 'master'
CI: Dynamic Pipeline!!!

Closes IDFCI-1211, IDFCI-1729, IDF-8500, IDF-8456, IDFCI-1828, RDT-610, and RDT-615

See merge request espressif/esp-idf!26662
2024-01-11 13:08:28 +08:00
Fu Hanxi fba96d58c2 ci: dynamic pipeline
build:
- upgrade idf-build-apps to 2.x
- unify get_pytest_apps and get_cmake_apps to get_all_apps
	- returns (test_apps, non_test_apps) tuple
- add tests for the new get_all_apps

assign:
- generate build report
- generate target test pipeline based on the build report

target test:
- download artifacts from minio server
- users can use `pytest --pipeline-id xxxxx` to download and flash
the binaries from the artifacts

.post:
- generate target test reports
2024-01-10 15:37:34 +01:00
Fu Hanxi a98923bc85 test: temp disable ip101 test cases 2024-01-10 15:37:34 +01:00
Fu Hanxi c1301c6145 build: bypass build issues 2024-01-10 15:34:50 +01:00
Fu Hanxi 3f03e56bb8 ci: add --keep-going to build all test apps in build_template_app job 2024-01-10 15:34:50 +01:00
Fu Hanxi fa34008c61 docs(pytest): improve docs, add new features and changes 2024-01-10 15:31:22 +01:00
Fu Hanxi 114af706bb ci(wifi): migrate from .gitlab/ci/rules.yml to .build-test-rules.yml 2024-01-10 15:31:21 +01:00
Fu Hanxi bb375ee79a ci(ethernet): migrate from .gitlab/ci/rules.yml to .build-test-rules.yml 2024-01-10 15:31:11 +01:00
Fu Hanxi 83d4e8c6ab ci(flash_encryption_wifi_high_traffic): migrate from .gitlab/ci/rules.yml to .build-test-rules.yml 2024-01-10 15:30:53 +01:00
Fu Hanxi 6f6092ed8d ci(sdio): migrate from .gitlab/ci/rules.yml to .build-test-rules.yml 2024-01-10 15:30:52 +01:00
Fu Hanxi d44f236f7b ci(usb): migrate from .gitlab/ci/rules.yml to .build-test-rules.yml 2024-01-10 15:29:44 +01:00
Fu Hanxi ed1c892a8a ci(adc): migrate from .gitlab/ci/rules.yml to .build-test-rules.yml 2024-01-10 15:29:44 +01:00
Fu Hanxi 9a9b1cd11f ci(ecdsa): migrate from .gitlab/ci/rules.yml to .build-test-rules.yml 2024-01-10 15:29:43 +01:00
Fu Hanxi 7138b977f8 ci(nvs_encr_hmac): migrate from .gitlab/ci/rules.yml to .build-test-rules.yml 2024-01-10 15:29:43 +01:00
Fu Hanxi 3645c041e2 ci(flash_multi): migrate from .gitlab/ci/rules.yml to .build-test-rules.yml 2024-01-10 15:29:43 +01:00
Fu Hanxi b6a93bf81e ci(i154): migrate from .gitlab/ci/rules.yml to .build-test-rules.yml 2024-01-10 15:29:42 +01:00
Fu Hanxi 06af021c9f ci(pytest): stop ambiguous markers for multi-dut test case
also add `tools/ci/idf_pytest/tests` for testing
2024-01-10 15:29:42 +01:00
Fu Hanxi b709c880dd ci: add linter for gitlab yaml files
- remove duplicated artifacts default values
- migrate check_artifacts_expire_time.py
- migrate check_rules_yml.py
2024-01-10 15:29:42 +01:00
Fu Hanxi 96aeead6f5 ci: fix ttfw type hint 2024-01-10 15:29:38 +01:00
Fu Hanxi 1c314f3084 Merge branch 'ci/temp_disable_jobs' into 'master'
ci: remove ip101 jobs and twai_std jobs

See merge request espressif/esp-idf!28375
2024-01-10 21:10:20 +08:00
Fu Hanxi 7962746c65 ci: remove ip101 jobs and twai_std jobs 2024-01-10 10:10:53 +01:00
Fu Hanxi 230243328c Merge branch 'ci/fix_code_quality_report' into 'master'
CI: fix code quality report

Closes IDFCI-1905

See merge request espressif/esp-idf!27988
2024-01-09 14:45:37 +08:00
Fu Hanxi c633ba167d ci: fix code_quality_check 2024-01-08 10:13:08 +01:00
Fu Hanxi d76334d83a Merge branch 'test/fix_lp_core_config_mismatch_issue' into 'master'
test: fix lp_core config file name mismatch issue

See merge request espressif/esp-idf!28217
2024-01-04 20:22:13 +08:00
Fu Hanxi d1f5497f43 test: fix lp_core config file name mismatch issue 2024-01-02 09:36:01 +01:00
Fu Hanxi b5c0293541 Merge branch 'ci/run_pytest_build_system_win_only_with_label_or_schedule' into 'master'
ci: run pytest_build_system_win only with labels and schedule pipeline

See merge request espressif/esp-idf!27744
2023-12-07 22:56:15 +08:00
Fu Hanxi d3858b493d ci: run pytest_build_system_win only with labels and schedule pipeline 2023-12-07 11:15:55 +01:00
Fu Hanxi 09eec2ba47 Merge branch 'ci/fix_upload_failed_job_log_script' into 'master'
ci: fix upload failed job log script

See merge request espressif/esp-idf!27357
2023-11-27 18:32:45 +08:00
Fu Hanxi 4ef1a8cc3a ci: fix upload failed job log script 2023-11-23 08:03:42 +01:00
Fu Hanxi ac0a1b4e8e Merge branch 'ci/git_strategy_optimization' into 'master'
ci: optimize git strategy

Closes IDFCI-1854

See merge request espressif/esp-idf!26797
2023-11-15 14:42:41 +08:00
Fu Hanxi a6ccc2e18e ci: optimize git strategy 2023-11-14 15:31:30 +01:00
Fu Hanxi 6ba8c75f1d Merge branch 'ci/build_log_artifacts' into 'master'
ci: added build log artifacts for linux

Closes IDFCI-1848

See merge request espressif/esp-idf!26948
2023-11-08 21:54:59 +08:00
Fu Hanxi a9079626bb Merge branch 'ci/upload_artifacts_of_target_stage' into 'master'
ci: Upload artifacts of target stage jobs to s3 bucket

Closes RDT-571

See merge request espressif/esp-idf!26722
2023-10-31 18:34:20 +08:00
Fu Hanxi 5e1826678d Merge branch 'ci/improve_check_pylint' into 'master'
ci: improve check pylint get files command

See merge request espressif/esp-idf!26578
2023-10-30 19:29:44 +08:00
Fu Hanxi 14d8fc82fe ci: update constraint file to 5.3 2023-10-30 12:00:29 +01:00
Fu Hanxi b4268c874a Merge branch 'ci/tune_build_jobs_parallel_count_master' into 'master'
ci: tune build test jobs parallel count

See merge request espressif/esp-idf!26627
2023-10-24 21:19:51 +08:00
Fu Hanxi 56500b1725 Merge branch 'ci/fix_test_case_name_while_setup' into 'master'
ci: assign the test_case_name attribute to the case item while setting up a pytest session

Closes RDT-548

See merge request espressif/esp-idf!26632
2023-10-24 00:20:17 +08:00
Fu Hanxi 4076e99a6c Merge branch 'ci/sort_pytest_cases_by_app_path' into 'master'
ci: sort pytest test cases by app path

See merge request espressif/esp-idf!26611
2023-10-23 18:47:01 +08:00
Fu Hanxi 1726ce888d ci: tune build test jobs parallel count 2023-10-23 10:43:51 +02:00
Fu Hanxi eb37150780 ci: add all nightly run env vars while checking 2023-10-23 09:19:31 +02:00
Fu Hanxi ad9b07f589 ci: add idf_pytest package into patterns to trigger target test jobs 2023-10-23 08:54:02 +02:00
Fu Hanxi d2f5f3549e ci: sort pytest test cases by app path 2023-10-23 08:53:20 +02:00
Fu Hanxi ba3d23342d ci: improve check pylint get files command 2023-10-19 11:53:18 +02:00
Fu Hanxi 9f379b224a Merge branch 'ci/reduce_minio_object_size' into 'master'
ci: reduce the archive file size by adding compression method

See merge request espressif/esp-idf!26552
2023-10-19 01:20:29 +08:00
Fu Hanxi 1199a22717 ci: reduce the archive file size by adding compression method
the default one of python won't do any compress

also limit a bit on the file patterns, otherwise the .bin files
generated by cmake would also be uploaded
2023-10-18 11:51:24 +02:00
Fu Hanxi 321d3c9ba6 Merge branch 'ci/remove_ttfw' into 'master'
ci: remove ttfw

See merge request espressif/esp-idf!26313
2023-10-17 20:43:56 +08:00
Fu Hanxi 00ae4ee386 Merge branch 'ci/fix_get_test_cases_issues' into 'master'
ci: set env var NIGHTLY_RUN while checking the apps readme files

See merge request espressif/esp-idf!26493
2023-10-17 19:01:01 +08:00
Fu Hanxi 6944d17be9 ci: set env var NIGHTLY_RUN while checking the apps readme files
sometimes we may want to build & test on only a specific set of targets,
add `NIGHTLY_RUN == "1"` for this use case
2023-10-16 13:26:43 +02:00
Fu Hanxi 4dbf8c8948 ci: remove ttfw related files 2023-10-16 10:23:09 +02:00
Fu Hanxi ca63d0f943 test: move network_tests from examples/ to tools/test_apps 2023-10-16 10:18:03 +02:00
Fu Hanxi 786a641851 Merge branch 'ci/build_jobs_use_cache' into 'master'
ci: Upload Artifacts to Minio Server Instead of Gitlab Server

Closes IDFCI-1653

See merge request espressif/esp-idf!25664
2023-10-16 00:49:47 +08:00
Fu Hanxi 79bc66b323 ci: upload to minio server instead of gitlab artifacts for pytest jobs 2023-10-13 13:01:23 +02:00
Fu Hanxi 9bef0db402 ci: remove SETUP_TOOLS since now we run install.sh for all jobs 2023-10-13 13:01:23 +02:00
Fu Hanxi dfdb9f9261 ci: reduce gitlab api calls by using lazy calls 2023-10-13 13:01:23 +02:00
Fu Hanxi 6be05d415b ci: remove unit-test-app ci jobs 2023-10-13 13:01:16 +02:00
Fu Hanxi 7311710e2c ci: support p4 in unit-test-app 2023-10-13 12:55:52 +02:00
Fu Hanxi a3a8c2acb9 ci: move default variables, before(after)_script into a single file
could help reuse the default settings on main pipeline and child
pipeline

renamed:
- .before_script_minimal -> .before_script:minimal
- .before_script_macos -> .before_script:build:macos
- .before_script_build_jobs -> .before_script:build
2023-10-13 12:55:51 +02:00
Fu Hanxi 0a4a31286c Merge branch 'ci/fix_param_tests' into 'master'
ci: different test case name with different params

See merge request espressif/esp-idf!26023
2023-10-05 00:15:03 +08:00
Fu Hanxi 24b2e0a56d ci: different test case name with different params 2023-10-04 16:05:29 +00:00
Fu Hanxi 1a0dd5a162 Merge branch 'ci/replace_internal_clang-tidy-runner' into 'master'
ci: replace internal clang-tidy runner with the pypi project

See merge request espressif/esp-idf!26133
2023-09-28 00:07:35 +08:00
Fu Hanxi 4dbe541f80 ci: replace internal clang-tidy runner with the pypi project 2023-09-27 10:25:49 +02:00
Fu Hanxi c79c16a73e ci: fix cleanup_ignore_lists.py on windows 2023-09-21 12:59:17 +02:00
Fu Hanxi 3f8400ef7c ci: add esp32 ethernet custom test 2023-08-22 16:36:25 +02:00
Fu Hanxi 614db5b3b3 Merge branch 'ci/improve_pytest' into 'master'
CI: introduce new plugin `pytest-ignore-test-results`

Closes IDFCI-1667

See merge request espressif/esp-idf!24480
2023-08-21 10:50:46 +08:00
Fu Hanxi 5e4427ab13 ci(pytest): add plugin pytest-ignore-test-results
pass with warning if test job got ignored.
2023-08-18 10:50:18 +08:00
Fu Hanxi 39f3a5f3ac ci(pytest): skip test case if no app found while collecting, not setup 2023-08-18 08:36:06 +08:00
Fu Hanxi 17bbb2a5a2 ci(pytest): use one class to filter the nightly_run 2023-08-18 08:36:06 +08:00
Fu Hanxi 1d69302eae ci(pytest): move pytest utils into tools/ci/idf_pytest
For future usage
2023-08-18 08:36:06 +08:00
Fu Hanxi c8cddaee8a ci: exclude checking manifest files under managed_components 2023-08-18 08:09:20 +08:00