Commit Graph

41 Commits

Author SHA1 Message Date
Xu Xiao 80ff7d8615 Merge branch 'enable_esp32c5_ci_test' into 'master'
fix(ci): enable esp32c5 eco1 ci test

See merge request espressif/esp-idf!34898
2024-12-26 14:04:02 +08:00
Radek Tandler 5b15320600 Merge branch 'bugfix/storage_generic_pytests' into 'master'
fix(ci): Removed storage related entries in known generate test child pipeline warnings

See merge request espressif/esp-idf!35738
2024-12-25 18:37:14 +08:00
xuxiao f58311cce9 fix(ci): enable esp32c5 eco1 ci test 2024-12-25 11:21:48 +08:00
radek.tandler df31bc6fdd fix(ci): Removed storage related ignore warnings 2024-12-20 19:40:33 +01:00
Armando da5b859886 test(adc): supported adc c5 calibration tests 2024-12-19 12:12:30 +08:00
Fu Hanxi eea2fdf9a9 ci(target-test): support timeout 4h markers 2024-12-04 15:51:11 +01:00
Fu Hanxi d03ead4cf8 Merge branch 'ci/improve_overall_logging' into 'master'
ci: target-test job skip installing toolchain, only install python env

See merge request espressif/esp-idf!34232
2024-11-08 23:27:04 +08:00
Fu Hanxi 2a5743c0c5 ci: target-test job skip installing toolchain, only install python env
also run with collapsed time section to better track run time
2024-11-08 11:17:57 +01:00
Fu Hanxi d137deed2a ci: add timeout for build jobs 2024-11-08 11:13:43 +01:00
Peter Macko 4fa6e03879 fix(macos): ccache: re-enable, show stats, set CCACHE_DIR, limit CCACHE_MAXSIZE 2024-11-07 22:22:28 +08:00
xuxiao 901812c589 fix(ci): disable esp32c5 adc ci test 2024-10-29 12:00:39 +08:00
Fu Hanxi 502749d254 ci: remove gitlab api call while generating pytest target-test child pipeline 2024-10-25 14:16:51 +02:00
xuxiao 8349621c15 fix(ci): temporarily pause the ESP32-C5 CI test in order to submit the C5 ECO1 code 2024-10-23 20:15:25 +08:00
Aleksei Apaseev 397fdb56fb ci: ensure binary size artifacts are uploaded in Build Stage Child pipeline via artifacts_handler script.
- Updated dynamic pipeline to include artifact upload commands for size reports, allowing easier parsing on the CI dashboard.
- Each job now handles its own size.json file, ensuring independent access for better CI artifact management.
2024-09-29 15:17:45 +08:00
wanckl 4e095f4b9f ci(esp32c61): enable c61 generic target test 2024-09-02 19:26:12 +08:00
Aleksei Apaseev a6b84b5ccc feat(ci): add retry job functionality to dynamic pipeline report
Introduced changes:

- add a manual ci job to retry failed jobs.
- refactor js scripts in report template
- extract the CI ENV vars related to the report generation script to the predefined constants.py module
- introduce a new action "retry_failed_jobs" in helper script "gitlab_api.py"
2024-08-09 19:05:53 +08:00
igor.udot a21247eada fix: save artifacts for generate job 2024-08-09 15:06:00 +08:00
igor.udot e669c7ab5b ci: fast_pipeline yml branch 2024-08-05 16:07:36 +08:00
Aleksei Apaseev cd59d96ff4 ci: add dut_log_url column to failed testcases report
Introduced changes:
- add xml attribute "dut_log_url" to pytest report
- add column "dut_log_url" to failed testcases table of dynamic pipeline report
- make the table header sticky
- add permalinks to the Table Titles
- split target test report by testcase type for better clarity
- fix the logic of finding the testcases failed on cur branch / other branches
2024-07-17 17:52:11 +08:00
laokaiyao cb22b8aaf7 ci(esp32c5): enable c5 target test 2024-07-02 16:45:49 +08:00
Aleksei Apaseev 63bd3a18ad ci: add failed jobs report generator. Improve Target Test Report
Introduced changes:
- refactor the cli script used for report generation
- introduce failed jobs report generator
- cover job report generation with tests
- add job failure rate
- add test cases failure rate
- add current branch / other branches statistic for failed jobs / testcases
2024-06-20 14:40:54 +08:00
Aleksei Apaseev 40c8a16ad4 ci: add known failure cases to the target test report
target test report:
- refactor the methods to ensure reusability
- cover report generation with tests
- introduce a known failure tests block in report
- add grafana link to testcases dashboard
2024-05-28 15:36:22 +08:00
Fu Hanxi 152db1a4ba ci: move log dir from pytest_embedded_log to pytest-embedded 2024-05-09 12:23:04 +02:00
igor.udot 99a0ce0db0 ci: revert pytest.ini -s -vv 2024-04-19 22:26:29 +08:00
Xu Si Yu 0d01a3ed72 ci: re-enable openthread runner 2024-04-09 20:52:05 +08:00
Fu Hanxi 8f2aebdc20 ci: ignore openthread runner temporarily 2024-04-08 14:44:17 +02:00
Chen Yudong 7d13f8210f ci: fix pytest generic env markers 2024-04-03 18:10:43 +08:00
Chen Yu Dong 6af93c154b Revert "Merge branch 'ci/ignore_c6_wifi_two_dut_runners' into 'master'"
This reverts merge request !28944
2024-02-27 14:24:37 +08:00
Fu Hanxi 0df25d5229 ci: ignore c3 flash_multi cases 2024-02-23 14:15:35 +01:00
Fu Hanxi 80a32713bb ci: ignore esp32c6_2,wifi_two_dut test cases 2024-02-06 13:38:25 +01:00
Chen Yudong a72d5f4b41 ci: update protocol/ethernet pytest markers 2024-02-01 22:47:18 +08:00
Fu Hanxi ecae464c52 ci: ignore p4,jtag runner 2024-01-30 09:08:35 +01:00
Fu Hanxi ceb2ef7208 ci: add init known warnings while generating the test child pipeline 2024-01-29 13:52:40 +01:00
Fu Hanxi 08312412ec ci: check warnings while generating the target test jobs 2024-01-29 13:52:40 +01:00
igor.udot f5972ab592 ci: change known_failure_cases workflow 2024-01-21 15:36:25 +08:00
Fu Hanxi b0af857d50 Merge branch 'ci/fix_search_multi_dut_with_markers' into 'master'
ci: fix collect multi-dut test case with markers issue

Closes IDFCI-1945

See merge request espressif/esp-idf!28448
2024-01-16 22:48:09 +08:00
Ondrej Kosta 9a3133f22a Merge branch 'bugfix/ci_extra_flags' into 'master'
ci: added bridge test credentials to  PYTEST_EXTRA_FLAGS variable

See merge request espressif/esp-idf!28470
2024-01-16 17:03:55 +08:00
Fu Hanxi c8dffc9378 ci: fix collect multi-dut test case with markers issue
While collecting, we stop registering the new plugin.
Otherwise the new created plugin will override the one we passed

also run the tests inside idf. the behavior is different.
2024-01-15 22:36:09 +01:00
Ondrej Kosta e339da981d ci: added bridge test credentials to PYTEST_EXTRA_FLAGS variable 2024-01-15 09:38:11 +01:00
Fu Hanxi 055f943028 ci: always upload junit report 2024-01-12 09:15:48 +01:00
Fu Hanxi fba96d58c2 ci: dynamic pipeline
build:
- upgrade idf-build-apps to 2.x
- unify get_pytest_apps and get_cmake_apps to get_all_apps
	- returns (test_apps, non_test_apps) tuple
- add tests for the new get_all_apps

assign:
- generate build report
- generate target test pipeline based on the build report

target test:
- download artifacts from minio server
- users can use `pytest --pipeline-id xxxxx` to download and flash
the binaries from the artifacts

.post:
- generate target test reports
2024-01-10 15:37:34 +01:00