Commit Graph
57 Commits
Author SHA1 Message Date
Yinling bf2a568924 remove not used code as rm -rf always return 0 2016-12-12 09:31:06 +08:00
Yinling a283042258 switch socket recv print for stress test 2016-12-09 10:45:10 +08:00
Yinling 5e1cdd3422 fix bug in test case TCPIP_TCP_5101
test time is not set in test case and not used to control test time
2016-12-08 16:15:49 +08:00
Yinling a241197067 handle the case that artifacts do not exist 2016-12-06 19:01:20 +08:00
Yinling ec40053720 add supported stress test cases to CI 2016-12-06 15:41:02 +08:00
Yinling b0ca2feabc support build multiple bin for SSC 2016-11-17 14:02:46 +08:00
Yinling 9e6e6b8ff6 save logs as test_report artifacts 2016-11-17 13:45:53 +08:00
Yinling 522f83ae3d remove unnecessary "git fetch" and add echo submodule path 2016-11-06 22:58:31 +08:00
Yinling 3051c74488 No need to deinit submodules as use clean clone by config 2016-11-06 22:53:23 +08:00
Yinling d093dcbbb7 try to checkout same branch for submodule in CI jobs 2016-11-06 22:43:12 +08:00
He Yin Ling 47910466ce Set result "Succeed" for passed cases 2016-11-02 20:54:22 +08:00
He Yin Ling e56b745527 incorrect "/", should be "\" 2016-11-02 20:21:46 +08:00
He Yin Ling c12aeb1127 add case select by name mark " before case name 2016-11-02 20:12:43 +08:00
Yinling 2e319705ec forget to break when test succeed 2016-11-02 19:41:33 +08:00
Yinling fdff6b2b01 run unit test case by case name 2016-11-02 19:08:55 +08:00
Yinling c67ac340c7 use correct template for unit test jobs 2016-11-01 20:33:23 +08:00
Yinling 5784586041 integrate unit test to CI 2016-11-01 19:30:42 +08:00
He Yin Ling e7cc1aded5 Merge branch 'test/clean_ci_fails' into 'master'
Test/clean ci fails



See merge request !159
2016-10-31 16:37:36 +08:00
Yinling 3edcf5b096 fix bug for case WIFI_CONN_0102:
after set AP, STA will disconnected and do reconnect. scan could fail as reconnect also use scan
2016-10-24 18:59:56 +08:00
Yinling abd4dc7d43 add know issue ^WIFI_CONN_0601:
in STA+AP mode, when STA reconencting to enternal AP, external STA can't connect to AP
2016-10-24 18:42:40 +08:00
Yinling d3d8c04535 add known issue exception when setting mac address:
WIFI_ADDR_0101,^WIFI_ADDR_0101
2016-10-20 16:43:04 +08:00
Yinling 5e8849d032 modify TCPIP_DHCP_0211:
delay 30s to make sure STA got enough time to disconnect and reconnect.
2016-10-20 11:28:06 +08:00
Yinling c350972eac update following know issues:
1. ^WIFI_CONN_0801: auth change event not correct
2. WIFI_SCAN_0303: scan interact with JAP not correct
3. ^WIFI_SCAN_0103,^WIFI_SCAN_0105: no scan done event
4. ^TCPIP_UDP_0304,TCPIP_UDP_0104: UDP poor performance
2016-10-19 20:22:43 +08:00
Yinling 18ebc6411e fix bug for WIFI_SCAN_0304: need to set AP config first 2016-10-19 18:03:43 +08:00
Yinling 6eaf595a0e change test WAN server URL:
form iot.espressif.cn to factory.espressif.cn
2016-10-19 18:00:27 +08:00
Yinling 0324373cd1 update auto generated CI job config 2016-10-19 15:23:07 +08:00
Yinling c2b63a614e sync test env from auto_test_script (add SSC_T5_IOT1) 2016-10-19 15:22:13 +08:00
Yinling de7b2f5a09 fix following test case bugs:
1. (^)TCPIP_DHCP_0101, (^)TCPIP_DHCP_0301: IDF set IP 0.0.0.0 may return error, don't check the result of setting IP to 0.0.0.0;
2. rename (^)TCPIP_DHCP_0102 to (^)TCPIP_DHCP_0212 as it's a DHCP server test case;
3. (^)TCPIP_TCP_0204,(^)TCPIP_TCP_0210,(^)TCPIP_UDP_0201,(^)TCPIP_UDP_0202: recv thread can't be deleted, change case to not create recv thread when create socket ;
4. (^)TCPIP_TCP_0206,(^)TCPIP_TCP_0212:  query TCP server status format changed.
5. WIFI_SCAN_0301: check command error and test environment not correct
6. WIFI_SCAN_0302, WIFI_SCAN_0303, WIFI_SCAN_0304: test environment not correct
2016-10-19 15:16:47 +08:00
Yinling 3f521c4afa update KnowIssues:
1. unsupported cases by "phy" command
2. DHCP server behavior different from ESP8266
3. TCP failed cases causes by unstable TCP behavior
4. UDP failed cases by poor UDP performance
2016-10-19 15:11:38 +08:00
Yinling 28d83e766a fix bug that deploy when test failed:
test report will be a single stage. The result of test report will be calculated from the result of all test jobs in test stage. So it will only deploy when all test job passed.
2016-10-17 17:03:54 +08:00
Yinling 5e0a9bfcf2 remove debug command "ls" in test report job 2016-10-12 11:48:24 +08:00
Yinling e9199a0320 should set TEST_CASE_FILE_PATH before CONFIG_FILE use it 2016-10-12 11:44:54 +08:00
Yinling b72d22041c rename components/test to idf_test:
1. test will be categorized by test level
2. add test level as attribute to test cases
3. will select TestCaseScript by the test cases added to CI (currently no test case uses test case script)
4. adding test level to test jobs
5. update .gitlab-ci.yml, each job need to set its test case file path
6. update .gitlab-ci.yml, test case path for test report is changed to idf_test
2016-10-12 11:17:56 +08:00
Yinling 1447cd4136 fix issue on test report job:
1. test report job should be put to deploy stage, otherwise it can't get logs from test stage
2. allow test fail so that test report job will be executed for failed test
2016-10-11 17:23:46 +11:00
He Yin Ling e5b8854d96 can not put test report to deploy stage, otherwise if test fails it won't generate test report. 2016-10-11 17:23:46 +11:00
Yinling 19ca66c968 add job to generate test report 2016-10-11 17:23:46 +11:00
Yinling fbb654fa68 move content from readme to wiki 2016-10-11 17:23:46 +11:00
Yinling 6442601333 add some missing cases caused by autogen bug 2016-10-11 17:23:46 +11:00
Yinling 12fa7472ea night jobs should exit succeed if no need to run 2016-10-11 17:23:46 +11:00
Yinling 547fb6ed6c update current known issue for ESP32 IDF test 2016-10-11 17:23:46 +11:00
Yinling 9b72441b45 Test cases use libpcap or libnet are not CI ready now:
1. It need rebuild native lib
2. require root permission
2016-10-11 17:23:46 +11:00
Yinling 4929534448 add gitlab key in test template job 2016-10-11 17:23:46 +11:00
He Yin Ling d7db3e6a35 build SSC should also use variable for server name 2016-10-11 17:23:46 +11:00
Yinling 5ba6c1b1b7 sync test config from test bench:
1. night jobs should exit without error if not triggered
2. remove get wifi connect status cases from IDF
3. use Env tag to check if test environment is special
2016-10-11 17:23:45 +11:00
Yinling 5fab6c36c8 update job configs for allow case fail feature 2016-10-11 17:23:45 +11:00
Yinling d695d40196 add note that test folder is for internal use.
Will move data in readme to wiki except first two notes.
2016-10-11 17:23:45 +11:00
Yinling 59b35eb16a sync several changes from auto_test_script:
1. use variable for gitlab server
2. add LOCAL_ENV_CONFIG_PATH to template
2. update jobs with feature "allow fail"
2016-10-11 17:23:45 +11:00
Yinling 024a1ce260 add KnownIssues file to test:
add known issues to this file so that they will be exculded in CI results
2016-10-11 17:23:45 +11:00
Yinling 4de2054541 fix bugs in config files:
1. filter name is "Add" not "ADD"
2. SSC_T1_APC is special environment
3. remove "debug mode" from config as it will implemented with other ways
2016-10-11 17:23:45 +11:00
Yinling 745ecef263 auto_test_script will be cloned from gitlab 2016-10-11 17:23:45 +11:00
Yinling 99ebc93abb modify document to add how to run test locally 2016-10-11 17:23:45 +11:00
Yinling e2dd6ebcf0 revise .gitlab-ci.yml:
1. remove duplicated code
2. fix path error for config file
2016-10-11 17:23:45 +11:00
Yinling 2fe759ce1d update CI config file:
1. add night job define (need to set variable in trigger to run night jobs)
2. move auto generated part to the end of file
3. add auto generated CI jobs
2016-10-11 17:23:28 +11:00
Yinling 90e57cdf8f add auto generated test folder to components:
1. add test cases and related scripts
2. add CI config files
read README.md for detail
2016-10-11 17:19:40 +11:00
Yinling 1f6fca672d installed gitlab key in global before_script,
don't need to overwrite in template before_script
2016-09-13 10:06:09 +08:00
Yinling 19bbe64a56 update ci: build ssc with idf submodule wifi lib 2016-09-12 19:09:28 +08:00
Yinling 04aea7f987 update ci config file with 2 changes:
1. add build SSC and do sanity test config
2. add tags to each job as sanity test need to be executed on special runner
2016-09-09 10:49:03 +08:00