Yinling
bf2a568924
remove not used code as rm -rf always return 0
2016-12-12 09:31:06 +08:00
Yinling
a283042258
switch socket recv print for stress test
2016-12-09 10:45:10 +08:00
Yinling
5e1cdd3422
fix bug in test case TCPIP_TCP_5101
...
test time is not set in test case and not used to control test time
2016-12-08 16:15:49 +08:00
Yinling
a241197067
handle the case that artifacts do not exist
2016-12-06 19:01:20 +08:00
Yinling
ec40053720
add supported stress test cases to CI
2016-12-06 15:41:02 +08:00
Yinling
b0ca2feabc
support build multiple bin for SSC
2016-11-17 14:02:46 +08:00
Yinling
9e6e6b8ff6
save logs as test_report artifacts
2016-11-17 13:45:53 +08:00
Yinling
522f83ae3d
remove unnecessary "git fetch" and add echo submodule path
2016-11-06 22:58:31 +08:00
Yinling
3051c74488
No need to deinit submodules as use clean clone by config
2016-11-06 22:53:23 +08:00
Yinling
d093dcbbb7
try to checkout same branch for submodule in CI jobs
2016-11-06 22:43:12 +08:00
He Yin Ling
47910466ce
Set result "Succeed" for passed cases
2016-11-02 20:54:22 +08:00
He Yin Ling
e56b745527
incorrect "/", should be "\"
2016-11-02 20:21:46 +08:00
He Yin Ling
c12aeb1127
add case select by name mark " before case name
2016-11-02 20:12:43 +08:00
Yinling
2e319705ec
forget to break when test succeed
2016-11-02 19:41:33 +08:00
Yinling
fdff6b2b01
run unit test case by case name
2016-11-02 19:08:55 +08:00
Yinling
c67ac340c7
use correct template for unit test jobs
2016-11-01 20:33:23 +08:00
Yinling
5784586041
integrate unit test to CI
2016-11-01 19:30:42 +08:00
He Yin Ling
e7cc1aded5
Merge branch 'test/clean_ci_fails' into 'master'
...
Test/clean ci fails
See merge request !159
2016-10-31 16:37:36 +08:00
Yinling
3edcf5b096
fix bug for case WIFI_CONN_0102:
...
after set AP, STA will disconnected and do reconnect. scan could fail as reconnect also use scan
2016-10-24 18:59:56 +08:00
Yinling
abd4dc7d43
add know issue ^WIFI_CONN_0601:
...
in STA+AP mode, when STA reconencting to enternal AP, external STA can't connect to AP
2016-10-24 18:42:40 +08:00
Yinling
d3d8c04535
add known issue exception when setting mac address:
...
WIFI_ADDR_0101,^WIFI_ADDR_0101
2016-10-20 16:43:04 +08:00
Yinling
5e8849d032
modify TCPIP_DHCP_0211:
...
delay 30s to make sure STA got enough time to disconnect and reconnect.
2016-10-20 11:28:06 +08:00
Yinling
c350972eac
update following know issues:
...
1. ^WIFI_CONN_0801: auth change event not correct
2. WIFI_SCAN_0303: scan interact with JAP not correct
3. ^WIFI_SCAN_0103,^WIFI_SCAN_0105: no scan done event
4. ^TCPIP_UDP_0304,TCPIP_UDP_0104: UDP poor performance
2016-10-19 20:22:43 +08:00
Yinling
18ebc6411e
fix bug for WIFI_SCAN_0304: need to set AP config first
2016-10-19 18:03:43 +08:00
Yinling
6eaf595a0e
change test WAN server URL:
...
form iot.espressif.cn to factory.espressif.cn
2016-10-19 18:00:27 +08:00
Yinling
0324373cd1
update auto generated CI job config
2016-10-19 15:23:07 +08:00
Yinling
c2b63a614e
sync test env from auto_test_script (add SSC_T5_IOT1)
2016-10-19 15:22:13 +08:00
Yinling
de7b2f5a09
fix following test case bugs:
...
1. (^)TCPIP_DHCP_0101, (^)TCPIP_DHCP_0301: IDF set IP 0.0.0.0 may return error, don't check the result of setting IP to 0.0.0.0;
2. rename (^)TCPIP_DHCP_0102 to (^)TCPIP_DHCP_0212 as it's a DHCP server test case;
3. (^)TCPIP_TCP_0204,(^)TCPIP_TCP_0210,(^)TCPIP_UDP_0201,(^)TCPIP_UDP_0202: recv thread can't be deleted, change case to not create recv thread when create socket ;
4. (^)TCPIP_TCP_0206,(^)TCPIP_TCP_0212: query TCP server status format changed.
5. WIFI_SCAN_0301: check command error and test environment not correct
6. WIFI_SCAN_0302, WIFI_SCAN_0303, WIFI_SCAN_0304: test environment not correct
2016-10-19 15:16:47 +08:00
Yinling
3f521c4afa
update KnowIssues:
...
1. unsupported cases by "phy" command
2. DHCP server behavior different from ESP8266
3. TCP failed cases causes by unstable TCP behavior
4. UDP failed cases by poor UDP performance
2016-10-19 15:11:38 +08:00
Yinling
28d83e766a
fix bug that deploy when test failed:
...
test report will be a single stage. The result of test report will be calculated from the result of all test jobs in test stage. So it will only deploy when all test job passed.
2016-10-17 17:03:54 +08:00
Yinling
5e0a9bfcf2
remove debug command "ls" in test report job
2016-10-12 11:48:24 +08:00
Yinling
e9199a0320
should set TEST_CASE_FILE_PATH before CONFIG_FILE use it
2016-10-12 11:44:54 +08:00
Yinling
b72d22041c
rename components/test to idf_test:
...
1. test will be categorized by test level
2. add test level as attribute to test cases
3. will select TestCaseScript by the test cases added to CI (currently no test case uses test case script)
4. adding test level to test jobs
5. update .gitlab-ci.yml, each job need to set its test case file path
6. update .gitlab-ci.yml, test case path for test report is changed to idf_test
2016-10-12 11:17:56 +08:00
Yinling
1447cd4136
fix issue on test report job:
...
1. test report job should be put to deploy stage, otherwise it can't get logs from test stage
2. allow test fail so that test report job will be executed for failed test
2016-10-11 17:23:46 +11:00
He Yin Ling
e5b8854d96
can not put test report to deploy stage, otherwise if test fails it won't generate test report.
2016-10-11 17:23:46 +11:00
Yinling
19ca66c968
add job to generate test report
2016-10-11 17:23:46 +11:00
Yinling
fbb654fa68
move content from readme to wiki
2016-10-11 17:23:46 +11:00
Yinling
6442601333
add some missing cases caused by autogen bug
2016-10-11 17:23:46 +11:00
Yinling
12fa7472ea
night jobs should exit succeed if no need to run
2016-10-11 17:23:46 +11:00
Yinling
547fb6ed6c
update current known issue for ESP32 IDF test
2016-10-11 17:23:46 +11:00
Yinling
9b72441b45
Test cases use libpcap or libnet are not CI ready now:
...
1. It need rebuild native lib
2. require root permission
2016-10-11 17:23:46 +11:00
Yinling
4929534448
add gitlab key in test template job
2016-10-11 17:23:46 +11:00
He Yin Ling
d7db3e6a35
build SSC should also use variable for server name
2016-10-11 17:23:46 +11:00
Yinling
5ba6c1b1b7
sync test config from test bench:
...
1. night jobs should exit without error if not triggered
2. remove get wifi connect status cases from IDF
3. use Env tag to check if test environment is special
2016-10-11 17:23:45 +11:00
Yinling
5fab6c36c8
update job configs for allow case fail feature
2016-10-11 17:23:45 +11:00
Yinling
d695d40196
add note that test folder is for internal use.
...
Will move data in readme to wiki except first two notes.
2016-10-11 17:23:45 +11:00
Yinling
59b35eb16a
sync several changes from auto_test_script:
...
1. use variable for gitlab server
2. add LOCAL_ENV_CONFIG_PATH to template
2. update jobs with feature "allow fail"
2016-10-11 17:23:45 +11:00
Yinling
024a1ce260
add KnownIssues file to test:
...
add known issues to this file so that they will be exculded in CI results
2016-10-11 17:23:45 +11:00
Yinling
4de2054541
fix bugs in config files:
...
1. filter name is "Add" not "ADD"
2. SSC_T1_APC is special environment
3. remove "debug mode" from config as it will implemented with other ways
2016-10-11 17:23:45 +11:00
Yinling
745ecef263
auto_test_script will be cloned from gitlab
2016-10-11 17:23:45 +11:00
Yinling
99ebc93abb
modify document to add how to run test locally
2016-10-11 17:23:45 +11:00
Yinling
e2dd6ebcf0
revise .gitlab-ci.yml:
...
1. remove duplicated code
2. fix path error for config file
2016-10-11 17:23:45 +11:00
Yinling
2fe759ce1d
update CI config file:
...
1. add night job define (need to set variable in trigger to run night jobs)
2. move auto generated part to the end of file
3. add auto generated CI jobs
2016-10-11 17:23:28 +11:00
Yinling
90e57cdf8f
add auto generated test folder to components:
...
1. add test cases and related scripts
2. add CI config files
read README.md for detail
2016-10-11 17:19:40 +11:00
Yinling
1f6fca672d
installed gitlab key in global before_script,
...
don't need to overwrite in template before_script
2016-09-13 10:06:09 +08:00
Yinling
19bbe64a56
update ci: build ssc with idf submodule wifi lib
2016-09-12 19:09:28 +08:00
Yinling
04aea7f987
update ci config file with 2 changes:
...
1. add build SSC and do sanity test config
2. add tags to each job as sanity test need to be executed on special runner
2016-09-09 10:49:03 +08:00