mirror of
https://gitee.com/milvus-io/milvus.git
synced 2024-12-04 04:49:08 +08:00
a5beec86f2
* Update framework * remove files * Remove files * Remove ann-acc cases && Update java-sdk cases * change cn to en * [skip ci] remove doc test * [skip ci] change cn to en |
||
|---|---|---|
| .. | ||
| assets | ||
| ci | ||
| conf | ||
| scripts | ||
| suites | ||
| __init__.py | ||
| .gitignore | ||
| client.py | ||
| docker_runner.py | ||
| k8s_runner.py | ||
| local_runner.py | ||
| main.py | ||
| operation.py | ||
| parser.py | ||
| README.md | ||
| report.py | ||
| requirements.txt | ||
| runner.py | ||
| utils.py | ||
Quick start
Description：
- Test cases can be organized with
yaml - Test can run with local mode or helm mode
Demos：
-
Using jenkins + helm mode：
-
Local test：
python3 main.py --local --host=*.* --port=19530 --suite=suites/gpu_search_performance_random50m.yaml
Definitions of test suites：
Testers need to write test suite config if adding a customizised test into the current test framework
The following are the searching performance test suite：
- search_performance: the test type，also we have
build_performance,insert_performance,accuracy,stability,search_stability - tables: list of test cases
- The following fields are in the
tablefield：- server: milvus的server_config
- table_name: currently support one table
- run_count: search count
- search_params: params of search_vectors
Test result：
The result of searching performance
Test result will be uploaded, and will be used to judge if the test run pass or failed