milvus/tests/milvus_benchmark
Jin Hai f8a28699b4
Change to 0.8.0 and rename from preload_table to preload_collection (#1904)
* Create new branch 0.8.0 and change preload_table to preload_collection

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix format

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>

* update helm version

Signed-off-by: zw <zw@zilliz.com>

Co-authored-by: zw <zw@zilliz.com>
2020-04-11 19:01:29 +08:00
..
assets Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00
ci Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00
conf Change to 0.8.0 and rename from preload_table to preload_collection (#1904) 2020-04-11 19:01:29 +08:00
scripts Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00
suites Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00
__init__.py #18 Add all test cases 2019-10-16 18:40:31 +08:00
.gitignore #18 Add all test cases 2019-10-16 18:40:31 +08:00
client.py Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00
docker_runner.py Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00
k8s_runner.py Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00
local_runner.py Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00
main.py Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00
operation.py #18 Add all test cases 2019-10-16 18:40:31 +08:00
parser.py Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00
README.md Change lang cn to en in reademe (#971) 2020-01-13 13:56:15 +08:00
report.py #18 Add all test cases 2019-10-16 18:40:31 +08:00
requirements.txt Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00
runner.py Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00
utils.py Enhance testing framework based on kubernetes (#935) 2020-01-07 16:20:37 +08:00

Quick start

Description

  • Test cases can be organized with yaml
  • Test can run with local mode or helm mode

Demos

  1. Using jenkins + helm mode

  2. Local test

    python3 main.py --local --host=*.* --port=19530 --suite=suites/gpu_search_performance_random50m.yaml

Definitions of test suites

Testers need to write test suite config if adding a customizised test into the current test framework

The following are the searching performance test suite

  1. search_performance: the test typealso we havebuild_performance,insert_performance,accuracy,stability,search_stability
  2. tables: list of test cases
  3. The following fields are in the table field
    • server: milvus的server_config
    • table_name: currently support one table
    • run_count: search count
    • search_params: params of search_vectors

Test result

The result of searching performance

Test result will be uploaded, and will be used to judge if the test run pass or failed