milvus/tests/python_client/scale
ThreadDao 56693836ae
[test] Add load balance verify in querynode scale test (#19028) (#19054)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-09-07 19:24:35 +08:00
..
constants.py [test] Update scale test image pull (#18437) 2022-07-28 16:00:31 +08:00
README.md [skip e2e] Update scale test README (#13864) 2021-12-21 15:55:46 +08:00
scale_common.py [test][skip-e2e] Add counter decorater and scale query multi replicas test (#16845) 2022-05-09 14:51:52 +08:00
test_data_node_scale.py [test] Upgrade milvus scale test and Change k8s client config (#18404) 2022-07-26 09:00:33 +08:00
test_index_node_scale.py [test] Add load balance verify in querynode scale test (#19028) (#19054) 2022-09-07 19:24:35 +08:00
test_proxy_scale.py [test] Upgrade milvus scale test and Change k8s client config (#18404) 2022-07-26 09:00:33 +08:00
test_query_node_scale.py [test] Add load balance verify in querynode scale test (#19028) (#19054) 2022-09-07 19:24:35 +08:00

Scale Tests

Goal

Scale tests are designed to check the scalability of Milvus.

For instance, if the dataNode pod expands from one to two:

  • verify the consistency of existing data

  • verify that the DDL and DML operation is working

Prerequisite

Test Scenarios

Milvus in cluster mode

  • scale dataNode replicas

  • expand / shrink indexNode replicas

  • scale queryNode replicas

  • scale proxy replicas

How it works

  • Milvus scales the number of pods in a deployment based on the milvus operator

  • Scale test decouple the milvus deployment from the test code

  • Each test scenario is carried out along the process:
    deploy milvus -> operate milvus -> scale milvus -> verify milvus

  • Milvus deployment and milvus scaling are designed in ./customize/milvus_operator.py

Run

Manually

Run a single test scenario manually(take scale dataNode as instance):

  • update update milvus image tag IMAGE_TAG in scale/constants.py

  • run the commands below:

  cd /milvus/tests/python_client/scale  
  
  pytest test_data_node_scale.py::TestDataNodeScale::test_expand_data_node -v -s  

Nightly

still in planning