milvus/tests/python_client/deploy
zhuwenxing 99721c8dd2
[skip e2e]Disable debug mode in etcd image (#27212)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-09-19 15:29:24 +08:00
..
cluster [skip e2e]Add docker-compose.yml for deploy test (#14106) 2021-12-23 22:13:32 +08:00
scripts [test]Not output vector field for sq pq index (#24912) 2023-06-19 18:48:44 +08:00
standalone [skip e2e]Add docker-compose.yml for deploy test (#14106) 2021-12-23 22:13:32 +08:00
testcases [test]skip index for empty collection (#25056) 2023-06-21 14:14:42 +08:00
__init__.py [test]Refine deploy test (#18212) 2022-07-11 17:08:25 +08:00
base.py [test]Refine deploy test (#18212) 2022-07-11 17:08:25 +08:00
check_healthy.sh [skip e2e]Update the method to check health for deploy (#17359) 2022-06-03 17:14:04 +08:00
cluster-values.yaml [skip e2e]Disable debug mode in etcd image (#27212) 2023-09-19 15:29:24 +08:00
common.py Remove ANNOY index type (#23189) 2023-04-04 16:30:27 +08:00
conftest.py [test]Refine deploy test (#18212) 2022-07-11 17:08:25 +08:00
milvus_crd.yaml [skip e2e]Update config of milvus crd for rolling update (#27126) 2023-09-15 15:55:21 +08:00
monitor_rolling_update.py [test]Wait index building complete before rolling update (#26377) 2023-08-17 16:38:18 +08:00
README.md [skip e2e]Update test description (#14845) 2022-01-05 14:33:25 +08:00
requirements.txt [test]Add method to analyze chaos test result (#26724) 2023-09-01 10:31:01 +08:00
run.sh [skip e2e]Fix typo in script (#13801) 2021-12-20 19:52:51 +08:00
standalone-values.yaml [skip e2e]Disable debug mode in etcd image (#27212) 2023-09-19 15:29:24 +08:00
test.sh [skip e2e]Move milvus-dev to milvus (#17941) 2022-06-30 15:20:22 +08:00
utils.sh [skip e2e]Update the method to check health for deploy (#17359) 2022-06-03 17:14:04 +08:00

Overview

To test deployment by docker-compose(Both standalone and cluster)

  • re-install milvus to check data persistence
    1. Deploy Milvus
    2. Insert data
    3. Build index
    4. Search
    5. Stop Milvus
    6. Repeat from step #1
  • upgrade milvus to check data compatibility
    1. Deploy Milvus (Previous Release)
    2. Insert data
    3. Search
    4. Stop Milvus
    5. Deploy Milvus (Latest Release/Build)
    6. Build index
    7. Search

Project structure

.
├── README.md
├── cluster # dir to deploy cluster
│   ├── logs # dir to save logs
│   └──docker-compose.yml
├── standalone # dir to deploy standalone
│   ├── logs # dir to save logs
│   └──docker-compose.yml
├── scripts
│   ├── action_after_upgrade.py
│   ├── action_before_upgrade.py
│   ├── action_reinstall.py
│   └── utils.py
├── cluster-values.yaml # config for helm deployment
├── test.sh # script to run a single task
└── run.sh # script to run all tasks

Usage

Make sure you have installed docker,docker-compose and pymilvus! For different version, you should modify the value of latest_tag, latest_rc_tag and Release. Password of root is needed for deleting volumes dir.

single test task

$ bash test.sh -m ${Mode} -t ${Task} -p ${Password}
# Mode, the mode of milvus deploy. standalone or cluster"
# Task, the task type of test. reinstall or upgrade
# Password, the password of root"

run all tasks

$ bash run.sh -p ${Password}
# Password, the password of root"

Integrate deploy test into CI

Provides a way to periodically run docker-compose deployment tests through GitHub actiondeploy-test

  • Parallel testing for four deployment scenarios
  • Upload logs to artifacts for further debug
  • Email notification for test failure
  • Support helm deployment tests
  • Cover more detail information in email notification