milvus/tests/integration
yiwangdr 1cd15d9322
test: support segment release in integration test (#31190)
issue: #29507

Notice that api_testonly.go files should be guarded by compiler tag
`test`, so that production build rules don't compile them and these APIs
don't get misused.

Signed-off-by: yiwangdr <yiwangdr@gmail.com>
2024-04-09 11:39:17 +08:00
..
alias feat: Implement DescribeAlias and ListAliases interfaces (#29641) 2024-01-11 19:12:51 +08:00
balance fix: Skip release duplicate l0 segment (#31540) 2024-03-27 12:53:10 +08:00
channel_balance enhance: [skip e2e]Add it for channel balance (#30973) 2024-04-02 10:25:15 +08:00
coorddownsearch fix: [skip e2e]Increase graceful time to ensure that bounded search executing normally (#31064) 2024-03-07 10:53:00 +08:00
coordrecovery enhance: Save collection targets by batches (#31616) 2024-03-27 00:09:08 +08:00
crossclusterrouting enhance: Simplify cross cluster routing integration test (#29873) 2024-01-11 14:00:52 +08:00
datanode fix: Skip unstable compaction test it (#31116) 2024-03-08 10:23:00 +08:00
expression enhance: Support more relational operators for binary expressions (#30902) 2024-03-01 16:57:00 +08:00
getvector Add float16 approve for multi-type part (#28427) 2024-01-11 15:48:51 +08:00
hellomilvus enhance: Remove the storage info report (#31772) 2024-04-01 20:50:59 -07:00
hybridsearch fix: create new HybridSearch request in case of data race (#29771) 2024-01-09 09:54:48 +08:00
import feat: Add disk quota checks for import V2 (#31131) 2024-03-15 14:43:03 +08:00
indexstat fix: Repair integration test framework (#28308) 2023-11-24 10:26:23 +08:00
insert fix: Repair integration test framework (#28308) 2023-11-24 10:26:23 +08:00
jsonexpr feat: Support for multiple forms of JSON (#31052) 2024-03-11 19:55:02 +08:00
partialsearch test: support segment release in integration test (#31190) 2024-04-09 11:39:17 +08:00
partitionkey enhance: Remove the storage info report (#31772) 2024-04-01 20:50:59 -07:00
querynode enhance: add configurable memory index load predict memory usage factor (#30561) 2024-03-01 15:23:00 +08:00
rangesearch fix: Repair integration test framework (#28308) 2023-11-24 10:26:23 +08:00
refreshconfig Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
replicas/balance fix: Grpcclient return unrecoverable error (#31256) 2024-03-15 10:03:05 +08:00
rollingupgrade enhance: Add restful api for devops to execute rolling upgrade (#29998) 2024-03-27 16:15:19 +08:00
target enhance: Speed up target recovery after query coord restart (#31240) 2024-03-15 14:19:03 +08:00
upsert fix: Repair integration test framework (#28308) 2023-11-24 10:26:23 +08:00
meta_watcher_test.go fix: Repair integration test framework (#28308) 2023-11-24 10:26:23 +08:00
meta_watcher.go fix: Repair integration test framework (#28308) 2023-11-24 10:26:23 +08:00
minicluster_v2.go fix: [skip e2e] Dedup available ports and retry for integration setup (#31902) 2024-04-08 10:35:17 +08:00
OWNERS Trigger main workflow when integration test changed (#24020) 2023-05-11 09:51:19 +08:00
querynodev2_test.go fix: Repair integration test framework (#28308) 2023-11-24 10:26:23 +08:00
README.md Add README for integration test (#24441) 2023-05-26 15:55:27 +08:00
suite.go feat: add more operation detail info for better allocation (#30438) 2024-03-28 06:33:11 +08:00
util_index.go feat: Support multiple vector search (#29433) 2024-01-08 15:34:48 +08:00
util_insert.go feat: add more operation detail info for better allocation (#30438) 2024-03-28 06:33:11 +08:00
util_query.go enhance:Add integration test for searching when coord down (#30717) 2024-03-01 17:07:00 +08:00
util_schema.go Add float16 approve for multi-type part (#28427) 2024-01-11 15:48:51 +08:00

Integration test

This folder contains the integration test for Milvus components.

How to run integration test locally

Integration test still need some thirdparty components to start:

cd [milvus-folder]/deployments/docker/dev && docker-compose up -d

Run following script to start the full integration test:

cd [milvus-folder]
make milvus # milvus needs to be compiled to make cpp build ready
./scripts/run_intergration_test.sh

If you want to run single test case, you could execute command like this example

# mq, etcd, minio ready before
cd [milvus-folder]
source scripts/setenv.sh
cd tests/integration/[testcase-folder]/
go test -run "$testCaseName^" -testify.m "$subTestifyCaseName^" -race -v

Using suite

MiniClusterandMiniClusterSuite` provides lots of comment preset tool function to execute intergration test.

It is recommend to add a new test with testify/suite


import (
    // ...
    "github.com/milvus-io/milvus/tests/integration"
)

type NewSuite struct {
    integration.MiniClusterSuite
}


// Setups and teardowns, optional if no custom logic needed
// example to suite setup & teardown, same logic applies to test setup&teardown

func (s *NewSuite) SetupSuite() {
    s.MiniClusterSuite.SetupSuite()
    // customized setup
}

func (s *NewSuite) TearDownSuite() {
    s.MiniClusterSuite.TearDownSuite()
    // customized teardown
}

New folder for each new scenario

It's a known issue that integration test cases run in same process might affect due to some singleton component not fully cleaned.

As a temp solution, test cases are separated into different packages to run independently.