test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-05 05:18:52 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
19,839 Commits 96 Branches 105 Tags 186 MiB
62663ac2e2
Commit Graph

19839 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
sre-ci-robot
b703d6cdbe
[automated] Update Knowhere Commit (#32586) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-04-25 02:27:24 +08:00
sammy.huang
4c7d3dade3
enhance: bind e2e to dedicated nodes (#32577) 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-04-24 19:27:24 +08:00
congqixia
faa559592d
enhance: Make applyDelete work in paralell in segment level (#32291) 
`applyDelete` used to be serial for delete entries on each segments.
This PR make it work in parallel with errgroup to improve performance

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-24 17:01:24 +08:00
congqixia
37ca32dbba
enhance: Make SegmentDistManager filter use node index (#32533) 
See also #32165

Change `SegmentDistFilter` to interface in order to provde node index
when filter segment dist.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-24 16:53:24 +08:00
yihao.dai
281a583eda
fix: Correct the negative queryable num entities metric (#32361) 
issue: https://github.com/milvus-io/milvus/issues/32281

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-04-24 15:55:24 +08:00
XuanYang-cn
15b989bb80
fix: Zero flushReq metric for all sealed segs (#32404) 
See also: #32399

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-04-24 14:27:23 +08:00
congqixia
dcc15e3ed8
enhance: Remove TestRateLimiter/tests_refresh_rate_by_config case (#32545) 
See also #32313

This case always fail since the watch config logic is removed

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-24 10:13:24 +08:00
PowderLi
29922829da
fix: [restful v2] parameters of create collection (#32485) 
issue: #31176

Signed-off-by: PowderLi <min.li@zilliz.com>
 2024-04-24 09:43:29 +08:00
sre-ci-robot
96911489a6
[automated] Update gpu Builder image changes (#32051) 
Update gpu Builder image changes
See changes:
08bfb431b7
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-04-23 18:53:23 +08:00
smellthemoon
365e50b63e
fix: revert add range search params check in proxy (#32366) 
no need to check params in empty segment.
#30365

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-04-23 17:41:23 +08:00
congqixia
6ef677f79e
fix: Remove metrics after flowgraph closed (#32515) 
See also #32403

`fg_buffer_size` was decreased after metrics removed in flowgraph
ddnode, which make metrics value negative.

This PR move remove metrics logic into `dataSyncService.Close`

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-23 17:33:23 +08:00
smellthemoon
96d95e7743
enhance: fix pass error msg as channel name (#32511) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-04-23 16:45:22 +08:00
yihao.dai
3119a7b23f
fix: Remove watching config event in rate limiter (#32313) 
Remove watching config event in rate limiter to prevent object leaks.
Instead, reset limiter rates periodically.

issue: https://github.com/milvus-io/milvus/issues/32312

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-04-23 16:19:24 +08:00
Cai Yudong
16b8b7b35d
enhance: Add get_vector unittest for float16 & bfloat16 (#32153) 
Issue: #22837

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2024-04-23 16:15:23 +08:00
zhuwenxing
a5f0fc4373
test: add bf/f16 bulk insert testcase (#32506) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-04-23 14:05:23 +08:00
Ted Xu
fef7812254
enhance: trigger compaction by size (#32326) 
See #32328

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-04-23 12:11:24 +08:00
congqixia
bfebdecf3e
enhance: Make LeaderView Manager filter use map index (#32505) 
See also #32165

Change `LeaderViewFilter` to interface to provided map key to avoid
iterating all key-values in LeaderViewManager

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-23 11:07:24 +08:00
chyezh
21a9de5c8e
fix: resource group ut fixup (#32509) 
issue: #30647

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-04-23 10:01:23 +08:00
pingliu
72b054e0c3
doc: change milvus docker image version to v2.4.0 (#32489) 
change milvus docker image version to v2.4.0

Signed-off-by: ping.liu <ping.liu@zilliz.com>
 2024-04-23 09:47:23 +08:00
sre-ci-robot
15558112c5
[automated] Update Knowhere Commit (#32516) 
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2024-04-23 01:33:23 +08:00
sre-ci-robot
ad5a49e6cc Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-04-22 12:00:56 +00:00
Gao
0fab265eed
enhance: update knowhere and some header changes (#32468) 
Signed-off-by: chasingegg <chao.gao@zilliz.com>
 2024-04-22 15:47:26 +08:00
aoiasd
d0ffb71a17
enhance: forbid delete with always true expression (#32472) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-04-22 11:09:23 +08:00
congqixia
d7ff1bbe5c
enhance: Make querycoordv2 collection observer task driven (#32441) 
See also #32440

- Add loadTask in collection observer
- For load collection/partitions, load task shall timeout as a whole
- Change related constructor to load jobs

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-22 10:39:22 +08:00
zhuwenxing
8442098457
test: skip index if it already created (#32402) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-04-22 10:37:22 +08:00
Cai Yudong
5fc439c600
feat: Bulk insert support fp16/bf16 (#32157) 
Issue: #22837

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2024-04-22 10:05:22 +08:00
yiwangdr
037de8e4d3
enhance: speed up minor functions calls in datacoord (#32389) 
Related to https://github.com/milvus-io/milvus/issues/32165

1. nodeid based channel store access should use map access instead of
iteration.

2. The join-ish functions calls are slow when # collections/segments
increases (e.g. 10k).
e.g.
getNumRowsOfCollectionUnsafe is O(num_segments); GetAllCollectionNumRows
is of O(num_collections*num_segments).

Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2024-04-20 07:55:21 +08:00
zhagnlu
93f0c262c1
fix: add bitset sve support macro protect (#32463) 
#32137

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-04-19 18:05:21 +08:00
Ted Xu
744a54a534
enhance: enforce milvus.yaml assertion in UT (#32357) 
See #32168

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-04-19 16:47:20 +08:00
XuanYang-cn
7e830f6185
fix: [skip-e2e] TestAvgReassignPolicy ut (#32450) 
See also: #32448

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-04-19 15:11:20 +08:00
congqixia
01c16fe6e3
enhance: Manual release pool after save targets (#32358) 
See also #31632

Release conc.Pool after usage to clean worker and stop background purge
and ticktock.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-04-19 13:51:21 +08:00
SimFG
8594b55ad5
enhance: add max insert request size and must use partition key configs (#32433) 
issue: https://github.com/milvus-io/milvus/issues/30577
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-04-19 10:31:20 +08:00
SimFG
31a29a2451
enhance: avoid the repeated metric info in the proxy (#32380) 
issue: #30577

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-04-19 10:21:20 +08:00
jaime
18c3cbe46d
enhance: Update tls user doc (#32353) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-04-18 21:07:23 +08:00
zhuwenxing
109cd0402f
test: fix delete expr (#32377) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-04-18 17:25:20 +08:00
zhuwenxing
2cff65511c
test: use float32 to do import (#32276) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-04-18 17:23:27 +08:00
sammy.huang
2a4dfde2de
enhance: revert [skip e2e] use pull_request_target event instead (#32426) 
This reverts commit ab6ddf6929.

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-04-18 17:15:37 +08:00
nico
e83651def4
test: update test cases (#32396) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-04-18 16:15:25 +08:00
sammy.huang
66fae53cd2
enhance: hotfix HOME variable (#32411) 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-04-18 14:49:26 +08:00
PowderLi
a0a23d0666
fix: [restful]use default search parameter nq: 0 (#32355) 
issue: #32225 #31978 #32360

1. v1 can only accept one vector, but v2 accept list of vectors #32225
2. cannot get dbName from AliasReq #31978
3. enhance: [restful v2]support config DB-Name in the http header #32360

---------

Signed-off-by: PowderLi <min.li@zilliz.com>
 2024-04-18 14:41:20 +08:00
zhagnlu
e2c38750c7
fix: modify retry error (#32351) 
#32322

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-04-18 14:25:14 +08:00
sammy.huang
70beec3e47
enhance: hotfix HOME variable (#32405) 
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-04-18 13:08:32 +08:00
sammy.huang
d343d2f3fc
enhance: add vcpkg for rockylinux8 (#32300) 
issues:#32299

Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
 2024-04-18 11:05:20 +08:00
presburger
e2541f04eb
fix: crash on arm64 (#31951) (#31980) 
issue: #31953

Signed-off-by: yusheng.ma <yusheng.ma@zilliz.com>
 2024-04-17 18:03:20 +08:00
zhenshan.cao
02f17b842a
fix: fix incomplete hybrid search result when nq > 1 (#32177) 
issue: https://github.com/milvus-io/milvus/issues/25639

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2024-04-17 17:09:32 +08:00
Jiquan Long
7add7248e2
fix: remove useless log of quota center (#32307) 
/kind improvement
issue: #31272

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-04-17 16:17:19 +08:00
chyezh
a8c8a6bb0f
fix: parameter check of TransferReplica and TransferNode (#32297) 
issue: #30647 

- Same dst and src resource group should not be allowed in
`TransferReplica` and `TransferNode`.

-  Remove redundant parameter check.

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-04-17 15:27:19 +08:00
zhuwenxing
3e2314ebee
test: add negative import testcase (#32163) 
add negative import testcase

---------

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-04-17 10:59:31 +08:00
smellthemoon
d1ef0a81ee
enhance: [skip e2e] change some long logs (#32309) 
<img width="1042" alt="image"
src="https://github.com/milvus-io/milvus/assets/64083300/8daa9ab9-1988-4398-a92a-7d2dac2cd8cd">
change this log

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-04-17 10:25:19 +08:00
yiwangdr
7deda4d5e9
enhance: speed up GetByCollectionAndNode (#32232) 
Related to https://github.com/milvus-io/milvus/issues/32165

Avoid iterating through all replicas/collections if possible. Iteration
is expensive when there are large number of replicas/collections.

Signed-off-by: yiwangdr <yiwangdr@gmail.com>
 2024-04-17 10:23:25 +08:00