test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-02 03:48:37 +08:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
20,740 Commits 94 Branches 105 Tags 184 MiB
489087d18b
Commit Graph

20740 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
zhagnlu
489087d18b
enhance: refactor executor framework V2 (#35251) 
#32636

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-09-13 20:57:09 +08:00
jaime
22cce44afc
fix: metrics stored_index_files_size is never cleared (#36160) 
issue: #36159

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-09-13 20:09:15 +08:00
congqixia
58d3200986
enhance: Filter out non-hit delete records during load delta (#36207) 
Related to #35303

This PR utilizes pk index in segment to exclude non-hit delete record
during load delete records. This ability is crucial when l0/delete
forward policy only replies on segment itself(without BF filtering).

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-13 19:05:08 +08:00
wei liu
f7d950d465
fix: [skip e2e] Fix unstable ut TestCollectionObserver (#36231) 
issue: #36237

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-13 19:01:09 +08:00
wei liu
fb2a41a94c
fix: Clean dirty segment/channel on querynode (#36202) 
issue: #36201
after querynode has been remove from replica, all dirty segment/channel
on it should be released.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-13 18:15:08 +08:00
Zhen Ye
b4c1603a57
fix: skip recover flusher on streaming node when channel is dropped (#36149) 
issue: #36016,#36230

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-09-13 17:19:08 +08:00
wei liu
bd658a6510
enhance: Enable dynamic update replica selection policy (#35860) 
issue: #35859

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-13 17:05:15 +08:00
Zhen Ye
c03eb6f664
fix: streaming node consume blocks if recv message is too large (#36151) 
issue: #36081

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-09-13 16:41:08 +08:00
yanliang567
2e434b2358
test: Add group size tests (#36240) 
related issue: #36146

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2024-09-13 16:13:08 +08:00
aoiasd
c22a2cebb6
fix: split stream query result to avoid grpc response too large error (#36090) 
relate: https://github.com/milvus-io/milvus/issues/36089

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-09-13 15:07:09 +08:00
Jiquan Long
f0f2fb4cf0
enhance: span tracing of c++ part (#36205) 
fix: https://github.com/milvus-io/milvus/issues/36204

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-09-13 11:19:09 +08:00
wei liu
06a706e5f0
fix: fix ReadWrite privilege group deny all global API (#36144) 
issue: #35471

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-13 10:33:08 +08:00
congqixia
c6eb6c7cb2
enhance: Add error handler for write buffer (#36216) 
Related to #36215

This PR add error handler setting option providing the possibility to
change error handling behavior other than panicking.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-13 10:11:09 +08:00
Ted Xu
b9c037f558
feat: adding cache to expression parse (#36185) 
See #36122

This PR improves the proxy node performance by adding cache to
expression parse.

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-09-13 10:03:09 +08:00
sre-ci-robot
1833f2d516 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-09-13 00:01:28 +00:00
cai.zhang
8395c8a8db
enhance: Update stats task to optional (#35947) 
issue: #33744

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-09-12 20:37:08 +08:00
XuanYang-cn
e8840a1b41
enhance: Add metrics for Delete entries num of L0seg (#36175) 
- Add metrics *DataCoordL0DeleteEntriesNum*
- Remove metrics *DataCoordRateStoredL0Segment*

See also: #36147

---------

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-09-12 18:07:08 +08:00
binbin
b5ff348906
test: Add part of test cases for default and null support (#36186) 
issue : #36129

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2024-09-12 17:29:13 +08:00
zhagnlu
5e5e87cc2f
enhance: rename some params and reduce default bitmapCardinalityLimit… (#36138) 
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-09-12 12:09:08 +08:00
congqixia
11dbe1e755
enhance: Add L0 forward policy to support remote load (#36189) 
Related to #35303

This PR add a param item to support change l0 forward behavior from bf
filtering and forward to remote load.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-12 12:01:08 +08:00
aoiasd
da227ff9a1
feat: Support create collection with functions (#35973) 
relate: https://github.com/milvus-io/milvus/issues/35853
Support create collection with functions. Prepare for support bm25
function.

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-09-12 10:43:06 +08:00
congqixia
08e681174a
fix: [GoSDK] Sync empty result set handling (#36177) 
Related to #33952

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-12 10:27:08 +08:00
congqixia
700a443e85
enhance: Check ANN field loaded in proxy (#36172) 
Related to #35415

Currently ANN field is loaded in Parital load is not performed in proxy,
this cause error message not clear and no error returned when collection
is empty

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-11 17:43:06 +08:00
Ted Xu
e7ea1d7a04
enhance: improve log encoding performance on proxy nodes (#36123) 
See #36122

This PR is designed to enhance log performance through two improvements:

1. Optimize JSON encoding by switching JSON serializer to
`json-iterator`.
2. Adding support of lazy initialization `WithLazy`.

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-09-11 14:51:07 +08:00
smellthemoon
3f75bf1f20
fix: clustering compact not support null (#36152) 
#36055

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-09-11 14:49:06 +08:00
XuanYang-cn
f31264c02c
fix: Change l0SegmentsRowCount limits to a reasonable value (#36014) 
See also: #36028

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-09-11 11:55:08 +08:00
binbin
d9c8d1ea90
test: Add part of test cases for default and null support (#36130) 
issue: #36129

Signed-off-by: binbin lv <binbin.lv@zilliz.com>
 2024-09-11 10:59:07 +08:00
wt
dbe03a6151
test: add check after altering cardinality limit (#36158) 
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2024-09-11 10:49:06 +08:00
nico
42eef4900d
test: update test cases and sdk version (#36148) 
Signed-off-by: nico <cheng.yuan@zilliz.com>
 2024-09-11 10:45:07 +08:00
sre-ci-robot
229f969560 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2024-09-10 12:00:39 +00:00
yellow-shine
2694551757
enhance: fix a security vulnerability (#36154) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-09-10 19:09:27 +08:00
yellow-shine
1d22de140a
enhance: [pipeline] list all status before uninstall helm release (#36040) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-09-10 19:07:08 +08:00
CharlesFeng
29ddb10e8c
enhance: timer instead of ticker (#36133) 
https://github.com/milvus-io/milvus/issues/36132

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-09-10 15:23:06 +08:00
yellow-shine
9d10f378e1
enhance: [skip e2e] [mergify]replace branch by reference (#36139) 
https://github.com/milvus-io/milvus/issues/36140

Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-09-10 15:21:07 +08:00
yellow-shine
9aa01c69f8
enhance: add a env (#36142) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-09-10 15:19:13 +08:00
Jiquan Long
89bf226f0b
feat: support keyword text match (#35923) 
fix: #35922

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-09-10 15:11:08 +08:00
cai.zhang
b0939fd20e
enhance: Reset task check interval configuration (#36121) 
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-09-10 14:35:08 +08:00
Chun Han
9d0aa5c202
fix: empty result when having only one subReq(#36098) (#36128) 
related: #36098

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-09-10 14:25:07 +08:00
Bingyi Sun
53a8a24554
fix: fix empty indices of sparse float (#35403) 
https://github.com/milvus-io/milvus/issues/35401

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-09-10 14:23:07 +08:00
CharlesFeng
4850641943
fix: BinlogDeserializeReader leak (#36087) 
https://github.com/milvus-io/milvus/issues/36086

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-09-10 12:43:07 +08:00
zhuwenxing
f4d0c589fa
test: set bulk insert test fail fast (#36039) 
/kind improvement

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2024-09-10 11:43:06 +08:00
yellow-shine
c9f7512e6d
enhance: [skip e2e] fix mergify (#36135) 
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
 2024-09-10 10:59:06 +08:00
wt
53a87825f3
test: add more bitmap test cases (#36131) 
1. verified issues #36054 and #35971 
2. add mix scenes test cases for BITMAP index

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2024-09-10 10:55:07 +08:00
wei liu
5aedc169cd
fix: Revert "enhance: avoid the coexistence of the old coordinator and the new node/proxy (#35720)" (#36113) 
issue: #36100
This reverts commit 73be0ba941.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-10 10:23:07 +08:00
congqixia
851f3b9883
fix: Make legacy non-lexicographic branch break swtich (#36125) 
Related to #35941
Previous PR: #36034

This patch makes the switch branching logic correct and make the unit
test work for cases which does not select the whole dataset.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-10 10:15:07 +08:00
congqixia
c0c12c6c5b
fix: Use SliceSetEqual to compare load field list (#36051) 
Related to #36037

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-10 10:13:14 +08:00
wt
c916407f37
test: add query expr test cases (#36073) 
1. query with expr under different scalar index types
2. test framework supports preparing one piece of data and multiple
parameter queries

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
 2024-09-09 19:55:06 +08:00
OxalisCu
3a381bc247
enhance: Bulkinsert supports null in csv formats (#35912) 
see details in this issue
https://github.com/milvus-io/milvus/issues/35911

---------

Signed-off-by: OxalisCu <2127298698@qq.com>
 2024-09-09 19:17:07 +08:00
congqixia
aaa8487590
enhance: Remove duplicated log in proxy service (#36110) 
Remove duplicate identical log in proxy/service.go

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-09 17:19:05 +08:00
congqixia
51870aef08
enhance: Use stats Handler to record request/response size metrics (#36107) 
Related to #36102

This PR use newly added `grpcSizeStatsHandler` to reduce calling
`proto.Size` since the request & response size info is recorded by grpc
framework.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-09 17:13:05 +08:00