test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-02 03:48:37 +08:00
Code Issues Actions 12 Packages Projects Releases Wiki Activity
20,972 Commits 94 Branches 105 Tags 184 MiB
346510ed23
Commit Graph

1574 Commits

Author SHA1 Message Date
XuanYang-cn
2e7670908f
enhance: Track complex delete rates (#36957) 
See also: #36953

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2024-10-18 17:47:30 +08:00
foxspy
3de57ec4fa
enhance: add vector index mgr to remove vector index type dependency (#36843) 
issue: #34298

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
 2024-10-17 22:15:25 +08:00
Chun Han
eccc326e8b
enhance: report err when group_size is wrong(#36146) (#36908) 
related: #36146

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-10-17 16:05:29 +08:00
Bingyi Sun
6851738fd1
fix: fix make generate-mockery panic with go1.22 (#36830) 
https://github.com/milvus-io/milvus/issues/36831
Fix `make generate-mockery` panic.

Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2024-10-17 12:11:31 +08:00
smellthemoon
463c47ced1
enhance: support default value in import (#36700) 
https://github.com/milvus-io/milvus/issues/31728

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-10-17 12:05:24 +08:00
Buqian Zheng
06b5e186a7
fix: return error if searching against BM25 output field with incorrect metric type (#36910) 
issue: https://github.com/milvus-io/milvus/issues/36835

currently searching BM25 output field using IP will end up in an error
in segcore which is hard to understand. now returning error in query
node delegator and provide more useful error message

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-10-16 19:45:23 +08:00
Chun Han
903450f5c6
enhance: add ts support for iterator(#22718) (#36572) 
related: #22718

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-10-16 18:51:23 +08:00
SimFG
bb3ef5349f
enhance: update the expr version to support automatic conversion of variable types (#36832) 
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2024-10-15 10:53:22 +08:00
Buqian Zheng
383350c120
feat: added more checks for function creation check (#36766) 
issue: https://github.com/milvus-io/milvus/issues/35853

* BM25 Function now takes no params, k1, b should be passed via index
params
* support BM25 full text search when metric type is not present in
search request
* add more strict validation with functions at collection creation time

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-10-13 17:43:22 +08:00
Buqian Zheng
16b533cbf0
feat: Restful support for BM25 function (#36713) 
issue: https://github.com/milvus-io/milvus/issues/35853

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-10-13 17:41:21 +08:00
jaime
5713620825
enhance: skip alter operation when no change are detected (#36785) 
issue: #36784

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-10-12 11:25:20 +08:00
aoiasd
db34572c56
feat: support load and query with bm25 metric (#36071) 
relate: https://github.com/milvus-io/milvus/issues/35853

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-10-11 10:23:20 +08:00
Buqian Zheng
f7b811450d
feat: add enable_tokenizer params to VarChar field (#36480) 
issue: #35922

add an enable_tokenizer param to varchar field: must be set to true so
that a varchar field can enable_match or used as input of BM25 function

---------

Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
 2024-10-10 20:33:21 +08:00
congqixia
e4292569c7
enhance: Unify InboundLabel case using metrics.Label (#36613) 
Previous label case broken by #36107, this PR make all inbound label
using label constants from metrics package.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-30 14:15:17 +08:00
jaime
5686a9a024
fix: unhandle error in upsert task (#36604) 
issue: #36611

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-09-30 12:59:16 +08:00
cai.zhang
ecb2b242e2
enhance: Add sorted for segment info (#36469) 
issue: #33744

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-09-30 10:01:16 +08:00
smellthemoon
a78a6b33ab
fix: not check json data when set nullable or default_value (#36575) 
#36354

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-09-29 20:39:15 +08:00
aoiasd
ffc12fb5c4
fix: split delete task msg to MaxMessageSize to avoid mq message too large error (#36197) 
relate: https://github.com/milvus-io/milvus/issues/36089

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-09-27 18:15:19 +08:00
cai.zhang
50905e0b45
fix: Check string array max length after type matching (#36449) 
issue: #36029

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-09-27 09:45:14 +08:00
Zhen Ye
d29e01e284
fix: port listen racing in mix or standalone mode (#36442) 
issue: #36441

---------

Signed-off-by: chyezh <chyezh@outlook.com>
 2024-09-26 21:23:16 +08:00
wei liu
c056620899
fix: Skip unnecessary query node health check in proxy (#36491) 
issue: #36490
After the query node changes from a delegator to a worker, proxy should
skip this querynode's health check.

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-26 18:13:15 +08:00
jaime
52cce4de58
fix: iaccurate size estimation for encoded array data (#36373) 
issue: #36029

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-09-24 14:51:14 +08:00
Chun Han
d55d9d6e1d
fix: change pymilvus version for hybridsearch-groupby(#36407) (#36451) 
related: #36407

---------

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-09-24 14:29:13 +08:00
Chun Han
df7ae08851
fix: iterator cursor progress too fast(#36179) (#36180) 
related: #36179

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-09-24 11:45:13 +08:00
Chun Han
eb23e23cd2
enhance: refine parameter relationship for hybridsearch_group_by(#35096) (#36289) 
related: #35096

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-09-20 14:55:11 +08:00
wei liu
3b10085f61
enhance: Optimize workload based replica selection policy (#36181) 
issue: #35859

This PR introduce two new param: toleranceFactor and checkRequestNum,
after every checkRequestNum request has been assigned, try to compute
querynode's workload score.

if the diff is less than the toleranceFactor, replica selection policy
will fallback to round_robin, which reduce the average cost to about
500ns.

if the diff is larger than the toleranceFactor, replica selection policy
will compute querynode's score to select the target node with smallest
score in every assigment.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-20 12:33:11 +08:00
Ted Xu
363004fd44
enhance: simplify reduction on single search result (#36334) 
See: #36122

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-09-20 11:59:10 +08:00
smellthemoon
e84c4f2a92
fix: to fill default value when nullable and default value are both enable (#36030) 
#36003

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-09-19 17:35:11 +08:00
zhenshan.cao
dcd904d2fa
fix: keep inner topK to avoid exceeding efSearch (#36284) 
issue: #https://github.com/milvus-io/milvus/issues/36243

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2024-09-16 11:01:25 +08:00
cai.zhang
e486442ca6
enhance: Disallow the keywords as a field name or dynamic field name (#36101) 
issue: #35873

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2024-09-15 15:19:14 +08:00
Chun Han
b8b4aea4f5
enhance: restrict max group size(#33544) (#36223) 
related: #33544

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-09-14 15:45:08 +08:00
congqixia
d07338b4b9
enhance: Ignore index check for non-loaded vector field (#36170) 
Related to #35996

For `Field Partial Load` feature, Milvus shall ignore index check for
non-loaded vector field.

Also, this PR unifies the logic of index check for load collection and
load partitions tasks.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-14 11:01:08 +08:00
smellthemoon
2d05b7f219
fix: to add check in partition key field when set nullable==true (#36218) 
#36213

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-09-14 10:53:08 +08:00
zhenshan.cao
9d8d332c88
fix: Fix improper use of offset in HybridSearch (#36244) 
issue :https://github.com/milvus-io/milvus/issues/36243

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2024-09-13 22:05:15 +08:00
wei liu
bd658a6510
enhance: Enable dynamic update replica selection policy (#35860) 
issue: #35859

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-13 17:05:15 +08:00
wei liu
06a706e5f0
fix: fix ReadWrite privilege group deny all global API (#36144) 
issue: #35471

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-13 10:33:08 +08:00
zhagnlu
5e5e87cc2f
enhance: rename some params and reduce default bitmapCardinalityLimit… (#36138) 
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-09-12 12:09:08 +08:00
aoiasd
da227ff9a1
feat: Support create collection with functions (#35973) 
relate: https://github.com/milvus-io/milvus/issues/35853
Support create collection with functions. Prepare for support bm25
function.

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2024-09-12 10:43:06 +08:00
Ted Xu
e7ea1d7a04
enhance: improve log encoding performance on proxy nodes (#36123) 
See #36122

This PR is designed to enhance log performance through two improvements:

1. Optimize JSON encoding by switching JSON serializer to
`json-iterator`.
2. Adding support of lazy initialization `WithLazy`.

---------

Signed-off-by: Ted Xu <ted.xu@zilliz.com>
 2024-09-11 14:51:07 +08:00
CharlesFeng
29ddb10e8c
enhance: timer instead of ticker (#36133) 
https://github.com/milvus-io/milvus/issues/36132

Signed-off-by: fengjun2016 <jornfeng@gmail.com>
 2024-09-10 15:23:06 +08:00
Jiquan Long
89bf226f0b
feat: support keyword text match (#35923) 
fix: #35922

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2024-09-10 15:11:08 +08:00
congqixia
51870aef08
enhance: Use stats Handler to record request/response size metrics (#36107) 
Related to #36102

This PR use newly added `grpcSizeStatsHandler` to reduce calling
`proto.Size` since the request & response size info is recorded by grpc
framework.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-09 17:13:05 +08:00
jaime
91d23ecbe1
fix: memory leak in proxy meta cache (#36075) 
issue: #36074

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-09-08 17:33:05 +08:00
Chun Han
e480b103bd
feat: supporing hybrid search group_by (#35982) 
related: #35096

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
 2024-09-08 17:09:04 +08:00
smellthemoon
21b135c7c2
fix: not append valid data when transfer to insert record (#36027) 
fix not append valid data when transfer to insert record and add a tiny
check when in groupBy field.
#35924

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2024-09-06 14:53:04 +08:00
yihao.dai
8b043f58dc
fix: Fix DB limiter nodes are mistakenly cleaned up (#35991) 
This issue only occurs for a short time right after a table is created.
To avoid this, we simply reduce the frequency of cleaning up invalid
limiter nodes.

issue: https://github.com/milvus-io/milvus/issues/35933

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-09-05 17:35:04 +08:00
wei liu
32e55a02ea
fix: Fix privilege group hasn't been register for validate (#35937) 
issue: #35471

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2024-09-05 15:35:04 +08:00
congqixia
66ed289a85
enhance: Fix typo of clustering key not loaded msg (#35948) 
Related to #35415

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2024-09-05 10:49:03 +08:00
jaime
24fb10114b
enhance: remove cooling off in rate limiter for read requests (#35935) 
issue: #35934

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2024-09-04 14:39:10 +08:00
zhagnlu
325f1987d9
enhance: rewrite index params for compatibility (#35788) 
#32900

Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
 2024-09-02 19:41:03 +08:00