Commit Graph

16400 Commits

Author SHA1 Message Date
aoiasd
60abe08f85
Add retention for access log on minio (#20681)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-12-08 19:39:19 +08:00
yah01
9ebaa10dec
Add more logs for GetShardLeaders (#21046)
Also increase the heartbeatAvailableInterval from 2.5s to 10s

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-08 19:09:18 +08:00
Bingyi Sun
27219ce9c0
Fix load progress bug (#21069)
issue: #21023

Signed-off-by: sunby <bingyi.sun@zilliz.com>

Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-12-08 18:41:20 +08:00
smellthemoon
18cad3a1fb
Optimization of delete and insert (#20990)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-12-08 18:37:19 +08:00
cai.zhang
eb7ef01b9a
Fix bug for ListWithPrefix from minio with recursive is false (#21059)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-12-08 15:47:18 +08:00
Jiquan Long
6709ccf690
Fix empty retrieve result (#21032)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-12-08 10:15:19 +08:00
NicoYuan1986
50acf00ff2
Modify test cases of search pagination (#20993)
Signed-off-by: nico <cheng.yuan@zilliz.com>

Signed-off-by: nico <cheng.yuan@zilliz.com>
2022-12-08 09:51:20 +08:00
binbin
a9b35b4981
Enable test case after code fix (#20983)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-12-08 09:49:24 +08:00
Bennu
ab801a1d67
[skip e2e] Add log export for milvus installed by operator (#20982)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>

Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2022-12-08 09:47:32 +08:00
ThreadDao
43dce09020
Add case query with empty partition names (#20989)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-12-08 09:45:26 +08:00
Enwei Jiao
89b810a4db
Refactor all params into ParamItem (#20987)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-07 18:01:19 +08:00
yah01
80a2a49681
Improve error message when target id not match (#21043)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-07 17:17:19 +08:00
Jiquan Long
dee426a7a5
Fix group checker ut (#21038)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-12-07 16:11:22 +08:00
Ji Bin
6692c9999e
Using first unicastable address as local ip (#20674)
Signed-off-by: Ji Bin <matrixji@live.com>

Signed-off-by: Ji Bin <matrixji@live.com>
2022-12-07 15:03:19 +08:00
groot
33a102c6fc
Refine bulkinsert (#20986)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-12-07 14:53:18 +08:00
Xiaofan
e131915207
Support 64M Rpc Limit (#20845)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-12-07 10:07:18 +08:00
SimFG
f8cff79804
Support the graceful stop for the query node (#20851)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-12-06 22:59:19 +08:00
congqixia
5e49b095f5
Fix compaction handler may double release and block forever (#21015)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-06 20:09:18 +08:00
yah01
0297ab1a46
Make progress if any channel/segment was loaded on node (#20775)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-06 18:29:19 +08:00
yah01
11e4445ef7
Check whether segments are fully loaded while fetching shard leaders (#20991)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-06 18:05:18 +08:00
XuanYang-cn
f844aa0cab
Remove not inuse stale segments in flushmsg (#20981)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-12-06 17:51:18 +08:00
smellthemoon
c49f20ea94
Load should base on the accurate loaded number (#20999)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-12-06 17:13:18 +08:00
Ten Thousand Leaves
2f5b03fef7
Split small segment proportion and small segment compactable proportion (#20996)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-06 14:37:18 +08:00
jaime
039e9ce4bb
Refine msgstream interface (#20832)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-12-05 20:55:17 +08:00
jaime
548e90ec68
Support an analogous Java Guava cache implementation (#20831)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-12-05 20:29:18 +08:00
XuanYang-cn
243d8cff82
Provide different channelNames for channelmanager test (#20969)
Fixes: #20790

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-12-05 15:39:22 +08:00
yah01
aec347e591
Check last heartbeat response time while fetching shard leaders (#20968)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-05 15:09:20 +08:00
yah01
47b76e13be
Fix shard leader misses to fill target ID while delegates query/search (#20973)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-05 14:09:17 +08:00
congqixia
2791f5526c
Fix BufferData limit calculation for BinaryVector (#20963)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-05 11:15:17 +08:00
XuanYang-cn
3a558aa04f
Add ut for rootcoord/kv/kv_catalog.go (#20909)
Add ut for CreateCredential, GetCredential, Dropcredential,
ListCredentials, CreateRole, DropRole AlterUserRole, ListRole,
ListUser, ListUserRole, DeleteGrant, AlterGrant, ListGrant, and, ListPolicy

Fixes: #20833

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-12-05 11:05:17 +08:00
zhuwenxing
c1b5e6aeb9
[test]Fix bulk insert perf (#20927)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-12-05 09:01:17 +08:00
yah01
25a3b9ae19
Check target node ID for query/search (#20967)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-04 20:05:17 +08:00
sre-ci-robot
8094eea2ed Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-12-02 12:00:37 +00:00
congqixia
4238b5dbab
Make datanode unittest use embed etcd server (#20948)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-02 16:05:16 +08:00
yah01
482986cdf6
Revert "Fix fake segment is never handled (#20935)" (#20945)
This reverts commit 8f449f2996.

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-02 11:41:16 +08:00
yah01
ec3aef1f3e
Add time records for search path (#20924)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-02 11:39:17 +08:00
liliu-z
aecf2e4f4b
Upgrade knowhere to 1.3.4 (#20914)
Signed-off-by: Li Liu <li.liu@zilliz.com>

Signed-off-by: Li Liu <li.liu@zilliz.com>
2022-12-02 00:33:21 +08:00
congqixia
40abb13413
Generate unique id with ts for sync task (#20928)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-01 20:35:18 +08:00
congqixia
f745d7f489
Fix compaction target segment rowNum is always 0 (#20937)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-01 20:33:17 +08:00
jingkl
e5c9da7152
add the testcase (#20891)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>

Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-12-01 20:13:19 +08:00
zhenshan.cao
9724ae5e27
Refine log level (#20904)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-12-01 20:07:15 +08:00
yah01
8f449f2996
Fix fake segment is never handled (#20935)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-01 20:03:16 +08:00
Ten Thousand Leaves
b238f4ee58
Remove bad & duplicate metric (#20905)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-01 16:39:16 +08:00
cai.zhang
9a42cff9b4
GetFlushedSegments should include flushing segment (#20859)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-12-01 16:35:20 +08:00
Ten Thousand Leaves
c373b44c2c
Verify and adjust segment # of rows before saving and passing SegmentInfo (#20837)
issue: #18120

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-12-01 16:31:16 +08:00
yah01
ddd29ea6ab
Optimize scheduler, increase merge tasks probability (#20922)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-12-01 16:25:16 +08:00
smellthemoon
f7d603f947
Fix Group Checker test fail (#20911)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-12-01 13:39:15 +08:00
congqixia
82fe655032
Setup lastSyncTs when add segment to avoid sync next timetick (#20920)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-12-01 12:29:16 +08:00
xige-16
a20770c172
Delete logs that print sensitive information (#20889)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-12-01 10:35:16 +08:00
Ten Thousand Leaves
67390d208b
Reduce seal proportion from 0.25 to 0.23 (#20907)
When segment are sealed with > 0.25 * segment.maxSize, we won't be able to compact 4 segments like these because the total size will be slightly over 0.25 * 4 * segment.maxSize.

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-30 18:47:15 +08:00