Commit Graph

14870 Commits

Author SHA1 Message Date
jaime
218326bafe
Use unified catalog interface to reconstruct metastore (#17042)
Co-authored-by: kejiang ke.jiang@zilliz.com
Co-authored-by: yun.zhang yun.zhang@zilliz.com

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-06-07 12:00:07 +08:00
sre-ci-robot
5cb9c429f6
Update Builder image changes (#17380)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-06-06 22:24:05 +08:00
zhuwenxing
916cd23efa
[skip e2e]Update the image of etcd for chaos and deploy test (#17399)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-06 22:12:05 +08:00
bigsheeper
f38637c227
Pass PlaceholderGroup pointer to prevent memory copy in SegCore (#17389)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-06 21:34:05 +08:00
zhenshan.cao
98e95275fe
Fix several code issues caused by carelessness (#17385)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-06 18:58:05 +08:00
bigsheeper
9f786dd752
Remove unnecessary bitset flip in Search and Query (#17387)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-06 17:38:05 +08:00
yah01
a2d2ad88bd
Make assigning segments faster (#17377)
This improve the Load performance,
and let the LoadBalance fails fast, which allows us to retry it timely

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-06 16:52:05 +08:00
congqixia
ac6394d0fd
Fix container/list removal in iteration (#17382)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-06 16:34:05 +08:00
Xiaofan
af994b5e1c
Fix etcd watch error (#17364)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-06 16:26:06 +08:00
bigsheeper
45febac298
Extract lease of cProto in QueryNode (#17373)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-06 15:56:05 +08:00
shaoyue
679820c8e7
Fix typo in publish builder (#17336)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-06-06 15:24:06 +08:00
XuanYang-cn
c70af73005
Fix datacoord set wrong state for node registering (#17376)
Fix datacoord datarace

See also: #17335

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-06-06 15:10:05 +08:00
Jenny Li
a4a699164c
[skip e2e] Disable daily release when repo is not milvus-io/milvus (#17374)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-06-06 11:50:05 +08:00
zhuwenxing
99cbaccdf1
[skip e2e]Update the method to check health for deploy (#17359)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-03 17:14:04 +08:00
bigsheeper
48cf63a2d7
Wait for flow graph to exit (#17341)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-02 19:48:04 +08:00
shaoyue
76eaa3fc50
Support access s3 through AWS IAM role (#17292)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-06-02 19:42:03 +08:00
SimFG
0986c29d7f
proxy tls support one-way authentication (#17348)
Signed-off-by: xiyichan <2863768433@qq.com>

Co-authored-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>

Co-authored-by: xiyichan <2863768433@qq.com>
2022-06-02 18:56:04 +08:00
Ten Thousand Leaves
f5e63177d2
Fix an issue with bulk load with multiple DataNodes (#17324)
issue: #17300
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-06-02 18:54:04 +08:00
yah01
4e83f37899
Improve load performance (#17273)
Load segment's fields concurrently

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-02 17:56:03 +08:00
shaoyue
7c52a8c535
Add RESTful API for new methods, fix err when receive empty boy (#17260)
create collection schema use struct instead of protobuf

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-06-02 17:40:04 +08:00
xige-16
8c69790383
Fix lost delete msg caused by loadSegment after watchDeltaChannel (#17308)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-02 16:56:04 +08:00
zhenshan.cao
5f44e45480
Add metrics on QueryNode and Proxy (#17328)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-02 16:06:03 +08:00
Jiquan Long
adf3b14027
Refine channels management in Proxy. (#17334)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-02 15:34:04 +08:00
zhuwenxing
5fdbe23779
[skip e2e]Add export log step for first deployment (#17337)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-02 14:36:03 +08:00
zhuwenxing
e5f5d5e08a
[skip e2e]Update config for deploy and chaos test (#17333)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-02 14:34:07 +08:00
bigsheeper
7a59a80506
Remove segmentPtr lock and use collection lock instead (#17303)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-02 14:00:04 +08:00
XuanYang-cn
42f643e727
Make DataNode release rather than delete when reassign (#17293)
1. Reassgin now will assign to the original Node if no other nodes
   avaliable
2. Make AddNode balance async: ToRealse + Reassign

See also: #16114, #17270

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-06-02 13:56:04 +08:00
Enwei Jiao
8cb59a9233
fix compile marisa failed when did not install libtool (#17326)
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
2022-06-02 13:43:11 +08:00
yah01
cc69c5cdd3
Make Cluster interface's methods called outside public (#17315)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-02 13:16:05 +08:00
congqixia
c76b4ade01
Fix data race in LoadSegmentsTask (#17342)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-02 12:52:03 +08:00
zhenshan.cao
2763efc9b0
Add cache of grpc client of ShardLeader in proxy (#17301)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-02 12:16:03 +08:00
jaime
5698bf4236
Add sasl configurations for kafka (#17323)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-06-02 12:12:03 +08:00
Jiquan Long
e88ffb8a57
Enable marisa trie ut on MacOS (#17316)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-02 10:48:03 +08:00
shaoyue
7527285ec4
Fix mixture (#17332)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-06-02 10:34:03 +08:00
bigsheeper
e0cbacba59
Check ignorable error to prevent unnecessary panic (#17317)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-02 10:12:03 +08:00
yah01
f5bd519e49
Add retry mechanism for NodeDown LoadBalance (#17306)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-01 20:00:03 +08:00
ThreadDao
3dea300efc
[test] Add case as annoy index knowhere crash (#17295)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-06-01 18:56:03 +08:00
jingkl
7e7941af78
[test]Add the testcase with query and search (#17320)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-06-01 18:54:03 +08:00
zhuwenxing
3ccc91532e
[skip e2e]Add information of etcd to logs in chaos and deploy test (#17299)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-06-01 17:32:02 +08:00
xige-16
63a31ccb38
Remove error return value when removeSegment (#17310)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-01 13:18:02 +08:00
Xiangyu Wang
c173ad19a7
Update account (#17304)
Signed-off-by: Xiangyu Wang <wxyucs@gmail.com>
2022-06-01 10:02:02 +08:00
Jiquan Long
b4f797506d
Fix err msg of invalid expression (#17296)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-01 10:00:07 +08:00
sre-ci-robot
04011a7ecd Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-06-01 00:01:30 +00:00
Jiquan Long
72f454e054
Fix 16961, make creating dml stream idempotent (#17302)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-05-31 22:58:02 +08:00
XuanYang-cn
d920e5c915
Fix DataNode panic while allocating IDs (#17294)
See also: #17270

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-05-31 18:02:03 +08:00
cai.zhang
bcf3b7426a
Add distributed lock for segment refgerence (#16782)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-31 16:36:03 +08:00
groot
affcc2acad
Fix bulkload entity number bug (#17278)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-05-31 15:40:04 +08:00
bigsheeper
f55fe6be3c
Merge historical replica and streaming replica in QueryNode (#17217)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-31 13:42:03 +08:00
Xiaofan
9579a645c6
Support compile marisa on Macos (#17261)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-31 13:28:02 +08:00
Jiquan Long
6bd786bf50
Reduce default seal propotion (#17287)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-31 12:02:04 +08:00