Commit Graph

15799 Commits

Author SHA1 Message Date
sre-ci-robot
11aed479d1
[create-pull-request] automated change (#19871)
Co-authored-by: sre-ci-robot <sre-ci-robot@users.noreply.github.com>
2022-10-19 10:15:37 +08:00
smellthemoon
108e51b2f0
[test]Create index before load and fix error message (#19874) (#19857)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Co-authored-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-10-19 10:01:26 +08:00
zhuwenxing
a752682de0
[test]Create index before load and fix error message (#19874)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-10-18 21:21:27 +08:00
congqixia
48463a12ef
Fix querynode concurrent map rw panic (#19867)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-18 19:47:36 +08:00
Xiaofan
5b9988b627
Support collection level monitoring metrics (#19686)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-18 19:17:27 +08:00
wayblink
4cc57adc5d
Initiatively release session in etcd when service close (#19825)
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-10-18 19:13:26 +08:00
Jenny Li
6f5ff61ac3
[skip e2e] Add publish migration image (#19869)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-18 18:49:26 +08:00
NicoYuan1986
7fd4710240
Modify according cases because load needs index now (#19860)
Signed-off-by: nico <cheng.yuan@zilliz.com>

Signed-off-by: nico <cheng.yuan@zilliz.com>
2022-10-18 18:47:31 +08:00
zhuwenxing
05fbbf2e33
[test]Update bulk insert test case and skip calc_distance testcases (#19855)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-10-18 17:21:26 +08:00
cai.zhang
b3f6b67977
Alloc timestamp instead of using start position timestamp for segment index (#19820)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-10-18 17:05:26 +08:00
bigsheeper
15f7592739
Intercept import request in Proxy interceptor (#19856)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-18 16:53:26 +08:00
XuanYang-cn
2785f98de6
Refactor segment replica in DN (#19815)
- Replace isNew and isFlushed with sType
- Add compacted into proto
- Rename replica to channel
- Rename segmentReplica to channelMeta
- Replace 4 maps with 1 map
- Add segment.go and segment_test.go

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-10-18 15:33:26 +08:00
jaime
f8cb260931
Add a collection TTL doc (#19859)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-10-18 14:09:26 +08:00
congqixia
a1cdc55bcb
Make newSegment transfer state after SaveBinlogPath succuess (#19858)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-18 14:07:25 +08:00
jaime
59bcbf0cf6
Support check health for the service level (#19779)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-10-18 13:39:26 +08:00
Ten Thousand Leaves
db33f401fd
Fix proxy crash issue when meta cache miss (#19844)
issue: #19557

/kind bug

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-10-18 13:11:26 +08:00
zhuwenxing
3e11f2a700
[test]Make pymilvus version compatible (#19824)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-10-18 13:09:30 +08:00
Ten Thousand Leaves
a4a6f60279
Refine NQ check logic (#19819)
issue: #19682

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-10-18 13:07:34 +08:00
sre-ci-robot
40091392f0
[create-pull-request] automated change (#19835)
Co-authored-by: sre-ci-robot <sre-ci-robot@users.noreply.github.com>
2022-10-18 09:01:25 +08:00
Enwei Jiao
0a83cdfe1b
Refactor grpclient, make it generic (#19791)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-10-17 20:05:26 +08:00
yah01
b0404cbbab
Remove dropped segments' info (#19839)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-17 19:41:26 +08:00
Jiquan Long
34e04c27ad
[skip e2e] Fix missing num_rows after meta migration (#19841)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-10-17 19:40:51 +08:00
yah01
17ce0c3979
Refine the error of QueryNode (#19836)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-17 19:39:26 +08:00
SimFG
7336d0580a
Fix the wrong file name (#19843)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-17 19:29:40 +08:00
SimFG
2b512a3371
Improve the making milvus process (#19833)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-17 19:19:25 +08:00
NicoYuan1986
c551b2bdfa
Modify cases associated with updated shard num (#19811)
Signed-off-by: nico <cheng.yuan@zilliz.com>

Signed-off-by: nico <cheng.yuan@zilliz.com>
2022-10-17 19:03:26 +08:00
congqixia
a3f84f2ea3
Remove dependency for dropped segment checkpoint in querynode (#19831)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-17 18:47:25 +08:00
cai.zhang
9d43947f1c
Must create index before load (#19516)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-10-17 18:01:25 +08:00
bigsheeper
760e9c5df2
Enable rate limit and update quota unit (#19816)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-17 16:23:25 +08:00
SimFG
ae8ec28925
Delete the unrelated content in the yaml file (#19812)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-17 15:45:25 +08:00
Jiquan Long
b0a12116c8
Fix meta migration tool (#19814)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-10-17 15:07:25 +08:00
xige-16
158787811e
Move assemble/disassemble func to core (#19420)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-10-16 21:17:25 +08:00
cai.zhang
9e8a59ac4c
Add nameing rules for index name (#19803)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-10-16 21:05:25 +08:00
SimFG
a55f739608
Separate public proto files (#19782)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
bigsheeper
a92b242ecd
Fix ttFactor in QuoterCenter (#19802)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-16 09:17:24 +08:00
yah01
89c9cb3680
Fix scan may break GC limitation (#19670)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-15 15:13:24 +08:00
Xiaofan
d45d667f5f
Update README.md 2022-10-14 22:18:38 +08:00
Jenny Li
cb5142aace
[skip e2e]Only allow one nightly at the same time (#19800)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-10-14 21:29:24 +08:00
NicoYuan1986
3e10fe6351
[skip e2e]Update the script for nightly test (#19799)
Signed-off-by: nico <cheng.yuan@zilliz.com>

Signed-off-by: nico <cheng.yuan@zilliz.com>
2022-10-14 21:21:26 +08:00
NicoYuan1986
7e75e15f6f
[skip e2e]Close nightly ci at 22:50 (#19798)
Signed-off-by: nico <cheng.yuan@zilliz.com>

Signed-off-by: nico <cheng.yuan@zilliz.com>
2022-10-14 21:19:28 +08:00
SimFG
3d12325796
Gracefully handle the hook plugin loading failure error (#19789)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-14 19:59:24 +08:00
NicoYuan1986
23f13de233
Modify test cases due to pymilvus updates (#19793)
Signed-off-by: nico <cheng.yuan@zilliz.com>

Signed-off-by: nico <cheng.yuan@zilliz.com>
2022-10-14 19:07:24 +08:00
yah01
5f542b96ba
Fix incorrect e2e test (#19786)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-14 18:11:24 +08:00
bigsheeper
3a5aaeb7ad
Fix read queue metrics and memory protection (#19787)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-14 18:05:24 +08:00
xige-16
a1db9038fb
Move disk index params to config file (#19714)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-10-14 17:51:24 +08:00
bigsheeper
bdaddd7b09
Revert DML quota check (#19790)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-14 17:17:23 +08:00
Ten Thousand Leaves
8b8df0a5e9
Do not use DataCoord context when DataNode is handling import task (#19732)
So that when DataCoord is done, DataNode can still proceed.

/kind bug

issue: #19730
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-10-14 15:15:24 +08:00
Jiquan Long
cb51d410a2
Limit max shard num to 64 (#19776)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-10-14 14:51:23 +08:00
xige-16
8c9c1672ae
Assign different storage config for indexes (#19517)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-10-14 14:45:23 +08:00
congqixia
089912baa7
Fix segcore unit test name (#19783)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-14 14:29:24 +08:00