Commit Graph

1164 Commits

Author SHA1 Message Date
wayblink
85e04d845c
Move GetComponentStates to milvus.proto, make it an external interface (#19594)
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-10-10 15:55:22 +08:00
congqixia
8c1c8000ac
Add TargetID in MsgBase and querynode v2 API check (#19627)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-08 20:26:57 +08:00
zhenshan.cao
0ac4bc32a5
Add logic of autoindex (#19570)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-10-08 15:38:58 +08:00
congqixia
d79f88c5f6
Fix segmentPtr concurrent visit and destroy (#19560)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-29 21:54:55 +08:00
yah01
51eb12a034
Fix QueryNode panics (#19541)
Applying delete messages during the segment was compacted,
the QueryNode would panic.

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-29 18:02:54 +08:00
congqixia
838a633584
Add ctx parameter for ChunkManager methods (#19546)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-29 16:18:56 +08:00
yah01
9dcee37e1c
Skip canceled tasks (#19513)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-28 19:58:54 +08:00
yah01
377f856833
Fix balance may confuse leader observer (#19435)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-28 12:10:54 +08:00
congqixia
16170e2cef
Return task context error when read task timeout (#19288)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-28 12:08:59 +08:00
wgcn
6972efe6ba
fix reduce latency metric (#19479)
Signed-off-by: wgcn <1026688210@qq.com>

Signed-off-by: wgcn <1026688210@qq.com>
2022-09-27 19:40:54 +08:00
bigsheeper
39be6e455a
Set cgopool's ExpiryDuration to infinite duration (#19458)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-09-27 19:36:54 +08:00
congqixia
384e7c3169
Fix force release segment logic (#19471)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-27 19:22:54 +08:00
XuanYang-cn
52c6a2706e
Fix binary results unstable (#19401)
See also: #19338, #19366, 19367

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-09-26 18:02:52 +08:00
Enwei Jiao
fc8061bb86
improve logs to debug growing segment load failed (#19419)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-09-26 17:36:54 +08:00
xige-16
d4bc00423c
Fix start milvus failed on macos (#19394)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-09-23 16:54:50 +08:00
Xiaofan
928a213e31
Fix Chunk Manager Path mis use (#19141)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-09-23 14:40:51 +08:00
congqixia
c4761100a7
Fix SyncDistribution set Action (#19360)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-22 13:18:50 +08:00
congqixia
72ee35a78f
Add loading list filter logic for load segments (#19347)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-21 21:30:51 +08:00
xige-16
428840178c
Support diskann index for vector field (#19093)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-09-21 20:16:51 +08:00
XuanYang-cn
297d75fc92
Enable query pagination (#19231)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-09-20 20:48:50 +08:00
Bingyi Sun
8f84208c6b
Move growing segments to leaderview in GetDataDistributionResponse (#19292)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-09-20 19:24:51 +08:00
congqixia
50ea4eeef1
Fix querynode data distribution return false positive dm channel (#19249)
Co-authored-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
2022-09-20 12:04:49 +08:00
congqixia
3759f23f88
Add error log for load segment file failure (#19227)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-19 14:08:48 +08:00
SimFG
d7f38a803d
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
bigsheeper
5cdd6ca251
Add quotaCenter, rateLimiter and rateCollector (#18636)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-09-16 09:56:47 +08:00
XuanYang-cn
ac1982c8a8
Add merger for retrieve results (#18948)
See also: #18893

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-09-15 19:12:32 +08:00
Bingyi Sun
626854cf0c
Refactor QueryCoord (#18836)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-15 18:48:32 +08:00
XuanYang-cn
086eb92ade
Enable sort for segcore RetrieveResults (#18894)
See also: #18893

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-09-14 11:04:30 +08:00
Xiaofan
ec48e2405a
Fix Cgo lock os thread failed (#19148)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-09-13 10:16:30 +08:00
cai.zhang
e65ba6331e
Only store segmentID for flushed segments event (#19075)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-09-09 15:52:35 +08:00
Cai Yudong
7b5eb85205
Remove redundant parameter for segcore Search() (#19025)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-09-06 12:05:11 +08:00
congqixia
6ea0fb82ab
Add InvalidNodeID logic to remove segments from offline segments (#18975)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-02 10:42:59 +08:00
congqixia
29c72cad15
Use segment statslog instead of separate statslog (#18775)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-02 10:34:59 +08:00
wei liu
d08581d9b5
fix remove offline nodes in watchDmChannel (#18921)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-08-31 19:56:57 +08:00
SimFG
bf2bd80986
Avoid the nil point (#18925)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-08-31 10:20:57 +08:00
Xiaofan
56840da74f
Fix Segment Loader Log (#18883)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-08-29 15:30:57 +08:00
Cai Yudong
9dc3bbecbd
Change the type of slice_nqs and slice_topks from int32_t[] to int64_t[] (#18867)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-08-29 11:36:56 +08:00
yah01
d76d6f42cd
Add unit test for case of stream closed (#18848)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-08-26 19:20:55 +08:00
yah01
63e08606e2
Fix load segment hangs forever (#18814)
Caused if the context is timeout

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-08-25 19:34:54 +08:00
wayblink
6fd83464cd
Fix watchDmChannel may be out-of-date after compaction issue and add context (#18681)
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-08-23 17:44:56 +08:00
wei liu
5c4f854271
fix load segment hangs (#18770)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-08-23 16:52:52 +08:00
Zach
0c9a10e8f8
1. refine logging interfaces (#18692)
2. adjust logs for query/search requests

Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>

Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
2022-08-23 10:44:52 +08:00
aoiasd
8a70f2badb
Add ShowConfigurations for all remaining session (#18594)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-08-12 13:20:39 +08:00
xige-16
cd04258122
Abort execute timeout search/query (#17729)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-08-11 09:58:41 +08:00
congqixia
179b496824
Add cgo worker pool for querynode (#18461)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-09 16:34:37 +08:00
bigsheeper
002f509808
Remove deprecated cacheSize param (#18566)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-08-09 15:54:36 +08:00
Xiaofan
b427450593
Remove Load Delta Channel Request (#18497)
Fix #18393

remove watch delta channel task related logic

Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-04 17:50:37 +08:00
aoiasd
a7ce0eb6f6
Add ShowConfigurations to QueryNode (#18426)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-08-03 01:12:33 +08:00
congqixia
ab461c6e5e
Release collection resources when all partition released (#18488)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-02 11:40:34 +08:00
congqixia
f0fe8dae0b
Close Node/Segment detector when close ShardCluster (#18476)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-01 13:50:33 +08:00