Commit Graph

94 Commits

Author SHA1 Message Date
SimFG
d7f38a803d
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
wei liu
d08581d9b5
fix remove offline nodes in watchDmChannel (#18921)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-08-31 19:56:57 +08:00
wei liu
1527aee019
fix watch dml channel remove offline node (#18835)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-08-29 16:32:57 +08:00
Jiquan Long
cf730f6fcd
Fix query cluster metrics (#18725)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-08-19 11:44:50 +08:00
Xiaofan
b427450593
Remove Load Delta Channel Request (#18497)
Fix #18393

remove watch delta channel task related logic

Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-04 17:50:37 +08:00
Xiaofan
c97563590c
fix missing handling channels while a node down (#18250)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-07-18 13:06:28 +08:00
yah01
bb2ad23e55
GetQuerySegmentInfo returns sealed loaded segments (#18255)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-07-14 16:44:27 +08:00
yah01
b4f21259ef
Fix SegmentChangeInfo is not set properly (#17701)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-22 21:08:13 +08:00
yah01
7d5c8c5f38
Fix bug not remove offline node (#17560)
The LoadBalance task won't remove the offline node if the node never load/watch any segment/dmchannel

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-16 16:00:10 +08:00
xige-16
8c69790383
Fix lost delete msg caused by loadSegment after watchDeltaChannel (#17308)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-02 16:56:04 +08:00
yah01
cc69c5cdd3
Make Cluster interface's methods called outside public (#17315)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-06-02 13:16:05 +08:00
congqixia
c88514bc49
Remove not used QueryChannel in Proxy and Query Cluster (#16856)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-30 19:50:04 +08:00
yah01
de0ba6d495
Fix GetQuerySegmentInfo() returns incorrect result after LoadBalance (#17190)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-25 15:17:59 +08:00
yah01
a382133a8a
Add new node into the replica which has the most of offline nodes (#16907)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-13 18:31:54 +08:00
yah01
415a0e5978
Fix miss segments/DmChannel when query by nodeID (#16719)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-29 14:11:47 +08:00
yah01
206b554d49
Sync the distribution of segments to shard leaders (#16685)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-28 16:01:48 +08:00
Xiaofan
c1ff0cec8f
Change QueryCoord Log level (#16590)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-26 11:29:54 +08:00
congqixia
69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord (#16470)
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-20 16:15:41 +08:00
XuanYang-cn
78200009a3
Impl GetReplicas in Proxy (#16390)
See also: #16298

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-04-06 14:57:31 +08:00
yah01
178eb8cce1
Modify proto to support replicas (#16218)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-28 16:43:27 +08:00
yah01
227889b0d0
Add replica interfaces for Meta and Cluster (#16190)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-25 14:03:25 +08:00
bigsheeper
e1bfd14db1
Add Prometheus metrics for QueryCoord (#15606)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: jingkl <34296482+jingkl@users.noreply.github.com>
2022-02-28 16:51:55 +08:00
xige-16
55cdc5aa35
Get indexInfo and segment size by queryCoord (#14207)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-02-08 21:57:46 +08:00
xige-16
dfc6670f0f
Unsubscribe channel after query node down (#15230)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-17 17:37:37 +08:00
Cai Yudong
b6a48817b0
Add MinioConfig in GlobalParams for all components (#15099)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 17:29:34 +08:00
xige-16
b063bfda8f
Add index info in loadSegmentRequest (#14524)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-30 19:09:33 +08:00
xige-16
1ee9d21fb0
[skip e2e]Improve log for QueryNode spell (#14469)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-28 21:53:07 +08:00
xige-16
5ad98c5738
[skip e2e]Improve log for QueryNode spell (#14468)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-28 21:49:07 +08:00
xige-16
eba0178a43
[skip e2e]Improve log for QueryNode spell (#14467)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-28 21:46:45 +08:00
xige-16
f55c12e9e7
[skip e2e]Improve log for QueryNode spell (#14208)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-24 19:39:03 +08:00
xige-16
ec9aefee55
[skip e2e]Improve log for QueryNode spell (#14206)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-24 19:37:12 +08:00
xige-16
28bf1f60a4
[skip e2e]Improve log for QueryNode spell (#14105)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-23 22:02:07 +08:00
xige-16
e0dcba987a
[skip e2e]Improve log for QueryNode spell (#14104)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-23 21:58:14 +08:00
xige-16
1a02ae9186
[skip e2e]Improve log for QueryNode spell (#14103)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-23 21:56:22 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
xige-16
324f8b9b87
[skip e2e]Improve log for QueryNode spell (#14012)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-22 21:01:19 +08:00
congqixia
ef3b71f22b
Use indexInfo SerializedSize when estimating segment size (#13969)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-22 20:27:34 +08:00
xige-16
db0b707dd2
[skip e2e]Improve log for QueryNode spell (#13913)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 21:27:09 +08:00
xige-16
fb0426afcc
[skip e2e]Improve log for QueryNode spell (#13912)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 21:25:15 +08:00
xige-16
76c4dccf71
[skip e2e]Improve log for QueryNode spell (#13911)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 21:23:19 +08:00
congqixia
55ab425010
Use binlog size from meta when estimate SegmentSize (#13891)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-21 20:01:03 +08:00
xige-16
4e4ff54d98
Watch query channel to near the latest position (#13682)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 13:50:54 +08:00
xige-16
11c8461c11
Refactor dmChannelWatchInfo to queryCoord meta (#13543)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 11:57:39 +08:00
XuanYang-cn
2e0f3695b2
Add more logs on failure path in load segments (#13785)
This PR added more clarified logs
- in IO failures of estimateSegmentsSize
- in esitimate goroutines

See also: #13250

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-21 11:13:03 +08:00
congqixia
1dcd06cc78
Add log file info for all kind of segment binlogs (#13606)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-19 20:00:42 +08:00
xige-16
b7f987ef47
[skip e2e]Fix golint for loadSegments (#13674)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-17 22:32:42 +08:00
Xiaofan
b8d3808052
Fix Query Coord UT and cleanup logic (#13618)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-17 21:30:42 +08:00
congqixia
835e0985fd
Reduce queryNodeCluster range prevent blocking online/offline events (#13249)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-13 21:51:10 +08:00
xige-16
6050504d43
[skip ci]Fix golint for querycoord cluster (#12918)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-07 21:47:12 +08:00
xige-16
9a208254d8
[skip ci] Fix golint of cluster (#12737)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-06 11:43:34 +08:00