Commit Graph

68 Commits

Author SHA1 Message Date
Xiaofan
a18d6b46a4
Fix watch dml channel fail because of no collection meta (#15436)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-02-10 13:19:46 +08:00
Cai Yudong
8255b713ac
Move ProxySubName/QueryNodeSubName/DataNodeSubName to msgChannelConfig (#15501)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-09 14:41:45 +08:00
Cai Yudong
4bccc85534
Use MsgChannelConfig in GlobalParams for all components (#15163)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-02 00:35:43 +08:00
xige-16
1cd2363bd8
Delete usless params SkipQueryChannelRecovery (#15289)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-21 21:43:40 +08:00
xige-16
c132302129
Clean flowGraph if watchChannel failed (#15303)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-20 10:01:38 +08:00
xige-16
dfc6670f0f
Unsubscribe channel after query node down (#15230)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-17 17:37:37 +08:00
Jiquan Long
675e6d352b
QueryNodes send search/query results by rpc (#15223)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-01-17 14:41:35 +08:00
bigsheeper
0c98f21d4d
Remove global sealed segments in historical (#15177)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-12 17:01:38 +08:00
godchen
9e51591b3a
Fix pulsar reader not close (#14543)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-04 14:45:19 +08:00
xige-16
148dad23ac
Format watchDmChannel's log (#14633)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-30 20:27:20 +08:00
bigsheeper
8a3a1b556a
Free OS memory in QueryNode and IndexNode (#14305)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-30 20:03:29 +08:00
congqixia
c62457a6ea
Add channel name check before querynode seek (#14169)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-24 15:38:17 +08:00
XuanYang-cn
3d24007efa
Add more logs for load sealed segment (#14079)
Add logs before&after flowgraph_ddnode forwarding delete msg

See also: #13879

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 10:50:07 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
bigsheeper
1ca08d9138
Simplify flow graph in QueryNode (#13613)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-17 20:12:42 +08:00
bigsheeper
bf6405ca93
Simplify tSafe in query node (#13241)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-17 14:41:33 +08:00
jaime
dcba2f38ee
[skip ci] Fix grammar mistake in task (#13542)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-16 22:31:49 +08:00
xige-16
97d5231a0a
Reorganize querycoord proto (#13181)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 16:53:12 +08:00
XuanYang-cn
bf8d245043
[skip ci]Update license for task (#13284)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-13 19:49:20 +08:00
congqixia
ee4d15aada
Fix log concat in querynode task execute (#13152)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-10 14:43:18 +08:00
bigsheeper
772771bd85
Stop queryCollection before releasing replica (#12982)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 14:31:28 +08:00
bigsheeper
496f3d0009
Move AddQueryChannel to taskScheduler in query node (#12294)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 10:29:43 +08:00
bigsheeper
65608836e6
Remove vChannel for collection in historical (#12359)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-29 20:11:49 +08:00
bigsheeper
58964621a5
Remove tSafeWatcher and vChannel when release (#12264)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-26 01:33:16 +08:00
godchen
88012acb86
Clear useless segments info. (#12262)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-25 17:37:15 +08:00
bigsheeper
e245ba87a9
Add excluded segments for dropped segemnts (#12247)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 14:25:15 +08:00
bigsheeper
62bbc9cd1d
Add excluded segments for flushed segments in query node (#12188)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-24 11:27:15 +08:00
godchen
116a503b4a
From dml cp load delete msg (#12144)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-21 07:33:14 +08:00
Bingyi Sun
e3e4dc7153
Improve GetVChanPosistion and fix unit tests (#11888)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 21:41:50 +08:00
godchen
4cd7680f87
Reschedule load segments (#11391)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-13 08:49:08 +08:00
bigsheeper
93149c5ad9
Load growing segment in query node (#11664)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 18:27:10 +08:00
godchen
5357e301f4
Fix retrieve search error (#11501)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
godchen
639800241d
Make flow graph for delta channel (#11379)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
yukun
4e5c8811da
Add flow_graph for delta channel in querynode (#11293)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-06 11:02:58 +08:00
bigsheeper
5c58924420
Add cgroups to get container memory and check index memory in segment loader (#10363)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 20:49:10 +08:00
xige-16
8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-22 19:07:15 +08:00
groot
70eb275ef4
[skip ci] Fix typo (#10412)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:11:52 +08:00
bigsheeper
4c420dac21
Update excluded segments info when receive changeInfo (#10011)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-16 17:00:33 +08:00
bigsheeper
e7d92e4e79
Add streaming segments memory to used memory when checkLoadMemory (#8940)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-30 21:54:08 +08:00
bigsheeper
977d55b66c
[skip ci] Add comment for task (#8497)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-24 20:53:49 +08:00
bigsheeper
52126f2d5a
Dynamic add tSafe watcher, use sync.Cond instead of selectCase, add ref count (#8050)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-24 13:57:54 +08:00
bigsheeper
c9b6a92366
Add release failed case unittest for query node (#7971)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-09-17 11:35:49 +08:00
bigsheeper
14391fe9a2
Release flowgraphs properly (#7266)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-27 17:03:56 +08:00
bigsheeper
4123deef9e
Return error message in grpc.LoadSegment in query node (#6908)
* return load error

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* init streaming meta in loadSegment

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix excluded init

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* improve impl

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-03 22:01:27 +08:00
bigsheeper
e8ea8b51d5
improve query node log (#6897)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-31 10:47:22 +08:00
bigsheeper
e50d39dfe1
Query result get global sealed segments from ETCD (#6377)
* get global sealed segments from ETCD

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix race error

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-14 11:15:54 +08:00
xige-16
6b65529086
Fix search error after releasePartition (#6135)
* fix search error after releasePartition

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-26 16:08:11 +08:00
bigsheeper
e87372761a
Remove tSafe in release partition task and return max timestamp (#6078)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-24 19:06:34 +08:00
yukun
b72e4c6372
Merge search_collection and retrieve_colletion into query_collection (#6037)
* Merge search_collection and retrieve_colletion into query_collection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix static-check

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-06-23 20:26:10 +08:00
bigsheeper
dca24f313a
fix search timeout error (#6027)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-23 18:04:22 +08:00