Commit Graph

808 Commits

Author SHA1 Message Date
bigsheeper
4d80ea2b11
[skip ci] Add comment for deleteData (#12906)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-07 21:29:21 +08:00
cai.zhang
b4be8acc1d
Use read lock when only read the var (#12626)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-07 10:03:47 +08:00
cai.zhang
1f67ab4e09
Use read lock when only read the var (#12712)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-07 10:01:52 +08:00
cai.zhang
ed58c277e3
Add log for search (#12625)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-07 09:54:01 +08:00
bigsheeper
7149a9f23c
[skip ci] Add comment for insertNode (#12820)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-06 21:15:48 +08:00
bigsheeper
e2389064bb
[skip ci] Add comment for newFilteredDmNode (#12819)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-06 21:13:53 +08:00
XuanYang-cn
02347baf2d
[skip ci]Update license for qn mock (#12817)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-06 21:10:09 +08:00
XuanYang-cn
9bc9be84dc
[skip ci]Update license for qn metric_info (#12816)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-06 21:08:17 +08:00
XuanYang-cn
64e04ecc56
[skip ci]Update license for qn load_index (#12815)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-06 21:06:26 +08:00
cai.zhang
b16bbb1ed2
Add log for GetComponentStates in querynode (#12713)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-06 15:25:35 +08:00
cai.zhang
dd88083db7
Use read lock when only read the var (#12711)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-06 15:23:41 +08:00
cai.zhang
6c1a471570
Use read lock when only read the var (#12627)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-06 15:21:46 +08:00
bigsheeper
2512ca3684
[skip ci] Add comment for filterInvalidInsertMessage (#12734)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-03 20:39:33 +08:00
bigsheeper
2a98ce272e
[skip ci] Add comment for filterInvalidDeleteMessage (#12733)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-03 20:37:38 +08:00
bigsheeper
a34b1a3e08
[skip ci] Add comment for filterDmNode Operate (#12732)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-03 20:35:44 +08:00
XuanYang-cn
a2f6e31d05
[skip ci]Update license for qn index loader (#12728)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-03 19:29:33 +08:00
XuanYang-cn
a036f8892f
[skip ci]Update license for qn index info (#12727)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-03 19:27:38 +08:00
XuanYang-cn
5071035701
[skip ci]Update license for qn impl (#12726)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-03 19:25:45 +08:00
zhenshan.cao
af22977cd3
Fixbug: grpc connection is closed by mistake (#12307)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-03 15:15:32 +08:00
Cai Yudong
1a806a174a
Support load collection with multiple vector column (#12630)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-03 11:29:33 +08:00
bigsheeper
ca4e0503fe
[skip ci] Add comment for filterDMNode Name (#12659)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-02 22:47:56 +08:00
bigsheeper
7a649e1c2f
[skip ci] Add comment for filterDMNode (#12658)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-02 22:46:01 +08:00
bigsheeper
192ab4eb91
[skip ci] Add comment for newFilterDeleteNode (#12657)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-02 22:44:09 +08:00
XuanYang-cn
cc91fae0bd
[skip ci]Update license for qn historical (#12647)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-02 22:32:42 +08:00
XuanYang-cn
3ab44e5f3f
[skip ci]Update license for qn fg service (#12645)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-02 22:30:52 +08:00
XuanYang-cn
5029d9b4ce
[skip ci]Update license for qn global sealed seg (#12646)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-02 22:26:45 +08:00
Cai Yudong
7dd3668cdc
Add ctx for indexLoader (#12631)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-02 19:07:40 +08:00
bigsheeper
88b53f6381
[skip ci] Add comment for filterDeleteNode filter func (#12566)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-01 22:31:55 +08:00
bigsheeper
87251ce295
[skip ci] Add comment for filterDeleteNode Operate (#12565)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-01 22:30:06 +08:00
XuanYang-cn
3d4084be48
[skip ci]Update license for qn fg querynode (#12557)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-01 22:28:08 +08:00
cai.zhang
deaf4a642c
Use write lock when writing the var (#12528)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-01 22:26:10 +08:00
bigsheeper
3e46c2a523
[skip ci] Add comment for filterDeleteNode Name (#12564)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-01 22:22:07 +08:00
godchen
3f060f4028
Remove querynode grpc error (#12532)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-01 22:13:37 +08:00
XuanYang-cn
62e3f68c79
[skip ci]Update license for qn fg message (#12556)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-01 18:45:32 +08:00
XuanYang-cn
16c1fe8098
[skip ci]Update license for qn fg insert (#12555)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-01 18:43:32 +08:00
Cai Yudong
bbc341a87a
Fix thread safe issue when search (#12546)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-01 18:13:32 +08:00
bigsheeper
37e6398ed6
[skip ci] Add comment for filterDeleteNode (#12490)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 20:15:35 +08:00
bigsheeper
6d93beb57f
[skip ci] Add comment for newDeleteNode (#12489)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 20:13:41 +08:00
bigsheeper
c749427bca
[skip ci] Add comment for flowGraph delete (#12488)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 20:09:37 +08:00
bigsheeper
496f3d0009
Move AddQueryChannel to taskScheduler in query node (#12294)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-30 10:29:43 +08:00
godchen
c4f0837d84
Fix insert pks overwrite (#12365)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-29 22:01:41 +08:00
XuanYang-cn
5797e6b3ac
[skip ci]Update license for qn fg filterdm node (#12398)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-29 20:17:41 +08:00
XuanYang-cn
37ae8e4283
[skip ci]Update license for qn fg deletenode (#12397)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-29 20:15:45 +08:00
XuanYang-cn
84f7f90f06
[skip ci]Update license for qn collection (#12396)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-29 20:13:50 +08:00
bigsheeper
65608836e6
Remove vChannel for collection in historical (#12359)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-29 20:11:49 +08:00
bigsheeper
ed4660b7de
[skip ci] Add comment for deleteNode Operate (#12388)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-29 20:01:49 +08:00
bigsheeper
1e92ac48d5
[skip ci] Add comment for getSegmentInfosByColID (#12386)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-29 19:59:54 +08:00
bigsheeper
f79e85cb36
[skip ci] Add comment for deleteNode Name (#12387)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-29 19:45:49 +08:00
bigsheeper
cad61ea47e
Fix tSafe replica unit test (#12325)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-29 14:17:17 +08:00
cai.zhang
2c484c7c7d
Parallel execution between segments (#12199)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-27 20:05:16 +08:00
godchen
f31ed089b5
Add timeout for reader next (#12308)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-26 22:45:24 +08:00
bigsheeper
dbcb153687
Fix delete failed in query node (#12302)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-26 16:15:16 +08:00
bigsheeper
58964621a5
Remove tSafeWatcher and vChannel when release (#12264)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-26 01:33:16 +08:00
bigsheeper
db3ad2bc5f
Disable log print in GetSgementInfo (#12139)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 17:49:19 +08:00
godchen
88012acb86
Clear useless segments info. (#12262)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-25 17:37:15 +08:00
bigsheeper
d2dae89f4c
Return success if query node is unhealthy in GetComponentStates (#12202)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 15:03:16 +08:00
bigsheeper
e245ba87a9
Add excluded segments for dropped segemnts (#12247)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 14:25:15 +08:00
godchen
e3f49858c5
Add subscription prefix (#12251)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-24 17:47:15 +08:00
dragondriver
6c4c0ef6b5
Add more deploy metrics (#12248)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-24 15:43:15 +08:00
bigsheeper
62bbc9cd1d
Add excluded segments for flushed segments in query node (#12188)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-24 11:27:15 +08:00
Xiaofan
0aaa87a79a
Fix MsgStream inconsistent seek (#12042)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-24 10:25:15 +08:00
zhenshan.cao
f95ef2260b
Add GetFlushState grpc method (#12220)
Update sdk version

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-23 22:57:17 +08:00
godchen
3fa5b4a9ce
Delete for segment indexing (#12197)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-23 17:17:16 +08:00
XuanYang-cn
6bf0c4326d
Fix compaction generates wrong insert binlogs (#12204)
This PR
- changes Get() to GetRow() in BinlogIterator
- removes Get() and Length() of FieldData
- adds ut in BinlogIterator for floatvector and binaryvector
- fix a log bug

Fixes: #12146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-23 17:09:15 +08:00
Cai Yudong
dd0b36f3fb
Clean debug log (#12205)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-23 14:25:15 +08:00
yukun
7a0d5ed6c4
Fix delete after create index (#12174)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-22 23:11:14 +08:00
godchen
9d5bcd3e3a
Close event and binlog reader (#12173)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 17:27:14 +08:00
congqixia
4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 16:23:17 +08:00
godchen
02bf77aabf
Close reader stream (#12167)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-22 16:17:14 +08:00
godchen
116a503b4a
From dml cp load delete msg (#12144)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-21 07:33:14 +08:00
bigsheeper
d4254f876a
[skip ci] Add comment for msgQueryNodeIsUnhealthy (#12111)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-18 21:45:12 +08:00
bigsheeper
98b0f73c46
[skip ci] Add comment for deleteNode (#12110)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-18 21:43:20 +08:00
bigsheeper
b35c2f60ea
[skip ci] Add comment for errQueryNodeIsUnhealthy (#12109)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-18 21:41:27 +08:00
bigsheeper
be1602f769
[skip ci] Add comment for dataSyncService close (#12028)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-18 09:25:17 +08:00
bigsheeper
152d55dbfa
Fix the deadlock of the querycoord cluster (#11796)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Co-authored-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 23:37:11 +08:00
bigsheeper
7df9600e5d
[skip ci] Add comment for removePartitionFlowGraph (#12027)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-17 20:27:24 +08:00
bigsheeper
f07b3ff8cb
[skip ci] Add comment for startPartitionFlowGraph (#12026)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-17 20:25:29 +08:00
Xiaofan
f654621650
Remove the etcd deletion of segment data path on querynode (#11863)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-17 12:13:10 +08:00
congqixia
5edbb82610
Add session revoke (#11908)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 22:31:14 +08:00
Bingyi Sun
e3e4dc7153
Improve GetVChanPosistion and fix unit tests (#11888)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 21:41:50 +08:00
bigsheeper
77b6dc2081
[skip ci] Add comment for getPartitionFlowGraphs (#11930)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 21:39:49 +08:00
bigsheeper
b79bf56226
[skip ci] Add comment for addPartitionFlowGraph (#11929)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 21:37:57 +08:00
bigsheeper
6e22d079ee
[skip ci] Add comment for removeCollectionDeltaFlowGraph (#11928)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 21:36:03 +08:00
Xiangyu Wang
12f50cb22c
[skip ci]Update OWNERS files (#11898)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
bigsheeper
698071de6f
[skip ci] Fix golint error for segmentInsert (#11856)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 09:27:36 +08:00
bigsheeper
fc0a34f40d
[skip ci] Fix golint error for segmentDelete (#11855)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 09:25:40 +08:00
Cai Yudong
b0054f1b48
Update C API NewSegment (#11809)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 16:57:09 +08:00
Cai Yudong
1f28dba497
Use API HandleCStatus to handle CStatus returned by CGo in querynode (#11789)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 16:13:10 +08:00
Cai Yudong
34ae61d8e2
Move HandleCProto into query node (#11763)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 11:05:09 +08:00
zhenshan.cao
8c6c031e80
FixBug:update serviceableTime incorrectly (#11769)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-15 10:31:09 +08:00
Cai Yudong
ad2572d0ef
Remove useless MarshalForCGo (#11698)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 10:13:09 +08:00
godchen
4cd7680f87
Reschedule load segments (#11391)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-13 08:49:08 +08:00
bigsheeper
be20567852
[skip ci] Add comment for removeCollectionFlowGraph (#11737)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 19:19:50 +08:00
bigsheeper
3f9c5baf63
[skip ci] Add comment for startCollectionFlowGraph (#11735)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 19:17:50 +08:00
bigsheeper
6d11f45b37
[skip ci] Add comment for startCollectionDeltaFlowGraph (#11736)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 19:09:16 +08:00
xige-16
d857577a7b
Postpone the execution of handoff until index creation is complete (#11648)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-12 18:49:10 +08:00
bigsheeper
93149c5ad9
Load growing segment in query node (#11664)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 18:27:10 +08:00
Cai Yudong
5fdc6626cb
Change API retrieve return type from CProtoResult to CProto (#11555)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-12 10:04:49 +08:00
bigsheeper
b261e89a92
[skip ci] Add comment for getCollectionDeltaFlowGraphs (#11689)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-11 22:14:57 +08:00
bigsheeper
c782a05c2f
[skip ci] Add comment for getCollectionFlowGraphs (#11688)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-11 22:13:05 +08:00