jaime
|
d126f06946
|
Decouple mq module from internal proto definition (#22536)
Signed-off-by: jaime <yun.zhang@zilliz.com>
|
2023-03-04 23:21:50 +08:00 |
|
yah01
|
7478e44911
|
Support using mmap to load data (#22052)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2023-03-01 18:07:49 +08:00 |
|
Enwei Jiao
|
697dedac7e
|
Use cockroachdb/errors to replace other error pkg (#22390)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2023-02-26 11:31:49 +08:00 |
|
cai.zhang
|
9dd2e1dcd8
|
Use tt msg stream for consume delete msg (#21478) (#21500)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2023-01-05 11:03:35 +08:00 |
|
Jiquan Long
|
d7156812c1
|
Try using ASAN in ci ut (#21089)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
|
2022-12-29 15:29:31 +08:00 |
|
jaime
|
039e9ce4bb
|
Refine msgstream interface (#20832)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-12-05 20:55:17 +08:00 |
|
liliu-z
|
aecf2e4f4b
|
Upgrade knowhere to 1.3.4 (#20914)
Signed-off-by: Li Liu <li.liu@zilliz.com>
Signed-off-by: Li Liu <li.liu@zilliz.com>
|
2022-12-02 00:33:21 +08:00 |
|
xige-16
|
ec617d4952
|
Avoid delete segment which has been loaded (#20730)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-11-21 16:33:12 +08:00 |
|
congqixia
|
e6831d5029
|
Stop querynode for unit tests (#20665)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-11-17 14:23:08 +08:00 |
|
congqixia
|
ad0cce8f70
|
Filter segments when doing FromDmlCPLoadDelete (#20388)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-11-08 11:47:02 +08:00 |
|
wei liu
|
c5cd92d36e
|
update target (#19296)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
|
2022-11-07 19:37:04 +08:00 |
|
Xiaofan
|
1f170ce1ba
|
Refine kafka consumer (#19846)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-10-25 13:23:30 +08:00 |
|
SimFG
|
a55f739608
|
Separate public proto files (#19782)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-10-16 20:49:27 +08:00 |
|
congqixia
|
d79f88c5f6
|
Fix segmentPtr concurrent visit and destroy (#19560)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-29 21:54:55 +08:00 |
|
congqixia
|
838a633584
|
Add ctx parameter for ChunkManager methods (#19546)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-29 16:18:56 +08:00 |
|
congqixia
|
3759f23f88
|
Add error log for load segment file failure (#19227)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-19 14:08:48 +08:00 |
|
SimFG
|
d7f38a803d
|
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-09-16 16:56:49 +08:00 |
|
Bingyi Sun
|
626854cf0c
|
Refactor QueryCoord (#18836)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-15 18:48:32 +08:00 |
|
yah01
|
d76d6f42cd
|
Add unit test for case of stream closed (#18848)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-08-26 19:20:55 +08:00 |
|
yah01
|
63e08606e2
|
Fix load segment hangs forever (#18814)
Caused if the context is timeout
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-08-25 19:34:54 +08:00 |
|
wei liu
|
5c4f854271
|
fix load segment hangs (#18770)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
|
2022-08-23 16:52:52 +08:00 |
|
congqixia
|
179b496824
|
Add cgo worker pool for querynode (#18461)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-09 16:34:37 +08:00 |
|
yah01
|
70f8bea4b4
|
Avoid growing slice as deserializing binlogs (#17421)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-06-08 11:46:06 +08:00 |
|
Ten Thousand Leaves
|
f5e63177d2
|
Fix an issue with bulk load with multiple DataNodes (#17324)
issue: #17300
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-06-02 18:54:04 +08:00 |
|
yah01
|
4e83f37899
|
Improve load performance (#17273)
Load segment's fields concurrently
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-06-02 17:56:03 +08:00 |
|
xige-16
|
8c69790383
|
Fix lost delete msg caused by loadSegment after watchDeltaChannel (#17308)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-06-02 16:56:04 +08:00 |
|
xige-16
|
63a31ccb38
|
Remove error return value when removeSegment (#17310)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-06-01 13:18:02 +08:00 |
|
bigsheeper
|
f55fe6be3c
|
Merge historical replica and streaming replica in QueryNode (#17217)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-05-31 13:42:03 +08:00 |
|
zhenshan.cao
|
08a4dff41d
|
Add logic for search merging and a simple task scheduler for read tasks (#17022)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-05-23 16:41:58 +08:00 |
|
Letian Jiang
|
b3eb2b1d0d
|
Support deltaLog loading on growing segment (#16903)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
|
2022-05-12 11:59:53 +08:00 |
|
Ten Thousand Leaves
|
216c45fbd6
|
Add tests where segments load delta logs (#16825)
issue: #16821
/kind improvements
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-05-10 17:59:52 +08:00 |
|
xige-16
|
515d0369de
|
Support string type in segcore (#16546)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
|
2022-04-29 13:35:49 +08:00 |
|
yah01
|
7af02fa531
|
Improve load performance, load binlogs concurrently per file, deserialize binlogs concurrently per field/segment (#16514)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-04-25 15:57:47 +08:00 |
|
xige-16
|
99984b88e1
|
Support delete varChar value (#16229)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-04-02 17:43:29 +08:00 |
|
Jiquan Long
|
ba37531456
|
Add support for loading multiple indexes (#16138)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
|
2022-03-30 21:11:28 +08:00 |
|
bigsheeper
|
7fee4743f5
|
Improve log print in OOM error info (#16170)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-03-24 20:17:25 +08:00 |
|
jaime
|
97b1ed7bca
|
Remove reader API from Mqstream and replace it with consumer API (#15971)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-03-15 14:45:22 +08:00 |
|
yah01
|
4f3d5fb6eb
|
Make load operation parallel improve performance (#15928)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-03-11 14:28:01 +08:00 |
|
zhenshan.cao
|
dff08dbf47
|
Refactor querynode unittest (#15929)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-03-08 17:39:58 +08:00 |
|
bigsheeper
|
6a48071a5c
|
Set BaseMsg for LoadSegmentRequest, prevent crashing in log printing (#15725)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-02-26 20:09:54 +08:00 |
|
xige-16
|
55cdc5aa35
|
Get indexInfo and segment size by queryCoord (#14207)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-02-08 21:57:46 +08:00 |
|
xige-16
|
c132302129
|
Clean flowGraph if watchChannel failed (#15303)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-01-20 10:01:38 +08:00 |
|
congqixia
|
1dcd06cc78
|
Add log file info for all kind of segment binlogs (#13606)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-12-19 20:00:42 +08:00 |
|
bigsheeper
|
1ca08d9138
|
Simplify flow graph in QueryNode (#13613)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-12-17 20:12:42 +08:00 |
|
xige-16
|
97d5231a0a
|
Reorganize querycoord proto (#13181)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2021-12-15 16:53:12 +08:00 |
|
XuanYang-cn
|
daf252c74a
|
[skip ci]Update license for qn segment loader (#13194)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-12-10 21:19:42 +08:00 |
|
Cai Yudong
|
1a806a174a
|
Support load collection with multiple vector column (#12630)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-12-03 11:29:33 +08:00 |
|
bigsheeper
|
93149c5ad9
|
Load growing segment in query node (#11664)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-11-12 18:27:10 +08:00 |
|
yukun
|
4e5c8811da
|
Add flow_graph for delta channel in querynode (#11293)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
|
2021-11-06 11:02:58 +08:00 |
|
bigsheeper
|
5c58924420
|
Add cgroups to get container memory and check index memory in segment loader (#10363)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-10-22 20:49:10 +08:00 |
|