bigsheeper
|
7fee4743f5
|
Improve log print in OOM error info (#16170)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-03-24 20:17:25 +08:00 |
|
yah01
|
63a71e247a
|
Loading segments concurrency level fallbacks to the value that won't cause OOM (#16172)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-03-24 13:39:25 +08:00 |
|
godchen
|
78557ca6d7
|
Replace minio kv with minio chunk manager (#15936)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
|
2022-03-17 18:03:23 +08:00 |
|
zhenshan.cao
|
f3eeecf146
|
Reduce the number of metrics (#16030)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-03-15 21:51:21 +08:00 |
|
jaime
|
97b1ed7bca
|
Remove reader API from Mqstream and replace it with consumer API (#15971)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-03-15 14:45:22 +08:00 |
|
yah01
|
4f3d5fb6eb
|
Make load operation parallel improve performance (#15928)
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-03-11 14:28:01 +08:00 |
|
顾炎
|
4f8c08f912
|
fix checkSegmentSize overflows int64 (#15858)
Signed-off-by: guyan <632722781@qq.com>
|
2022-03-09 13:29:58 +08:00 |
|
jaime
|
7a3a721380
|
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-03-03 21:57:56 +08:00 |
|
bigsheeper
|
12eb8c3da5
|
Add prometheus metrics for QueryNode (#15649)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-03-02 14:49:55 +08:00 |
|
bigsheeper
|
6a48071a5c
|
Set BaseMsg for LoadSegmentRequest, prevent crashing in log printing (#15725)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-02-26 20:09:54 +08:00 |
|
xige-16
|
55cdc5aa35
|
Get indexInfo and segment size by queryCoord (#14207)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-02-08 21:57:46 +08:00 |
|
Cai Yudong
|
b6a48817b0
|
Add MinioConfig in GlobalParams for all components (#15099)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-01-10 17:29:34 +08:00 |
|
godchen
|
9e51591b3a
|
Fix pulsar reader not close (#14543)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
|
2022-01-04 14:45:19 +08:00 |
|
XuanYang-cn
|
3d24007efa
|
Add more logs for load sealed segment (#14079)
Add logs before&after flowgraph_ddnode forwarding delete msg
See also: #13879
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-12-24 10:50:07 +08:00 |
|
Cai Yudong
|
891c202b73
|
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-12-23 18:39:11 +08:00 |
|
congqixia
|
1dcd06cc78
|
Add log file info for all kind of segment binlogs (#13606)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-12-19 20:00:42 +08:00 |
|
bigsheeper
|
5e5787ddd2
|
Update memory util in metricinfo (#13320)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-12-16 17:25:13 +08:00 |
|
XuanYang-cn
|
b1ec235644
|
[skip ci]Update license for qn segment (#13193)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-12-10 20:59:42 +08:00 |
|
xige-16
|
8b2cd271c7
|
Improve querynode log (#13158)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2021-12-10 18:51:08 +08:00 |
|
congqixia
|
8f87cc7ef1
|
Fix JoinIDPath logic problem (#13039)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-12-09 12:05:04 +08:00 |
|
Cai Yudong
|
1a806a174a
|
Support load collection with multiple vector column (#12630)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-12-03 11:29:33 +08:00 |
|
godchen
|
c4f0837d84
|
Fix insert pks overwrite (#12365)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-29 22:01:41 +08:00 |
|
godchen
|
f31ed089b5
|
Add timeout for reader next (#12308)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-26 22:45:24 +08:00 |
|
godchen
|
e3f49858c5
|
Add subscription prefix (#12251)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-24 17:47:15 +08:00 |
|
godchen
|
3fa5b4a9ce
|
Delete for segment indexing (#12197)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-23 17:17:16 +08:00 |
|
godchen
|
9d5bcd3e3a
|
Close event and binlog reader (#12173)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-22 17:27:14 +08:00 |
|
godchen
|
02bf77aabf
|
Close reader stream (#12167)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-22 16:17:14 +08:00 |
|
godchen
|
116a503b4a
|
From dml cp load delete msg (#12144)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-21 07:33:14 +08:00 |
|
Xiaofan
|
f654621650
|
Remove the etcd deletion of segment data path on querynode (#11863)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2021-11-17 12:13:10 +08:00 |
|
xige-16
|
d857577a7b
|
Postpone the execution of handoff until index creation is complete (#11648)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2021-11-12 18:49:10 +08:00 |
|
bigsheeper
|
93149c5ad9
|
Load growing segment in query node (#11664)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-11-12 18:27:10 +08:00 |
|
godchen
|
863f1bb34e
|
Fix multi delete data not effect (#11422)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-09 15:01:17 +08:00 |
|
cai.zhang
|
5b42a3223c
|
Increase compatibility for EstimateMemorySize interface (#10603)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
|
2021-10-26 15:34:21 +08:00 |
|
yukun
|
6949350b8b
|
Call segmentLoadDeletedRecord in segment_loader (#10472)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
|
2021-10-23 09:31:10 +08:00 |
|
bigsheeper
|
5c58924420
|
Add cgroups to get container memory and check index memory in segment loader (#10363)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-10-22 20:49:10 +08:00 |
|
xige-16
|
8a046a6495
|
BroadCast sealedSegmentChangeInfo to queryChannel (#10084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2021-10-22 19:07:15 +08:00 |
|
godchen
|
ffc0c07610
|
Change delete data primary key to int64 (#10438)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-22 15:37:12 +08:00 |
|
godchen
|
d6bf0c928f
|
Get stats delta path from datacoord (#10362)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-22 14:31:13 +08:00 |
|
congqixia
|
f39e06b24e
|
Filters out nil BF stats (#10279)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-20 16:14:36 +08:00 |
|
sunby
|
db53eccec9
|
Add binlog iterators (#10173)
issue: #9530
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-10-20 11:52:35 +08:00 |
|
godchen
|
8daeb0d519
|
Change bloom filter use pk (#10193)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-19 20:18:47 +08:00 |
|
godchen
|
24a6fc096b
|
Update query node bloom filter (#10109)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-18 20:08:42 +08:00 |
|
bigsheeper
|
e7d92e4e79
|
Add streaming segments memory to used memory when checkLoadMemory (#8940)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-09-30 21:54:08 +08:00 |
|
zhenshan.cao
|
d1d5f9e409
|
Replace proto.MarshalTextString with proto.Marshal (#8542)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2021-09-29 20:26:00 +08:00 |
|
bigsheeper
|
9d6c95bf25
|
Add cacheSize to prevent OOM in query node (#8765)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-09-28 22:24:03 +08:00 |
|
bigsheeper
|
338e32362b
|
Return error if setSegment failed when loadSegment (#8075)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-09-18 10:03:50 +08:00 |
|
bigsheeper
|
691e4c5bc9
|
Use definitional type instead of raw type (#7797)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-09-14 10:25:26 +08:00 |
|
bigsheeper
|
cb5cd1cf12
|
Add index unittests for query node (#7674)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-09-10 17:11:09 +08:00 |
|
bigsheeper
|
b7103357fd
|
Load failed if collection beyonds the memory limit (#7434)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-09-07 11:35:18 +08:00 |
|
bigsheeper
|
b9d3897deb
|
Return error when any failed detected in loadSegment (#7005)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-08-12 14:14:08 +08:00 |
|