Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable ( #15434 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
Cai Yudong
4bccc85534
Use MsgChannelConfig in GlobalParams for all components ( #15163 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-02 00:35:43 +08:00
congqixia
273890a91e
Fix datanode flush manager injection unit test ( #15358 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-27 10:23:40 +08:00
XuanYang-cn
8ab9d769de
Fix logs of compaction_executor ( #15365 )
...
- Remove not useful log in `stopExecutingtaskByVChannelName`
- Add planID info in `mergeFlushedSegments`
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-25 13:29:40 +08:00
congqixia
1e61112b5a
Add retry logic in pulsar consumer unsubscribe ( #15284 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-20 01:23:37 +08:00
XuanYang-cn
87394e29b6
Fix compaction ut datarace ( #15267 )
...
Fixes : #15241
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-18 17:49:39 +08:00
bigsheeper
7f775096c5
Unsubscribe when close pulsar consumer ( #15221 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-17 18:53:36 +08:00
yah01
fd8d452cfd
remove unused fieldIDs and fieldTypes ( #15229 )
...
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2022-01-16 17:37:35 +08:00
congqixia
2528b6850d
Refactor flush manager injection to reduce goroutine number ( #15180 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-13 18:49:34 +08:00
XuanYang-cn
008e08a996
Add flowgraph manager and event manager ( #15102 )
...
1. Add flowgraph manager to manager start and release of dataSyncService
2. Add event manager to manager etcd watchInfo event
- Make put event able to retry
- Make delete event able to terminate the retry loop
See also: #14604 , #14300
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-13 14:21:34 +08:00
XuanYang-cn
6e847ff194
Make dn handleChannelInfo log more consist ( #14936 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-11 09:37:35 +08:00
Cai Yudong
b6a48817b0
Add MinioConfig in GlobalParams for all components ( #15099 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 17:29:34 +08:00
XuanYang-cn
45f1f97ac4
Fix deltalog savebinlogpath save log ( #15092 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-10 15:45:34 +08:00
Cai Yudong
7efb02a4c5
Use PulsarConfig in GlobalParams for all components ( #15046 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-09 23:45:33 +08:00
Cai Yudong
f8f61fb116
Use BaseParams etcd configuration for all components ( #15012 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
Xieql
8b06aac7a9
[skip e2e] Improve annotation ( #14976 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2022-01-07 13:57:49 +08:00
zhenshan.cao
a5f8bdeb42
Fix bug: data race in MsgFactory ( #14839 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-06 14:57:20 +08:00
Xieql
25b00230c8
[skip e2e] Improve annotation ( #14908 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2022-01-06 14:15:20 +08:00
Xieql
c488c41dfb
[skip e2e] Improve annotation ( #14912 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2022-01-06 13:38:08 +08:00
congqixia
ecdc3f7bf7
[skip e2e] Improve comment for DataNode delete node ( #14825 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-01-05 14:29:35 +08:00
godchen
98232b4942
[skip e2e]Sort imports ( #14820 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-05 14:25:48 +08:00
godchen
e1eb721532
[skip e2e]Sort imports ( #14819 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-05 14:23:52 +08:00
godchen
7031a511ce
[skip e2e]Sort imports ( #14806 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-05 14:00:38 +08:00
zhenshan.cao
b10c361822
Fix bug: should use Lock instead of RLock ( #14797 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-04 23:33:24 +08:00
zhenshan.cao
76a9687310
Adjust usage of lock in datanode ( #14631 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2022-01-04 19:35:32 +08:00
zhenshan.cao
7abebe576c
Add more logs on write path ( #14600 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-04 15:47:18 +08:00
XuanYang-cn
f0a40f1569
Make FieldBinlog in a segment unique for a field ( #14632 )
...
See also: #14620
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-30 20:29:22 +08:00
Jiquan Long
ebb9b24b47
Improve name of flowgraph node ( #14538 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-30 10:33:46 +08:00
XuanYang-cn
9d0bc136e0
Add vChannelName in IBN timetick log ( #14527 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-30 10:09:48 +08:00
Xiaofan
69087ff8dd
Support embedded etcd ( #14333 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
congqixia
a8c7e0c827
[skip e2e] Add comment for Compaction of DataNode ( #14350 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-28 09:38:07 +08:00
XuanYang-cn
3cfa88d6f2
Fix delete node not aware of merged segments error ( #14190 )
...
This PR made merge gracefully remove merged segment by moving
them into `compactedSegments`
And everytime when delete_node operates, if compactedSegments
have contents, delete_node will replace the latest segment in delBuf
merged from the merged segments, and truely remove the compactedSegments
Fixes : #14085
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-27 11:02:18 +08:00
zhenshan.cao
9a2c91d326
Fix bug: refresh config after session init ( #14194 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-24 22:22:17 +08:00
XuanYang-cn
3d24007efa
Add more logs for load sealed segment ( #14079 )
...
Add logs before&after flowgraph_ddnode forwarding delete msg
See also: #13879
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 10:50:07 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
Jiquan Long
0871bd3d63
Add log when update pk range ( #14006 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-23 11:57:08 +08:00
Bingyi Sun
6b91e5e9d1
Add warning log to trace old messages ( #13939 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-22 16:59:05 +08:00
congqixia
2b352bcde5
Fix compact result segment log size always zero ( #13953 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-22 14:27:06 +08:00
Xiangyu Wang
2a6168e937
Improve import statement ( #13734 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-21 19:15:32 +08:00
JackLCL
87071f3f41
[skip e2e]Fix error log output format in segment_replica.go ( #13806 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-20 22:51:25 +08:00
Xiangyu Wang
5d4c4f38c8
Improve import statement ( #13735 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-20 15:49:06 +08:00
Xiangyu Wang
cabc40cb09
Improve import statement ( #13737 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-20 14:39:12 +08:00
Xiangyu Wang
a7dfd53f53
Improve import statement ( #13736 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-20 14:38:25 +08:00
Xiangyu Wang
08be6888d5
Improve import statement ( #13733 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-20 14:33:47 +08:00
congqixia
2de5cf7762
[skip e2e] Improve log in flush manager ( #13689 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-20 12:22:43 +08:00
congqixia
d4afc812d1
Normalize DataNode term in errors.go ( #13688 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-20 12:20:50 +08:00
congqixia
1dcd06cc78
Add log file info for all kind of segment binlogs ( #13606 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-19 20:00:42 +08:00
JackLCL
20c956b675
[skip e2e]Fix error log output format in segment_replica.go ( #13676 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-19 12:32:42 +08:00
godchen
154f11e3a1
[skip e2e]Fix redundant conversion ( #13648 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 22:28:50 +08:00
godchen
e191b23249
[skip e2e]Fix error string ( #13647 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:22:42 +08:00