Xiaofan
69087ff8dd
Support embedded etcd ( #14333 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
congqixia
a8c7e0c827
[skip e2e] Add comment for Compaction of DataNode ( #14350 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-28 09:38:07 +08:00
XuanYang-cn
3cfa88d6f2
Fix delete node not aware of merged segments error ( #14190 )
...
This PR made merge gracefully remove merged segment by moving
them into `compactedSegments`
And everytime when delete_node operates, if compactedSegments
have contents, delete_node will replace the latest segment in delBuf
merged from the merged segments, and truely remove the compactedSegments
Fixes : #14085
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-27 11:02:18 +08:00
zhenshan.cao
9a2c91d326
Fix bug: refresh config after session init ( #14194 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-24 22:22:17 +08:00
XuanYang-cn
3d24007efa
Add more logs for load sealed segment ( #14079 )
...
Add logs before&after flowgraph_ddnode forwarding delete msg
See also: #13879
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-24 10:50:07 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
Jiquan Long
0871bd3d63
Add log when update pk range ( #14006 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-23 11:57:08 +08:00
Bingyi Sun
6b91e5e9d1
Add warning log to trace old messages ( #13939 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-22 16:59:05 +08:00
congqixia
2b352bcde5
Fix compact result segment log size always zero ( #13953 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-22 14:27:06 +08:00
Xiangyu Wang
2a6168e937
Improve import statement ( #13734 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-21 19:15:32 +08:00
JackLCL
87071f3f41
[skip e2e]Fix error log output format in segment_replica.go ( #13806 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-20 22:51:25 +08:00
Xiangyu Wang
5d4c4f38c8
Improve import statement ( #13735 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-20 15:49:06 +08:00
Xiangyu Wang
cabc40cb09
Improve import statement ( #13737 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-20 14:39:12 +08:00
Xiangyu Wang
a7dfd53f53
Improve import statement ( #13736 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-20 14:38:25 +08:00
Xiangyu Wang
08be6888d5
Improve import statement ( #13733 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-20 14:33:47 +08:00
congqixia
2de5cf7762
[skip e2e] Improve log in flush manager ( #13689 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-20 12:22:43 +08:00
congqixia
d4afc812d1
Normalize DataNode term in errors.go ( #13688 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-20 12:20:50 +08:00
congqixia
1dcd06cc78
Add log file info for all kind of segment binlogs ( #13606 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-19 20:00:42 +08:00
JackLCL
20c956b675
[skip e2e]Fix error log output format in segment_replica.go ( #13676 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-19 12:32:42 +08:00
godchen
154f11e3a1
[skip e2e]Fix redundant conversion ( #13648 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 22:28:50 +08:00
godchen
e191b23249
[skip e2e]Fix error string ( #13647 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:22:42 +08:00
godchen
fefeaa2e1d
[skip e2e]Fix compaction executor typo ( #13646 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-17 19:20:46 +08:00
cai.zhang
9f23fc7f2a
Register the service when the component state is healthy ( #13248 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
Bingyi Sun
0c39e0370c
Move segment statistics update to datanode tt loop ( #13233 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-15 10:53:16 +08:00
JackLCL
30afcf2311
[skip ci]Fix error log output format in segment_replica.go ( #13350 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-14 16:51:09 +08:00
JackLCL
5f02a3738a
[skip ci]Fix error log output format in meta_service.go ( #13349 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-14 16:43:25 +08:00
Xiangyu Wang
405b3cd932
Use the same lint rules with golint in revive ( #13324 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
congqixia
8f87cc7ef1
Fix JoinIDPath logic problem ( #13039 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-09 12:05:04 +08:00
XuanYang-cn
dbf757e08b
Change genKey into JoinIDPath ( #12959 )
...
1. Simplify genKey(), make genKey a rpc call
2. Unify the usage of JoinIDPath
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 11:09:06 +08:00
XuanYang-cn
a9a332dbcf
Fix empty segment compact and load ( #12710 )
...
1. Fix compaction save empty segment bug
2. Fix load empty segment bug
3. Add UT for dmlchannels to 100%
Resolves : #12450
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 11:03:08 +08:00
congqixia
1195f441b2
Update DataNode state before stop ( #12946 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 14:19:04 +08:00
JackLCL
73b63b9a02
[skip ci]Fix error log output format in segment_replica.go ( #12929 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-08 13:55:04 +08:00
JackLCL
a6ce7d7f53
[skip ci]Fix error log output format in meta_service.go ( #12928 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-08 13:51:09 +08:00
JackLCL
e51ef53632
[skip ci]Fix error log output format in flush_manager.go ( #12857 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-07 14:38:15 +08:00
congqixia
b20a238c38
Fix newDataSyncService panicking with normal segment has no dml pos ( #12771 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-06 16:21:35 +08:00
congqixia
58c5b6093d
Fix close10000 ut has chances to fail ( #12740 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-06 09:59:35 +08:00
Bingyi Sun
8bbaae04ff
Decrease compaction parallel ( #12707 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-03 18:57:33 +08:00
congqixia
ffd05eb140
Fix deadlock in mergedTimeTickSender ( #12697 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-03 16:39:33 +08:00
edward.zeng
45cbec1f7b
[skip ci] Refine datanode binlog io comment ( #12638 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-02 19:11:32 +08:00
edward.zeng
c2b73e1b55
[skip ci] Refine data node flow graph comment ( #12637 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-02 18:59:33 +08:00
congqixia
8f9e62fa18
Apply DropVirtualChannel and FlushManager drop mode ( #12563 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-02 16:39:33 +08:00
godchen
5e3e3b3b41
Remove grpc returned error ( #12537 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-01 22:17:46 +08:00
edward.zeng
271aaa7537
[skip ci] Refine data node param table comment ( #12560 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-01 19:31:36 +08:00
congqixia
e813867652
Implement Drop mode for flush manager ( #12469 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-01 10:11:39 +08:00
godchen
f31ed089b5
Add timeout for reader next ( #12308 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-26 22:45:24 +08:00
XuanYang-cn
48b45d82e5
Add ut for binlog_io to 100 coverage ( #12283 )
...
Make DN ut coverage upto 90%
Resolves : #8058
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-26 17:43:17 +08:00
dragondriver
b6d0150dc5
Fix health check when disconnect to etcd ( #12292 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-26 11:39:16 +08:00
bigsheeper
e245ba87a9
Add excluded segments for dropped segemnts ( #12247 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-25 14:25:15 +08:00
XuanYang-cn
8a8ebed23d
Fix DN GC bug ( #12258 )
...
Fixes : #12249
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-25 09:43:15 +08:00
congqixia
59d19384dc
Fix flush manager injection logic with multiple segments ( #12260 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-24 18:41:16 +08:00