Commit Graph

241 Commits

Author SHA1 Message Date
Cai Yudong
12d640a023
Update filterSegmentByPK (#9450)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-08 12:04:56 +08:00
XuanYang-cn
a1f9e46e44
[skip ci]Update comment in datanode package (#9428)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
2021-10-07 23:50:52 +08:00
XuanYang-cn
9526d22dc7
[skip ci]Add comment for normal2FlushedSegment (#9431)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
2021-10-07 23:46:37 +08:00
godchen
445f5426d1
Check data node error (#9303)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-07 22:16:56 +08:00
congqixia
908b7df41d
Add comment and implementation assertion for ddnode (#9333)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-07 19:54:56 +08:00
godchen
cd4205e447
[skip ci]Fix allocator comment typo (#9363)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-10-06 23:32:27 +08:00
XuanYang-cn
e7e37448d2
[skip ci]Add comment for flowgraph insertBufferNode (#9361)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
2021-10-06 23:30:21 +08:00
XuanYang-cn
5bb832e6cc
[skip ci]Add comment on flowgraph dmstream inputnode (#9359)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
2021-10-06 23:02:08 +08:00
XuanYang-cn
27143c6095
[skip ci]Add comment on flowgraph ddNode (#9358)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
2021-10-06 22:51:58 +08:00
XuanYang-cn
7b14b0e63d
[skip ci]Add comment on readBinary (#9355)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
2021-10-06 22:28:11 +08:00
XuanYang-cn
65a76b9bb5
[skip ci]Add comment in insertbuffernode (#9354)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
2021-10-06 22:20:05 +08:00
godchen
83228c35ad
Add flowgraph insert buffer node error check (#9310)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-06 21:06:23 +08:00
XuanYang-cn
e7aa5eebd6
[skip ci]Update comment of cache in datanode (#9313)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
2021-10-06 07:08:24 +08:00
XuanYang-cn
cb6d853b56
[skip ci]Add README.md in datanode (#9311)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
2021-10-05 23:12:03 +08:00
XuanYang-cn
f49e35a7fb
[skip ci]Update datanode param table comment (#9308)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
2021-10-05 22:54:03 +08:00
godchen
e6ee4f39bb
Add flow graph dmstream input node test error check (#9213)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-04 17:37:57 +08:00
godchen
3eee4e4259
Add segment replica test error check (#9212)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-04 17:36:06 +08:00
godchen
83f256c31b
Remove datanode mock test error (#9211)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-04 17:34:16 +08:00
congqixia
becf6c8f7d
Add DataNode implementation Assertion (#9144)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-03 19:46:05 +08:00
congqixia
109186db9c
[skip ci] Add comment for datanode meta_service.go (#9036)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-01 22:25:24 +08:00
Xiaofan
2c2b800ff4
Change Log Name with NodeId (#8721)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-01 08:52:50 +08:00
congqixia
6bbf0a8f8f
Read datanode insertbuf from env (#8942)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-30 17:45:07 +08:00
congqixia
10a6f7f146
Defer buf removal from insertBuf after SaveBinlog succeeds (#8930)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-30 17:42:11 +08:00
zhenshan.cao
d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-29 20:26:00 +08:00
congqixia
db944cd09c
Refactor flowgraph and related invocation (#8770)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-29 20:19:59 +08:00
Cai Yudong
d94361fdcc
Add parameter partitionID for API filterSegments (#8813)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-29 10:27:58 +08:00
XuanYang-cn
3be6672753
Add flush channel for delete_node (#8762)
Resolves: #8761

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-28 18:22:16 +08:00
congqixia
d374ea71ba
Unify liveness check in datacoord and datanode (#8480)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-28 16:10:04 +08:00
XuanYang-cn
b150f57927
No buffer also means flushed (#8686)
Resolves: #8684

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-28 11:18:03 +08:00
Xiaofan
585989935a
Revert the logger change (#8677)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-27 17:37:57 +08:00
godchen
51151b7b95
Fix delete node ut error (#8674)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-27 17:07:58 +08:00
godchen
77a773dff0
Change segment replica struct (#8608)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-27 14:38:00 +08:00
congqixia
e7117f67ee
Add BroadcastMark for Msgstream returning MessageIDs (#8654)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-27 14:10:09 +08:00
zhenshan.cao
b71bffe26f
Replace ChannelID with ShardName in DML Request (#8539)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-27 10:01:59 +08:00
Xiaofan
d38adda8c2
Rename log file based on node id (#8517)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-26 21:18:11 +08:00
XuanYang-cn
1307782093
[skip-ci]Fix golint in param_table in datanode (#8602)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-26 20:57:59 +08:00
XuanYang-cn
ebd894d8b7
Refactor buffer size calculation (#8565)
This PR changes the datanode insertBufSize config
from 32000 number of rows to 16MB

Resolves: #7741

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-26 20:55:59 +08:00
XuanYang-cn
b376107ab3
[skip-ci]Fix golint in segmentRep (#8601)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-26 20:51:58 +08:00
XuanYang-cn
b13170f83e
[skip-ci]Fix golint in flowgraphnode.go (#8600)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-26 20:49:59 +08:00
groot
e4e762f2e8
Reduce go unittest time cost (#8503)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-26 12:50:24 +08:00
Cai Yudong
b2e5627061
Rename insertMsg to flowGraphMsg in datanode flow graph (#8546)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-26 10:43:57 +08:00
Cai Yudong
28d305148a
Update ddnode insert (#8536)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-26 09:43:57 +08:00
XuanYang-cn
3aabc1d3ee
[skip-ci]Fix golint in type_def.go (#8464)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-24 21:43:56 +08:00
sunby
816bac82ec
Add root path in minio and replace etcd.rootPath in datanode (#8272)
issue: #7905
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-24 20:50:23 +08:00
XuanYang-cn
e4f0d4bab6
[skip-ci]Fix golint in flow_graph_message.go (#8463)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-24 20:46:04 +08:00
XuanYang-cn
2539dd4593
[skip-ci]Fix golint in data_node.go (#8462)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-24 20:44:05 +08:00
XuanYang-cn
faeb1bf50f
Add comment on exposed struct (#8348)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 20:15:54 +08:00
XuanYang-cn
2b82482679
Fix golint and ruleguard (#8347)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 19:14:01 +08:00
XuanYang-cn
a830c28bd8
Fix golint in datanode (#8345)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 19:05:55 +08:00
congqixia
2aa9deda1c
Improve logic when watch dm channel fails (#8386)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-23 18:31:55 +08:00