bigsheeper
a4ea2fb18a
Handle errors in DataNode and QueryNode flow graph ( #17096 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-24 21:11:59 +08:00
xige-16
99984b88e1
Support delete varChar value ( #16229 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-04-02 17:43:29 +08:00
godchen
78557ca6d7
Replace minio kv with minio chunk manager ( #15936 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-03-17 18:03:23 +08:00
jaime
7a3a721380
Reconstruct mqstream module ( #15784 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable ( #15434 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
Cai Yudong
f8f61fb116
Use BaseParams etcd configuration for all components ( #15012 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
Jiquan Long
ebb9b24b47
Improve name of flowgraph node ( #14538 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-30 10:33:46 +08:00
XuanYang-cn
3cfa88d6f2
Fix delete node not aware of merged segments error ( #14190 )
...
This PR made merge gracefully remove merged segment by moving
them into `compactedSegments`
And everytime when delete_node operates, if compactedSegments
have contents, delete_node will replace the latest segment in delBuf
merged from the merged segments, and truely remove the compactedSegments
Fixes : #14085
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-27 11:02:18 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
congqixia
8f9e62fa18
Apply DropVirtualChannel and FlushManager drop mode ( #12563 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-02 16:39:33 +08:00
congqixia
e813867652
Implement Drop mode for flush manager ( #12469 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-01 10:11:39 +08:00
XuanYang-cn
8a8ebed23d
Fix DN GC bug ( #12258 )
...
Fixes : #12249
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-25 09:43:15 +08:00
congqixia
579416e3d3
Apply retry for flush manager execution ( #11808 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-15 17:19:10 +08:00
XuanYang-cn
c4bb73dc74
Complete drop collection procedure in DN ( #11552 )
...
drop, cancel compaction, flush all buffers and release fg
See also: #11426
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-11 20:56:49 +08:00
godchen
b63a9521c2
Make gen msg private ( #10115 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-04 15:36:19 +08:00
godchen
a0a3a889e7
Add common endian for global use ( #11092 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00
congqixia
5737e0075f
Apply flush manager logic in datanode ( #10142 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-19 11:04:34 +08:00
congqixia
0438ed2bfe
Use single signal chan to notify flush ( #10075 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-18 12:34:34 +08:00
XuanYang-cn
dcd56a575d
[skip ci]Update license for flowgraph of dn ( #9962 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-15 18:07:09 +08:00
XuanYang-cn
aac6323cff
Use config as parameter ( #9707 )
...
Make functions in flowgraph lesser parameters
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 11:16:32 +08:00
Cai Yudong
84e568ee32
Support Delete in datanode ( #8505 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 16:31:44 +08:00
Cai Yudong
12d640a023
Update filterSegmentByPK ( #9450 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-08 12:04:56 +08:00
Cai Yudong
d94361fdcc
Add parameter partitionID for API filterSegments ( #8813 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-29 10:27:58 +08:00
XuanYang-cn
3be6672753
Add flush channel for delete_node ( #8762 )
...
Resolves : #8761
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-28 18:22:16 +08:00
godchen
51151b7b95
Fix delete node ut error ( #8674 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-27 17:07:58 +08:00
godchen
77a773dff0
Change segment replica struct ( #8608 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-27 14:38:00 +08:00
Cai Yudong
b2e5627061
Rename insertMsg to flowGraphMsg in datanode flow graph ( #8546 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-26 10:43:57 +08:00
XuanYang-cn
64aad49959
Add ut in datasync service to 88% ( #7615 )
...
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-09 15:36:01 +08:00
XuanYang-cn
a5767e05c6
Add ut for flowgraph_delete_node to 100% ( #7550 )
...
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-08 10:41:59 +08:00
godchen
c333af0dcf
Add query node segment filter ( #7303 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-28 10:12:00 +08:00
godchen
b4c55f6b3c
Add delete node ( #7261 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-25 11:41:52 +08:00
