Commit Graph

289 Commits

Author SHA1 Message Date
congqixia
90f88c6559
Add flush manager structure (#9986)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-18 10:38:35 +08:00
Xiaofan
d845153de4
Add Buffer for consumer channel (#9578)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-15 20:31:16 +08:00
XuanYang-cn
d0e6b52ce9
[skip ci]Update license for datanode (#9963)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-15 18:09:00 +08:00
XuanYang-cn
dcd56a575d
[skip ci]Update license for flowgraph of dn (#9962)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-15 18:07:09 +08:00
XuanYang-cn
9c706c6dc3
[skip ci]Update license on datanode (#9960)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-15 18:03:25 +08:00
XuanYang-cn
880056e664
[skip ci]Update license for datesync (#9959)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-15 18:01:38 +08:00
godchen
bf71965f58
Check watchlist error (#9953)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-15 17:02:37 +08:00
godchen
9e9ad7c7e6
Check pk filter merge error (#9952)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-15 16:58:42 +08:00
Xiaofan
a0b98dacda
Skip reconsume tt msgstream when datacoord restart (#9684)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-15 11:46:33 +08:00
godchen
2e0f7dfe42
Check data sync service error (#9856)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-14 17:40:42 +08:00
congqixia
ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order (#9860)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 16:40:35 +08:00
sunby
044b06421a
Use etcd to watch channel on datanode (#7115)
issue: #6578
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-14 15:44:34 +08:00
yukun
92815f4542
Change timestamp to timestamps in internalproto.DeleteRequest (#9802)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-14 14:48:34 +08:00
godchen
77a9b521c6
Check data sync service test error (#9854)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-14 14:12:34 +08:00
dragondriver
72d3d470ba
Use the server id as identifier in system topology graph (#9825)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-14 11:12:38 +08:00
godchen
a2dc0d8808
Init segment replica bloom filter (#9770)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-14 10:24:33 +08:00
congqixia
c50233639f
Add allocIDBatch for datanode allocator (#9782)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-13 22:12:32 +08:00
XuanYang-cn
c2c927bd55
Use reader in the right way (#9790)
Avoid to mantaining the position myself.

Make Read bytes more easy to read and maintain.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 21:32:33 +08:00
congqixia
c90a97f95a
Fix Watch Channel canceled due to revision compacted (#9788)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-13 17:02:33 +08:00
XuanYang-cn
aac6323cff
Use config as parameter (#9707)
Make functions in flowgraph lesser parameters

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 11:16:32 +08:00
godchen
59ab0e441c
Add bloom filter for stats (#9630)
* Add bloom filter for stats

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* trigger GitHub actions

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-13 10:22:33 +08:00
congqixia
d8f490082c
Normalize dmInputNode seek log (#9714)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-12 23:44:35 +08:00
godchen
653ba91cc7
[skip ci ]Add join id path comment (#9718)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-12 19:23:39 +08:00
godchen
f496bc70c0
[skip ci]Fix delete node comment lint (#9717)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-12 18:32:33 +08:00
godchen
13c1a1c746
Add joinIDPath for reuse (#9650)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-12 17:20:33 +08:00
congqixia
80ac456cf8
Normalize dmInputNode log (#9652)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-11 21:54:33 +08:00
godchen
3e26c19bad
[skip ci]Fix segment replica comment (#9654)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-11 21:12:44 +08:00
XuanYang-cn
f0bedc7046
Add ut for data_node.go (#9489)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-11 18:50:30 +08:00
congqixia
e05877f828
Change datanode cache implementation to sync.Map (#9607)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-11 17:32:30 +08:00
Cai Yudong
84e568ee32
Support Delete in datanode (#8505)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 16:31:44 +08:00
xige-16
e99ecc8cab
Add ProduceMark interface to return messageID (#9556)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 11:38:57 +08:00
godchen
d0bc0cd697
Skip data sync service test (#9571)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-09 17:41:00 +08:00
godchen
5e7648fc7c
Check data node test error (#9532)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-09 15:45:15 +08:00
godchen
376be1b532
Add data sync service error check (#9498)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-09 15:38:57 +08:00
godchen
55ec988544
[skip ci]Fix data node comment lint (#9534)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-09 11:28:57 +08:00
zwd1208
9ceb1c73db
[skip ci]Change uppercase of MinIO (#9539)
Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
2021-10-09 11:22:58 +08:00
groot
735b02cf2b
Add unittest for distributed/datanode (#9503)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-09 10:10:59 +08:00
XuanYang-cn
30395cb1b1
Add more specific comment in datanode (#9488)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-09 00:09:47 +08:00
zhenshan.cao
aacfa172ba
Fix unittest bug: delete variables that do not need to be initialized (#9520)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-08 22:02:58 +08:00
godchen
ac35aa7e34
Add flowgraph dmstream input node error check (#9497)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-08 19:25:00 +08:00
XuanYang-cn
e6346d7b60
[skip ci]Add license in cache_test.go (#9500)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-08 19:18:57 +08:00
XuanYang-cn
a853ca6044
[skip ci]Add license in cache.go (#9499)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-08 19:17:03 +08:00
godchen
937dbf4279
Add flushed segments (#9476)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-08 19:09:12 +08:00
Cai Yudong
b9f5a6bb1e
Rename some variables in unittest (#9484)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-08 17:47:25 +08:00
Cai Yudong
ec9ec97cec
Fix typo (#9482)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-08 17:45:35 +08:00
Cai Yudong
78755263e2
Update ddnode test (#9477)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-08 17:43:46 +08:00
congqixia
a1651104c3
[skip ci] Fix datanode Cache comment typo (#9483)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-08 17:22:54 +08:00
Cai Yudong
3dac2611b6
Remove redundant variable load (#9452)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-08 14:49:08 +08:00
Cai Yudong
12d640a023
Update filterSegmentByPK (#9450)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-08 12:04:56 +08:00
XuanYang-cn
a1f9e46e44
[skip ci]Update comment in datanode package (#9428)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
2021-10-07 23:50:52 +08:00