congqixia
2aa9deda1c
Improve logic when watch dm channel fails ( #8386 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-23 18:31:55 +08:00
SS
58a178fdf5
[skip ci] Fix grammar in comment ( #8382 )
...
Signed-off-by: sida shen <sida@sidas-MacBook-Pro.local>
Co-authored-by: sida shen <sida@sidas-MacBook-Pro.local>
2021-09-23 16:50:16 +08:00
XuanYang-cn
d816a81ee3
Make FlushSegments async ( #8159 )
...
Resolves : #8122
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 16:03:54 +08:00
congqixia
6469d83072
Add datanode etcd alive check ( #8363 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-23 14:29:54 +08:00
Xiaofan
f5173b595f
Add a channel prefix for all channels ( #8166 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-23 10:53:53 +08:00
godchen
050e27cbcf
[skip ci]Add delete node comment ( #8323 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-22 20:02:09 +08:00
Xiangyu Wang
c314b2b4a8
Remove unused label rules ( #7929 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-18 18:19:51 +08:00
groot
334297b49d
[skip ci] Update OWNERS files ( #8211 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-18 15:30:37 +08:00
congqixia
bdfb8768d4
Enable gosec ( #8202 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-18 14:45:50 +08:00
XuanYang-cn
46c72c57c2
Add BufferData in insertbufferNode ( #8138 )
...
Optimize bufferInsertMsg param to avoid a second transfer
of endposition
See also: #8058 , #7741
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-18 14:25:50 +08:00
Cai Yudong
d10c6abc9e
Apply for msgstream from pool when creating collection ( #7738 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 09:13:50 +08:00
dragondriver
daf001f683
Expose created time and updated time to datanode metrics ( #8173 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 21:32:47 +08:00
XuanYang-cn
6c434b4801
Improve codes in insertbuffernode ( #8054 )
...
Add error handling in insertbuffernode
See also: #7624 , #7684
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-17 16:27:56 +08:00
XuanYang-cn
82d4d19337
Remove not in use segmentCheckPoints ( #8039 )
...
Resolves : #8037
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-17 16:25:55 +08:00
XuanYang-cn
3db76e8e59
[skip-ci]Add comment in data sync service ( #8002 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 21:25:49 +08:00
XuanYang-cn
376d39fa02
[skip-ci]Add comment for Cache and allocator ( #7924 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-15 10:33:37 +08:00
dragondriver
a872a4357c
Add more test cases for proxy implementation ( #7685 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-11 11:36:22 +08:00
XuanYang-cn
ce33855652
[skip-ci]Fix datanode comment typo ( #7689 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-10 14:46:00 +08:00
Cai Yudong
4e23ed9a18
Revert apply physical channels from pool ( d5f7e358
and 3b960969
) ( #7687 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-10 13:00:00 +08:00
sunby
06cee85a39
Add data node unit tests ( #7622 )
...
Issue: #6357
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-09 16:40:00 +08:00
XuanYang-cn
64aad49959
Add ut in datasync service to 88% ( #7615 )
...
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-09 15:36:01 +08:00
congqixia
69794fd32d
Refactor insertBufferNode and add unit tests ( #7621 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-09 15:00:00 +08:00
XuanYang-cn
762060e670
Add ut for segmentReplica to 100% ( #7589 )
...
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-09 10:14:00 +08:00
XuanYang-cn
074b610811
Add ut for dmstream_input_node to 100% ( #7593 )
...
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-08 19:12:00 +08:00
XuanYang-cn
a5767e05c6
Add ut for flowgraph_delete_node to 100% ( #7550 )
...
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-08 10:41:59 +08:00
XuanYang-cn
29756c6ce8
Add ut for flow_graph_dd_node to 100% ( #7511 )
...
This PR:
- Change mutex to sync.Map
- Add ut for flow_graph_dd_node.go to 100%
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-07 15:41:59 +08:00
dragondriver
960741ee16
Support more detailed metrics information ( #7472 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-03 19:35:47 +08:00
dragondriver
89748ac639
Expose metrics of data cluster ( #7177 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-01 10:13:15 +08:00
Cai Yudong
3b9609692b
Apply for msgstream from pool when creating collection ( #7377 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-31 18:35:58 +08:00
Cai Yudong
f4b53df727
Revert "Apply for msgstream from pool when creating collection ( #7323 )" ( #7376 )
...
This reverts commit e6de86a433
.
2021-08-31 11:07:58 +08:00
Cai Yudong
e6de86a433
Apply for msgstream from pool when creating collection ( #7323 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-31 09:47:58 +08:00
congqixia
65f168eac1
Fix datanode corner cases ( #7336 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-30 10:03:58 +08:00
godchen
c333af0dcf
Add query node segment filter ( #7303 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-28 10:12:00 +08:00
godchen
b4c55f6b3c
Add delete node ( #7261 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-25 11:41:52 +08:00
congqixia
daae05641a
Construct bloom filter when inserting ( #7268 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-25 10:29:52 +08:00
Xiaofan
58b2089692
Import Embedded Etcd Kv Part 1( #7112 ) ( #7174 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-08-24 09:45:51 +08:00
congqixia
881d0af1fc
Add sync logic in TestWatchChannel ( #7188 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-20 17:48:13 +08:00
sunby
4f7c3e7d3a
Save binlog path in SegmentInfo ( #6590 )
...
issue: #6589
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-19 13:00:12 +08:00
XuanYang-cn
86ca96a02e
Fix master branch unittest error ( #7083 )
...
Resolves : #7080
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-13 14:00:14 +08:00
XuanYang-cn
6c5be83ea1
Refactor NewEtcdKV API ( #7075 )
...
This PR mainly did the following 3 things:
- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision
The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.
Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.
Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.
Resolves : #6955
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-13 11:04:09 +08:00
congqixia
e1b3273d1c
Add Datanode watch etcd channel ( #6965 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-13 10:50:09 +08:00
Xiangyu Wang
5e78fd6a97
[skip ci]Update approvers ( #7063 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-12 19:36:09 +08:00
XuanYang-cn
9d81a90402
Fix mem leak of flush cache in DataNode ( #6862 )
...
Resolves : #6858
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-11 14:24:09 +08:00
XuanYang-cn
47df4a2e57
Fix DataNode BackGroudGC problem ( #6551 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-03 09:59:24 +08:00
bigsheeper
7307332fab
Add nil check ( #6832 )
...
* add nil check
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* use grpc functions
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* use grpc functions
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
* fix indexCoord crash
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-07-29 20:11:23 +08:00
godchen
db94d7771f
Read vector from disk ( #6707 )
...
* Read vector from disk
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix git action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix test error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix caculate error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change var name
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix len error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused code
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change bytes to float method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change float to bytes method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-24 09:25:22 +08:00
XuanYang-cn
dca6c6afde
Add unittest for BackGroundGC in DataNode ( #6522 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-07-15 10:05:55 +08:00
XuanYang-cn
f0a68704e2
Add unittests for getChannelName in DataNode ( #6346 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-07-08 15:52:40 +08:00
godchen
49a0528d53
Fix trace ( #6218 )
...
* Fix trace
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-30 16:18:13 +08:00
XuanYang-cn
357af89d55
Add unittest in segment_replica ( #6197 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-06-30 10:26:12 +08:00