congqixia
|
5e550a8793
|
Add close for flushManager (#11874)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-11-17 10:39:15 +08:00 |
|
congqixia
|
579416e3d3
|
Apply retry for flush manager execution (#11808)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-11-15 17:19:10 +08:00 |
|
XuanYang-cn
|
f3852c1db0
|
Add more specific logs (#11724)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-15 15:25:09 +08:00 |
|
Bingyi Sun
|
5c8978e5d6
|
Fix drop segment bug (#11709)
issue: #11708
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
|
2021-11-12 17:31:11 +08:00 |
|
XuanYang-cn
|
c4bb73dc74
|
Complete drop collection procedure in DN (#11552)
drop, cancel compaction, flush all buffers and release fg
See also: #11426
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-11 20:56:49 +08:00 |
|
congqixia
|
3ac7d7a9de
|
Add detailed comments for dataSyncService in DataNode (#11285)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-11-05 22:59:04 +08:00 |
|
godchen
|
9186d5527e
|
Forward delete msg (#11210)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-05 11:59:02 +08:00 |
|
XuanYang-cn
|
8863c01ff7
|
Make DN fail faster when watching an invalid chan (#11102)
See also: #11098
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-04 15:56:28 +08:00 |
|
congqixia
|
169af67eb1
|
Fix segments not removed from flushingCache (#10738)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-27 16:06:24 +08:00 |
|
godchen
|
d2e0943f21
|
Fix delete node flush error (#10549)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-25 18:49:20 +08:00 |
|
godchen
|
d6bf0c928f
|
Get stats delta path from datacoord (#10362)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-22 14:31:13 +08:00 |
|
congqixia
|
ed4e516ce7
|
Save stats and delta logs from DataNode (#10159)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-19 14:34:35 +08:00 |
|
congqixia
|
5737e0075f
|
Apply flush manager logic in datanode (#10142)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-19 11:04:34 +08:00 |
|
congqixia
|
0438ed2bfe
|
Use single signal chan to notify flush (#10075)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-18 12:34:34 +08:00 |
|
XuanYang-cn
|
880056e664
|
[skip ci]Update license for datesync (#9959)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-15 18:01:38 +08:00 |
|
godchen
|
2e0f7dfe42
|
Check data sync service error (#9856)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-14 17:40:42 +08:00 |
|
XuanYang-cn
|
aac6323cff
|
Use config as parameter (#9707)
Make functions in flowgraph lesser parameters
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-13 11:16:32 +08:00 |
|
Cai Yudong
|
84e568ee32
|
Support Delete in datanode (#8505)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-10-11 16:31:44 +08:00 |
|
godchen
|
376be1b532
|
Add data sync service error check (#9498)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-09 15:38:57 +08:00 |
|
godchen
|
937dbf4279
|
Add flushed segments (#9476)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-08 19:09:12 +08:00 |
|
XuanYang-cn
|
3be6672753
|
Add flush channel for delete_node (#8762)
Resolves: #8761
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-28 18:22:16 +08:00 |
|
godchen
|
77a773dff0
|
Change segment replica struct (#8608)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-09-27 14:38:00 +08:00 |
|
congqixia
|
2aa9deda1c
|
Improve logic when watch dm channel fails (#8386)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-09-23 18:31:55 +08:00 |
|
XuanYang-cn
|
d816a81ee3
|
Make FlushSegments async (#8159)
Resolves: #8122
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-23 16:03:54 +08:00 |
|
Cai Yudong
|
d10c6abc9e
|
Apply for msgstream from pool when creating collection (#7738)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-18 09:13:50 +08:00 |
|
XuanYang-cn
|
3db76e8e59
|
[skip-ci]Add comment in data sync service (#8002)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-15 21:25:49 +08:00 |
|
Cai Yudong
|
4e23ed9a18
|
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-10 13:00:00 +08:00 |
|
XuanYang-cn
|
64aad49959
|
Add ut in datasync service to 88% (#7615)
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-09 15:36:01 +08:00 |
|
XuanYang-cn
|
a5767e05c6
|
Add ut for flowgraph_delete_node to 100% (#7550)
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-08 10:41:59 +08:00 |
|
Cai Yudong
|
3b9609692b
|
Apply for msgstream from pool when creating collection (#7377)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-08-31 18:35:58 +08:00 |
|
Cai Yudong
|
f4b53df727
|
Revert "Apply for msgstream from pool when creating collection (#7323)" (#7376)
This reverts commit e6de86a433.
|
2021-08-31 11:07:58 +08:00 |
|
Cai Yudong
|
e6de86a433
|
Apply for msgstream from pool when creating collection (#7323)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-08-31 09:47:58 +08:00 |
|
congqixia
|
65f168eac1
|
Fix datanode corner cases (#7336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-08-30 10:03:58 +08:00 |
|
godchen
|
b4c55f6b3c
|
Add delete node (#7261)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-08-25 11:41:52 +08:00 |
|
sunby
|
4f7c3e7d3a
|
Save binlog path in SegmentInfo (#6590)
issue: #6589
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-08-19 13:00:12 +08:00 |
|
XuanYang-cn
|
f0a68704e2
|
Add unittests for getChannelName in DataNode (#6346)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-07-08 15:52:40 +08:00 |
|
sunby
|
7f2d7c1da3
|
Rename dataservice to datacoordinator (#5912)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-06-21 18:22:13 +08:00 |
|
XuanYang-cn
|
441300140d
|
Tidy replica (#5920)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-06-21 16:00:22 +08:00 |
|
sunby
|
3cc0ab1345
|
Remove panic in NewDataSyncService (#5888)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-06-19 15:18:06 +08:00 |
|
sunby
|
33f5225968
|
Use physical channel to init msg stream (#5815)
* Use physical channel to init msg stream
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* fix search collection error check (#1)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: bigsheeper <954206947@qq.com>
|
2021-06-18 16:02:05 +08:00 |
|
XuanYang-cn
|
5bcb94294c
|
Set start positions in datanode (#5757)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-06-15 16:36:36 +08:00 |
|
XuanYang-cn
|
ab2fd34a2f
|
fix double messages bug in datanode recovery (#5733)
* fix double messages bug in datanode recovery
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* remove debug log
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-06-15 16:14:29 +08:00 |
|
XuanYang-cn
|
46699c4c2b
|
fix datanode dropcollection error (#5690)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-06-15 16:06:13 +08:00 |
|
sunby
|
189ac881f3
|
Fix bugs (#5676)
* Remove redundant session startup
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Register datanode after start success
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* fix meta snap shot
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* fix datanode message stream channel
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Fix bugs when drop empty collection
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Fix bug of getting pchan statistics from task scheduler
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* Fix i/dist/dataservice test code
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Fix epoch lifetime not applied
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* fix datanode flowgraph dd node
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Fix handle datanode timetick bug
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Remove repack function of dml stream
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* fix proxynode
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Apply extended seal policy
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* add check for time tick
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* fix check
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Fix the repack function of dml stream
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* Fix the bug when send statistics of pchan
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* Fix the repack function when craete dml stream
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* fix bugs
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* fix describe collection
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Fix bug when send timestamp statistics
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* fix data node
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Add length check before flush request
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* add log for data node
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Fix SaveBinlog bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Add more log in datanode
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Put SegmentState.Flushing as the last one in enum to fit the client
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Fix params in GetInsertBinlogPaths
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Rename policy
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Remove unused ddl functions and fields
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Remove pchan when drop collection
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* Add balanced assignment policy
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* fix master ut
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Add lock in session manager
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* add log for debug
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Fix some logic bug and typo
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Fix recover bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Get collection scheme of a specific timestamp
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Change CheckPoint to SegmentInfo in VchannelInfo
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Recover Unflushed segment numOfRows
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Fix dataservice unit tests
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-06-15 16:06:11 +08:00 |
|
XuanYang-cn
|
e7fd3aa926
|
Flowgraph recovery (#5640)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-06-15 16:04:48 +08:00 |
|
XuanYang-cn
|
ac19711d74
|
Destroy DataNode when drop collections (#5638)
* Destroy DataNode when drop collections
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* golanci-lint
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
|
2021-06-15 16:04:48 +08:00 |
|
neza2017
|
74c73fa75f
|
fix datanode (#5635)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
|
2021-06-15 16:04:48 +08:00 |
|
neza2017
|
3c70675313
|
data node, save binlog to minIO, and let data service save these meta (#5618)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
|
2021-06-15 16:04:48 +08:00 |
|
neza2017
|
0a82c6381f
|
add auto flush for data node (#5609)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
|
2021-06-15 16:04:48 +08:00 |
|
congqixia
|
d0d845805b
|
Change WatchDmChannelsRequest proto (#5577)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-06-15 16:04:48 +08:00 |
|