XuanYang-cn
|
9d0bc136e0
|
Add vChannelName in IBN timetick log (#14527)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-12-30 10:09:48 +08:00 |
|
Cai Yudong
|
891c202b73
|
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-12-23 18:39:11 +08:00 |
|
Bingyi Sun
|
6b91e5e9d1
|
Add warning log to trace old messages (#13939)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
|
2021-12-22 16:59:05 +08:00 |
|
congqixia
|
1dcd06cc78
|
Add log file info for all kind of segment binlogs (#13606)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-12-19 20:00:42 +08:00 |
|
Bingyi Sun
|
0c39e0370c
|
Move segment statistics update to datanode tt loop (#13233)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
|
2021-12-15 10:53:16 +08:00 |
|
Xiangyu Wang
|
405b3cd932
|
Use the same lint rules with golint in revive (#13324)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
|
2021-12-14 15:31:07 +08:00 |
|
congqixia
|
8f9e62fa18
|
Apply DropVirtualChannel and FlushManager drop mode (#12563)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-12-02 16:39:33 +08:00 |
|
Bingyi Sun
|
038f42851e
|
Add more log for debug (#11893)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
|
2021-11-18 10:37:41 +08:00 |
|
XuanYang-cn
|
9bd3664672
|
Fix compaction bug (#11816)
This PR fixes:
- timeout in compaction
- BinlogIterator using rawID as PKField bug
See also: #11757
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-17 10:07:13 +08:00 |
|
XuanYang-cn
|
f3852c1db0
|
Add more specific logs (#11724)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-15 15:25:09 +08:00 |
|
Bingyi Sun
|
5c8978e5d6
|
Fix drop segment bug (#11709)
issue: #11708
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
|
2021-11-12 17:31:11 +08:00 |
|
XuanYang-cn
|
c4bb73dc74
|
Complete drop collection procedure in DN (#11552)
drop, cancel compaction, flush all buffers and release fg
See also: #11426
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-11 20:56:49 +08:00 |
|
congqixia
|
0e5931a3da
|
Add mergedTimetickSender for datanode (#11297)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-11-05 14:59:32 +08:00 |
|
congqixia
|
0ef95c5df1
|
Add timeticker logger for insert buffer node (#11216)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-11-04 15:40:14 +08:00 |
|
godchen
|
a0a3a889e7
|
Add common endian for global use (#11092)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-02 18:16:32 +08:00 |
|
XuanYang-cn
|
225b2c66a0
|
Fix datanode ut using register bug (#10885)
Resolves: #10881
See also: #8058
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-01 11:01:49 +08:00 |
|
congqixia
|
2713988ff2
|
Merge auto manual flush with same segment id (#10550)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-25 18:03:42 +08:00 |
|
congqixia
|
7ce7cb7a5e
|
Add a timed flush trigger mechanism (#10197)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-20 15:02:36 +08:00 |
|
godchen
|
8daeb0d519
|
Change bloom filter use pk (#10193)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-19 20:18:47 +08:00 |
|
sunby
|
4031b8746f
|
Fix panic when flushing segment (#10182)
issue: #10180
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-10-19 19:06:37 +08:00 |
|
congqixia
|
5737e0075f
|
Apply flush manager logic in datanode (#10142)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-19 11:04:34 +08:00 |
|
congqixia
|
0438ed2bfe
|
Use single signal chan to notify flush (#10075)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-18 12:34:34 +08:00 |
|
XuanYang-cn
|
dcd56a575d
|
[skip ci]Update license for flowgraph of dn (#9962)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-15 18:07:09 +08:00 |
|
XuanYang-cn
|
c2c927bd55
|
Use reader in the right way (#9790)
Avoid to mantaining the position myself.
Make Read bytes more easy to read and maintain.
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-13 21:32:33 +08:00 |
|
XuanYang-cn
|
aac6323cff
|
Use config as parameter (#9707)
Make functions in flowgraph lesser parameters
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-13 11:16:32 +08:00 |
|
Cai Yudong
|
84e568ee32
|
Support Delete in datanode (#8505)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-10-11 16:31:44 +08:00 |
|
Cai Yudong
|
3dac2611b6
|
Remove redundant variable load (#9452)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-10-08 14:49:08 +08:00 |
|
XuanYang-cn
|
e7e37448d2
|
[skip ci]Add comment for flowgraph insertBufferNode (#9361)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
|
2021-10-06 23:30:21 +08:00 |
|
XuanYang-cn
|
7b14b0e63d
|
[skip ci]Add comment on readBinary (#9355)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
|
2021-10-06 22:28:11 +08:00 |
|
XuanYang-cn
|
65a76b9bb5
|
[skip ci]Add comment in insertbuffernode (#9354)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
|
2021-10-06 22:20:05 +08:00 |
|
godchen
|
83228c35ad
|
Add flowgraph insert buffer node error check (#9310)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-06 21:06:23 +08:00 |
|
congqixia
|
10a6f7f146
|
Defer buf removal from insertBuf after SaveBinlog succeeds (#8930)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-09-30 17:42:11 +08:00 |
|
XuanYang-cn
|
b150f57927
|
No buffer also means flushed (#8686)
Resolves: #8684
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-28 11:18:03 +08:00 |
|
zhenshan.cao
|
b71bffe26f
|
Replace ChannelID with ShardName in DML Request (#8539)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2021-09-27 10:01:59 +08:00 |
|
XuanYang-cn
|
ebd894d8b7
|
Refactor buffer size calculation (#8565)
This PR changes the datanode insertBufSize config
from 32000 number of rows to 16MB
Resolves: #7741
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-26 20:55:59 +08:00 |
|
Cai Yudong
|
b2e5627061
|
Rename insertMsg to flowGraphMsg in datanode flow graph (#8546)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-26 10:43:57 +08:00 |
|
XuanYang-cn
|
faeb1bf50f
|
Add comment on exposed struct (#8348)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-23 20:15:54 +08:00 |
|
XuanYang-cn
|
2b82482679
|
Fix golint and ruleguard (#8347)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-23 19:14:01 +08:00 |
|
XuanYang-cn
|
a830c28bd8
|
Fix golint in datanode (#8345)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-23 19:05:55 +08:00 |
|
XuanYang-cn
|
d816a81ee3
|
Make FlushSegments async (#8159)
Resolves: #8122
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-23 16:03:54 +08:00 |
|
congqixia
|
bdfb8768d4
|
Enable gosec (#8202)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-09-18 14:45:50 +08:00 |
|
XuanYang-cn
|
46c72c57c2
|
Add BufferData in insertbufferNode (#8138)
Optimize bufferInsertMsg param to avoid a second transfer
of endposition
See also: #8058, #7741
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-18 14:25:50 +08:00 |
|
Cai Yudong
|
d10c6abc9e
|
Apply for msgstream from pool when creating collection (#7738)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-18 09:13:50 +08:00 |
|
XuanYang-cn
|
6c434b4801
|
Improve codes in insertbuffernode (#8054)
Add error handling in insertbuffernode
See also: #7624, #7684
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-17 16:27:56 +08:00 |
|
XuanYang-cn
|
82d4d19337
|
Remove not in use segmentCheckPoints (#8039)
Resolves: #8037
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-17 16:25:55 +08:00 |
|
dragondriver
|
a872a4357c
|
Add more test cases for proxy implementation (#7685)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
|
2021-09-11 11:36:22 +08:00 |
|
Cai Yudong
|
4e23ed9a18
|
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-10 13:00:00 +08:00 |
|
congqixia
|
69794fd32d
|
Refactor insertBufferNode and add unit tests (#7621)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-09-09 15:00:00 +08:00 |
|
Cai Yudong
|
3b9609692b
|
Apply for msgstream from pool when creating collection (#7377)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-08-31 18:35:58 +08:00 |
|
Cai Yudong
|
f4b53df727
|
Revert "Apply for msgstream from pool when creating collection (#7323)" (#7376)
This reverts commit e6de86a433.
|
2021-08-31 11:07:58 +08:00 |
|