Bingyi Sun
|
5c8978e5d6
|
Fix drop segment bug (#11709)
issue: #11708
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
|
2021-11-12 17:31:11 +08:00 |
|
XuanYang-cn
|
c4bb73dc74
|
Complete drop collection procedure in DN (#11552)
drop, cancel compaction, flush all buffers and release fg
See also: #11426
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-11 20:56:49 +08:00 |
|
congqixia
|
0e5931a3da
|
Add mergedTimetickSender for datanode (#11297)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-11-05 14:59:32 +08:00 |
|
congqixia
|
0ef95c5df1
|
Add timeticker logger for insert buffer node (#11216)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-11-04 15:40:14 +08:00 |
|
godchen
|
a0a3a889e7
|
Add common endian for global use (#11092)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-02 18:16:32 +08:00 |
|
XuanYang-cn
|
225b2c66a0
|
Fix datanode ut using register bug (#10885)
Resolves: #10881
See also: #8058
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-01 11:01:49 +08:00 |
|
congqixia
|
2713988ff2
|
Merge auto manual flush with same segment id (#10550)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-25 18:03:42 +08:00 |
|
congqixia
|
7ce7cb7a5e
|
Add a timed flush trigger mechanism (#10197)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-20 15:02:36 +08:00 |
|
godchen
|
8daeb0d519
|
Change bloom filter use pk (#10193)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-19 20:18:47 +08:00 |
|
sunby
|
4031b8746f
|
Fix panic when flushing segment (#10182)
issue: #10180
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-10-19 19:06:37 +08:00 |
|
congqixia
|
5737e0075f
|
Apply flush manager logic in datanode (#10142)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-19 11:04:34 +08:00 |
|
congqixia
|
0438ed2bfe
|
Use single signal chan to notify flush (#10075)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-18 12:34:34 +08:00 |
|
XuanYang-cn
|
dcd56a575d
|
[skip ci]Update license for flowgraph of dn (#9962)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-15 18:07:09 +08:00 |
|
XuanYang-cn
|
c2c927bd55
|
Use reader in the right way (#9790)
Avoid to mantaining the position myself.
Make Read bytes more easy to read and maintain.
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-13 21:32:33 +08:00 |
|
XuanYang-cn
|
aac6323cff
|
Use config as parameter (#9707)
Make functions in flowgraph lesser parameters
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-13 11:16:32 +08:00 |
|
Cai Yudong
|
84e568ee32
|
Support Delete in datanode (#8505)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-10-11 16:31:44 +08:00 |
|
Cai Yudong
|
3dac2611b6
|
Remove redundant variable load (#9452)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-10-08 14:49:08 +08:00 |
|
XuanYang-cn
|
e7e37448d2
|
[skip ci]Add comment for flowgraph insertBufferNode (#9361)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
|
2021-10-06 23:30:21 +08:00 |
|
XuanYang-cn
|
7b14b0e63d
|
[skip ci]Add comment on readBinary (#9355)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
|
2021-10-06 22:28:11 +08:00 |
|
XuanYang-cn
|
65a76b9bb5
|
[skip ci]Add comment in insertbuffernode (#9354)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
|
2021-10-06 22:20:05 +08:00 |
|
godchen
|
83228c35ad
|
Add flowgraph insert buffer node error check (#9310)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-06 21:06:23 +08:00 |
|
congqixia
|
10a6f7f146
|
Defer buf removal from insertBuf after SaveBinlog succeeds (#8930)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-09-30 17:42:11 +08:00 |
|
XuanYang-cn
|
b150f57927
|
No buffer also means flushed (#8686)
Resolves: #8684
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-28 11:18:03 +08:00 |
|
zhenshan.cao
|
b71bffe26f
|
Replace ChannelID with ShardName in DML Request (#8539)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2021-09-27 10:01:59 +08:00 |
|
XuanYang-cn
|
ebd894d8b7
|
Refactor buffer size calculation (#8565)
This PR changes the datanode insertBufSize config
from 32000 number of rows to 16MB
Resolves: #7741
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-26 20:55:59 +08:00 |
|
Cai Yudong
|
b2e5627061
|
Rename insertMsg to flowGraphMsg in datanode flow graph (#8546)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-26 10:43:57 +08:00 |
|
XuanYang-cn
|
faeb1bf50f
|
Add comment on exposed struct (#8348)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-23 20:15:54 +08:00 |
|
XuanYang-cn
|
2b82482679
|
Fix golint and ruleguard (#8347)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-23 19:14:01 +08:00 |
|
XuanYang-cn
|
a830c28bd8
|
Fix golint in datanode (#8345)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-23 19:05:55 +08:00 |
|
XuanYang-cn
|
d816a81ee3
|
Make FlushSegments async (#8159)
Resolves: #8122
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-23 16:03:54 +08:00 |
|
congqixia
|
bdfb8768d4
|
Enable gosec (#8202)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-09-18 14:45:50 +08:00 |
|
XuanYang-cn
|
46c72c57c2
|
Add BufferData in insertbufferNode (#8138)
Optimize bufferInsertMsg param to avoid a second transfer
of endposition
See also: #8058, #7741
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-18 14:25:50 +08:00 |
|
Cai Yudong
|
d10c6abc9e
|
Apply for msgstream from pool when creating collection (#7738)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-18 09:13:50 +08:00 |
|
XuanYang-cn
|
6c434b4801
|
Improve codes in insertbuffernode (#8054)
Add error handling in insertbuffernode
See also: #7624, #7684
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-17 16:27:56 +08:00 |
|
XuanYang-cn
|
82d4d19337
|
Remove not in use segmentCheckPoints (#8039)
Resolves: #8037
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-17 16:25:55 +08:00 |
|
dragondriver
|
a872a4357c
|
Add more test cases for proxy implementation (#7685)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
|
2021-09-11 11:36:22 +08:00 |
|
Cai Yudong
|
4e23ed9a18
|
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-10 13:00:00 +08:00 |
|
congqixia
|
69794fd32d
|
Refactor insertBufferNode and add unit tests (#7621)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-09-09 15:00:00 +08:00 |
|
Cai Yudong
|
3b9609692b
|
Apply for msgstream from pool when creating collection (#7377)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-08-31 18:35:58 +08:00 |
|
Cai Yudong
|
f4b53df727
|
Revert "Apply for msgstream from pool when creating collection (#7323)" (#7376)
This reverts commit e6de86a433.
|
2021-08-31 11:07:58 +08:00 |
|
Cai Yudong
|
e6de86a433
|
Apply for msgstream from pool when creating collection (#7323)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-08-31 09:47:58 +08:00 |
|
congqixia
|
65f168eac1
|
Fix datanode corner cases (#7336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-08-30 10:03:58 +08:00 |
|
congqixia
|
daae05641a
|
Construct bloom filter when inserting (#7268)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-08-25 10:29:52 +08:00 |
|
sunby
|
4f7c3e7d3a
|
Save binlog path in SegmentInfo (#6590)
issue: #6589
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-08-19 13:00:12 +08:00 |
|
XuanYang-cn
|
9d81a90402
|
Fix mem leak of flush cache in DataNode (#6862)
Resolves: #6858
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-08-11 14:24:09 +08:00 |
|
XuanYang-cn
|
47df4a2e57
|
Fix DataNode BackGroudGC problem (#6551)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-08-03 09:59:24 +08:00 |
|
godchen
|
db94d7771f
|
Read vector from disk (#6707)
* Read vector from disk
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix git action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix test error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix caculate error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change var name
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix len error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused code
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change bytes to float method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change float to bytes method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-07-24 09:25:22 +08:00 |
|
sunby
|
7f2d7c1da3
|
Rename dataservice to datacoordinator (#5912)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-06-21 18:22:13 +08:00 |
|
XuanYang-cn
|
441300140d
|
Tidy replica (#5920)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-06-21 16:00:22 +08:00 |
|
sunby
|
33f5225968
|
Use physical channel to init msg stream (#5815)
* Use physical channel to init msg stream
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* fix search collection error check (#1)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: bigsheeper <954206947@qq.com>
|
2021-06-18 16:02:05 +08:00 |
|