SimFG
|
d7f38a803d
|
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-09-16 16:56:49 +08:00 |
|
bigsheeper
|
5cdd6ca251
|
Add quotaCenter, rateLimiter and rateCollector (#18636)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-09-16 09:56:47 +08:00 |
|
congqixia
|
91663a6603
|
Fix bloom filter size not match (#19140)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-13 14:12:31 +08:00 |
|
jaime
|
362c663b22
|
Remove deprecated inner compaction type (#19024)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-09-07 19:16:34 +08:00 |
|
congqixia
|
68a6587374
|
Set insert&stats binlog timestamp range (#19005)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-04 09:05:09 +08:00 |
|
congqixia
|
ff5201cbe5
|
Improve log of datanode compactor (#18981)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-02 14:31:06 +08:00 |
|
congqixia
|
29c72cad15
|
Use segment statslog instead of separate statslog (#18775)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-02 10:34:59 +08:00 |
|
congqixia
|
c91bb0b015
|
Unify rootPath in configs and ChunkManager (#18808)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-25 19:32:53 +08:00 |
|
wei liu
|
9338ad45c5
|
fix insert meets vChannels reuse pChannel (#18695)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
|
2022-08-23 19:12:55 +08:00 |
|
Enwei Jiao
|
d9c7519107
|
refactor compaction concurency logic (#18660)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-08-23 15:50:52 +08:00 |
|
XuanYang-cn
|
16dcd9718b
|
Fix flush panic after compaction (#18677)
See also: #18565
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-08-17 17:08:49 +08:00 |
|
XuanYang-cn
|
4c86cc63ba
|
Fix DN flowgraph delete buffer logs (#18657)
1. Remove logs about not existing segments.
2. Group logs by timestamp.
3. Log changed segments only.
4. Pair the segments reference lock and unlock log by taskID.
Resolves: #18655
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-08-15 16:28:48 +08:00 |
|
aoiasd
|
8a70f2badb
|
Add ShowConfigurations for all remaining session (#18594)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
|
2022-08-12 13:20:39 +08:00 |
|
congqixia
|
28aadc988d
|
Use vchannel name in datanode subName (#18519)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-03 17:10:36 +08:00 |
|
jaime
|
c9174d55ba
|
Refine merge operation during compacting phase (#18399)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-07-28 14:52:31 +08:00 |
|
SimFG
|
74fd28df9c
|
Refine some datanode code (#18351)
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-07-21 15:52:27 +08:00 |
|
Ten Thousand Leaves
|
0ebe407221
|
Make DataNode not panic if stale segment is not found during flush (#18322)
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-07-20 15:06:30 +08:00 |
|
congqixia
|
be6ca6358d
|
Use serialized size before compression in log meta (#18336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-19 21:30:30 +08:00 |
|
congqixia
|
f0846fb79b
|
Handles DropPartitionMsg in datanode flowgraph (#18292)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-15 17:12:27 +08:00 |
|
Ten Thousand Leaves
|
ecc250c20e
|
Improve logs to better cover segment flush lifecycle (#18157)
/kind improvements
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-07-08 14:50:21 +08:00 |
|
XuanYang-cn
|
53734bef58
|
Add seek msgID in DataNode (#17881)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-07-08 10:18:28 +08:00 |
|
wayblink
|
43ae6791e6
|
Make VChannelInfo read compatible with 2.0.2 (#17995)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-07-07 21:58:22 +08:00 |
|
XuanYang-cn
|
d9e8231728
|
Filter sealed segments (#18065)
- Remove FilterThreshold in DataNode
- Alter filter logic in flowgraph DDNode
See also: #17943
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-07-07 18:26:20 +08:00 |
|
congqixia
|
8f1ba6a0bb
|
Concurrent load segment stats log when initialize dataSyncService (#18125)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-07 14:32:21 +08:00 |
|
Ten Thousand Leaves
|
d4a1e94f32
|
Fix flush failure caused by empty stale segments (#18097)
/bug
issue: #18096
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-07-06 18:10:21 +08:00 |
|
Xiaofan
|
a9b1d71a8f
|
change the etcd compareAndSwap interface (#18068)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-07-06 13:54:21 +08:00 |
|
zhenshan.cao
|
9bd35dd84e
|
Refine logs to reduce print (#17759) (#18028)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-07-04 11:10:20 +08:00 |
|
bigsheeper
|
cdbd75d4dd
|
Log delta channel timetick in DataNode (#17947)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-30 17:44:18 +08:00 |
|
zhenshan.cao
|
0baeb609dc
|
Fix bugs in monitoring metrics (#17894)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-06-30 17:26:19 +08:00 |
|
Ten Thousand Leaves
|
f0b036a35a
|
Move bulk load segment lock happen early (#17612)
issue: #17600
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-06-27 13:56:17 +08:00 |
|
SimFG
|
50d5d04552
|
Refine some codes about the datanode (#17720)
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-06-23 09:58:14 +08:00 |
|
Xiaofan
|
6fdf88f452
|
Fix compaction selection policy (#17690)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-06-22 19:00:14 +08:00 |
|
XuanYang-cn
|
12158432bb
|
Clear segment cache when closing flowgraph (#17671)
See also: #17537
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-06-22 10:16:14 +08:00 |
|
congqixia
|
12b3a29db8
|
Fix segments info in drop virtual channel request is not set (#17641)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-06-20 13:40:12 +08:00 |
|
wayblink
|
074ec3060a
|
Support return dropped segments info in GetSegmentInfo rpc (#17617)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-06-17 18:24:12 +08:00 |
|
Xiaofan
|
1f6fbf91b2
|
Fix pulsar unsubsribe issue (#17562)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-06-16 17:28:11 +08:00 |
|
wayblink
|
eb5b0b7fc8
|
Move SegmentInfo out of VchannelInfo, leave Id only to decrease kv size. Get complete SegmentInfo through RPC (#17441)
Resolves: #17233 #16047
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-06-16 12:00:10 +08:00 |
|
Ten Thousand Leaves
|
65ab847815
|
Add segment reference lock for bulk load (#17457)
So we can support DataQueryable and DataIndexed states
issue: #16607
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-06-15 12:20:10 +08:00 |
|
groot
|
ab9b186f15
|
Change bulkload bufsize for row-based parser (#17473)
Signed-off-by: groot <yihua.mo@zilliz.com>
|
2022-06-14 16:18:09 +08:00 |
|
wayblink
|
25883840b2
|
Remove delete log in datanode because it may influence datanode performance (#17415)
Resolves #16984
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-06-08 19:10:07 +08:00 |
|
XuanYang-cn
|
4f66bcbb22
|
Fix DataNode processes event out of order (#17440)
The probability is low so very unlikly to reproduce
See also: #15966
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-06-08 17:24:07 +08:00 |
|
groot
|
f31be941bb
|
Fix bulkload row count bug for multi datanodes (#17384)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
|
2022-06-07 16:56:07 +08:00 |
|
xige-16
|
b5c11a216d
|
Alter varChar type params's name to max_length (#17409)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-06-07 15:58:06 +08:00 |
|
Xiaofan
|
af994b5e1c
|
Fix etcd watch error (#17364)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-06-06 16:26:06 +08:00 |
|
Ten Thousand Leaves
|
f5e63177d2
|
Fix an issue with bulk load with multiple DataNodes (#17324)
issue: #17300
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-06-02 18:54:04 +08:00 |
|
bigsheeper
|
e0cbacba59
|
Check ignorable error to prevent unnecessary panic (#17317)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-02 10:12:03 +08:00 |
|
XuanYang-cn
|
d920e5c915
|
Fix DataNode panic while allocating IDs (#17294)
See also: #17270
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-05-31 18:02:03 +08:00 |
|
groot
|
affcc2acad
|
Fix bulkload entity number bug (#17278)
Signed-off-by: groot <yihua.mo@zilliz.com>
|
2022-05-31 15:40:04 +08:00 |
|
congqixia
|
55f1e03ca7
|
Allow DataNode clean vchannel with meta error without panicking (#17247)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-05-27 16:20:00 +08:00 |
|
Jiquan Long
|
c12ee2f5cb
|
Fix flow_graph_insert_buffer_node.go code style (#17216)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
|
2022-05-25 17:03:59 +08:00 |
|