congqixia
|
838a633584
|
Add ctx parameter for ChunkManager methods (#19546)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-29 16:18:56 +08:00 |
|
XuanYang-cn
|
a0ce533727
|
Add a SyncSegments to sync meta between DN and DC (#19298)
See also: #19072
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-09-27 16:02:53 +08:00 |
|
yah01
|
9801c6dfc9
|
Fix data race in DataNode (#19470)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
|
2022-09-27 15:16:55 +08:00 |
|
XuanYang-cn
|
f6e7b92db6
|
Fix read lock to write lock (#19464)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-09-27 11:50:57 +08:00 |
|
Ten Thousand Leaves
|
b30c9d4f60
|
Support Bulk Load in Milvus 2.2 (#18982)
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-09-26 18:06:54 +08:00 |
|
zhenshan.cao
|
c15b880f0e
|
Remove redundant logs (#19412)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-09-26 15:40:53 +08:00 |
|
Enwei Jiao
|
ee8896d81b
|
fix compile error (#19428)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-09-26 11:24:54 +08:00 |
|
zhagnlu
|
59f8e96522
|
Change compactor policy from loading all binlogs to loading serially (#13716) (#19280)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
|
2022-09-25 20:12:52 +08:00 |
|
jaime
|
91df8f2d6a
|
Use log id instead of log path of the binlog in metastore (#19123)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-09-25 15:56:51 +08:00 |
|
Xiaofan
|
928a213e31
|
Fix Chunk Manager Path mis use (#19141)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-09-23 14:40:51 +08:00 |
|
XuanYang-cn
|
432b5ddf2e
|
Add SyncSegments into proto (#19312)
See also: #19072
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-09-23 10:22:52 +08:00 |
|
SimFG
|
d7f38a803d
|
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-09-16 16:56:49 +08:00 |
|
bigsheeper
|
5cdd6ca251
|
Add quotaCenter, rateLimiter and rateCollector (#18636)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-09-16 09:56:47 +08:00 |
|
congqixia
|
91663a6603
|
Fix bloom filter size not match (#19140)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-13 14:12:31 +08:00 |
|
jaime
|
362c663b22
|
Remove deprecated inner compaction type (#19024)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-09-07 19:16:34 +08:00 |
|
congqixia
|
68a6587374
|
Set insert&stats binlog timestamp range (#19005)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-04 09:05:09 +08:00 |
|
congqixia
|
ff5201cbe5
|
Improve log of datanode compactor (#18981)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-02 14:31:06 +08:00 |
|
congqixia
|
29c72cad15
|
Use segment statslog instead of separate statslog (#18775)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-02 10:34:59 +08:00 |
|
congqixia
|
c91bb0b015
|
Unify rootPath in configs and ChunkManager (#18808)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-25 19:32:53 +08:00 |
|
wei liu
|
9338ad45c5
|
fix insert meets vChannels reuse pChannel (#18695)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
|
2022-08-23 19:12:55 +08:00 |
|
Enwei Jiao
|
d9c7519107
|
refactor compaction concurency logic (#18660)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
|
2022-08-23 15:50:52 +08:00 |
|
XuanYang-cn
|
16dcd9718b
|
Fix flush panic after compaction (#18677)
See also: #18565
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-08-17 17:08:49 +08:00 |
|
XuanYang-cn
|
4c86cc63ba
|
Fix DN flowgraph delete buffer logs (#18657)
1. Remove logs about not existing segments.
2. Group logs by timestamp.
3. Log changed segments only.
4. Pair the segments reference lock and unlock log by taskID.
Resolves: #18655
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-08-15 16:28:48 +08:00 |
|
aoiasd
|
8a70f2badb
|
Add ShowConfigurations for all remaining session (#18594)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
|
2022-08-12 13:20:39 +08:00 |
|
congqixia
|
28aadc988d
|
Use vchannel name in datanode subName (#18519)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-08-03 17:10:36 +08:00 |
|
jaime
|
c9174d55ba
|
Refine merge operation during compacting phase (#18399)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-07-28 14:52:31 +08:00 |
|
SimFG
|
74fd28df9c
|
Refine some datanode code (#18351)
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-07-21 15:52:27 +08:00 |
|
Ten Thousand Leaves
|
0ebe407221
|
Make DataNode not panic if stale segment is not found during flush (#18322)
/kind improvement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-07-20 15:06:30 +08:00 |
|
congqixia
|
be6ca6358d
|
Use serialized size before compression in log meta (#18336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-19 21:30:30 +08:00 |
|
congqixia
|
f0846fb79b
|
Handles DropPartitionMsg in datanode flowgraph (#18292)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-15 17:12:27 +08:00 |
|
Ten Thousand Leaves
|
ecc250c20e
|
Improve logs to better cover segment flush lifecycle (#18157)
/kind improvements
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-07-08 14:50:21 +08:00 |
|
XuanYang-cn
|
53734bef58
|
Add seek msgID in DataNode (#17881)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-07-08 10:18:28 +08:00 |
|
wayblink
|
43ae6791e6
|
Make VChannelInfo read compatible with 2.0.2 (#17995)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-07-07 21:58:22 +08:00 |
|
XuanYang-cn
|
d9e8231728
|
Filter sealed segments (#18065)
- Remove FilterThreshold in DataNode
- Alter filter logic in flowgraph DDNode
See also: #17943
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-07-07 18:26:20 +08:00 |
|
congqixia
|
8f1ba6a0bb
|
Concurrent load segment stats log when initialize dataSyncService (#18125)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-07 14:32:21 +08:00 |
|
Ten Thousand Leaves
|
d4a1e94f32
|
Fix flush failure caused by empty stale segments (#18097)
/bug
issue: #18096
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-07-06 18:10:21 +08:00 |
|
Xiaofan
|
a9b1d71a8f
|
change the etcd compareAndSwap interface (#18068)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-07-06 13:54:21 +08:00 |
|
zhenshan.cao
|
9bd35dd84e
|
Refine logs to reduce print (#17759) (#18028)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-07-04 11:10:20 +08:00 |
|
bigsheeper
|
cdbd75d4dd
|
Log delta channel timetick in DataNode (#17947)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-30 17:44:18 +08:00 |
|
zhenshan.cao
|
0baeb609dc
|
Fix bugs in monitoring metrics (#17894)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-06-30 17:26:19 +08:00 |
|
Ten Thousand Leaves
|
f0b036a35a
|
Move bulk load segment lock happen early (#17612)
issue: #17600
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-06-27 13:56:17 +08:00 |
|
SimFG
|
50d5d04552
|
Refine some codes about the datanode (#17720)
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-06-23 09:58:14 +08:00 |
|
Xiaofan
|
6fdf88f452
|
Fix compaction selection policy (#17690)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-06-22 19:00:14 +08:00 |
|
XuanYang-cn
|
12158432bb
|
Clear segment cache when closing flowgraph (#17671)
See also: #17537
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-06-22 10:16:14 +08:00 |
|
congqixia
|
12b3a29db8
|
Fix segments info in drop virtual channel request is not set (#17641)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-06-20 13:40:12 +08:00 |
|
wayblink
|
074ec3060a
|
Support return dropped segments info in GetSegmentInfo rpc (#17617)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-06-17 18:24:12 +08:00 |
|
Xiaofan
|
1f6fbf91b2
|
Fix pulsar unsubsribe issue (#17562)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-06-16 17:28:11 +08:00 |
|
wayblink
|
eb5b0b7fc8
|
Move SegmentInfo out of VchannelInfo, leave Id only to decrease kv size. Get complete SegmentInfo through RPC (#17441)
Resolves: #17233 #16047
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-06-16 12:00:10 +08:00 |
|
Ten Thousand Leaves
|
65ab847815
|
Add segment reference lock for bulk load (#17457)
So we can support DataQueryable and DataIndexed states
issue: #16607
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-06-15 12:20:10 +08:00 |
|
groot
|
ab9b186f15
|
Change bulkload bufsize for row-based parser (#17473)
Signed-off-by: groot <yihua.mo@zilliz.com>
|
2022-06-14 16:18:09 +08:00 |
|