Xiaofan
|
db3f4be49d
|
Simplify flow graph node to pipeline mode (#19667)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-10-10 22:15:22 +08:00 |
|
SimFG
|
d7f38a803d
|
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-09-16 16:56:49 +08:00 |
|
bigsheeper
|
5cdd6ca251
|
Add quotaCenter, rateLimiter and rateCollector (#18636)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-09-16 09:56:47 +08:00 |
|
congqixia
|
91663a6603
|
Fix bloom filter size not match (#19140)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-13 14:12:31 +08:00 |
|
wei liu
|
9338ad45c5
|
fix insert meets vChannels reuse pChannel (#18695)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
|
2022-08-23 19:12:55 +08:00 |
|
congqixia
|
f0846fb79b
|
Handles DropPartitionMsg in datanode flowgraph (#18292)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-15 17:12:27 +08:00 |
|
XuanYang-cn
|
d9e8231728
|
Filter sealed segments (#18065)
- Remove FilterThreshold in DataNode
- Alter filter logic in flowgraph DDNode
See also: #17943
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2022-07-07 18:26:20 +08:00 |
|
bigsheeper
|
cdbd75d4dd
|
Log delta channel timetick in DataNode (#17947)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-30 17:44:18 +08:00 |
|
wayblink
|
eb5b0b7fc8
|
Move SegmentInfo out of VchannelInfo, leave Id only to decrease kv size. Get complete SegmentInfo through RPC (#17441)
Resolves: #17233 #16047
Signed-off-by: wayblink <anyang.wang@zilliz.com>
|
2022-06-16 12:00:10 +08:00 |
|
bigsheeper
|
e0cbacba59
|
Check ignorable error to prevent unnecessary panic (#17317)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-06-02 10:12:03 +08:00 |
|
bigsheeper
|
a4ea2fb18a
|
Handle errors in DataNode and QueryNode flow graph (#17096)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-05-24 21:11:59 +08:00 |
|
Xiaofan
|
89b4a34892
|
Fix Data race in NodeID (#16603)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-04-24 22:03:44 +08:00 |
|
Ten Thousand Leaves
|
289e468a7a
|
Make bulk load fully work (#16512)
issue: #15604
/kind enhancement
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-04-20 14:03:40 +08:00 |
|
xige-16
|
99984b88e1
|
Support delete varChar value (#16229)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-04-02 17:43:29 +08:00 |
|
zhenshan.cao
|
f3eeecf146
|
Reduce the number of metrics (#16030)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
|
2022-03-15 21:51:21 +08:00 |
|
Cai Yudong
|
3e862ecdfb
|
Merge msgChannelConfig and knowhereConfig into commonConfig (#15843)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-03-04 11:17:56 +08:00 |
|
jaime
|
7a3a721380
|
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-03-03 21:57:56 +08:00 |
|
Xiaofan
|
bd7d294c6d
|
Refine log level in data (#15821)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
|
2022-03-02 15:35:55 +08:00 |
|
bigsheeper
|
13177a90af
|
Add prometheus metrics for DataNode (#15650)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
|
2022-02-28 19:11:55 +08:00 |
|
Cai Yudong
|
4bccc85534
|
Use MsgChannelConfig in GlobalParams for all components (#15163)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-02-02 00:35:43 +08:00 |
|
godchen
|
98232b4942
|
[skip e2e]Sort imports (#14820)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
|
2022-01-05 14:25:48 +08:00 |
|
Jiquan Long
|
ebb9b24b47
|
Improve name of flowgraph node (#14538)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
|
2021-12-30 10:33:46 +08:00 |
|
XuanYang-cn
|
3d24007efa
|
Add more logs for load sealed segment (#14079)
Add logs before&after flowgraph_ddnode forwarding delete msg
See also: #13879
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-12-24 10:50:07 +08:00 |
|
Cai Yudong
|
891c202b73
|
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-12-23 18:39:11 +08:00 |
|
edward.zeng
|
c2b73e1b55
|
[skip ci] Refine data node flow graph comment (#12637)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
|
2021-12-02 18:59:33 +08:00 |
|
congqixia
|
8f9e62fa18
|
Apply DropVirtualChannel and FlushManager drop mode (#12563)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-12-02 16:39:33 +08:00 |
|
bigsheeper
|
e245ba87a9
|
Add excluded segments for dropped segemnts (#12247)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2021-11-25 14:25:15 +08:00 |
|
XuanYang-cn
|
8a8ebed23d
|
Fix DN GC bug (#12258)
Fixes: #12249
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-25 09:43:15 +08:00 |
|
XuanYang-cn
|
e72c5b9351
|
Filter dropped segments in DN (#12242)
See also: #12131, #12230
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-24 14:11:15 +08:00 |
|
XuanYang-cn
|
f3852c1db0
|
Add more specific logs (#11724)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-15 15:25:09 +08:00 |
|
XuanYang-cn
|
c4bb73dc74
|
Complete drop collection procedure in DN (#11552)
drop, cancel compaction, flush all buffers and release fg
See also: #11426
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-11 20:56:49 +08:00 |
|
godchen
|
5357e301f4
|
Fix retrieve search error (#11501)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-11 00:54:45 +08:00 |
|
godchen
|
639800241d
|
Make flow graph for delta channel (#11379)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-09 09:27:04 +08:00 |
|
godchen
|
9186d5527e
|
Forward delete msg (#11210)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-05 11:59:02 +08:00 |
|
XuanYang-cn
|
dcd56a575d
|
[skip ci]Update license for flowgraph of dn (#9962)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-15 18:07:09 +08:00 |
|
XuanYang-cn
|
aac6323cff
|
Use config as parameter (#9707)
Make functions in flowgraph lesser parameters
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-13 11:16:32 +08:00 |
|
Cai Yudong
|
84e568ee32
|
Support Delete in datanode (#8505)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-10-11 16:31:44 +08:00 |
|
godchen
|
937dbf4279
|
Add flushed segments (#9476)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-08 19:09:12 +08:00 |
|
congqixia
|
908b7df41d
|
Add comment and implementation assertion for ddnode (#9333)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-07 19:54:56 +08:00 |
|
XuanYang-cn
|
27143c6095
|
[skip ci]Add comment on flowgraph ddNode (#9358)
Signed-off-by: Yang Xuan <xuan.yang@zilliz.com>
|
2021-10-06 22:51:58 +08:00 |
|
Cai Yudong
|
b2e5627061
|
Rename insertMsg to flowGraphMsg in datanode flow graph (#8546)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-26 10:43:57 +08:00 |
|
Cai Yudong
|
28d305148a
|
Update ddnode insert (#8536)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-26 09:43:57 +08:00 |
|
Cai Yudong
|
d10c6abc9e
|
Apply for msgstream from pool when creating collection (#7738)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-18 09:13:50 +08:00 |
|
Cai Yudong
|
4e23ed9a18
|
Revert apply physical channels from pool (d5f7e358 and 3b960969 ) (#7687)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-10 13:00:00 +08:00 |
|
XuanYang-cn
|
29756c6ce8
|
Add ut for flow_graph_dd_node to 100% (#7511)
This PR:
- Change mutex to sync.Map
- Add ut for flow_graph_dd_node.go to 100%
See also: #6357
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-07 15:41:59 +08:00 |
|
Cai Yudong
|
3b9609692b
|
Apply for msgstream from pool when creating collection (#7377)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-08-31 18:35:58 +08:00 |
|
Cai Yudong
|
f4b53df727
|
Revert "Apply for msgstream from pool when creating collection (#7323)" (#7376)
This reverts commit e6de86a433 .
|
2021-08-31 11:07:58 +08:00 |
|
Cai Yudong
|
e6de86a433
|
Apply for msgstream from pool when creating collection (#7323)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-08-31 09:47:58 +08:00 |
|
XuanYang-cn
|
dca6c6afde
|
Add unittest for BackGroundGC in DataNode (#6522)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-07-15 10:05:55 +08:00 |
|
XuanYang-cn
|
f0a68704e2
|
Add unittests for getChannelName in DataNode (#6346)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-07-08 15:52:40 +08:00 |
|