milvus/internal/querycoordv2/balance
wei liu 30a99b66c1
fix: Fix logic dead lock when delegator has high memory usage (#36065)
issue: #36064
when delegator has high memory usage, load l0 segment will failed. and
balance segment task will blocked by load segment task, then delegator
cann't free memory by moving out some segment, causes a logic dead lock.

this PR remove the limit for balance, we permit segment and balance
execute in parallel. which won't cause side effect due to:
1. one segment can only has one task in qc's scheduler, and load/release
task will replace balance task if necessary
2. balance speed has been limited, and it won't block load segment task.

3. if collection has load task and balance task at same time, load task
will be scheduled first due to high proirity.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-09-09 10:21:06 +08:00
..
balance_test.go enhance: Limit collection's normal balance speed (#34810) 2024-07-24 19:11:44 +08:00
balance.go fix: Fix logic dead lock when delegator has high memory usage (#36065) 2024-09-09 10:21:06 +08:00
channel_level_score_balancer_test.go enhance: Mark query node as read only after suspend (#35492) 2024-08-20 14:02:54 +08:00
channel_level_score_balancer.go fix: check collection health(queryable) fail for releasing collection (#34947) 2024-08-02 17:20:15 +08:00
mock_balancer.go enhance: Add restful api for devops to execute rolling upgrade (#29998) 2024-03-27 16:15:19 +08:00
multi_target_balance.go fix: fix panic when generating plans (#35309) 2024-08-07 18:14:16 +08:00
multi_target_balancer_test.go fix: Remove balance plan of which From, To nodes are same when merging (#30634) 2024-02-18 17:24:50 +08:00
OWNERS Add OWNERS files for querycoordv2 sub pkgs (#23489) 2023-04-18 15:52:30 +08:00
priority_queue_test.go enhance segment balance by considering global rowCount(##22914) (#23056) 2023-04-03 14:16:25 +08:00
priority_queue.go Add license header (#19678) 2022-10-11 11:39:22 +08:00
rowcount_based_balancer_test.go enhance: Mark query node as read only after suspend (#35492) 2024-08-20 14:02:54 +08:00
rowcount_based_balancer.go fix: check collection health(queryable) fail for releasing collection (#34947) 2024-08-02 17:20:15 +08:00
score_based_balancer_test.go enhance: Mark query node as read only after suspend (#35492) 2024-08-20 14:02:54 +08:00
score_based_balancer.go fix: Fix logic dead lock when delegator has high memory usage (#36065) 2024-09-09 10:21:06 +08:00
utils.go enhance: Support L0 import (#33514) 2024-06-07 14:17:20 +08:00