milvus/internal/querycoordv2
wei liu 8123bea1ae
enhance: Avoid assign too much segment/channels to new querynode (#34096)
issue: #34095

When a new query node comes online, the segment_checker,
channel_checker, and balance_checker simultaneously attempt to allocate
segments to it. If this occurs during the execution of a load task and
the distribution of the new query node hasn't been updated, the query
coordinator may mistakenly view the new query node as empty. As a
result, it assigns segments or channels to it, potentially overloading
the new query node with more segments or channels than expected.

This PR measures the workload of the executing tasks on the target query
node to prevent assigning an excessive number of segments to it.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-06-27 19:06:05 +08:00
..
balance enhance: Avoid assign too much segment/channels to new querynode (#34096) 2024-06-27 19:06:05 +08:00
checkers enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
dist enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
job enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
meta enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
mocks enhance:Refactor hybrid search (#32020) 2024-04-09 14:21:18 +08:00
observers enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
params Moving etcd client into session (#27069) 2023-10-27 07:36:12 +08:00
session enhance: Add restful api for devops to execute rolling upgrade (#29998) 2024-03-27 16:15:19 +08:00
task enhance: Avoid assign too much segment/channels to new querynode (#34096) 2024-06-27 19:06:05 +08:00
utils fix: query node may stuck at stopping progress (#33104) 2024-05-20 10:21:38 +08:00
api_testonly.go test: support segment release in integration test (#31190) 2024-04-09 11:39:17 +08:00
handlers.go enhance: Enable to dynamic update balancer policy in querycoord (#33037) 2024-05-21 14:29:39 +08:00
ops_service_test.go enhance: Avoid assign too much segment/channels to new querynode (#34096) 2024-06-27 19:06:05 +08:00
ops_services.go fix: query node may stuck at stopping progress (#33104) 2024-05-20 10:21:38 +08:00
OWNERS Add QueryCoord OWNERS file (#21552) 2023-01-10 16:15:37 +08:00
server_test.go enhance: Enable database level replica num and resource groups for loading collection (#33052) 2024-05-29 10:59:43 +08:00
server.go enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
services_test.go enhance: Avoid assign too much segment/channels to new querynode (#34096) 2024-06-27 19:06:05 +08:00
services.go fix: Fix GetReplicas API return nil status (#33715) 2024-06-20 14:40:15 +08:00