milvus/internal
wei liu 8123bea1ae
enhance: Avoid assign too much segment/channels to new querynode (#34096)
issue: #34095

When a new query node comes online, the segment_checker,
channel_checker, and balance_checker simultaneously attempt to allocate
segments to it. If this occurs during the execution of a load task and
the distribution of the new query node hasn't been updated, the query
coordinator may mistakenly view the new query node as empty. As a
result, it assigns segments or channels to it, potentially overloading
the new query node with more segments or channels than expected.

This PR measures the workload of the executing tasks on the target query
node to prevent assigning an excessive number of segments to it.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-06-27 19:06:05 +08:00
..
allocator enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
core enhance: Update knowhere commit (#34223) 2024-06-27 18:20:06 +08:00
datacoord enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
datanode fix: fix error ignore in compactor (#34169) 2024-06-26 10:24:03 +08:00
distributed enhance: Rename Compaction to CompactionV2 (#33858) 2024-06-16 22:07:57 +08:00
http enhance: add restful api to trigger component stop (#32076) 2024-06-07 10:35:54 +08:00
indexnode enhance: Add nilness linter and fix some small issues (#34049) 2024-06-24 14:52:03 +08:00
kv enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
metastore enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
mocks enhance: implement rmq and pulsar as wal (#34046) 2024-06-27 15:11:05 +08:00
parser/planparserv2 enhance: optimize plan parser pool to avoid unnessary recycle (#32869) 2024-05-11 10:51:31 +08:00
proto enhance: implement rmq and pulsar as wal (#34046) 2024-06-27 15:11:05 +08:00
proxy enhance: refine error message for invalid limit parameter (#34178) 2024-06-26 22:14:04 +08:00
querycoordv2 enhance: Avoid assign too much segment/channels to new querynode (#34096) 2024-06-27 19:06:05 +08:00
querynodev2 enhance: Avoid search querynode return nil status in response (#34100) 2024-06-26 11:50:11 +08:00
registry
rootcoord fix: Fix datacoord's properties overwriten (#34146) 2024-06-26 11:56:04 +08:00
storage enhance: Add unittest for storage.DeleteLog (#34190) 2024-06-26 17:14:04 +08:00
streamingnode/server/wal enhance: implement rmq and pulsar as wal (#34046) 2024-06-27 15:11:05 +08:00
streamingservice enhance: implement rmq and pulsar as wal (#34046) 2024-06-27 15:11:05 +08:00
tso enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
types enhance: Check by proxy rate limiter when delete get data by query. (#30891) 2024-05-23 20:03:40 +08:00
util enhance: implement rmq and pulsar as wal (#34046) 2024-06-27 15:11:05 +08:00