milvus/internal
wei liu cf701a9bf0
enhance: Preserve fixed-size memory in delegator node for growing segment (#34600)
issue: #34595
pr: #34596
When consuming insert data on the delegator node, QueryCoord will move
out some sealed segments to manage its memory usage. After the growing
segment gets flushed, some sealed segments from other workers will be
moved back to the delegator node. To avoid the frequent movement of
segments, we estimate the maximum growing row count and preserve a
fixed-size memory in the delegator node.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-07-15 20:51:46 +08:00
..
allocator enhance: move rocksmq from internal to pkg (#34165) 2024-06-26 13:36:05 +08:00
core fix: fix auto merge error (#34662) 2024-07-13 10:39:38 +08:00
datacoord enhance: [2.4] Add param item for segmentFlushInterval (#34629) (#34663) 2024-07-15 14:31:40 +08:00
datanode enhance: [2.4] add the seal segment when dispatch delete msgs (#34566) 2024-07-10 19:18:51 +08:00
distributed fix: [Cherry-pick] Restful API use deprecate error code cause access log panic. (#34579) 2024-07-11 11:58:51 +08:00
http enhance: add restful api to trigger component stop (#32076) (#33799) 2024-06-17 21:53:59 +08:00
indexnode fix: Indexnode stuck at stopping progress cause by wrong lifetime control (#34559) 2024-07-10 15:14:13 +08:00
kv enhance: move rocksmq from internal to pkg (#34165) 2024-06-26 13:36:05 +08:00
metastore enhance: Add back compactionTaskNum metrics (#34534) 2024-07-11 00:08:52 +08:00
mocks enhance: [cherry-pick] Remove compaction plans on the datanode (#33548) (#34312) 2024-07-02 17:39:08 +08:00
parser/planparserv2 enhance: optimize plan parser pool to avoid unnessary recycle (#32869) 2024-05-11 10:51:31 +08:00
proto enhance: ensure autoindex default metric type compatibility (#34479) 2024-07-08 19:48:14 +08:00
proxy enhance: [2.4] use the insert rate limit for the upsert request (#34616) 2024-07-12 16:19:36 +08:00
querycoordv2 enhance: Preserve fixed-size memory in delegator node for growing segment (#34600) 2024-07-15 20:51:46 +08:00
querynodev2 enhance: [2.4] Add lint rule to forbid gogo protobuf (#34594) (#34630) 2024-07-12 18:13:36 +08:00
registry Add querynode client wrapper and avoid grpc in standalone mode (#27781) 2023-10-19 11:10:07 +08:00
rootcoord fix: RootCoord panic during check health (#34542) 2024-07-10 09:50:38 +08:00
storage enhance: [2.4] Add lint rule to forbid gogo protobuf (#34594) (#34630) 2024-07-12 18:13:36 +08:00
tso enhance: move rocksmq from internal to pkg (#34165) 2024-06-26 13:36:05 +08:00
types feat: support rate limiter based on db and partition levels (#31070) 2024-04-12 16:01:19 +08:00
util enhance: Use Blocked Bloom Filter instead of basic bloom fitler impl (#34377) 2024-07-05 17:04:10 +08:00