milvus/internal
wei liu d79aa58b37
enhance: Speed up target recovery after query coord restart (#31240)
issue: #28491

after querycoord restart, it will pull a new target, which include
channel and segment list. when segments loaded on querynode has reached
the target, the collection could provide search/query. but if segment
list changes by time, ater querycoord pull a new target, it will takes a
few minutes to catch up the target's segment distribution. and before
that, query/search will fail due to lack of segments.

This PR save the current loaded target to meta storein querycoord's stop
progress, and recover it when query coord starts, to speed up the target
recovery time.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-03-15 14:19:03 +08:00
..
allocator enhance:change some logs (#29579) 2024-01-05 16:12:48 +08:00
core fix:possible out-of-bound due to groupby when reduing(#30711) (#31200) 2024-03-14 13:07:03 +08:00
datacoord enhance: Allow import tasks to retry for more errors (#31268) 2024-03-15 11:05:04 +08:00
datanode fix: Fix binlog import and refine error reporting (#31241) 2024-03-15 10:55:05 +08:00
distributed enhance: Speed up target recovery after query coord restart (#31240) 2024-03-15 14:19:03 +08:00
http enhance: Support to get the param value in the runtime (#29297) 2023-12-22 18:36:44 +08:00
indexnode fix: ctx cancel should be the last step while stopping server (#31220) 2024-03-15 10:33:05 +08:00
kv enhance: disallow tikv/rawkv usages (#30027) 2024-02-06 10:41:41 +08:00
metastore enhance: Speed up target recovery after query coord restart (#31240) 2024-03-15 14:19:03 +08:00
mocks fix: merge index params when creating index (#31127) 2024-03-11 17:31:03 +08:00
mq fix: close rocksmq and natsmq when shutdown (#30706) 2024-02-26 11:38:55 +08:00
parser/planparserv2 feat: [Sparse Float Vector] add sparse vector support to milvus components (#30630) 2024-03-13 14:32:54 -07:00
proto enhance: Speed up target recovery after query coord restart (#31240) 2024-03-15 14:19:03 +08:00
proxy fix: Set node unreachable when get shard client failed (#31277) 2024-03-15 10:23:03 +08:00
querycoordv2 enhance: Speed up target recovery after query coord restart (#31240) 2024-03-15 14:19:03 +08:00
querynodev2 fix: ctx cancel should be the last step while stopping server (#31220) 2024-03-15 10:33:05 +08:00
registry Add querynode client wrapper and avoid grpc in standalone mode (#27781) 2023-10-19 11:10:07 +08:00
rootcoord fix: ctx cancel should be the last step while stopping server (#31220) 2024-03-15 10:33:05 +08:00
storage feat: [Sparse Float Vector] add sparse vector support to milvus components (#30630) 2024-03-13 14:32:54 -07:00
tso Format the code (#27275) 2023-09-21 09:45:27 +08:00
types feat: Revise the RESTful bulk insert API (#29698) 2024-03-05 15:03:00 +08:00
util fix: ctx cancel should be the last step while stopping server (#31220) 2024-03-15 10:33:05 +08:00