milvus/internal
congqixia eaabe0293b
fix: Update segment compactTo when compactTo segment is compacted (#28755)
Related to #28736 #28748
See also #27675
Previous PR: #28646

This PR fixes `SegmentNotFound` issue when compaction happens multiple
times and the buffer of first generation segment is sync due to stale
policy

Now the `CompactSegments` API of metacache shall update the compactTo
field of segmentInfo if the compactTo segment is also compacted to keep
the bloodline clean

Also, add the `CompactedSegment` SyncPolicy to sync the compacted
segment asap to keep metacache clean

Now the `SyncPolicy` is an interface instead of a function type so that
when it selects some segments to sync, we colud log the reason and
target segment

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-11-27 19:48:26 +08:00
..
allocator enhance:Remove msgbase unnecessary assignments (#28511) 2023-11-24 15:02:39 +08:00
core [automated] Update Knowhere Commit (#28704) 2023-11-24 16:56:24 +08:00
datacoord enhance: Add logs for each step during service initialization (#28624) 2023-11-27 16:30:26 +08:00
datanode fix: Update segment compactTo when compactTo segment is compacted (#28755) 2023-11-27 19:48:26 +08:00
distributed fix: cmux graceful shutdown on proxy service (#28383) 2023-11-27 16:28:34 +08:00
http Improve HTTP server include metrics and RESTful API (#28045) 2023-11-19 17:14:20 +08:00
indexnode enhance: Add logs for each step during service initialization (#28624) 2023-11-27 16:30:26 +08:00
kv enhance: Make etcd kv request timeout configurable (#28661) 2023-11-23 19:34:23 +08:00
metastore fix: failed to release collection with more than 128 partitions (#28446) 2023-11-19 18:28:21 +08:00
mocks feat: trigger compaction to handle index version (#28442) 2023-11-21 09:26:22 +08:00
mq Fix getting incorrect CPU num (#28146) 2023-11-06 06:02:16 +08:00
parser/planparserv2 fix: Fix bug for parsing expression that include quotes (#28416) 2023-11-23 17:18:32 +08:00
proto feat: enable balance based on growing segment row count (#28623) 2023-11-27 14:58:26 +08:00
proxy enhance: Add logs for each step during service initialization (#28624) 2023-11-27 16:30:26 +08:00
querycoordv2 enhance: Add logs for each step during service initialization (#28624) 2023-11-27 16:30:26 +08:00
querynodev2 feat: enable balance based on growing segment row count (#28623) 2023-11-27 14:58:26 +08:00
registry Add querynode client wrapper and avoid grpc in standalone mode (#27781) 2023-10-19 11:10:07 +08:00
rootcoord enhance: Add logs for each step during service initialization (#28624) 2023-11-27 16:30:26 +08:00
storage fix: Skip statslog generation flushing empty L0 segment (#28733) 2023-11-25 15:10:25 +08:00
tso Format the code (#27275) 2023-09-21 09:45:27 +08:00
types Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
util enhance: Support Array DataType for bulk_insert (#28341) 2023-11-27 13:50:27 +08:00