milvus/internal/datanode/compaction
wayblink c62bf8a0b0
fix: [Cherry-pick]Pick major compaction fixs and optimizations (#34360)
This PR cherry-picks the following commits:

- fix: sync partitiion stats blocking balance task #33742
- fix: Fix meta prefix overlap bug #33830
- fix: Small fixs of major compaction #33929 
- fix: Fix memory buffer error & some renaming #33850
- fix: sync part stats task cannot be finished #34027 
- Add an option to enable/disable vector field clustering key #34097
- fix: fix error ignore in compactor #34169
- fix:load major compaction partial result #34052
- Use new stream segment reader in clustering compaction #34232

issue: #30633
pr: #33742 #33830 #33929 #33850 #34027 #34097 #34169 #34052 #34232

---------

Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
Signed-off-by: wayblink <anyang.wang@zilliz.com>
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: Chun Han <116052805+MrPresent-Han@users.noreply.github.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2024-07-03 09:53:37 +08:00
..
clustering_compactor_test.go feat: [cherry-pick] Major compaction (#34326) 2024-07-02 18:29:01 +08:00
clustering_compactor.go fix: [Cherry-pick]Pick major compaction fixs and optimizations (#34360) 2024-07-03 09:53:37 +08:00
compactor_common.go feat: [cherry-pick] Major compaction (#34326) 2024-07-02 18:29:01 +08:00
compactor.go enhance: [cherry-pick] Decouple compaction from shard (#34157) 2024-06-25 20:22:03 +08:00
executor_test.go feat: [cherry-pick] Major compaction (#34326) 2024-07-02 18:29:01 +08:00
executor.go feat: [cherry-pick] Major compaction (#34326) 2024-07-02 18:29:01 +08:00
l0_compactor_test.go enhance: [cherry-pick] Decouple compaction from shard (#34157) 2024-06-25 20:22:03 +08:00
l0_compactor.go feat: [cherry-pick] Major compaction (#34326) 2024-07-02 18:29:01 +08:00
mix_compactor_test.go feat: [cherry-pick] Major compaction (#34326) 2024-07-02 18:29:01 +08:00
mix_compactor.go fix: [Cherry-pick]Pick major compaction fixs and optimizations (#34360) 2024-07-03 09:53:37 +08:00
mock_compactor.go enhance: [cherry-pick] Periodically synchronize segments to datanode watcher (#33420) (#34186) 2024-06-27 11:24:05 +08:00
segment_writer.go fix: [Cherry-pick]Pick major compaction fixs and optimizations (#34360) 2024-07-03 09:53:37 +08:00