milvus/internal/datanode/syncmgr
congqixia dc6a6a50fa
enhance: reduce SyncTask AllocID call and refine code (#29701)
See also #27675

`Allocator.Alloc` and `Allocator.AllocOne` might be invoked multiple
times if there were multiple blobs set in one sync task.

This PR add pre-fetch logic for all blobs and cache logIDs in sync task
so that at most only one call of the allocator is needed.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-01-05 10:04:46 +08:00
..
key_lock_dispatcher_test.go feat: integrate storage v2 into the write path (#28440) 2023-11-23 17:26:24 +08:00
key_lock_dispatcher.go fix: add back existing datanode metrics (#29360) 2023-12-22 14:20:43 +08:00
meta_writer_test.go enhance: separate serializer logic from sync task (#29413) 2023-12-26 10:40:47 +08:00
meta_writer.go enhance: separate serializer logic from sync task (#29413) 2023-12-26 10:40:47 +08:00
mock_meta_writer.go enhance: separate serializer logic from sync task (#29413) 2023-12-26 10:40:47 +08:00
mock_serializer.go fix: serializer shall bypass L0 segment merge stats step (#29636) 2024-01-04 16:52:45 +08:00
mock_sync_manager.go enhance: Log channel checkpoint source info in writebuffer (#28993) 2023-12-07 11:50:36 +08:00
options.go enhance: separate serializer logic from sync task (#29413) 2023-12-26 10:40:47 +08:00
serializer.go enhance: separate serializer logic from sync task (#29413) 2023-12-26 10:40:47 +08:00
storage_serializer_test.go enhance: separate serializer logic from sync task (#29413) 2023-12-26 10:40:47 +08:00
storage_serializer.go fix: serializer shall bypass L0 segment merge stats step (#29636) 2024-01-04 16:52:45 +08:00
storage_v2_serializer_test.go enhance: separate serializer logic from sync task (#29413) 2023-12-26 10:40:47 +08:00
storage_v2_serializer.go fix: serializer shall bypass L0 segment merge stats step (#29636) 2024-01-04 16:52:45 +08:00
sync_manager_test.go enhance: make SyncManager pool size refreshable (#29224) 2023-12-15 09:58:43 +08:00
sync_manager.go enhance: make SyncManager pool size refreshable (#29224) 2023-12-15 09:58:43 +08:00
task_test.go enhance: reduce SyncTask AllocID call and refine code (#29701) 2024-01-05 10:04:46 +08:00
task.go enhance: reduce SyncTask AllocID call and refine code (#29701) 2024-01-05 10:04:46 +08:00
taskv2_test.go enhance: separate serializer logic from sync task (#29413) 2023-12-26 10:40:47 +08:00
taskv2.go enhance: separate serializer logic from sync task (#29413) 2023-12-26 10:40:47 +08:00