milvus/internal/datanode/writebuffer
congqixia f741bb7526
enhance: [2.4] Avoid merging insert data when buffering insert msgs (#34205)
Cherry-pick from master
pr: #33526 #33817
See also #33561

This PR:
- Use zero copy when buffering insert messages
- Make `storage.InsertCodec` support serialize multiple insert data
chunk into same batch binlog files

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-27 10:14:05 +08:00
..
bf_write_buffer_test.go enhance: [cherry-pick] Decouple compaction from shard (#34157) 2024-06-25 20:22:03 +08:00
bf_write_buffer.go enhance: [cherry-pick] Decouple compaction from shard (#34157) 2024-06-25 20:22:03 +08:00
delta_buffer_test.go fix: Correct Size calculation of DeleteData (#30397) 2024-02-02 10:47:04 +08:00
delta_buffer.go fix: Correct Size calculation of DeleteData (#30397) 2024-02-02 10:47:04 +08:00
insert_buffer_test.go enhance: [2.4] Avoid merging insert data when buffering insert msgs (#34205) 2024-06-27 10:14:05 +08:00
insert_buffer.go enhance: [2.4] Avoid merging insert data when buffering insert msgs (#34205) 2024-06-27 10:14:05 +08:00
l0_write_buffer_test.go enhance: [cherry-pick] Decouple compaction from shard (#34157) 2024-06-25 20:22:03 +08:00
l0_write_buffer.go enhance: [cherry-pick] Decouple compaction from shard (#34157) 2024-06-25 20:22:03 +08:00
manager_test.go fix: [2.4]Sync dropped segment for dropped partition (#33332) 2024-05-27 17:57:43 +08:00
manager.go fix: [2.4]Sync dropped segment for dropped partition (#33332) 2024-05-27 17:57:43 +08:00
mock_mananger.go fix: [2.4]Sync dropped segment for dropped partition (#33332) 2024-05-27 17:57:43 +08:00
mock_write_buffer.go fix: [2.4]Sync dropped segment for dropped partition (#33332) 2024-05-27 17:57:43 +08:00
options.go enhance: [cherry-pick] Decouple compaction from shard (#34157) 2024-06-25 20:22:03 +08:00
segment_buffer.go enhance: [2.4] Avoid merging insert data when buffering insert msgs (#34205) 2024-06-27 10:14:05 +08:00
sync_policy_test.go enhance: [cherry-pick] Decouple compaction from shard (#34157) 2024-06-25 20:22:03 +08:00
sync_policy.go enhance: [cherry-pick] Decouple compaction from shard (#34157) 2024-06-25 20:22:03 +08:00
write_buffer_test.go fix: [2.4]Sync dropped segment for dropped partition (#33332) 2024-05-27 17:57:43 +08:00
write_buffer.go enhance: [2.4] Avoid merging insert data when buffering insert msgs (#34205) 2024-06-27 10:14:05 +08:00