milvus/internal/datanode/importv2
congqixia f741bb7526
enhance: [2.4] Avoid merging insert data when buffering insert msgs (#34205)
Cherry-pick from master
pr: #33526 #33817
See also #33561

This PR:
- Use zero copy when buffering insert messages
- Make `storage.InsertCodec` support serialize multiple insert data
chunk into same batch binlog files

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-06-27 10:14:05 +08:00
..
hash.go enhance: Support L0 import (#33514) (#33712) 2024-06-08 11:17:52 +08:00
pool.go enhance: Abstract Execute interface for import/preimport task (#33234) (#33607) 2024-06-05 11:17:56 +08:00
scheduler_test.go enhance: Support L0 import (#33514) (#33712) 2024-06-08 11:17:52 +08:00
scheduler.go enhance: Abstract Execute interface for import/preimport task (#33234) (#33607) 2024-06-05 11:17:56 +08:00
task_import.go fix: [2.4] Deep copy ImportTask.segmentsInfo to prevent data race (#34090) (#34126) 2024-06-26 11:50:11 +08:00
task_l0_import_test.go enhance: Support L0 import (#33514) (#33712) 2024-06-08 11:17:52 +08:00
task_l0_import.go fix: [2.4] Deep copy ImportTask.segmentsInfo to prevent data race (#34090) (#34126) 2024-06-26 11:50:11 +08:00
task_l0_preimport.go fix: [2.4] Deep copy ImportTask.segmentsInfo to prevent data race (#34090) (#34126) 2024-06-26 11:50:11 +08:00
task_manager_test.go enhance: Support L0 import (#33514) (#33712) 2024-06-08 11:17:52 +08:00
task_manager.go feat: Add import executor and manager for datanode (#29438) 2024-01-31 20:45:04 +08:00
task_preimport.go fix: [2.4] Deep copy ImportTask.segmentsInfo to prevent data race (#34090) (#34126) 2024-06-26 11:50:11 +08:00
task.go enhance: Support L0 import (#33514) (#33712) 2024-06-08 11:17:52 +08:00
util_test.go fix: Check if the import job exists (#33672) (#33673) 2024-06-10 21:50:29 +08:00
util.go enhance: [2.4] Avoid merging insert data when buffering insert msgs (#34205) 2024-06-27 10:14:05 +08:00