milvus/internal/flushcommon/syncmgr
yihao.dai 6130a85444
enhance: Remove bf from streaming node (#35902)
Remove bf from streaming node:
1. When watching vchannels, skip loading bloom filters for segments.
2. Bypass bloom filter checks for delete messages, directly writing to
L0 segments.
3. Remove flushed segments proactively after flush.

issue: https://github.com/milvus-io/milvus/issues/33285,
https://github.com/milvus-io/milvus/issues/34585

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-09-03 14:17:02 +08:00
..
key_lock_dispatcher_test.go
key_lock_dispatcher.go enhance: Remove bf from streaming node (#35902) 2024-09-03 14:17:02 +08:00
meta_writer_test.go enhance: Add back BF lazy load logic for datanode watch channel (#35646) 2024-08-22 19:42:57 +08:00
meta_writer.go enhance: Implement flusher in streamingNode (#34942) 2024-08-02 18:30:23 +08:00
mock_meta_writer.go enhance: remove unused code for StorageV2 (#35132) 2024-08-01 12:08:13 +08:00
mock_serializer.go
mock_sync_manager.go
mock_task.go enhance: Remove bf from streaming node (#35902) 2024-09-03 14:17:02 +08:00
options.go
serializer.go
storage_serializer_test.go enhance: Add back BF lazy load logic for datanode watch channel (#35646) 2024-08-22 19:42:57 +08:00
storage_serializer.go feat: integrate new deltalog format (#35522) 2024-08-20 19:06:56 +08:00
sync_manager_test.go enhance: Add back BF lazy load logic for datanode watch channel (#35646) 2024-08-22 19:42:57 +08:00
sync_manager.go enhance: Implement flusher in streamingNode (#34942) 2024-08-02 18:30:23 +08:00
task_test.go enhance: Add back BF lazy load logic for datanode watch channel (#35646) 2024-08-22 19:42:57 +08:00
task.go enhance: Remove bf from streaming node (#35902) 2024-09-03 14:17:02 +08:00