milvus/internal/flushcommon/writebuffer
yihao.dai 6130a85444
enhance: Remove bf from streaming node (#35902)
Remove bf from streaming node:
1. When watching vchannels, skip loading bloom filters for segments.
2. Bypass bloom filter checks for delete messages, directly writing to
L0 segments.
3. Remove flushed segments proactively after flush.

issue: https://github.com/milvus-io/milvus/issues/33285,
https://github.com/milvus-io/milvus/issues/34585

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-09-03 14:17:02 +08:00
..
bf_write_buffer_test.go enhance: Add back BF lazy load logic for datanode watch channel (#35646) 2024-08-22 19:42:57 +08:00
bf_write_buffer.go enhance: remove unused code for StorageV2 (#35132) 2024-08-01 12:08:13 +08:00
delta_buffer_test.go enhance: Organize the common modules of streamingNode and dataNode (#34773) 2024-07-22 11:33:51 +08:00
delta_buffer.go enhance: Organize the common modules of streamingNode and dataNode (#34773) 2024-07-22 11:33:51 +08:00
insert_buffer_test.go enhance: import supports null in parquet and json formats (#35558) 2024-08-20 16:50:55 +08:00
insert_buffer.go enhance: Organize the common modules of streamingNode and dataNode (#34773) 2024-07-22 11:33:51 +08:00
l0_write_buffer_test.go enhance: Add back BF lazy load logic for datanode watch channel (#35646) 2024-08-22 19:42:57 +08:00
l0_write_buffer.go enhance: Remove bf from streaming node (#35902) 2024-09-03 14:17:02 +08:00
manager_test.go enhance: remove unused code for StorageV2 (#35132) 2024-08-01 12:08:13 +08:00
manager.go enhance: remove unused code for StorageV2 (#35132) 2024-08-01 12:08:13 +08:00
mock_manager.go enhance: remove unused code for StorageV2 (#35132) 2024-08-01 12:08:13 +08:00
mock_write_buffer.go enhance: Organize the common modules of streamingNode and dataNode (#34773) 2024-07-22 11:33:51 +08:00
options.go enhance: Organize the common modules of streamingNode and dataNode (#34773) 2024-07-22 11:33:51 +08:00
segment_buffer.go enhance: Organize the common modules of streamingNode and dataNode (#34773) 2024-07-22 11:33:51 +08:00
sync_policy_test.go enhance: Organize the common modules of streamingNode and dataNode (#34773) 2024-07-22 11:33:51 +08:00
sync_policy.go enhance: Organize the common modules of streamingNode and dataNode (#34773) 2024-07-22 11:33:51 +08:00
write_buffer_test.go enhance: Add back BF lazy load logic for datanode watch channel (#35646) 2024-08-22 19:42:57 +08:00
write_buffer.go enhance: Remove bf from streaming node (#35902) 2024-09-03 14:17:02 +08:00