milvus/internal/flushcommon/io
yihao.dai 81879425e1
enhance: Optimize the performance of stats task (#37374)
1. Increase the writer's `batchSize` to avoid multiple serialization
operations.
2. Perform asynchronous upload of binlog files to prevent blocking the
data processing flow.
3. Reduce multiple calls to `writer.Flush()`.

issue: https://github.com/milvus-io/milvus/issues/37373

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-11-08 10:08:27 +08:00
..
binlog_io_test.go enhance: Implement flusher in streamingNode (#34942) 2024-08-02 18:30:23 +08:00
binlog_io.go enhance: Optimize the performance of stats task (#37374) 2024-11-08 10:08:27 +08:00
io_pool_test.go enhance: Implement flusher in streamingNode (#34942) 2024-08-02 18:30:23 +08:00
io_pool.go enhance: Implement flusher in streamingNode (#34942) 2024-08-02 18:30:23 +08:00
mock_binlogio.go enhance: Optimize the performance of stats task (#37374) 2024-11-08 10:08:27 +08:00