milvus/internal/indexnode
cai.zhang b9357e4716
fix: Modify the batchsize of writer to timely flushing binlogs (#37692)
issue: #37579 

If the schema includes large varchar fields, a few thousand rows can
reach hundreds of MB in size. Therefore, if the batch size of the
segment writer is large, it will produce relatively large `binlogs`,
which can cause datanode to run out of memory (OOM) during compaction.

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-11-15 10:14:31 +08:00
..
chunk_mgr_factory.go enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214) 2024-09-30 13:23:32 +08:00
chunkmgr_mock.go enhance: Avoid merging insert data when buffering insert msgs (#33562) 2024-06-13 11:15:56 +08:00
etcd_mock.go Remove deprecated io/ioutil usage (#27747) 2023-10-17 20:32:09 +08:00
index_test.go feat: Support stats task to sort segment by PK (#35054) 2024-09-02 14:19:03 +08:00
indexnode_component_mock.go Decouple basetable and componentparam (#26725) 2023-09-05 10:31:48 +08:00
indexnode_service_test.go feat: Support stats task to sort segment by PK (#35054) 2024-09-02 14:19:03 +08:00
indexnode_service.go feat: management WebUI homepage (#36822) 2024-10-23 11:29:28 +08:00
indexnode_test.go enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214) 2024-09-30 13:23:32 +08:00
indexnode.go feat: Support stats task to sort segment by PK (#35054) 2024-09-02 14:19:03 +08:00
metrics_info_test.go Move some modules from internal to public package (#22572) 2023-04-06 19:14:32 +08:00
metrics_info.go Refine state check (#27541) 2023-10-11 21:01:35 +08:00
OWNERS [skip ci]Update OWNERS files (#11898) 2021-11-16 15:41:11 +08:00
task_analyze.go enhance: GCS native support (GCS implemented using Google Cloud Storage libraries) (#36214) 2024-09-30 13:23:32 +08:00
task_index.go enhance: add unify vector index config management (#36846) 2024-11-01 06:18:21 +08:00
task_scheduler_test.go enhance: Support analyze data (#33651) 2024-06-06 17:37:51 +08:00
task_scheduler.go enhance: Support analyze data (#33651) 2024-06-06 17:37:51 +08:00
task_state_test.go feat: Support stats task to sort segment by PK (#35054) 2024-09-02 14:19:03 +08:00
task_state.go IndexCoord handle events correctly (#17878) 2022-07-07 14:44:21 +08:00
task_stats_test.go enhance: Optimize the performance of stats task (#37374) 2024-11-08 10:08:27 +08:00
task_stats.go fix: Modify the batchsize of writer to timely flushing binlogs (#37692) 2024-11-15 10:14:31 +08:00
task_test.go feat: Support stats task to sort segment by PK (#35054) 2024-09-02 14:19:03 +08:00
task.go enhance: Support analyze data (#33651) 2024-06-06 17:37:51 +08:00
taskinfo_ops_test.go feat: support bm25 logs mixcompaction (#36072) 2024-10-14 16:57:22 +08:00
taskinfo_ops.go feat: support bm25 logs mixcompaction (#36072) 2024-10-14 16:57:22 +08:00
util_test.go enhance: Support analyze data (#33651) 2024-06-06 17:37:51 +08:00
util.go enhance: Use proto for passing info in cgo (#33184) 2024-05-23 10:31:40 +08:00