milvus/pkg
yihao.dai 0fc2a4aa53
enhance: Optimize import scheduling and add time cost metric (#36601)
1. Optimize import scheduling strategic:
a. Revise slot weights, calculating them based on the number of files
and segments for both import and pre-import tasks.
b. Ensure that the DN executes tasks in ascending order of task ID.
2. Add time cost metric and log.

issue: https://github.com/milvus-io/milvus/issues/36600,
https://github.com/milvus-io/milvus/issues/36518

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-10-09 14:41:20 +08:00
..
common enhance: add search params in search request in restful (#36304) 2024-09-23 16:51:12 +08:00
config enhance: Enable dynamic update loaded collection's replica (#35822) 2024-09-25 10:13:18 +08:00
eventlog enhance: Update protobuf-go to protobuf-go v2 (#34394) 2024-07-29 11:31:51 +08:00
kv enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
log enhance: improve log encoding performance on proxy nodes (#36123) 2024-09-11 14:51:07 +08:00
metrics enhance: Optimize import scheduling and add time cost metric (#36601) 2024-10-09 14:41:20 +08:00
mocks enhance: using streaming service in insert/upsert/flush/delete/querynode (#35406) 2024-08-29 10:03:08 +08:00
mq enhance: fix skip msg log with empty position info (#36626) 2024-10-09 12:01:20 +08:00
streaming enhance: add streaming client metrics (#36523) 2024-10-08 21:25:19 +08:00
tracer fix: Fix tracing config update logic (#35928) 2024-09-05 14:27:04 +08:00
util enhance: Optimize import scheduling and add time cost metric (#36601) 2024-10-09 14:41:20 +08:00
.mockery_pkg.yaml enhance: support single pchannel level transaction (#35289) 2024-08-19 21:22:56 +08:00
go.mod enhance: upgrade pulsar-client-go to 0.12.1 (#36615) 2024-09-30 17:13:16 +08:00
go.sum enhance: upgrade pulsar-client-go to 0.12.1 (#36615) 2024-09-30 17:13:16 +08:00
Makefile enhance: Update Makefile to generate mockery (#35517) 2024-08-16 18:44:53 +08:00
rules.go Add back gocritic linter and fix related issues (#27289) 2023-09-22 10:05:26 +08:00