milvus/internal/proto
yihao.dai c411cb4a49
enhance: Prevent the backlog of channelCP update tasks, perform batch updates of channelCPs (#30941)
This PR includes the following adjustments:
1. To prevent channelCP update task backlog, only one task with the same
vchannel is retained in the updater. Additionally, the lastUpdateTime is
refreshed after the flowgraph submits the update task, rather than in
the callBack function.
2. Batch updates of multiple vchannel checkpoints are performed in the
UpdateChannelCheckpoint RPC (default batch size is 128). Additionally,
the lock for channelCPs in DataCoord meta has been switched from key
lock to global lock.
3. The concurrency of UpdateChannelCheckpoint RPCs in the datanode has
been reduced from 1000 to 10.

issue: https://github.com/milvus-io/milvus/issues/30004

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: congqixia <congqi.xia@zilliz.com>
2024-03-07 20:39:02 +08:00
..
internalpb fix: Restore the MVCC functionality. (#29749) 2024-01-09 11:38:48 +08:00
data_coord.proto enhance: Prevent the backlog of channelCP update tasks, perform batch updates of channelCPs (#30941) 2024-03-07 20:39:02 +08:00
etcd_meta.proto [Cherry-Pick] Support Database (#24769) 2023-06-25 17:20:43 +08:00
index_cgo_msg.proto Unify interface of vector index & scalar index. (#15959) 2022-03-21 14:23:24 +08:00
index_coord.proto enhance: Add ListIndexes API from datacoord (#31104) 2024-03-07 17:37:01 +08:00
internal.proto feat: Add import scheduler and manager (#29367) 2024-03-01 18:31:02 +08:00
OWNERS
plan.proto Add float16 approve for multi-type part (#28427) 2024-01-11 15:48:51 +08:00
proxy.proto feat: Add import scheduler and manager (#29367) 2024-03-01 18:31:02 +08:00
query_coord.proto fix: check collection lazy load prop using schema (#30992) 2024-03-06 16:19:01 +08:00
root_coord.proto feat: Implement DescribeAlias and ListAliases interfaces (#29641) 2024-01-11 19:12:51 +08:00
segcore.proto add growing segment index (#23615) 2023-04-26 10:14:41 +08:00