milvus/internal
yihao.dai c5918290e6
feat: Add import executor and manager for datanode (#29438)
This PR introduces novel importv2 roles for datanode:
1. Executor: To execute tasks, a import task will be divided into the
following steps: read data -> hash data -> sync data;
2. Manager: To manage all the tasks;

issue: https://github.com/milvus-io/milvus/issues/28521

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-01-31 20:45:04 +08:00
..
allocator enhance:change some logs (#29579) 2024-01-05 16:12:48 +08:00
core enhance: restful support import jobs (#30343) 2024-01-31 17:57:04 +08:00
datacoord enhance: Make compaction log has traceID (#30338) 2024-01-30 10:09:03 +08:00
datanode feat: Add import executor and manager for datanode (#29438) 2024-01-31 20:45:04 +08:00
distributed enhance: restful support import jobs (#30343) 2024-01-31 17:57:04 +08:00
http enhance: Support to get the param value in the runtime (#29297) 2023-12-22 18:36:44 +08:00
indexnode enhance: Limit index pool size of standalone server (#30170) 2024-01-30 16:47:03 +08:00
kv feat: support etcd authentication (#30226) 2024-01-24 11:35:00 +08:00
metastore fix: collection properties not saved for alter collection (#30145) 2024-01-19 23:06:54 +08:00
mocks feat: Implement DescribeAlias and ListAliases interfaces (#29641) 2024-01-11 19:12:51 +08:00
mq enhance:change some logs (#29579) 2024-01-05 16:12:48 +08:00
parser/planparserv2 Add float16 approve for multi-type part (#28427) 2024-01-11 15:48:51 +08:00
proto feat: Add import executor and manager for datanode (#29438) 2024-01-31 20:45:04 +08:00
proxy enhance: Break down the granularity of collection info cache expired (#29977) 2024-01-30 16:45:02 +08:00
querycoordv2 enhance: Add growing row count weight (#30271) 2024-01-29 14:05:02 +08:00
querynodev2 enhance: limit the max pool size to 16 (#30371) 2024-01-31 14:13:06 +08:00
registry Add querynode client wrapper and avoid grpc in standalone mode (#27781) 2023-10-19 11:10:07 +08:00
rootcoord enhance: Break down the granularity of collection info cache expired (#29977) 2024-01-30 16:45:02 +08:00
storage feat: Add import executor and manager for datanode (#29438) 2024-01-31 20:45:04 +08:00
tso
types Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
util feat: Add import executor and manager for datanode (#29438) 2024-01-31 20:45:04 +08:00