milvus/internal/util
yihao.dai c5918290e6
feat: Add import executor and manager for datanode (#29438)
This PR introduces novel importv2 roles for datanode:
1. Executor: To execute tasks, a import task will be divided into the
following steps: read data -> hash data -> sync data;
2. Manager: To manage all the tasks;

issue: https://github.com/milvus-io/milvus/issues/28521

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-01-31 20:45:04 +08:00
..
cgoconverter enhance: move the cgo code in the pkg dir to interal dir (#30261) 2024-01-25 15:15:01 +08:00
componentutil enhance:add some log when create client and get component states (#28160) 2023-11-22 09:12:22 +08:00
dependency enhance: add basic information of milvus into metrics (#29665) 2024-01-29 15:47:02 +08:00
flowgraph fix: Use determined order to lock in BlockAll to avoid deadlock (#29246) 2024-01-22 14:50:56 +08:00
funcutil Format the code (#27275) 2023-09-21 09:45:27 +08:00
grpcclient fix: grpc client check session skipped due to role not match (#29356) 2023-12-21 10:12:51 +08:00
importutil enhance: reduce memory when read data (#30284) 2024-01-26 20:49:00 +08:00
importutilv2 feat: Add import executor and manager for datanode (#29438) 2024-01-31 20:45:04 +08:00
indexcgowrapper enhance: pass partition key scalar info if enabled when build vector index (#29931) 2024-01-24 00:04:55 +08:00
initcore enhance: free CString in InitTraceConfig (#30055) 2024-01-17 15:15:03 +08:00
metrics fix: symbol 'GetStorageMetrics' and 'enableDynamicField' (#28580) 2023-11-21 10:20:22 +08:00
mock feat: Implement DescribeAlias and ListAliases interfaces (#29641) 2024-01-11 19:12:51 +08:00
pipeline Format the code (#27275) 2023-09-21 09:45:27 +08:00
proxyutil enhance: Break down the granularity of collection info cache expired (#29977) 2024-01-30 16:45:02 +08:00
segmentutil Format the code (#27275) 2023-09-21 09:45:27 +08:00
sessionutil enhance:change some logs (#29579) 2024-01-05 16:12:48 +08:00
streamrpc Add querynode client wrapper and avoid grpc in standalone mode (#27781) 2023-10-19 11:10:07 +08:00
tsoutil tikv integration (#26246) 2023-09-07 07:25:14 +08:00
typeutil feat: integrate storagev2 into loading segment (#29336) 2024-01-12 18:10:51 +08:00
wrappers Add querynode client wrapper and avoid grpc in standalone mode (#27781) 2023-10-19 11:10:07 +08:00