milvus/internal
congqixia 8e5865f630
enhance: Save collection targets by batches (#31616)
See also #28491 #31240

When colleciton number is large, querycoord saves collection target one
by one, which is slow and may block querycoord exits.

In local run, 500 collections scenario may lead to about 40 seconds
saving collection targets.

This PR changes the `SaveCollectionTarget` interface into batch one and
organizes the collection in 16 per bundle batches to accelerate this
procedure.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-03-27 00:09:08 +08:00
..
allocator
core fix: remove deprecated ut test (#31499) 2024-03-26 14:01:07 +08:00
datacoord enhance: Return more fields in import progress response (#31539) 2024-03-24 21:57:06 +08:00
datanode enhance: Support retriving file size from importutilv2.Reader (#31533) 2024-03-25 20:29:07 +08:00
distributed enhance: Return more fields in import progress response (#31539) 2024-03-24 21:57:06 +08:00
http
indexnode enhance: Support MinIO TLS connection (#31311) 2024-03-21 11:15:20 +08:00
kv chore: remove repetitive words (#31153) 2024-03-20 10:17:07 +08:00
metastore enhance: Save collection targets by batches (#31616) 2024-03-27 00:09:08 +08:00
mocks enhance: Remove import v1 (#31403) 2024-03-22 15:29:09 +08:00
mq fix: close rocksmq and natsmq when shutdown (#30706) 2024-02-26 11:38:55 +08:00
parser/planparserv2 feat: support segment pruner (#31003) 2024-03-22 13:57:06 +08:00
proto enhance: Return more fields in import progress response (#31539) 2024-03-24 21:57:06 +08:00
proxy fix: proxy ctx cancel before revoking session (#31596) 2024-03-26 14:25:07 +08:00
querycoordv2 enhance: Save collection targets by batches (#31616) 2024-03-27 00:09:08 +08:00
querynodev2 doc: remove repetitive words (#31105) 2024-03-25 17:27:09 +08:00
registry
rootcoord enhance: Remove import v1 (#31403) 2024-03-22 15:29:09 +08:00
storage enhance: Support retriving file size from importutilv2.Reader (#31533) 2024-03-25 20:29:07 +08:00
tso enhance: Remove import v1 (#31403) 2024-03-22 15:29:09 +08:00
types feat: Revise the RESTful bulk insert API (#29698) 2024-03-05 15:03:00 +08:00
util enhance: Support retriving file size from importutilv2.Reader (#31533) 2024-03-25 20:29:07 +08:00