milvus/internal/util
cai.zhang 2c9bb4dfa3
feat: Support stats task to sort segment by PK (#35054)
issue: #33744 

This PR includes the following changes:
1. Added a new task type to the task scheduler in datacoord: stats task,
which sorts segments by primary key.
2. Implemented segment sorting in indexnode.
3. Added a new field `FieldStatsLog` to SegmentInfo to store token index
information.

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-09-02 14:19:03 +08:00
..
analyzecgowrapper enhance: optimize milvus core building (#35610) 2024-08-23 12:35:02 +08:00
bloomfilter enhance: remove unused code for StorageV2 (#35132) 2024-08-01 12:08:13 +08:00
cgo enhance: optimize milvus core building (#35610) 2024-08-23 12:35:02 +08:00
cgoconverter enhance: move the cgo code in the pkg dir to interal dir (#30261) 2024-01-25 15:15:01 +08:00
clustering Add an option to enable/disable vector field clustering key (#34097) 2024-06-25 18:52:04 +08:00
componentutil enhance: add streaming coord and node grpc service register (#34655) 2024-07-25 12:19:44 +08:00
ctokenizer feat: tantivy tokenizer binding (#35801) 2024-09-01 17:13:03 +08:00
dependency enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
exprutil enhance: improve error msg when expr invalid during isolation (#35127) 2024-07-31 17:23:51 +08:00
flowgraph enhance: Enable linux code checker (#35084) 2024-07-30 15:53:51 +08:00
funcutil Format the code (#27275) 2023-09-21 09:45:27 +08:00
grpcclient enhance: Force to reset coord connection for unavailable error (#33908) 2024-06-18 14:53:59 +08:00
hookutil fix: Unify hook singleton implementation in proxy (#34887) 2024-07-26 18:07:53 +08:00
importutilv2 feat: Support stats task to sort segment by PK (#35054) 2024-09-02 14:19:03 +08:00
indexcgowrapper enhance: optimize milvus core building (#35610) 2024-08-23 12:35:02 +08:00
initcore enhance: optimize milvus core building (#35610) 2024-08-23 12:35:02 +08:00
metrics enhance: optimize milvus core building (#35610) 2024-08-23 12:35:02 +08:00
mock feat: Support stats task to sort segment by PK (#35054) 2024-09-02 14:19:03 +08:00
pipeline enhance: using streaming service in insert/upsert/flush/delete/querynode (#35406) 2024-08-29 10:03:08 +08:00
proxyutil enhance: update shard leader cache when leader location changed (#32470) 2024-05-08 10:05:29 +08:00
quota enhance: add metric to record maxInsertRate and queryNodeMemoryHighWaterLevel (#35185) 2024-08-02 10:14:13 +08:00
ratelimitutil enhance: set database properties to restrict read access (#35745) 2024-08-29 13:17:01 +08:00
segmentutil Format the code (#27275) 2023-09-21 09:45:27 +08:00
sessionutil fix: streaming service related fix patch (#34696) 2024-07-16 15:49:38 +08:00
streamingutil enhance: using streaming service in insert/upsert/flush/delete/querynode (#35406) 2024-08-29 10:03:08 +08:00
streamrpc enhance: Update protobuf-go to protobuf-go v2 (#34394) 2024-07-29 11:31:51 +08:00
testutil enhance: add csv support for bulkinsert (#34938) 2024-08-21 17:47:01 +08:00
tokenizerapi feat: tantivy tokenizer binding (#35801) 2024-09-01 17:13:03 +08:00
tsoutil enhance: move rocksmq from internal to pkg module (#33881) 2024-06-25 21:18:15 +08:00
typeutil enhance: Update protobuf-go to protobuf-go v2 (#34394) 2024-07-29 11:31:51 +08:00
wrappers enhance:Refactor hybrid search (#32020) 2024-04-09 14:21:18 +08:00