milvus/internal/util/importutilv2
cai.zhang 2c9bb4dfa3
feat: Support stats task to sort segment by PK (#35054)
issue: #33744 

This PR includes the following changes:
1. Added a new task type to the task scheduler in datacoord: stats task,
which sorts segments by primary key.
2. Implemented segment sorting in indexnode.
3. Added a new field `FieldStatsLog` to SegmentInfo to store token index
information.

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-09-02 14:19:03 +08:00
..
binlog feat: integrate new deltalog format (#35522) 2024-08-20 19:06:56 +08:00
common fix: Added check for validating varchar,array max length (#35499) 2024-08-20 11:42:55 +08:00
csv enhance: add nan and inf check (#35683) 2024-08-25 15:22:57 +08:00
json enhance: add nan and inf check (#35683) 2024-08-25 15:22:57 +08:00
numpy enhance: import supports null in parquet and json formats (#35558) 2024-08-20 16:50:55 +08:00
parquet enhance: import supports null in parquet and json formats (#35558) 2024-08-20 16:50:55 +08:00
mock_reader.go enhance: Support retriving file size from importutilv2.Reader (#31533) 2024-03-25 20:29:07 +08:00
option.go enhance: add csv support for bulkinsert (#34938) 2024-08-21 17:47:01 +08:00
reader.go enhance: add csv support for bulkinsert (#34938) 2024-08-21 17:47:01 +08:00
util.go feat: Support stats task to sort segment by PK (#35054) 2024-09-02 14:19:03 +08:00