milvus/internal/util/importutilv2
yihao.dai 31cf849f68
enhance: Support retriving file size from importutilv2.Reader (#31533)
To reduce the overhead caused by listing the S3 objects, add an
interface to importutil.Reader to retrieve file sizes.

issue: https://github.com/milvus-io/milvus/issues/31532,
https://github.com/milvus-io/milvus/issues/28521

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-03-25 20:29:07 +08:00
..
binlog enhance: Support retriving file size from importutilv2.Reader (#31533) 2024-03-25 20:29:07 +08:00
json enhance: Support retriving file size from importutilv2.Reader (#31533) 2024-03-25 20:29:07 +08:00
numpy enhance: Support retriving file size from importutilv2.Reader (#31533) 2024-03-25 20:29:07 +08:00
parquet enhance: Support retriving file size from importutilv2.Reader (#31533) 2024-03-25 20:29:07 +08:00
mock_reader.go enhance: Support retriving file size from importutilv2.Reader (#31533) 2024-03-25 20:29:07 +08:00
option.go enhance: Return more fields in import progress response (#31539) 2024-03-24 21:57:06 +08:00
reader.go enhance: Support retriving file size from importutilv2.Reader (#31533) 2024-03-25 20:29:07 +08:00
util.go enhance: Support retriving file size from importutilv2.Reader (#31533) 2024-03-25 20:29:07 +08:00