test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 21:09:06 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
4ebdccd160
milvus/internal/querynodev2/segments
History
wei liu c344083f22
enhance: Optimize grow slice cost during query (#34254) 
issue: #32252
pr: #34253

This PR try to pre-allocate FieldData for Reduce operations in the Query
chain using typeutil.PrepareResultFieldData to avoid the overhead of
dynamically growing the slice during appendFieldData process.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-07-01 15:18:11 +08:00
..
metricsutil enhance: add more metrics for cache and search (#31777) 2024-04-10 10:55:17 +08:00
state fix: async warmup will be blocked by state lock (#33687) 2024-06-07 14:23:54 +08:00
bloom_filter_set_test.go enhance: add param for bloomfilter(#29388) (#29490) 2023-12-28 18:10:46 +08:00
bloom_filter_set.go enhance: add param for bloomfilter(#29388) (#29490) 2023-12-28 18:10:46 +08:00
cgo_util.go feat: LRU cache implementation (#32567) 2024-05-06 20:29:30 +08:00
collection.go fix: Unify querynode metrics cleanup in collection release (#32805) 2024-05-07 15:41:29 +08:00
count_reducer_test.go enhance: retrieve output fields after local reduce (#32346) 2024-04-25 09:49:26 +08:00
count_reducer.go enhance: retrieve output fields after local reduce (#32346) 2024-04-25 09:49:26 +08:00
default_limit_reducer.go fix: two-phase retrieval on lru-segment (#32945) (#33313) 2024-05-23 16:25:40 +08:00
index_attr_cache_test.go fix: predict inverted index resource usage more reasonably (#31615) 2024-03-27 19:33:09 +08:00
index_attr_cache.go enhance: Add memory size for binlog (#33025) 2024-05-15 12:59:34 +08:00
load_field_data_info.go fix: Use correct pools for all CGO methods in segments pkg (#30274) 2024-01-26 10:09:00 +08:00
load_index_info.go feat: support inverted index for array (#33452) (#34053) 2024-06-24 10:50:03 +08:00
manager_test.go enhance: [cherry-pick]growing segment support mmap (#34110) 2024-06-25 14:52:07 +08:00
manager.go fix: fix partition loaded num metric (#33316) (#34195) 2024-06-28 14:58:05 +08:00
mock_collection_manager.go fix: Remove QueryNodeEntitiesSize after segment/collection released (#31290) 2024-03-15 15:43:04 +08:00
mock_data.go enhance: unify data generation test APIs (#32955) 2024-05-14 14:33:33 +08:00
mock_loader.go feat: LRU cache implementation (#32567) 2024-05-06 20:29:30 +08:00
mock_segment_manager.go fix: load operation when segment is on releasing (#33699) 2024-06-14 11:47:57 +08:00
mock_segment.go enhance: Use BatchPkExist to reduce bloom filter func call cost (#33752) 2024-06-12 17:45:58 +08:00
OWNERS
plan_test.go enhance: transfer resource group and dbname to querynode when load (#30936) 2024-03-21 11:59:12 +08:00
plan.go enhance: retrieve output fields after local reduce (#32346) 2024-04-25 09:49:26 +08:00
pool_test.go enhance: Execute bloom filter apply in parallel to speed up segment predict (#33793) 2024-06-13 14:14:04 +08:00
pool.go enhance: decrease cpu overhead during filter segments on datacoord (#34231) 2024-07-01 10:20:08 +08:00
reduce_test.go enhance: mmap load raw data if scalar index does not have raw data (#… (#33317) 2024-05-24 09:09:42 +08:00
reduce.go enhance: add more trace for search & query (#32734) 2024-05-07 13:03:29 +08:00
reducer_test.go fix: two-phase retrieval on lru-segment (#32945) (#33313) 2024-05-23 16:25:40 +08:00
reducer.go fix: [2.4] Return record with largest timestamp for entires with same PK (#33936) (#34024) 2024-06-21 14:14:01 +08:00
result_sorter.go
result_test.go fix: [2.4] Return record with largest timestamp for entires with same PK (#33936) (#34024) 2024-06-21 14:14:01 +08:00
result.go enhance: Optimize grow slice cost during query (#34254) 2024-07-01 15:18:11 +08:00
retrieve_test.go enhance: mmap load raw data if scalar index does not have raw data (#… (#33317) 2024-05-24 09:09:42 +08:00
retrieve.go fix: two-phase retrieval on lru-segment (#32945) (#33313) 2024-05-23 16:25:40 +08:00
search_test.go enhance: mmap load raw data if scalar index does not have raw data (#… (#33317) 2024-05-24 09:09:42 +08:00
search.go fix: add request resource timeout for lazy load, refactor context usage in cache (#32709) 2024-05-07 16:33:30 +08:00
segment_do.go fix: two-phase retrieval on lru-segment (#32945) (#33313) 2024-05-23 16:25:40 +08:00
segment_interface.go enhance: Use BatchPkExist to reduce bloom filter func call cost (#33752) 2024-06-12 17:45:58 +08:00
segment_l0.go enhance: Add metautil.Channel to convert string compare to int (#32749) 2024-05-07 19:13:35 +08:00
segment_loader_test.go fix: load operation when segment is on releasing (#33699) 2024-06-14 11:47:57 +08:00
segment_loader.go fix: load operation when segment is on releasing (#33699) 2024-06-14 11:47:57 +08:00
segment_test.go enhance: [cherry-pick]growing segment support mmap (#34110) 2024-06-25 14:52:07 +08:00
segment.go enhance: decrease cpu overhead during filter segments on datacoord (#34231) 2024-07-01 10:20:08 +08:00
statistics.go Protect segment from being released while query/search (#26322) 2023-08-16 18:38:17 +08:00
trace.go fix: Add Wrapper and Keepalive for CTraceContext ids (#32746) 2024-05-07 10:05:35 +08:00
utils_test.go enhance: use different value to get related data size according to segment type (#33017) 2024-05-14 14:59:33 +08:00
utils.go enhance: use different value to get related data size according to segment type (#33017) 2024-05-14 14:59:33 +08:00
validate.go Format the code (#27275) 2023-09-21 09:45:27 +08:00