milvus/internal/proxy
wei liu c344083f22
enhance: Optimize grow slice cost during query (#34254)
issue: #32252
pr: #34253

This PR try to pre-allocate FieldData for Reduce operations in the Query
chain using typeutil.PrepareResultFieldData to avoid the overhead of
dynamically growing the slice during appendFieldData process.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-07-01 15:18:11 +08:00
..
accesslog enhance: support access log dynamic config and prepare for support resutful interface access log (#29638) 2024-04-12 10:37:27 +08:00
connection enhance: purge client infos periodically (#31037) 2024-03-06 12:50:59 +08:00
authentication_interceptor_test.go feat: add more operation detail info for better allocation (#30438) 2024-03-28 06:33:11 +08:00
authentication_interceptor.go enhance: make the auth error message more suitable (#32253) 2024-04-16 16:47:19 +08:00
cgo_util_test.go enhance: [cherry-pick]remove CheckVecIndexWithDataTypeExist function in pkg (#34104) 2024-06-26 21:14:26 +08:00
cgo_util.go enhance: [cherry-pick]remove CheckVecIndexWithDataTypeExist function in pkg (#34104) 2024-06-26 21:14:26 +08:00
channels_mgr_test.go enhance: make sure stream closed (#29456) 2023-12-26 19:56:47 +08:00
channels_mgr.go feat: add more operation detail info for better allocation (#30438) 2024-03-28 06:33:11 +08:00
channels_time_ticker_test.go
channels_time_ticker.go
condition_test.go
condition.go Propagate task ctx done err for proxy (#27892) 2023-10-26 19:06:13 +08:00
count_reducer_test.go
count_reducer.go feat: add more operation detail info for better allocation (#30438) 2024-03-28 06:33:11 +08:00
data_coord_mock_test.go enhance: Remove import v1 (#31403) 2024-03-22 15:29:09 +08:00
database_interceptor_test.go fix: add more requests to the database interceptor (#30452) 2024-02-02 16:49:06 +08:00
database_interceptor.go fix: add more requests to the database interceptor (#30452) 2024-02-02 16:49:06 +08:00
default_limit_reducer.go Improve the error message for getting all indexes of collection (#27389) 2023-10-08 21:23:32 +08:00
dummyreq_test.go
dummyreq.go
hook_interceptor_test.go feat: add more operation detail info for better allocation (#30438) 2024-03-28 06:33:11 +08:00
hook_interceptor.go enhance: Add db label for some usual metrics (#30956) 2024-04-02 14:27:13 +08:00
impl_test.go enhance: move rocksmq from internal to pkg (#34165) 2024-06-26 13:36:05 +08:00
impl.go enhance: Support L0 import (#33514) (#33712) 2024-06-08 11:17:52 +08:00
interface_def.go Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
lb_balancer.go
lb_policy_test.go fix: Restore the MVCC functionality. (#29749) 2024-01-09 11:38:48 +08:00
lb_policy.go fix: fix GetShardLeaders return empty node list (#32685) 2024-04-29 14:19:26 +08:00
look_aside_balancer_test.go fix: Unstable ut TestGetClientFailed (#31296) 2024-03-15 17:41:04 +08:00
look_aside_balancer.go fix: Set node unreachable when get shard client failed (#31277) 2024-03-15 10:23:03 +08:00
management_test.go enhance: add restful api to trigger component stop (#32076) (#33799) 2024-06-17 21:53:59 +08:00
management.go enhance: add restful api to trigger component stop (#32076) (#33799) 2024-06-17 21:53:59 +08:00
meta_cache_adapter_test.go enhance: Avoid initializing casbin enforcer for each request (#29117) 2023-12-12 10:36:43 +08:00
meta_cache_adapter.go enhance: [2.4] the panic when db isn't existed in the rate limit interceptor (#33308) 2024-05-23 17:25:41 +08:00
meta_cache_test.go enhance: update shard leader cache when leader location changed (#32470) 2024-05-08 10:05:29 +08:00
meta_cache.go fix: Proxy crash due to shard leader cache data race (#32971) 2024-05-11 14:32:12 +08:00
metrics_info_test.go Refine state check (#27541) 2023-10-11 21:01:35 +08:00
metrics_info.go feat: support rate limiter based on db and partition levels (#31070) 2024-04-12 16:01:19 +08:00
mock_cache.go enhance: update shard leader cache when leader location changed (#32470) 2024-05-08 10:05:29 +08:00
mock_channels_manager.go
mock_lb_balancer.go
mock_lb_policy.go
mock_msgstream_test.go Support to replicate the mq message (#27240) 2023-10-20 14:26:09 +08:00
mock_shardclient_manager.go Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
mock_test.go enhance: move rocksmq from internal to pkg (#34165) 2024-06-26 13:36:05 +08:00
mock_tso_test.go Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
msg_pack_test.go enhance: unify data generation test APIs (#32955) 2024-05-14 14:33:33 +08:00
msg_pack.go fix: Fix filtering by partition key fails for importing data (#33274) (#33277) 2024-05-23 11:25:40 +08:00
OWNERS
privilege_interceptor_test.go enhance: make the auth error message more suitable (#32253) 2024-04-16 16:47:19 +08:00
privilege_interceptor.go enhance: make the auth error message more suitable (#32253) 2024-04-16 16:47:19 +08:00
proxy_rpc_test.go Refine Proxy errors (#27499) 2023-10-09 10:09:33 +08:00
proxy_test.go enhance: unify data generation test APIs (#32955) 2024-05-14 14:33:33 +08:00
proxy.go fix: should init access logger before init server (#32976) 2024-05-14 10:47:32 +08:00
rate_limit_interceptor_test.go fix: Fix frequent 'failed to get request info' log (#33334) (#33337) 2024-05-27 01:37:41 +08:00
rate_limit_interceptor.go fix: Fix frequent 'failed to get request info' log (#33334) (#33337) 2024-05-27 01:37:41 +08:00
reducer_test.go
reducer.go Fill output fields for count request (#27967) 2023-10-30 10:00:12 +08:00
repack_func_test.go
repack_func.go Support to replicate the mq message (#27240) 2023-10-20 14:26:09 +08:00
replicate_stream_manager_test.go fix: Fix the unstable unit test TestReplicateManager (#28718) 2023-11-24 17:50:30 +08:00
replicate_stream_manager.go Support to replicate the mq message (#27240) 2023-10-20 14:26:09 +08:00
reScorer_test.go enhance:Refactor hybrid search (#32020) 2024-04-09 14:21:18 +08:00
reScorer.go enhance:Refactor hybrid search (#32020) 2024-04-09 14:21:18 +08:00
rootcoord_mock_test.go enhance: Enable alter database props in rootcoord (#32458) 2024-04-25 10:53:25 +08:00
roundrobin_balancer_test.go
roundrobin_balancer.go
rpc_msg.go
search_reduce_util.go enhance: improve reduce performance on very large topk (#32871) 2024-05-13 11:55:31 +08:00
search_util.go enhance: refine error message for invalid limit parameter (#34179) 2024-06-26 20:46:06 +08:00
segment_test.go fix: wrong context passing into NewClient, error handling lost in session_util (#30817) 2024-02-28 10:40:09 +08:00
segment.go enhance:change some logs (#29579) 2024-01-05 16:12:48 +08:00
shard_client_test.go Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
shard_client.go Add querynode client wrapper and avoid grpc in standalone mode (#27781) 2023-10-19 11:10:07 +08:00
simple_rate_limiter_test.go enhance: enable flush rate limiter of collection level (#33864) 2024-06-14 16:27:57 +08:00
simple_rate_limiter.go fix: Fix global rate limit is not working (#33335) (#33336) 2024-05-24 09:05:47 +08:00
task_alias_test.go feat: Implement DescribeAlias and ListAliases interfaces (#29641) 2024-01-11 19:12:51 +08:00
task_alias.go enhance: Skip timestamp allocation when search/query consistency level is eventually (#29773) 2024-02-21 09:52:59 +08:00
task_database_test.go enhance: expose DescribeDatabase api in proxy (#32732) 2024-05-09 22:51:30 +08:00
task_database.go enhance: expose DescribeDatabase api in proxy (#32732) 2024-05-09 22:51:30 +08:00
task_delete_test.go enhance: forbid delete with always true expression (#32472) 2024-04-22 11:09:23 +08:00
task_delete.go enhance: forbid delete with always true expression (#32472) 2024-04-22 11:09:23 +08:00
task_index_test.go enhance: [2.4] autoindex for multi data type (#33867) 2024-06-14 23:26:00 +08:00
task_index.go enhance: [cherry-pick]remove CheckVecIndexWithDataTypeExist function in pkg (#34104) 2024-06-26 21:14:26 +08:00
task_insert_test.go enhance: unify data generation test APIs (#32955) 2024-05-14 14:33:33 +08:00
task_insert.go enhance: add max insert request size and must use partition key configs (#32433) 2024-04-19 10:31:20 +08:00
task_policies_test.go Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
task_policies.go Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
task_query_test.go fix: query iterator lack results(#33137) (#33422) (#33506) 2024-06-05 18:51:52 +08:00
task_query.go enhance: Optimize grow slice cost during query (#34254) 2024-07-01 15:18:11 +08:00
task_scheduler_test.go enhance: Skip timestamp allocation when search/query consistency level is eventually (#29773) 2024-02-21 09:52:59 +08:00
task_scheduler.go feat: add more operation detail info for better allocation (#30438) 2024-03-28 06:33:11 +08:00
task_search_test.go enhance: [2.4] support integral type for MV and skip MV if there is only one category (#34005) 2024-06-24 19:12:02 +08:00
task_search.go enhance: add more trace for search & query (#32734) 2024-05-07 13:03:29 +08:00
task_statistic_test.go Refine state check (#27541) 2023-10-11 21:01:35 +08:00
task_statistic.go fix: Hybrid search doesn't expire shard leader cache (#31380) 2024-03-19 18:03:07 +08:00
task_test.go fix: Fix filtering by partition key fails for importing data (#33274) (#33277) 2024-05-23 11:25:40 +08:00
task_upsert_test.go enhance: unify data generation test APIs (#32955) 2024-05-14 14:33:33 +08:00
task_upsert.go enhance: Add AllPartitionsID const to replace InvalidPartitionID (#31438) 2024-03-20 19:01:05 +08:00
task.go enhance: Enable database level replica num and resource groups for loading collection (#33052) (#33981) 2024-06-21 16:56:02 +08:00
timestamp_test.go
timestamp.go enhance:Remove msgbase unnecessary assignments (#28511) 2023-11-24 15:02:39 +08:00
trace_log_interceptor_test.go enhance: Support to trace restful request and request error (#28685) 2023-11-27 20:14:26 +08:00
trace_log_interceptor.go enhance: refine access log to support format access log by yaml and print name info. (#28319) 2023-11-28 15:32:31 +08:00
type_def.go
util_test.go enhance: refine error message for invalid limit parameter (#34179) 2024-06-26 20:46:06 +08:00
util.go enhance: refine error message for invalid limit parameter (#34179) 2024-06-26 20:46:06 +08:00
validate_util_test.go fix: check array field data is nil before getting the type (#33114) (#33311) 2024-05-24 09:07:11 +08:00
validate_util.go fix: [2.4] fix binary vector data size (#33751) 2024-06-12 20:11:55 +08:00