milvus/internal/proxy
wei liu 79e6ef2617
fix: Search/Query may failed during updating delegator cache (#37174)
issue: #37115
pr: #37116
casue init query node client is too heavy, so we remove
updateShardClient from leader mutex, which cause much more concurrent
cornor cases.

This PR delay query node client's init operation until `getClient` is
called, then use leader mutex to protect updating shard client progress
to avoid concurrent issues.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-10-28 20:08:25 +08:00
..
accesslog enhance: Update protobuf-go to protobuf-go v2 (#34394) (#35555) 2024-08-21 18:50:58 +08:00
connection enhance: purge client infos periodically (#31037) 2024-03-06 12:50:59 +08:00
authentication_interceptor_test.go fix: [2.4] Unify hook singleton implementation in proxy (#34888) 2024-07-26 18:07:53 +08:00
authentication_interceptor.go enhance: make the auth error message more suitable (#32253) 2024-04-16 16:47:19 +08:00
cgo_util_test.go enhance: [cherry-pick]remove CheckVecIndexWithDataTypeExist function in pkg (#34104) 2024-06-26 21:14:26 +08:00
cgo_util.go enhance: optimize milvus core building (#35660) 2024-08-27 18:55:00 +08:00
channels_mgr_test.go enhance: make sure stream closed (#29456) 2023-12-26 19:56:47 +08:00
channels_mgr.go feat: add more operation detail info for better allocation (#30438) 2024-03-28 06:33:11 +08:00
channels_time_ticker_test.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
channels_time_ticker.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
condition_test.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
condition.go Propagate task ctx done err for proxy (#27892) 2023-10-26 19:06:13 +08:00
count_reducer_test.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
count_reducer.go feat: add more operation detail info for better allocation (#30438) 2024-03-28 06:33:11 +08:00
data_coord_mock_test.go enhance: Remove import v1 (#31403) 2024-03-22 15:29:09 +08:00
database_interceptor_test.go enhance: Update protobuf-go to protobuf-go v2 (#34394) (#35555) 2024-08-21 18:50:58 +08:00
database_interceptor.go fix: add more requests to the database interceptor (#30452) 2024-02-02 16:49:06 +08:00
default_limit_reducer.go Improve the error message for getting all indexes of collection (#27389) 2023-10-08 21:23:32 +08:00
dummyreq_test.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
dummyreq.go [skip ci]Update license for proxy dummy (#11605) 2021-11-10 23:43:27 +08:00
hook_interceptor_test.go enhance: [2.4] set the rpc error code to avoid the invalid retry (#37025) 2024-10-22 11:17:28 +08:00
hook_interceptor.go enhance: [2.4] set the rpc error code to avoid the invalid retry (#37025) 2024-10-22 11:17:28 +08:00
impl_test.go enhance: Support db for bulkinsert (#37012) (#37017) 2024-10-23 16:31:29 +08:00
impl.go enhance: Tidy import options (#37077) (#37078) 2024-10-25 14:35:45 +08:00
interface_def.go Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
lb_balancer.go add metrics for replica selection (#25037) 2023-06-27 09:52:44 +08:00
lb_policy_test.go enhance: Enable dynamic update replica selection policy (#35824) 2024-09-13 17:05:15 +08:00
lb_policy.go fix: Search/Query may failed during updating delegator cache (#37174) 2024-10-28 20:08:25 +08:00
look_aside_balancer_test.go fix: Skip unnecessary query node health check in proxy (#36491) (#36553) 2024-09-30 14:27:16 +08:00
look_aside_balancer.go fix: Skip unnecessary query node health check in proxy (#36491) (#36553) 2024-09-30 14:27:16 +08:00
management_test.go enhance: add restful api to trigger component stop (#32076) (#33799) 2024-06-17 21:53:59 +08:00
management.go enhance: Mark query node as read only after suspend (#35492) (#35586) 2024-08-20 19:00:56 +08:00
meta_cache_adapter_test.go enhance: Avoid initializing casbin enforcer for each request (#29117) 2023-12-12 10:36:43 +08:00
meta_cache_adapter.go enhance: [2.4] the panic when db isn't existed in the rate limit interceptor (#33308) 2024-05-23 17:25:41 +08:00
meta_cache_test.go fix: memory leak in proxy meta cache (#36076) 2024-09-08 17:49:06 +08:00
meta_cache.go fix: Search/Query may failed during updating delegator cache (#37174) 2024-10-28 20:08:25 +08:00
metrics_info_test.go Refine state check (#27541) 2023-10-11 21:01:35 +08:00
metrics_info.go enhance: remove cooling off in rate limiter for read requests (#35936) 2024-09-04 14:39:10 +08:00
mock_cache.go fix: memory leak in proxy meta cache (#36076) 2024-09-08 17:49:06 +08:00
mock_channels_manager.go support complex delete expression (#25752) 2023-09-12 10:19:17 +08:00
mock_lb_balancer.go Organize all mockery generation commands in Makefile (#26826) 2023-09-04 21:19:48 +08:00
mock_lb_policy.go Organize all mockery generation commands in Makefile (#26826) 2023-09-04 21:19:48 +08:00
mock_msgstream_test.go Support to replicate the mq message (#27240) 2023-10-20 14:26:09 +08:00
mock_shardclient_manager.go Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
mock_test.go feat: record the duration waiting in the proxy queue (#34744) (#34788) 2024-07-19 15:37:44 +08:00
mock_tso_test.go Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
msg_pack_test.go feat: [2.4] Support field partial load collection (#35416) (#35696) 2024-08-27 14:07:00 +08:00
msg_pack.go enhance: Update protobuf-go to protobuf-go v2 (#34394) (#35555) 2024-08-21 18:50:58 +08:00
OWNERS [skip ci]Update OWNERS files (#11898) 2021-11-16 15:41:11 +08:00
privilege_cache_test.go enhance: [2.4] Add in-memory cache for casbin enforcer result (#35272) 2024-08-06 12:14:17 +08:00
privilege_cache.go fix: [2.4] Re-read value after once initialization (#35643) 2024-08-22 16:30:57 +08:00
privilege_interceptor_test.go fix: fix ReadWrite privilege group deny all global API (#36145) 2024-09-13 10:31:07 +08:00
privilege_interceptor.go fix: fix ReadWrite privilege group deny all global API (#36145) 2024-09-13 10:31:07 +08:00
proxy_rpc_test.go Refine Proxy errors (#27499) 2023-10-09 10:09:33 +08:00
proxy_test.go enhance: Support db for bulkinsert (#37012) (#37017) 2024-10-23 16:31:29 +08:00
proxy.go enhance: remove cooling off in rate limiter for read requests (#35936) 2024-09-04 14:39:10 +08:00
rate_limit_interceptor_test.go enhance: Update protobuf-go to protobuf-go v2 (#34394) (#35555) 2024-08-21 18:50:58 +08:00
rate_limit_interceptor.go enhance: support httpv1/v2 throttle and add it for httpV2(#35350) (#35504) 2024-08-20 16:32:56 +08:00
reducer_test.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
reducer.go Fill output fields for count request (#27967) 2023-10-30 10:00:12 +08:00
repack_func_test.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
repack_func.go Support to replicate the mq message (#27240) 2023-10-20 14:26:09 +08:00
replicate_stream_manager_test.go fix: Fix the unstable unit test TestReplicateManager (#28718) 2023-11-24 17:50:30 +08:00
replicate_stream_manager.go Support to replicate the mq message (#27240) 2023-10-20 14:26:09 +08:00
reScorer_test.go enhance:Refactor hybrid search (#32020) 2024-04-09 14:21:18 +08:00
reScorer.go enhance:Refactor hybrid search (#32020) 2024-04-09 14:21:18 +08:00
rootcoord_mock_test.go enhance: Update protobuf-go to protobuf-go v2 (#34394) (#35555) 2024-08-21 18:50:58 +08:00
roundrobin_balancer_test.go enhance: Enable dynamic update replica selection policy (#35824) 2024-09-13 17:05:15 +08:00
roundrobin_balancer.go enhance: Enable dynamic update replica selection policy (#35824) 2024-09-13 17:05:15 +08:00
rpc_msg.go Add slow log for read (#23272) 2023-04-14 15:30:29 +08:00
search_reduce_util.go enhance: improve reduce performance on very large topk (#32871) 2024-05-13 11:55:31 +08:00
search_util.go fix: keep inner topK to avoid exceeding efSearch (#36287) 2024-09-15 15:12:38 +08:00
segment_test.go fix: wrong context passing into NewClient, error handling lost in session_util (#30817) 2024-02-28 10:40:09 +08:00
segment.go enhance:change some logs (#29579) 2024-01-05 16:12:48 +08:00
shard_client_test.go Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
shard_client.go fix: Search/Query may failed during updating delegator cache (#37174) 2024-10-28 20:08:25 +08:00
simple_rate_limiter_test.go enhance:[Cherry-pick] Check by proxy rate limiter when delete get data by query. (#30891) (#35262) 2024-08-13 14:32:21 +08:00
simple_rate_limiter.go fix: Fix DB limiter nodes are mistakenly cleaned up (#35991) (#35992) 2024-09-05 17:31:05 +08:00
task_alias_test.go fix: [2.4] execute method should return an error when result is a failure (#34872) 2024-07-22 12:13:42 +08:00
task_alias.go enhance: [2.4] Add Segment Level in milvus segment info APIs (#34763) (#35023) 2024-07-29 10:11:52 +08:00
task_database_test.go enhance: expose DescribeDatabase api in proxy (#32732) 2024-05-09 22:51:30 +08:00
task_database.go feat: [2.4] add the rbac msg and send them to the replicate channel (#35562) 2024-08-27 14:45:00 +08:00
task_delete_test.go feat: [cherry-pick]The expression supports filling elements through templates (#37058) 2024-10-28 15:17:30 +08:00
task_delete.go feat: [cherry-pick]The expression supports filling elements through templates (#37058) 2024-10-28 15:17:30 +08:00
task_index_test.go feat: [2.4] Support field partial load collection (#35416) (#35696) 2024-08-27 14:07:00 +08:00
task_index.go feat: [2.4] provide more general configuration to control mmap behavior (#35609) 2024-08-23 12:35:02 +08:00
task_insert_test.go enhance: Update protobuf-go to protobuf-go v2 (#34394) (#35555) 2024-08-21 18:50:58 +08:00
task_insert.go fix: iaccurate size estimation for encoded array data (#36379) 2024-09-23 21:17:13 +08:00
task_policies_test.go Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
task_policies.go Decoupling client and server API in types interface (#27186) 2023-09-26 09:57:25 +08:00
task_query_test.go feat: [cherry-pick]The expression supports filling elements through templates (#37058) 2024-10-28 15:17:30 +08:00
task_query.go feat: [cherry-pick]The expression supports filling elements through templates (#37058) 2024-10-28 15:17:30 +08:00
task_scheduler_test.go enhance: Update protobuf-go to protobuf-go v2 (#34394) (#35555) 2024-08-21 18:50:58 +08:00
task_scheduler.go feat: record the duration waiting in the proxy queue (#34744) (#34788) 2024-07-19 15:37:44 +08:00
task_search_test.go fix: keep inner topK to avoid exceeding efSearch (#36287) 2024-09-15 15:12:38 +08:00
task_search.go feat: [cherry-pick]The expression supports filling elements through templates (#37058) 2024-10-28 15:17:30 +08:00
task_statistic_test.go feat: [2.4] Support field partial load collection (#35416) (#35696) 2024-08-27 14:07:00 +08:00
task_statistic.go enhance: Update protobuf-go to protobuf-go v2 (#34394) (#35555) 2024-08-21 18:50:58 +08:00
task_test.go enhance: [2.4] Add skip load validation for create collection task (#35761) 2024-08-28 18:25:00 +08:00
task_upsert_test.go enhance: Update protobuf-go to protobuf-go v2 (#34394) (#35555) 2024-08-21 18:50:58 +08:00
task_upsert.go fix: iaccurate size estimation for encoded array data (#36379) 2024-09-23 21:17:13 +08:00
task.go feat: [cherry-pick]The expression supports filling elements through templates (#37058) 2024-10-28 15:17:30 +08:00
timestamp_test.go Format the code (#27275) 2023-09-21 09:45:27 +08:00
timestamp.go enhance:Remove msgbase unnecessary assignments (#28511) 2023-11-24 15:02:39 +08:00
trace_log_interceptor_test.go enhance: Support to trace restful request and request error (#28685) 2023-11-27 20:14:26 +08:00
trace_log_interceptor.go enhance: refine access log to support format access log by yaml and print name info. (#28319) 2023-11-28 15:32:31 +08:00
type_def.go [skip e2e] Add comment for pChan (#14098) 2021-12-23 21:44:12 +08:00
util_test.go fix: iaccurate size estimation for encoded array data (#36379) 2024-09-23 21:17:13 +08:00
util.go fix: iaccurate size estimation for encoded array data (#36379) 2024-09-23 21:17:13 +08:00
validate_util_test.go enhance: [2.4] Remove duplicated schema helper creation in proxy (#35489) (#35502) 2024-08-16 14:32:54 +08:00
validate_util.go fix: [cherry-pick]Check string array max length after type matching (#36497) 2024-09-27 11:15:14 +08:00