Commit Graph

114 Commits

Author SHA1 Message Date
Jiquan Long
a2ac84bd64
feat: record the duration waiting in the proxy queue (#34744)
fix: https://github.com/milvus-io/milvus/issues/34743

---------

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-07-23 14:23:52 +08:00
ArenaSu
a59ed65c48
doc: [skip-e2e] add comments for task queue (#33388)
Add comments for task queue in internal/proxy/task_scheduler.go.

Signed-off-by: ArenaSu <704427617@qq.com>
2024-05-27 20:51:42 +08:00
SimFG
b1a1cca10b
feat: add more operation detail info for better allocation (#30438)
issue: #30436

---------

Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-03-28 06:33:11 +08:00
cai.zhang
40ca98f57f
enhance: Skip timestamp allocation when search/query consistency level is eventually (#29773)
issue: #29772 
1. Skip timestamp allocation when search/query consistency level is
eventually.

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-02-21 09:52:59 +08:00
aoiasd
4ef6217fc0
enhance: add pool for scheduler dmQueue task (#30103)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-01-19 14:20:54 +08:00
smellthemoon
1c1f2a1371
enhance:change some logs (#29579)
related #29588

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-01-05 16:12:48 +08:00
yah01
9467de79c3
Use pool to block exceeded tasks (#27767)
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-10-19 03:30:06 +08:00
wei liu
310739d115
remove flush from ddl queue in proxy (#27688)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2023-10-13 18:33:36 +08:00
SimFG
26f06dd732
Format the code (#27275)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-09-21 09:45:27 +08:00
Enwei Jiao
d143682d7d
Refactor logs in proxy package. (#24936)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-06-19 13:28:41 +08:00
yihao.dai
b62429070c
Set pchannels before dml enqueue to prevent panic (#24828)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-06-16 16:36:40 +08:00
yihao.dai
0b354cbab1
Fix timetick block caused by dml task pop failed (#23277)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-04-11 11:00:31 +08:00
jaime
c9d0c157ec
Move some modules from internal to public package (#22572)
Signed-off-by: jaime <yun.zhang@zilliz.com>
2023-04-06 19:14:32 +08:00
zhenshan.cao
ecde42a493
Fix proxy's pchan statistic min ts out of order (#22757)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-03-15 11:17:55 +08:00
MrPresent-Han
89618b7e12
fix wrong sequence of timetick stats on proxy #21855 (#22685)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2023-03-14 15:43:54 +08:00
yah01
e581fef115
Use the request's context to allocate ts (#22633)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-03-09 18:51:52 +08:00
Enwei Jiao
697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-02-26 11:31:49 +08:00
smellthemoon
bb086f47e4
Swap execution flow order in enqueue (#21845)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-01-30 10:27:50 +08:00
Enwei Jiao
fb42466c65
Use opentelemetry (#21509)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2023-01-12 16:09:39 +08:00
Enwei Jiao
89b810a4db
Refactor all params into ParamItem (#20987)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-07 18:01:19 +08:00
Jiquan Long
5a6a92d603
Refine log level (#20896)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-30 14:11:15 +08:00
yah01
bec1d4c50f
Revert "Make proxy process data definition requests concurrently (#20503)" (#20566)
This reverts commit 911921d5a7.

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-15 00:41:06 +08:00
yah01
911921d5a7
Make proxy process data definition requests concurrently (#20503)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-14 16:03:07 +08:00
smellthemoon
7325b3e1c3
Substitute traceid for msgid in rpc (#20450)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-11-14 15:29:06 +08:00
Jiquan Long
2189530f5b
Fix some unreasonable logs in Proxy (#20411)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 15:05:08 +08:00
Xiaofan
2bfecf5b4e
Refine bloomfilter and memory usage (#20168)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-31 17:41:34 +08:00
Xiaofan
6826964e60
Rename some interface and files in id allocator (#19605)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-09 10:06:58 +08:00
congqixia
69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord (#16470)
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-20 16:15:41 +08:00
jaime
cf4c014b2e
Remove collect query result by mq (#15988)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-16 10:19:21 +08:00
Cai Yudong
3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig (#15843)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-04 11:17:56 +08:00
jaime
7a3a721380
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
xige-16
782f350da5
Modify parameter spelling of task queue (#15581)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-02-22 10:25:51 +08:00
Cai Yudong
8255b713ac
Move ProxySubName/QueryNodeSubName/DataNodeSubName to msgChannelConfig (#15501)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-09 14:41:45 +08:00
Jiquan Long
675e6d352b
QueryNodes send search/query results by rpc (#15223)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-01-17 14:41:35 +08:00
Jiquan Long
3bf34f6326
[skip e2e] Add comment for baseTaskQueue (#15170)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-01-12 10:59:37 +08:00
Jiquan Long
92b466800f
[skip e2e] Add implementation assertion for taskQueue (#15023)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-01-07 17:53:28 +08:00
Jiquan Long
4fe0e5e457
[skip e2e] Add comment for definitionLoop (#14637)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-30 20:45:21 +08:00
Jiquan Long
b358e9c88d
[skip e2e] Add comment for taskScheduler (#14528)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-29 17:42:45 +08:00
Jiquan Long
673806b1c1
[skip e2e] Add comment for baseTaskQueue (#14460)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-29 14:31:21 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
Jiquan Long
f6e23458aa
Refine log of ready to reduce (#13448)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-22 10:23:00 +08:00
Cai Yudong
74a4a4e15b
Fix golint warnings for proxy (#11895)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-29 12:25:17 +08:00
godchen
927f72d588
Add delete task channel stats interface (#12250)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-24 16:01:17 +08:00
zhenshan.cao
0f2b7d1790
Fix deadlock caused by not releasing the lock in time (#12161)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-22 12:19:14 +08:00
shaoyue
5b50731ff4
Fix searchResultBufFlags & queryResultBufFlags memory leak (#11585)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-16 14:13:12 +08:00
godchen
5357e301f4
Fix retrieve search error (#11501)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
XuanYang-cn
99894e451d
[skip ci]Update license for proxy task (#11611)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-10 23:55:48 +08:00
shaoyue
25382cdfdf
[skip ci] Update comment typo in collectResultLoop (#11479)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-09 19:34:49 +08:00
godchen
639800241d
Make flow graph for delta channel (#11379)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
Xiaofan
d81b15163f
Seek Query/Query Result channel to Latest (#10985)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-05 14:57:44 +08:00