Commit Graph

187 Commits

Author SHA1 Message Date
bigsheeper
5cdd6ca251
Add quotaCenter, rateLimiter and rateCollector (#18636)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-09-16 09:56:47 +08:00
Jiquan Long
a5e2d6b6fb
Refactor RootCoord (#18930)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Co-authored-by: xaxys <tpnnghd@163.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Co-authored-by: xaxys <tpnnghd@163.com>
2022-09-05 13:29:11 +08:00
jaime
0e4e7966ec
Refine grpc server options of interceptor (#18943)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-09-01 09:48:58 +08:00
cai.zhang
c924f73105
Refactor for IndexCoord to support cloud (#18643)
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
2022-08-25 15:48:54 +08:00
Zach
0c9a10e8f8
1. refine logging interfaces (#18692)
2. adjust logs for query/search requests

Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>

Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
2022-08-23 10:44:52 +08:00
aoiasd
8a70f2badb
Add ShowConfigurations for all remaining session (#18594)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-08-12 13:20:39 +08:00
SimFG
ff0200210a
Support Role-Based Access Control (#18425)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-08-04 11:04:34 +08:00
codeman
5fda8261d0
Fix: Unable to list newly created credential users (#18117) (#18153)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-07-07 21:16:22 +08:00
shaoyue
96b97f7f58
RESTful api use same port as metrics & healthcheck (#17732)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-06-24 15:34:14 +08:00
SimFG
f4c6a6734e
Fix rpc retry policy not taking effect (#17673)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-06-22 22:22:13 +08:00
shaoyue
32a3ed0791
Add e2e test for RESTful APIs, fix json encoding for on proto_oneof fields (#17362)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-06-20 22:06:12 +08:00
cai.zhang
141a3bbe00
Mark deleted before drop index (#17490)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-17 18:08:12 +08:00
cai.zhang
53a49a9255
GetIndexState only get the state generated call CreateIndex (#17549)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-16 20:12:11 +08:00
SimFG
0986c29d7f
proxy tls support one-way authentication (#17348)
Signed-off-by: xiyichan <2863768433@qq.com>

Co-authored-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>

Co-authored-by: xiyichan <2863768433@qq.com>
2022-06-02 18:56:04 +08:00
Ten Thousand Leaves
f5e63177d2
Fix an issue with bulk load with multiple DataNodes (#17324)
issue: #17300
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-06-02 18:54:04 +08:00
shaoyue
7c52a8c535
Add RESTful API for new methods, fix err when receive empty boy (#17260)
create collection schema use struct instead of protobuf

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-06-02 17:40:04 +08:00
cai.zhang
bcf3b7426a
Add distributed lock for segment refgerence (#16782)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-31 16:36:03 +08:00
congqixia
c88514bc49
Remove not used QueryChannel in Proxy and Query Cluster (#16856)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-30 19:50:04 +08:00
zhenshan.cao
b0d54ed0af
Rename Client to GrpcClient in mock package (#17230)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-30 17:16:08 +08:00
SimFG
731870211a
Support role-based access control (only pb) (#16987)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-05-28 00:04:01 +08:00
Jiquan Long
e44afc7aa3
Fix ut: wait service ready after run Proxy server (#17208)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-05-25 18:56:00 +08:00
bigsheeper
9eeec4a2d5
Add collection load cache and InvalidateCollMetaCache by collID (#16882)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-19 10:13:56 +08:00
Jiquan Long
ca3ecec5b5
Fix ut data race (#16939)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-13 17:43:53 +08:00
exia
4ee78eb5ad
proxy support tls (#16706)
Signed-off-by: xiyichan <2863768433@qq.com>
2022-05-10 20:05:53 +08:00
Xiaofan
333b439a6c
Support config grpc log level (#16618)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-05 10:35:50 +08:00
shaoyue
2f49db9d3c
Implements remaining rest APIs (#16387)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-04-29 15:15:47 +08:00
groot
bc5e9ec929
Add list import tasks api (#16605)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-04-25 17:37:46 +08:00
Ten Thousand Leaves
289e468a7a
Make bulk load fully work (#16512)
issue: #15604

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-20 14:03:40 +08:00
codeman
f5e1ded854
fix #16504 (#16523)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-04-19 16:35:39 +08:00
Ten Thousand Leaves
e76a8c5ec2
Update compile options and config for embedded Milvus (#16472)
/kind enhancement

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-14 19:57:34 +08:00
codeman
4e12271d79
Support login with username and password (#15656) (#16341)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-04-11 19:49:34 +08:00
godchen
bb7a0766fe
Add dependency factory (#16204)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-04-07 22:05:32 +08:00
Ten Thousand Leaves
1e6f6bd072
Implement set segment state call from RootCoord to DataCoord. (#16374)
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-06 15:33:32 +08:00
XuanYang-cn
78200009a3
Impl GetReplicas in Proxy (#16390)
See also: #16298

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-04-06 14:57:31 +08:00
yah01
c005f07ccc
Modify proto to add GetReplicas() interface (#16328)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-01 16:15:29 +08:00
Ten Thousand Leaves
45be3deb3f
Implement RC, DC, DN calling path for import. (#16321)
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-01 11:33:28 +08:00
XuanYang-cn
58addbf9f4
Add GetShardLeaders rpc in querycoord proto (#16299)
See also: #16298

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-31 16:39:29 +08:00
Jiquan Long
ba37531456
Add support for loading multiple indexes (#16138)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-30 21:11:28 +08:00
groot
1c4b949a1d
modify import rpc interface (#16129)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-22 15:11:24 +08:00
groot
2078b24dca
Prepare for import (#16083)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-21 15:47:23 +08:00
shaoyue
97e5d77953
implements restful entities api (#15916)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-03-21 11:21:23 +08:00
zhenshan.cao
0bd07daae3
Add grpc healthy check (#16050)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-15 15:05:21 +08:00
groot
89356ebcb9
Modify import rpc interfaces (#16006)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-11 17:13:59 +08:00
Ten Thousand Leaves
d5bae6710f
Make all logs configurable for standalone/embedded Milvus. (#15926)
Resolves: #15919, #15708
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-10 10:35:59 +08:00
groot
5fdef607d5
Add rpc interfaces for import (#15930)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-09 18:33:59 +08:00
jaime
7a3a721380
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
shaoyue
83fdc1da7c
Add web server in proxy with sample handler (#15647)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-02-23 14:37:52 +08:00
Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
Jiquan Long
675e6d352b
QueryNodes send search/query results by rpc (#15223)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-01-17 14:41:35 +08:00
zhenshan.cao
1601a61b78
Move logic of checking available port to service (#15222)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-14 21:17:34 +08:00
Cai Yudong
f8f61fb116
Use BaseParams etcd configuration for all components (#15012)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
Xiaofan
69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
Jiquan Long
8a488f1f20
Refine startup workflow of proxy (#13459)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-25 16:10:17 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
jingkl
6c3f1a9162
[skip e2e]Add comments to proxy service (#14082)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-23 18:17:15 +08:00
jingkl
df546bc241
[skip e2e]Add comments to proxy service (#14081)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-23 18:15:21 +08:00
jingkl
df90402a7f
[skip e2e]Add comments to proxy service (#14080)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-23 18:11:31 +08:00
jingkl
e3e45ef069
[skip e2e]Add comments to proxy service (#13996)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-22 19:37:19 +08:00
jingkl
7423da8cb0
[skip e2e]Add comments to proxy service (#13995)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-22 19:35:27 +08:00
shaoyue
33963955dc
[skip e2e] Add comment for distributed/proxy.Server (#13991)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-22 19:29:50 +08:00
jingkl
1e658f26ea
[skip e2e]Add comments to proxy service (#13994)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-22 19:13:14 +08:00
jingkl
e4ef536bb5
[skip e2e]Add comments to proxy service (#13829)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-21 15:25:08 +08:00
jingkl
0011f39530
[skip e2e]Add comments to proxy service (#13835)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-21 15:12:55 +08:00
jingkl
398a11cda0
[skip e2e]Add comments to proxy service (#13831)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-21 11:55:31 +08:00
jingkl
93e634c189
[skip e2e]Add comments to proxy service (#13756)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-20 19:16:37 +08:00
jingkl
9e7f548ee6
[skip e2e]Add comments to proxy service (#13754)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-20 18:58:50 +08:00
Cai Yudong
a101d1d3c5
[skip e2e] Unify component import alias (#13765)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 16:43:05 +08:00
Cai Yudong
966119526a
Rename Params to ClientParams for all component clients (#13743)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 14:25:25 +08:00
jingkl
572afa502c
[skip e2e]Add comments to proxy service (#13565)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-17 14:30:27 +08:00
jingkl
21189779ee
[skip e2e]Add comments to proxy service (#13564)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-17 14:27:30 +08:00
Cai Yudong
cf50e9ac55
Use GrpcServerConfig and GrpcClientConfig for distributed components (#13469)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 10:23:15 +08:00
Jiquan Long
acbb680c91
[skip ci] Fix go fmt error (#13538)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-16 20:47:14 +08:00
jingkl
fd33750aec
[skip ci] Add the comments to service (#13509)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-16 16:39:52 +08:00
jingkl
d4c998e6f5
[skip ci] Add the comments to service (#13508)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-16 16:37:27 +08:00
jingkl
24b8b6e4c7
[skip ci] Add the comments to service (#13507)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-16 16:33:44 +08:00
jingkl
2aa1d5d714
[skip ci] Add the comments to service (#13400)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-15 17:01:49 +08:00
jingkl
706cc9d7c2
[skip ci] Add the comments to service (#13404)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-15 16:59:56 +08:00
jingkl
3ea83d77cc
[skip ci] Add the comments to service (#13411)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-15 12:00:20 +08:00
cai.zhang
9f23fc7f2a
Register the service when the component state is healthy (#13248)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
jingkl
f311353182
[skip ci] Add the comments to service (#13316)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-14 16:21:22 +08:00
jingkl
96a0352272
[skip ci] Add notes to service (#13315)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-14 16:19:33 +08:00
jingkl
1950beba24
[skip ci] Add comments to service (#13314)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-14 11:59:10 +08:00
jingkl
4d27c8ef14
[skip ci]Add notes to client (#13178)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-10 21:12:23 +08:00
jaime
b97e88e859
[skip ci] Add graceful stop grpc server log in proxy (#12827)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-07 09:51:56 +08:00
zhenshan.cao
af22977cd3
Fixbug: grpc connection is closed by mistake (#12307)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-03 15:15:32 +08:00
jingkl
8a71aa7b09
[skip ci] add client notes (#12543)
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>

Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
2021-12-01 17:11:31 +08:00
jingkl
d68142de86
[skip ci] add notes to client.go (#12542)
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>

Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
2021-12-01 17:09:36 +08:00
Xiaofan
1d9f4e0a5c
Add log when server is stopped (#12233)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-30 10:59:42 +08:00
congqixia
06ced4d1d1
Add DropVirtualChannel for DataCoord (#12361)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-29 22:35:41 +08:00
shaoyue
8bd7365172
[skip ci] Add Comments for exported items in proxy/service.go (#12376)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-29 19:57:57 +08:00
dragondriver
3850979308
Show stack trace info when rpc fail (#12290)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-29 14:29:24 +08:00
zhenshan.cao
6831589b0b
Enable keepalive on the grpc (#12328)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-29 14:25:17 +08:00
Bingyi Sun
01be91116e
Add GetFlushState interface (#12170)
issue: #12075
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-23 10:55:14 +08:00
shaoyue
fc6bc48e3b
[skip ci] Add comments for exported items in proxy/client.go (#12087)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-18 19:19:32 +08:00
zhenshan.cao
543c4891b3
Prevent the client from closing grpc connection by mistake (#11918)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-18 11:17:12 +08:00
Xiaofan
71e814f796
Remove common.yaml and component.yaml (#11661)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 21:25:08 +08:00
godchen
5357e301f4
Fix retrieve search error (#11501)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
Bingyi Sun
c3f0c5a3ff
Add compaction interfaces in proxy (#11431)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-09 14:47:02 +08:00
bigsheeper
38375ee1d3
Add LoadBalance (#9945)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-06 16:54:59 +08:00
sunby
c26cd79532
Add compaction (#9906)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00