Commit Graph

187 Commits

Author SHA1 Message Date
Cai Yudong
f8f61fb116
Use BaseParams etcd configuration for all components (#15012)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
Xiaofan
69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
Jiquan Long
8a488f1f20
Refine startup workflow of proxy (#13459)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-25 16:10:17 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
jingkl
6c3f1a9162
[skip e2e]Add comments to proxy service (#14082)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-23 18:17:15 +08:00
jingkl
df546bc241
[skip e2e]Add comments to proxy service (#14081)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-23 18:15:21 +08:00
jingkl
df90402a7f
[skip e2e]Add comments to proxy service (#14080)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-23 18:11:31 +08:00
jingkl
e3e45ef069
[skip e2e]Add comments to proxy service (#13996)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-22 19:37:19 +08:00
jingkl
7423da8cb0
[skip e2e]Add comments to proxy service (#13995)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-22 19:35:27 +08:00
shaoyue
33963955dc
[skip e2e] Add comment for distributed/proxy.Server (#13991)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-22 19:29:50 +08:00
jingkl
1e658f26ea
[skip e2e]Add comments to proxy service (#13994)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-22 19:13:14 +08:00
jingkl
e4ef536bb5
[skip e2e]Add comments to proxy service (#13829)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-21 15:25:08 +08:00
jingkl
0011f39530
[skip e2e]Add comments to proxy service (#13835)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-21 15:12:55 +08:00
jingkl
398a11cda0
[skip e2e]Add comments to proxy service (#13831)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-21 11:55:31 +08:00
jingkl
93e634c189
[skip e2e]Add comments to proxy service (#13756)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-20 19:16:37 +08:00
jingkl
9e7f548ee6
[skip e2e]Add comments to proxy service (#13754)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-20 18:58:50 +08:00
Cai Yudong
a101d1d3c5
[skip e2e] Unify component import alias (#13765)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 16:43:05 +08:00
Cai Yudong
966119526a
Rename Params to ClientParams for all component clients (#13743)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-20 14:25:25 +08:00
jingkl
572afa502c
[skip e2e]Add comments to proxy service (#13565)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-17 14:30:27 +08:00
jingkl
21189779ee
[skip e2e]Add comments to proxy service (#13564)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-17 14:27:30 +08:00
Cai Yudong
cf50e9ac55
Use GrpcServerConfig and GrpcClientConfig for distributed components (#13469)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 10:23:15 +08:00
Jiquan Long
acbb680c91
[skip ci] Fix go fmt error (#13538)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-16 20:47:14 +08:00
jingkl
fd33750aec
[skip ci] Add the comments to service (#13509)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-16 16:39:52 +08:00
jingkl
d4c998e6f5
[skip ci] Add the comments to service (#13508)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-16 16:37:27 +08:00
jingkl
24b8b6e4c7
[skip ci] Add the comments to service (#13507)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-16 16:33:44 +08:00
jingkl
2aa1d5d714
[skip ci] Add the comments to service (#13400)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-15 17:01:49 +08:00
jingkl
706cc9d7c2
[skip ci] Add the comments to service (#13404)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-15 16:59:56 +08:00
jingkl
3ea83d77cc
[skip ci] Add the comments to service (#13411)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-15 12:00:20 +08:00
cai.zhang
9f23fc7f2a
Register the service when the component state is healthy (#13248)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
jingkl
f311353182
[skip ci] Add the comments to service (#13316)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-14 16:21:22 +08:00
jingkl
96a0352272
[skip ci] Add notes to service (#13315)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-14 16:19:33 +08:00
jingkl
1950beba24
[skip ci] Add comments to service (#13314)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-14 11:59:10 +08:00
jingkl
4d27c8ef14
[skip ci]Add notes to client (#13178)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-10 21:12:23 +08:00
jaime
b97e88e859
[skip ci] Add graceful stop grpc server log in proxy (#12827)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-07 09:51:56 +08:00
zhenshan.cao
af22977cd3
Fixbug: grpc connection is closed by mistake (#12307)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-03 15:15:32 +08:00
jingkl
8a71aa7b09
[skip ci] add client notes (#12543)
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>

Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
2021-12-01 17:11:31 +08:00
jingkl
d68142de86
[skip ci] add notes to client.go (#12542)
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>

Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
2021-12-01 17:09:36 +08:00
Xiaofan
1d9f4e0a5c
Add log when server is stopped (#12233)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-30 10:59:42 +08:00
congqixia
06ced4d1d1
Add DropVirtualChannel for DataCoord (#12361)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-29 22:35:41 +08:00
shaoyue
8bd7365172
[skip ci] Add Comments for exported items in proxy/service.go (#12376)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-29 19:57:57 +08:00
dragondriver
3850979308
Show stack trace info when rpc fail (#12290)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-29 14:29:24 +08:00
zhenshan.cao
6831589b0b
Enable keepalive on the grpc (#12328)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-29 14:25:17 +08:00
Bingyi Sun
01be91116e
Add GetFlushState interface (#12170)
issue: #12075
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-23 10:55:14 +08:00
shaoyue
fc6bc48e3b
[skip ci] Add comments for exported items in proxy/client.go (#12087)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-18 19:19:32 +08:00
zhenshan.cao
543c4891b3
Prevent the client from closing grpc connection by mistake (#11918)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-18 11:17:12 +08:00
Xiaofan
71e814f796
Remove common.yaml and component.yaml (#11661)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 21:25:08 +08:00
godchen
5357e301f4
Fix retrieve search error (#11501)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
Bingyi Sun
c3f0c5a3ff
Add compaction interfaces in proxy (#11431)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-09 14:47:02 +08:00
bigsheeper
38375ee1d3
Add LoadBalance (#9945)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-06 16:54:59 +08:00
sunby
c26cd79532
Add compaction (#9906)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00
dragondriver
b3305da3fa
[skip ci] Add comments for NewServer (#11184)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-03 19:50:27 +08:00
dragondriver
e581a6364c
[skip ci] Add comments for client (#11183)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-03 19:48:48 +08:00
zhenshan.cao
690dcb8b39
[skip ci]Fix golint error in proxy (#10864)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-29 00:00:41 +08:00
groot
4d41bbe32f
Add log (#10718)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-27 14:56:48 +08:00
XuanYang-cn
bd93d9f01d
[skip ci]Update license for distributed p.client (#10298)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-20 19:49:28 +08:00
XuanYang-cn
4a35fb1d45
[skip ci]Update license for distributed proxy (#10299)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-20 19:41:37 +08:00
groot
bd7baf8912
Add unittest for distributed/proxy (#9875)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-14 17:48:34 +08:00
zhenshan.cao
6cf049130d
[skip ci] Fix golint error in proxy (#9283)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-05 21:12:13 +08:00
zhenshan.cao
2d3824e6e2
[skip ci] Fix golint error in proxy (#9188)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-04 17:20:49 +08:00
groot
ac7c22d84e
Add unittest for distributed/proxy (#8907)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-01 22:54:09 +08:00
Xiaofan
34157a4943
Unify Param Table name (#8491)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-24 21:35:57 +08:00
Xiaofan
f5173b595f
Add a channel prefix for all channels (#8166)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-23 10:53:53 +08:00
Yusup
ccb57ba4b2
add collection alias (#7255)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-18 11:13:51 +08:00
dragondriver
4f9d124ed4
Fix data race of proxy ut (#8119)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 19:45:42 +08:00
dragondriver
ca2d09a167
Fix data race of proxy grpc client (#8091)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-16 19:31:59 +08:00
groot
2398dafbca
Add unittest for distributed proxy (#7976)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-15 17:29:49 +08:00
dragondriver
84bddd0a03
Add unittest cases for proxy (#7364)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-31 10:25:59 +08:00
groot
8701c477e2
Add delete api into proto (#7304)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-08-26 12:15:52 +08:00
godchen
bf2c427609
Fix connection timeout (#7203)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-20 17:52:11 +08:00
dragondriver
e45cb6c644
Expose system topology information by proxy (#7137)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-18 10:12:10 +08:00
yukun
671b2737d2
Remove RetrieveRequest and RetrieveTask (#6848)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-08-16 17:06:10 +08:00
dragondriver
b3f10ae5cc
Fix 6990, enhance the log when parsing grpc recv/send parameters (#6993)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-12 16:16:09 +08:00
godchen
7557616fea
Change client timeout (#6982)
* Change client timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix conflicts

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-06 14:09:26 +08:00
dragondriver
ad77a6e0d4
Fix #6859, increase the MaxCallRecvMsgSize and MaxCallSendMsgSize of grpc client (#6861)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-04 13:03:24 +08:00
neza2017
8b89744c6b
search with exp (#6409)
* process float vector and binary vector field
on the search result

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add more debug info on etcd

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add debug info when grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-10 10:21:52 +08:00
groot
a364d7303b
Implement calculate vectors distance in server (#6219)
* calc distance stage 3

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 5

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* calc distance stage 6

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* code style

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-07-01 18:56:17 +08:00
godchen
2a07124885
Change default grpc retry config (#6233)
* Change default grpc retry config

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* add retry code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-01 15:24:17 +08:00
godchen
1c1ffc8b32
Add connect err log (#6186)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-29 14:30:17 +08:00
godchen
73996aba91
Change client init timeout (#6107)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-25 15:50:23 +08:00
godchen
3785bb6330
Change retry times (#6083)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-24 19:05:06 +08:00
sunby
46f86a0354
Return sealed segments when calling flush (#6011)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-23 16:56:11 +08:00
Cai Yudong
a09a3a1905
rename service to coord (#6020)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-23 16:14:08 +08:00
godchen
99be4c09a5
change retry (#5996)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-23 09:24:10 +08:00
Cai Yudong
7dbf33b788
Update component names in config files (#5989)
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 19:08:03 +08:00
xige-16
2af1c27811
Rename queryservice to querycoordinator (#5931)
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 16:44:09 +08:00
Cai Yudong
d5f4ee6f44
Rename proto master/index_service/proxy_service (#5973)
* rename proto proxy_service to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto index_service to index_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto master to root_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 16:14:09 +08:00
Cai Yudong
2926a78968
Rename proxynode to proxy (#5961)
* rename package name from proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/proxynode to distributed/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/proxynode to internal/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 14:40:07 +08:00