XuanYang-cn
fa4ccb05fe
[skip-ci]Add comment on FlushSegments of DataNode interface ( #8767 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-29 10:37:59 +08:00
Cai Yudong
72252eccc4
[skip ci] Update index related comments ( #8819 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-29 10:31:59 +08:00
Cai Yudong
bada3935da
[skip ci] Update partition related comments ( #8747 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-29 09:44:03 +08:00
XuanYang-cn
38a94a104d
[skip-ci]Fix golint in types/types.go ( #8766 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-28 22:06:06 +08:00
Cai Yudong
45950f158b
[skip ci] Update collection related comments ( #8740 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-28 14:14:03 +08:00
Cai Yudong
37e4a3203e
[skip ci] Clean comments ( #8731 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-28 11:58:03 +08:00
cai.zhang
b70665ed89
Add comment for index interface ( #8712 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-27 22:48:03 +08:00
dragondriver
c05d4fa362
[skip ci] Add description for proxy api ( #8696 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-27 18:23:59 +08:00
congqixia
b23761f3ed
[skip ci] Add Datacoord Flush description in types ( #8641 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-27 10:23:57 +08:00
Yusup
ccb57ba4b2
add collection alias ( #7255 )
...
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-18 11:13:51 +08:00
cai.zhang
e6e03fc93f
Add unittest for index component ( #7475 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-06 17:54:41 +08:00
dragondriver
3721cbfea1
Proxy metrics integrates with other coordinators ( #7400 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-01 17:35:00 +08:00
dragondriver
89748ac639
Expose metrics of data cluster ( #7177 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-01 10:13:15 +08:00
dragondriver
f0dbdd7f13
Expose metrics of root coordinator ( #7228 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-31 11:45:59 +08:00
dragondriver
648d22ee40
Expose metrics of IndexCoord and IndexNodes ( #7157 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-19 10:28:10 +08:00
dragondriver
7eb8a665b2
Expose metrics of QueryCoord and QueryNodes ( #7113 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-17 10:06:11 +08:00
cai.zhang
f469a315d6
Refactor the logic of assign tasks in IndexCoord ( #6328 )
...
* Refactor the logic of assign tasks in IndexCoord
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bugs
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bug for unittest
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Add lock for map
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Improve code
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix unittest bug
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Reduce duriation for timetick
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Update orm version
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Reset sdk version
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bug
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Reset orm version
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Reset test ip
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bug
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bug for unissued
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Rename some variables
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Fix bug
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
* Use break instead of continue in select::case
Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-07-14 14:15:55 +08:00
neza2017
111a24a49f
remove msgstream of segment info ( #6280 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-03 14:36:18 +08:00
sunby
07b0989628
Add GetFlushedSegments in data coordinator ( #6253 )
...
Send segment flush message by grpc and add a new interface
`GetFlushedSegments`
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-02 11:16:20 +08:00
neza2017
6019c193fc
add grpc interface to process NewSegment And FlushSegmentCompleted ( #6247 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-01 14:58:17 +08:00
xige-16
5417fee45f
fix releasePartition not work after loadCollection ( #6025 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-23 17:44:12 +08:00
sunby
46f86a0354
Return sealed segments when calling flush ( #6011 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-23 16:56:11 +08:00
Cai Yudong
7dbf33b788
Update component names in config files ( #5989 )
...
* rename master/indexService in .yaml
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename proxyNode to proxy in config files
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move proto/query_service.proto to proto/query_coord.proto
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move proxy_node_manager.go to proxy_manager.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add query_coord.pb.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ci
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 19:08:03 +08:00
xige-16
2af1c27811
Rename queryservice to querycoordinator ( #5931 )
...
* Rename queryservice to querycoordinator
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix param table
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix unittest
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* service to coordinator
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* code format
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* set querycoord in ci
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-22 16:44:09 +08:00
Cai Yudong
d5f4ee6f44
Rename proto master/index_service/proxy_service ( #5973 )
...
* rename proto proxy_service to proxy
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename proto index_service to index_coord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename proto master to root_coord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-22 16:14:09 +08:00
sunby
7f2d7c1da3
Rename dataservice to datacoordinator ( #5912 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 18:22:13 +08:00
sunby
0300b682f8
Remove deprecated interfaces in data coordinator ( #5929 )
...
* Remove derecated interfaces in data coordinator
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Remove RegisterNode in data coordinator
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 17:40:05 +08:00
Cai Yudong
92e429d812
Rename IndexService to IndexCoord ( #5932 )
...
* rename package indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix queryservice static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move distributed/indexservice to distributed/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move internal/indexservice to internal/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename MasterComponent to RootCoordComponent
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for queryservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for dataservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for datanode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for proxynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for querynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix rebase issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-21 17:28:03 +08:00
neza2017
b2908c4780
Release collection ( #5839 )
...
* relese collection
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* gen-proto
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* release collection
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* release collection
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-17 17:45:56 +08:00
Cai Yudong
ae3daff5e4
Rename Master to RootCoord ( #5830 )
...
* rename master_service.go to root_coordinator.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coordinator under cmd
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord under cmd
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord for metrics
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord for masterservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix metrics unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* roll back cmd
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-17 16:47:57 +08:00
zhenshan.cao
f74ea3beee
[skip ci] Remove ProxyService ( #5738 )
...
* [skip ci] Remove ProxyService
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Change helm branch
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fix bug: paramstable crashed
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:36:35 +08:00
Cai Yudong
a948b71e06
Support to send dd msg to all dml channels ( #5597 )
...
* send dd msg to dml channel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add dml_channels.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix race
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-15 16:04:48 +08:00
Cai Yudong
2cc330b117
Remove proxy service from master ( #5510 )
...
* remove proxy service
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* remove time sync
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* remove proxy service
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* remove proxy service
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* remove proxy service
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* remove proxy service from distributed/masterservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-15 15:59:04 +08:00
sunby
a14c35274f
Fix bugs in dataservice ( #5457 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-15 15:59:04 +08:00
XuanYang-cn
55eac3ee7f
Complete Flush procedure in DataNode ( #5454 )
...
* Complete Flush proceduer in DataNode
Resolves : #5220
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix unittest
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-06-15 15:59:04 +08:00
bigsheeper
cdbc6d2c94
Refactor query node and query service ( #5751 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-15 12:41:40 +08:00
sunby
50b3d39370
Add GetRecoveryInfo interface and proto ( #5598 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-07 14:16:36 +08:00
cai.zhang
a606ab9c67
Add power-off restart logic for IndexService and IndexNode ( #5395 )
...
Add power-off restart logic for IndexService and IndexNode
Signed-off-by: <xiaocai2333> <cai.zhang@zilliz.com>
2021-05-27 14:24:29 +00:00
neza2017
f80dbab6ec
watch proxynode ( #5424 )
...
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
Resolves : #5423
2021-05-26 12:14:30 +00:00
neza2017
c28c34e852
let master use session.ServerID as nodeID ( #5385 )
...
let master use session.ServerID as nodeID
also see #5386
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-25 07:06:05 +00:00
Cai Yudong
761350e44d
Refactor timetick msg handling between proxy node and master ( #5321 )
...
Proxy node send channel timetick msg to master, master reduce timetick
msg for each channel and send the min timetick to msg stream.
Resolves : #5276
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-21 08:08:12 +00:00
neza2017
ada58b5bde
add unit test for master's grpc server, the coverage of package "internal/distributed/masterservice" increase from 46.6% to 82.9% ( #5019 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-24 09:23:35 +00:00
Xiangyu Wang
82ccd4cec0
Rename module ( #4988 )
...
* Rename module
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
zhenshan.cao
b1f664d04f
Add copyright
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-04-19 15:15:33 +08:00
godchen
f3649f0419
Refactor interface and proto
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
sunby
aeb3038545
Remove GetCount in data service
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-08 10:49:44 +08:00
ThreadDao
7a3223dc81
tags collection stats
...
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-08 10:09:48 +08:00
yukun
33d8e13f96
Fix load-collection in singlenode
...
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-03-05 18:14:59 +08:00
XuanYang-cn
a5c6f40c60
Enable tests in test_index.py
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-05 15:21:33 +08:00