test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 12:59:23 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
16,434 Commits 96 Branches 105 Tags 185 MiB
ec282b1958
Commit Graph

296 Commits

Author SHA1 Message Date
Xiaofan
69087ff8dd
Support embedded etcd (#14333) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-12-29 14:35:21 +08:00
Xiaofan
1408926cd9
Remove logs without enough info (#14440) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-12-29 10:06:47 +08:00
edward.zeng
9977bea982
[skip e2e] Refine indexnode task scheduler comment (#14450) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-28 19:50:25 +08:00
xige-16
a8cb995216
Improve log for build index in indexNode (#14051) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-23 22:00:16 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components (#13885) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-23 18:39:11 +08:00
JackLCL
2c0d9397fb
[skip e2e]Fix error log output format in task.go (#14028) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-23 14:28:25 +08:00
cai.zhang
1dab9ccc7f
[skip e2e]Add commont for initMinIOAccessKeyID in indexnode (#13975) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-22 17:11:35 +08:00
cai.zhang
595692c350
[skip e2e]Add commont for initMinIOAddress in indexnode (#13973) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-22 17:03:43 +08:00
cai.zhang
9f23fc7f2a
Register the service when the component state is healthy (#13248) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-15 11:47:10 +08:00
JackLCL
7cb35e4172
[skip ci]Fix error log output format in task.go (#13102) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-09 19:45:28 +08:00
cai.zhang
342200ce13
Estimate the memory size of the index before building the index (#12973) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-09 14:19:40 +08:00
yanliang567
694e3f72a1
[skip ci]Refine etcd name in comments (#12798) 
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
 2021-12-06 18:59:55 +08:00
congqixia
38956215aa
Update indexnode state to unhealthy before stopping (#12744) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-06 10:39:36 +08:00
godchen
5e3e3b3b41
Remove grpc returned error (#12537) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-01 22:17:46 +08:00
jaime
90a1d016a0
Refine return value (#11730) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-30 19:32:17 +08:00
dragondriver
b6d0150dc5
Fix health check when disconnect to etcd (#12292) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-26 11:39:16 +08:00
dragondriver
6c4c0ef6b5
Add more deploy metrics (#12248) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-24 15:43:15 +08:00
godchen
9d5bcd3e3a
Close event and binlog reader (#12173) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-22 17:27:14 +08:00
congqixia
4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-22 16:23:17 +08:00
dragondriver
ee0f753f7a
Fix datarace between GetComponentStates and Register (#11935) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-19 13:57:12 +08:00
Baiqiang Zhao
ba9977951a
Fix log in indexnode (#11988) 
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
 2021-11-17 16:41:13 +08:00
congqixia
5edbb82610
Add session revoke (#11908) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-16 22:31:14 +08:00
Xiangyu Wang
12f50cb22c
[skip ci]Update OWNERS files (#11898) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-16 15:41:11 +08:00
Cai Yudong
95fff75dec
Use API HandleCStatus to handle CStatus returned by CGo in indexnode (#11788) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-15 15:27:10 +08:00
Xiaofan
5f08b67156
Move node.yaml to component.yaml (#11363) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-10 14:27:37 +08:00
XuanYang-cn
35e8779bd9
Rename IndexRootPath to IndexStorageRootPath (#11236) 
IndexRootPath is index file's blob storage prefix.
But the name is confusing with the MetaRootPath, which is prefix of etcd.

This PR changes the IndexRootPath to IndexStorageRootPath to
elimilate the confusion.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-05 11:45:00 +08:00
XuanYang-cn
a086042b45
[skip ci]Update in task (#11032) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-01 22:51:41 +08:00
XuanYang-cn
41e720aad8
[skip ci]Update license for in pt (#11031) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-01 22:49:57 +08:00
XuanYang-cn
e6a87ba94f
[skip ci]Update license for in in (#11030) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-01 22:48:06 +08:00
XuanYang-cn
8566d64f4a
[skip ci]Update license for in errors (#11028) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-01 22:46:00 +08:00
Xiaofan
385eed1d17
Remove knowhere config (#10614) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-01 10:26:03 +08:00
Xiaofan
2df2d488e1
Fix Unit test fatal fail (#10933) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-30 10:24:38 +08:00
godchen
bdbe9067f2
Check indexnode mock error (#10204) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-29 11:48:39 +08:00
Xiaofan
93f205b49e
Rename param names (#10853) 
* Rename param names

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

* Rename configs

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-28 23:16:40 +08:00
godchen
92dfacc2d7
Check index node test error (#10205) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-28 17:24:29 +08:00
Xiaofan
6fddcb3925
Fix Session checker for proxy (#10737) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-27 21:58:33 +08:00
cai.zhang
aff5cd9598
Supprot to read the configuration of minio from environment variables (#10534) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-26 15:10:03 +08:00
zhenshan.cao
83684628b2
Fix bug:Index building task canceled by indexcoord by mistake (#10314) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-20 21:02:35 +08:00
groot
d33e810aa1
[skip ci] Fix a typo (#10155) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-19 16:24:35 +08:00
congqixia
ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order (#9860) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-14 16:40:35 +08:00
dragondriver
72d3d470ba
Use the server id as identifier in system topology graph (#9825) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-14 11:12:38 +08:00
Xiaofan
91d8f85df7
Refine log in task.go (#8992) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-13 23:24:32 +08:00
NotRyan
539fac4f83
Log language changes in Indexnode (#9692) 
Signed-off-by: NotRyan <ryan.chan@zilliz.com>

Co-authored-by: NotRyan <ryan.chan@zilliz.com>
 2021-10-13 10:54:33 +08:00
cai.zhang
6938e7b8e6
[skip ci]Fix golint in indexnode/param_table.go (#9629) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-11 19:17:02 +08:00
cai.zhang
7801357dd3
Retry index building task in case of internal error such as minio failure (#9552) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-11 16:38:33 +08:00
cai.zhang
6b58c5930e
[skip ci]Fix golint for BaseTask in indexnode.go (#9495) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-09 18:27:00 +08:00
cai.zhang
e368b51d3e
[skip ci]Fix golint for task executing in indexnode.go (#9494) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-09 18:24:58 +08:00
godchen
faac37e726
Remove index registration after ut (#9558) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-09 15:47:00 +08:00
cai.zhang
3b7b10c18e
[skip ci]Fix golint for IndexBuildTask in indexnode.go (#9493) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-09 00:05:49 +08:00
Xiaofan
0f65b845d2
Refine Index Create Log (#9233) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-07 22:20:50 +08:00
Xiaofan
d23f9a6d82
Remove unnessary const in index param table (#9052) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-06 22:41:58 +08:00
zhenshan.cao
e86a236e83
[skip ci] Fix golint error in indexnode (#9284) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-05 21:14:03 +08:00
cai.zhang
2640dfebc6
[skip ci]Fix golint in indexnode/indexnode_mock.go (#9120) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-05 20:35:35 +08:00
congqixia
3939197d79
Add IndexNode implementation Assertion (#9202) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-04 17:24:38 +08:00
cai.zhang
96823eb7db
[skip ci]Fix golint in indexnode/indexnode.go (#9118) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-03 10:19:57 +08:00
cai.zhang
4ec9937998
[skip ci]Fix golint in indexnode/task_scheduler.go (#9117) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-03 10:15:56 +08:00
Xiaofan
a0d3450457
Refine indexnode logs (#8991) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-01 11:51:41 +08:00
cai.zhang
a4328617ad
[skip ci]Fix golint in indexnode/index.go (#8977) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-01 11:39:17 +08:00
cai.zhang
fcdb79ffe8
[skip ci]Fix golint in indexnode/param_table.go (#8975) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-01 11:24:43 +08:00
Xiaofan
2c2b800ff4
Change Log Name with NodeId (#8721) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-01 08:52:50 +08:00
dragondriver
a10f421c14
Get SIMD type used in faiss (#8849) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-29 20:50:19 +08:00
zhenshan.cao
d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-29 20:26:00 +08:00
dragondriver
cf8600077f
Refactor the index file format (#8514) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-29 09:52:12 +08:00
XuanYang-cn
3be6672753
Add flush channel for delete_node (#8762) 
Resolves: #8761

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-28 18:22:16 +08:00
Xiaofan
585989935a
Revert the logger change (#8677) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-27 17:37:57 +08:00
Xiaofan
55f8baa6cc
[skip ci]Remove unnecessary log in index (#8630) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-26 22:03:58 +08:00
cai.zhang
df30315144
Standard indexnode log printing (#8587) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-26 21:22:04 +08:00
Xiaofan
d38adda8c2
Rename log file based on node id (#8517) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-26 21:18:11 +08:00
cai.zhang
0fa38d5d93
Add root path for index files in minio (#8212) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-26 19:19:57 +08:00
dragondriver
68b9da219a
Expose created time and updated time to indexnode metrics (#8592) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-26 17:56:08 +08:00
groot
e4e762f2e8
Reduce go unittest time cost (#8503) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-26 12:50:24 +08:00
cai.zhang
93c912e681
Start once for IndexNode (#8170) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-24 20:37:56 +08:00
cai.zhang
1d16930a03
Init once for indexnode (#8027) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-23 21:27:54 +08:00
XuanYang-cn
2b82482679
Fix golint and ruleguard (#8347) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-09-23 19:14:01 +08:00
congqixia
da6d93527d
Add session liveness check (#8408) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-23 18:29:55 +08:00
dragondriver
fb98f06de8
Expose simd type to index node metrics (#8300) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-23 11:29:54 +08:00
Xiaofan
f5173b595f
Add a channel prefix for all channels (#8166) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-23 10:53:53 +08:00
dragondriver
78fe530d87
Initialize the simd type when initialize an indexnode (#8276) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-22 16:05:59 +08:00
Xiaofan
0c35cd57b0
Unify param table to the same naming format (#8254) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-20 23:27:52 +08:00
Xiangyu Wang
c314b2b4a8
Remove unused label rules (#7929) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-18 18:19:51 +08:00
cai.zhang
a6b6d16381
Delete unused code in indexnode (#8169) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-18 11:05:50 +08:00
cai.zhang
8d5dc5ba07
Add comment for CreateIndex in indexnode (#8168) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-18 00:01:51 +08:00
cai.zhang
fa00f1f48a
It is also correct to get the failed index status in indexcoord ut (#8059) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-16 19:56:41 +08:00
cai.zhang
4814f9cb1c
Add opentrace log for index component (#7946) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-16 10:07:48 +08:00
cai.zhang
b965767e5c
Increase code coverage rate for indexcoord (#7857) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-14 14:09:48 +08:00
cai.zhang
63a83f027f
Reduce running unit test time for indexcoord (#7779) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-14 10:41:21 +08:00
cai.zhang
b1805d980c
Reduce running unit test time for indexnode (#7773) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-13 12:00:08 +08:00
cai.zhang
be9427e8b9
Increase covd coverage for paramtable (#7583) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-10 14:14:12 +08:00
cai.zhang
f6621dc847
Increase code coverage for indexnode component (#7520) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Co-authored-by: edward.zeng <jie.zeng@zilliz.com>
 2021-09-09 17:09:08 +08:00
dragondriver
9b21b3b5fd
Initialize test framework of proxy (#7563) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-09 10:06:29 +08:00
cai.zhang
e1081b6783
Increase indexcoord component code coverage (#7558) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-08 14:23:59 +08:00
cai.zhang
e6e03fc93f
Add unittest for index component (#7475) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-06 17:54:41 +08:00
dragondriver
960741ee16
Support more detailed metrics information (#7472) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 19:35:47 +08:00
dragondriver
648d22ee40
Expose metrics of IndexCoord and IndexNodes (#7157) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-19 10:28:10 +08:00
cai.zhang
382fa6f274
IndexNode dose not need to wait for IndexCoord to start to comlete (#7074) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-08-13 18:12:08 +08:00
XuanYang-cn
6c5be83ea1
Refactor NewEtcdKV API (#7075) 
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-08-13 11:04:09 +08:00
Xiangyu Wang
5e78fd6a97
[skip ci]Update approvers (#7063) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-12 19:36:09 +08:00
cai.zhang
d51fec6678
Enhance log when create index failed (#6871) 
* Enhance log when create index failed

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for repeatedly drop index

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-29 14:47:22 +08:00
godchen
db94d7771f
Read vector from disk (#6707) 
* Read vector from disk

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix git action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix test error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix caculate error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change var name

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix len error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change bytes to float method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change float to bytes method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-07-24 09:25:22 +08:00
dragondriver
2821c08560
Add unittests for metric_type: tanimoto (#6773) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-23 20:59:33 +08:00
cai.zhang
e1b52b0583
Add unittest for IndexCoord and IndexNode (#6698) 
* Add unittest for IndexCoord and IndexNode

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix verifiers

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-23 10:44:12 +08:00
cai.zhang
9aa56cd7b8
Add log for IndexCoord and IndexNode (#6597) 
* Add log for IndexCoord and IndexNode

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Make verifier

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Delete unused script

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-22 11:40:11 +08:00
cai.zhang
f469a315d6
Refactor the logic of assign tasks in IndexCoord (#6328) 
* Refactor the logic of assign tasks in IndexCoord

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bugs

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for unittest

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Add lock for map

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Improve code

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix unittest bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reduce duriation for timetick

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Update orm version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset sdk version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset orm version

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Reset test ip

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for unissued

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Rename some variables

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Use break instead of continue in select::case

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-14 14:15:55 +08:00
Cai Yudong
a7a9eeeffe
Add time record for build index and search process (#6231) 
* add timerecord for build index process

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add timerecord for query process

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-30 19:46:14 +08:00
neza2017
bf068d84ad
fix index coord (#6042) 
* fix index coord

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* remove memstream from RmsFactory

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-24 14:36:08 +08:00
godchen
99be4c09a5
change retry (#5996) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 09:24:10 +08:00
Cai Yudong
7dbf33b788
Update component names in config files (#5989) 
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 19:08:03 +08:00
Cai Yudong
92e429d812
Rename IndexService to IndexCoord (#5932) 
* rename package indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix queryservice static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/indexservice to distributed/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/indexservice to internal/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename MasterComponent to RootCoordComponent

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for queryservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for dataservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for datanode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for proxynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for querynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix rebase issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-21 17:28:03 +08:00
XuanYang-cn
ab7f642740
Add alias in paramtable (#5878) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-06-19 12:38:06 +08:00
zhenshan.cao
5c69c6902d Refactor proxy channelTimeTick and fix search timeout (#5760) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-15 16:36:36 +08:00
Cai Yudong
0f4bd50ce3 Support ETCD endpoints array (#5755) 2021-06-15 16:36:36 +08:00
zhenshan.cao
33a43f48c8 [skip ci] Fix bug: Search timeout and refactor client init logic (#5735) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-15 16:24:48 +08:00
zhenshan.cao
bc46e4780d
Fixbug:index is not loaded in some cases (#5633) 
* Fixbug:index is not created in some cases

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Delete unecessary print

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* fix create index

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-06 09:41:35 +08:00
zhenshan.cao
03e3b4beb4
Add log to startup process (#5594) 
* Add log to startup process

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fixbug: avoid ctx exceed deadline

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fmt code

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fix bug: wrong time unit

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Fixbug: datanservice client reconnect use time ctx

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-04 16:29:35 +08:00
FluorineDog
9a90313390
Support GetEntityByIDs in CGo, fix segcore bugs (#5563) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
 2021-06-04 10:38:34 +08:00
Xiangyu Wang
f791ccb246 Update OWNERS file 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-06-03 20:01:24 +08:00
zhenshan.cao
b0b8f58192
Fix bug: search timeout (#5557) 
* Fix bug: search timeout

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Add log and fix unittest bug

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-03 14:58:34 +08:00
zhenshan.cao
4af2cacb28
Refactor IndexService and IndexNode: remove redundant serviceID (#5491) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-05-31 10:32:30 +08:00
Xiangyu Wang
ca0993c274 Update OWNERS 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-05-30 18:58:47 +08:00
zhenshan.cao
67c4c915b7
Move debugging code of index query to a separate module (#5490) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-05-29 17:07:29 +08:00
cai.zhang
a606ab9c67
Add power-off restart logic for IndexService and IndexNode (#5395) 
Add power-off restart logic for IndexService and IndexNode


Signed-off-by: <xiaocai2333> <cai.zhang@zilliz.com>
 2021-05-27 14:24:29 +00:00
neza2017
f80dbab6ec
watch proxynode (#5424) 
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

Resolves: #5423
 2021-05-26 12:14:30 +00:00
neza2017
c28c34e852
let master use session.ServerID as nodeID (#5385) 
let master use session.ServerID as nodeID

also see #5386 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-05-25 07:06:05 +00:00
neza2017
e326eaad1e
master client,reconnect if grpc failed (#5360) 
master client,reconnect if grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-05-24 01:44:49 +00:00
godchen
0eee7e5252
Change session (#5329) 
Change session.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-21 11:28:52 +00:00
godchen
e224d1e725
Add SessionManager (#5288) 
Add SessionManager.
Resolves: #5174 

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-19 10:36:05 +00:00
godchen
b74afd7a0e
Add service registration (#5189) 
Add service registration.
Part of Issue #5174.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-14 02:05:18 +00:00
Xiangyu Wang
82ccd4cec0
Rename module (#4988) 
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-04-22 14:45:57 +08:00
cai.zhang
8a037a404e Add Copyright for indexnode and indexservice 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-04-19 13:50:12 +08:00
cai.zhang
a54097708d Adjust the DropIndex logic of the indexservice 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-04-16 15:37:13 +08:00
godchen
deba964590 Change name of kvBase 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-04-12 18:09:28 +08:00
dragondriver
41e1975611 Parallelize the processing of loading binlog and saving index files 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-03-26 11:19:02 +08:00
cai.zhang
30cc84b164 Add more log for indexservice and indexnode 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-03-26 10:01:08 +08:00
bigsheeper
1634d75980 Release flowgraph properly 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-03-22 12:49:50 -05:00
zhenshan.cao
c2734fa55f Fix bug and enchance system 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-03-22 16:36:10 +08:00
cai.zhang
012f5f360e Add init log logic for index and proxy 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-03-12 19:47:37 +08:00
godchen
f3649f0419 Refactor interface and proto 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-03-12 14:22:09 +08:00
xige-16
09ae985daa Fix wrong error code in master_service_test.go 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-03-10 22:06:22 +08:00
del-zhenwu
b1763c3690 Disable xdist in test cases 
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
 2021-03-10 15:27:26 +08:00
cai.zhang
60b97f9b65 Replace log of indexnode and indexservice 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-03-10 09:56:09 +08:00
quicksilver
455cc59dbb Update publish-test-images.yaml 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-03-09 13:55:35 +08:00
sunby
ab21115d54 Init rand.Seed 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-03-08 15:25:55 +08:00
ThreadDao
7a3223dc81 tags collection stats 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2021-03-08 10:09:48 +08:00
zhenshan.cao
ce5d7c7ecc Change retry times and sleep duration 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-03-06 11:52:43 +08:00
quicksilver
74154a11a4 Fix deploy error during regression stage 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-03-05 16:52:45 +08:00
sunby
ddddd65d10 Delete internal/errors package 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-03-05 10:15:27 +08:00
godchen
3ba0dc2f44 Change doc 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-03-04 10:35:28 +08:00
zhenshan.cao
966cf42b54 Enable indexnode to build index asynchronously 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-27 10:45:03 +08:00
godchen
7b9fdd7f29 Add opentracing 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-02-26 17:44:24 +08:00
cai.zhang
f5977a1302 Change retry times and add retry logic 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-02-26 15:17:47 +08:00