Commit Graph

147 Commits

Author SHA1 Message Date
Xiaofan
0f65b845d2
Refine Index Create Log (#9233)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-07 22:20:50 +08:00
Xiaofan
d23f9a6d82
Remove unnessary const in index param table (#9052)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-06 22:41:58 +08:00
zhenshan.cao
e86a236e83
[skip ci] Fix golint error in indexnode (#9284)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-05 21:14:03 +08:00
cai.zhang
2640dfebc6
[skip ci]Fix golint in indexnode/indexnode_mock.go (#9120)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-05 20:35:35 +08:00
congqixia
3939197d79
Add IndexNode implementation Assertion (#9202)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-04 17:24:38 +08:00
cai.zhang
96823eb7db
[skip ci]Fix golint in indexnode/indexnode.go (#9118)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-03 10:19:57 +08:00
cai.zhang
4ec9937998
[skip ci]Fix golint in indexnode/task_scheduler.go (#9117)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-03 10:15:56 +08:00
Xiaofan
a0d3450457
Refine indexnode logs (#8991)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-01 11:51:41 +08:00
cai.zhang
a4328617ad
[skip ci]Fix golint in indexnode/index.go (#8977)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-01 11:39:17 +08:00
cai.zhang
fcdb79ffe8
[skip ci]Fix golint in indexnode/param_table.go (#8975)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-01 11:24:43 +08:00
Xiaofan
2c2b800ff4
Change Log Name with NodeId (#8721)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-01 08:52:50 +08:00
dragondriver
a10f421c14
Get SIMD type used in faiss (#8849)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-29 20:50:19 +08:00
zhenshan.cao
d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-29 20:26:00 +08:00
dragondriver
cf8600077f
Refactor the index file format (#8514)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-29 09:52:12 +08:00
XuanYang-cn
3be6672753
Add flush channel for delete_node (#8762)
Resolves: #8761

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-28 18:22:16 +08:00
Xiaofan
585989935a
Revert the logger change (#8677)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-27 17:37:57 +08:00
Xiaofan
55f8baa6cc
[skip ci]Remove unnecessary log in index (#8630)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-26 22:03:58 +08:00
cai.zhang
df30315144
Standard indexnode log printing (#8587)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-26 21:22:04 +08:00
Xiaofan
d38adda8c2
Rename log file based on node id (#8517)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-26 21:18:11 +08:00
cai.zhang
0fa38d5d93
Add root path for index files in minio (#8212)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-26 19:19:57 +08:00
dragondriver
68b9da219a
Expose created time and updated time to indexnode metrics (#8592)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-26 17:56:08 +08:00
groot
e4e762f2e8
Reduce go unittest time cost (#8503)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-26 12:50:24 +08:00
cai.zhang
93c912e681
Start once for IndexNode (#8170)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-24 20:37:56 +08:00
cai.zhang
1d16930a03
Init once for indexnode (#8027)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-23 21:27:54 +08:00
XuanYang-cn
2b82482679
Fix golint and ruleguard (#8347)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-23 19:14:01 +08:00
congqixia
da6d93527d
Add session liveness check (#8408)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-23 18:29:55 +08:00
dragondriver
fb98f06de8
Expose simd type to index node metrics (#8300)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-23 11:29:54 +08:00
Xiaofan
f5173b595f
Add a channel prefix for all channels (#8166)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-23 10:53:53 +08:00
dragondriver
78fe530d87
Initialize the simd type when initialize an indexnode (#8276)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-22 16:05:59 +08:00
Xiaofan
0c35cd57b0
Unify param table to the same naming format (#8254)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-20 23:27:52 +08:00
Xiangyu Wang
c314b2b4a8
Remove unused label rules (#7929)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-18 18:19:51 +08:00
cai.zhang
a6b6d16381
Delete unused code in indexnode (#8169)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-18 11:05:50 +08:00
cai.zhang
8d5dc5ba07
Add comment for CreateIndex in indexnode (#8168)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-18 00:01:51 +08:00
cai.zhang
fa00f1f48a
It is also correct to get the failed index status in indexcoord ut (#8059)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-16 19:56:41 +08:00
cai.zhang
4814f9cb1c
Add opentrace log for index component (#7946)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-16 10:07:48 +08:00
cai.zhang
b965767e5c
Increase code coverage rate for indexcoord (#7857)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-14 14:09:48 +08:00
cai.zhang
63a83f027f
Reduce running unit test time for indexcoord (#7779)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-14 10:41:21 +08:00
cai.zhang
b1805d980c
Reduce running unit test time for indexnode (#7773)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-13 12:00:08 +08:00
cai.zhang
be9427e8b9
Increase covd coverage for paramtable (#7583)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-10 14:14:12 +08:00
cai.zhang
f6621dc847
Increase code coverage for indexnode component (#7520)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Co-authored-by: edward.zeng <jie.zeng@zilliz.com>
2021-09-09 17:09:08 +08:00
dragondriver
9b21b3b5fd
Initialize test framework of proxy (#7563)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-09 10:06:29 +08:00
cai.zhang
e1081b6783
Increase indexcoord component code coverage (#7558)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-08 14:23:59 +08:00
cai.zhang
e6e03fc93f
Add unittest for index component (#7475)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-06 17:54:41 +08:00
dragondriver
960741ee16
Support more detailed metrics information (#7472)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-03 19:35:47 +08:00
dragondriver
648d22ee40
Expose metrics of IndexCoord and IndexNodes (#7157)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-19 10:28:10 +08:00
cai.zhang
382fa6f274
IndexNode dose not need to wait for IndexCoord to start to comlete (#7074)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-08-13 18:12:08 +08:00
XuanYang-cn
6c5be83ea1
Refactor NewEtcdKV API (#7075)
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-13 11:04:09 +08:00
Xiangyu Wang
5e78fd6a97
[skip ci]Update approvers (#7063)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-12 19:36:09 +08:00
cai.zhang
d51fec6678
Enhance log when create index failed (#6871)
* Enhance log when create index failed

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Fix bug for repeatedly drop index

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
2021-07-29 14:47:22 +08:00
godchen
db94d7771f
Read vector from disk (#6707)
* Read vector from disk

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix git action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix test error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix caculate error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change var name

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix len error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove unused code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change bytes to float method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change float to bytes method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-07-24 09:25:22 +08:00