test/milvus
1
0
Fork 0
mirror of https://gitee.com/milvus-io/milvus.git synced 2024-12-04 21:09:06 +08:00
Code Issues Actions 14 Packages Projects Releases Wiki Activity
14,577 Commits 96 Branches 105 Tags 186 MiB
7017756601
Commit Graph

191 Commits

Author SHA1 Message Date
edward.zeng
a92a6f34b4
[skip ci] Fix typo in etcd kv comment (#12091) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-18 19:25:19 +08:00
edward.zeng
77264ae493
[skip ci] Refine etcd kv comment (#12090) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-18 19:23:25 +08:00
yukun
3b51232d59
[skip ci]Format rocksdbkv (#12034) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-17 22:03:24 +08:00
yukun
18b9f7810c
[skip ci]Format rocksdbkv (#12033) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-17 22:01:31 +08:00
congqixia
b7de3bda3b
Fix mem_kv.go slice 0 length declaration (#11996) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-17 20:57:17 +08:00
edward.zeng
2b566eb622
[skip ci] Refine comments in mem kv (#12006) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-17 19:27:27 +08:00
edward.zeng
bcb7cce026
[skip ci] Refine comment in minio kv (#12004) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-17 19:25:20 +08:00
edward.zeng
776a01b5b9
[skip ci] Add comment to embed etcd kv (#12003) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-11-17 19:23:25 +08:00
shaoyue
6e5334ab11
[skip ci] Add comments for exported funcs in mem_kv.go (#11979) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-17 16:11:16 +08:00
shaoyue
585d9be439
[skip ci] Add comments for exported funcs in etcd_kv.go (#11975) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-17 16:09:23 +08:00
shaoyue
6542b092b2
[skip ci] Add comments of exported items in etcd_kv.go (#11884) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-16 17:41:11 +08:00
Xiangyu Wang
12f50cb22c
[skip ci]Update OWNERS files (#11898) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-16 15:41:11 +08:00
shaoyue
53c29088b0
[skip ci] Add comment for exported funcs in mem_key.go (#11877) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-16 13:23:10 +08:00
yukun
5e19629b3b
[skip ci]Format rocksdbkv (#11854) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-16 09:23:45 +08:00
yukun
36966504b1
[skip ci]Format rocksdbkv (#11853) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-16 09:21:48 +08:00
yukun
8593d75fd1
[skip ci]Format rocksdbkv (#11852) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-11-16 09:19:55 +08:00
XuanYang-cn
72c0711919
Refine minio kv test (#11255) 
This PR refines the minio_kv_test, makes sure the minIO test
is in the scope of configed rootPath

See also: #11237

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-05 23:05:10 +08:00
Xiaofan
2b0f1a14ac
Remove secretkey and accesskey log print for MinIO (#11130) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-03 13:04:09 +08:00
dragondriver
232f75a001
[skip ci] Fix golint warning of kv (#11087) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-02 21:40:12 +08:00
dragondriver
c208363b0d
[skip ci] Fix golint warning of MinIOKV (#10913) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-29 17:51:28 +08:00
XuanYang-cn
41f1378a01
[skip ci]Update license for kv kv (#10896) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-29 13:15:04 +08:00
XuanYang-cn
848fa77d13
[skip ci]Update license for kv rocksdb (#10895) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-29 13:13:15 +08:00
XuanYang-cn
005d177f68
[skip ci]Update license for kv etcdkv (#10894) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-29 13:11:24 +08:00
XuanYang-cn
978229517d
[skip ci]Update license for kv mem (#10893) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-29 13:09:33 +08:00
XuanYang-cn
08cd25c14f
[skip ci]Update license for kv minio (#10892) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-29 13:07:43 +08:00
XuanYang-cn
8885c510ef
[skip ci]Update license for kv etcd (#10891) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-29 12:12:44 +08:00
congqixia
95b8953bac
Add kv Value interface (#10469) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-29 00:16:38 +08:00
zhenshan.cao
5320698e29
[skip ci]Fix golint error in mem_kv (#10862) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-28 23:54:55 +08:00
zhenshan.cao
25551ffa2f
[skip ci]Fix golint error in memory_kv (#10861) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-28 23:42:39 +08:00
Xiaofan
93f205b49e
Rename param names (#10853) 
* Rename param names

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

* Rename configs

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-28 23:16:40 +08:00
BIKI DAS
1f2f76789e
Combined function params (#10786) 
Signed-off-by: Biki-das <bikid475@gmail.com>
 2021-10-28 15:58:29 +08:00
zhenshan.cao
d598c78bbf
[skip ci]Fix golint error in minio_kv (#10702) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-26 22:42:25 +08:00
zhenshan.cao
dcac9c71b1
[skip ci]Fix golint error in minio_kv (#10701) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-26 22:40:34 +08:00
zhenshan.cao
4ca4c81ce3
[skip ci]Fix golint error in minio_kv (#10700) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-26 22:38:44 +08:00
zhenshan.cao
58d202f200
[skip ci]Fix golint error in minio_kv (#10699) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-26 22:36:53 +08:00
cai.zhang
5b42a3223c
Increase compatibility for EstimateMemorySize interface (#10603) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-10-26 15:34:21 +08:00
congqixia
ed2b8d67c0
Reduce info saved in SnapshotMeta (#10288) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-21 14:04:36 +08:00
godchen
8daeb0d519
Change bloom filter use pk (#10193) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-19 20:18:47 +08:00
zhenshan.cao
e97b62cf67
Change RocksDBLRUCache size to 0 (#9820) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-13 20:28:34 +08:00
Cai Yudong
c7566345eb
Simplify meta_snapshot interface (#9778) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 15:54:33 +08:00
dragondriver
41bd866ff6
Support LoadPartial interface for DataKV (#9554) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-09 19:33:03 +08:00
yukun
a6e97e0d44
Change LRUCache size of rocksdb to 512MB (#9509) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-09 11:08:56 +08:00
yukun
d9115fe78d
Set PinL0FilterAndIndexBlocksInCache to true for rocksdb (#8855) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-10-08 10:19:06 +08:00
zhenshan.cao
405fe29b0b
[skip ci] fix golint error in metakv_factory.go (#9152) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-03 20:52:20 +08:00
yukun
2e77c1d1cd
Format rocksdb_kv code (#8982) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-30 22:40:14 +08:00
yukun
e85cbea18d
Set CacheIndexAndFilterBlocks to true for rocksdb (#8851) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-29 18:45:59 +08:00
godchen
167069c810
[skip ci]Add kv comment (#8880) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-29 18:39:59 +08:00
yukun
c438001a62
Fix rocksdb_kv value free (#8798) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-28 22:34:04 +08:00
yukun
7c2729916b
Fix rocksdb_kv error process (#8744) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-28 20:36:04 +08:00
yukun
93fa86daf2
Fix rocksdb_kv memory leak (#8743) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-28 19:36:04 +08:00
yukun
aea7cc1630
Add rocksdb_kv ut (#8769) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-28 17:48:08 +08:00
ZhiShen
0e767f0e1b
Change cmake version (#8666) 
Change cmake version from 3.16 to 3.18

1. Change the CMakeList's minimum require version.

2. Change the describtion document of cmake version.

Resolves: milvus-io#8407

Signed-off-by: Shen Zhi <m13120163046@163.com>
 2021-09-28 14:00:03 +08:00
Xiangyu Wang
ea53d52dba
Fix golint warnings in rockskv (#8723) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-28 08:28:02 +08:00
cai.zhang
171f362b86
Use recursion to delete objects in minio (#8671) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-27 16:20:06 +08:00
groot
e4e762f2e8
Reduce go unittest time cost (#8503) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-26 12:50:24 +08:00
Xiaofan
2f92f78e7b
Remove meaningless Etcd kv logs (#8019) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-22 20:27:54 +08:00
yukun
06c9f03c59
Refactor rocksmq close logic and improve codecov (#8278) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-22 17:21:00 +08:00
godchen
c8c10bb3d6
Remove performanceTest (#8164) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-18 10:13:52 +08:00
godchen
74bb712527
[skip ci]Add minio comment (#8165) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-17 23:59:47 +08:00
yukun
5a303e7672
Fix rocksmq load with prefix (#7678) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-09-10 10:22:01 +08:00
sunby
62f4cb5e1b
Remove stats watcher (#7501) 
issue: #7500
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-07 16:11:07 +08:00
dragondriver
960741ee16
Support more detailed metrics information (#7472) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 19:35:47 +08:00
zhenshan.cao
7c60e6aa00
Avoid port conflicts between embedded etcd and external etcd (#7320) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-08-27 10:13:57 +08:00
Xiangyu Wang
c62f23e201
[skip ci]Remove neza2017 from reviewers (#7324) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-27 00:27:36 +08:00
sunby
4d56d53c0b
Add a tool to move binlog path to SegmentInfo (#7243) 
issue: #7214
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-24 15:51:51 +08:00
Xiaofan
58b2089692
Import Embedded Etcd Kv Part 1(#7112) (#7174) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-08-24 09:45:51 +08:00
XuanYang-cn
9e71daa759
Fix rocksdb not installed problem (#7200) 2021-08-20 17:46:48 +08:00
Cai Yudong
305fa9c17e
Fix timestamp go back issue for timeticksync (#7123) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-18 14:36:10 +08:00
yukun
847586eb95
Add rocksmq retention (#6617) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-08-16 18:46:10 +08:00
XuanYang-cn
6c5be83ea1
Refactor NewEtcdKV API (#7075) 
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-08-13 11:04:09 +08:00
Xiangyu Wang
5e78fd6a97
[skip ci]Update approvers (#7063) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-12 19:36:09 +08:00
congqixia
4d5eeb2890
Fix minio object leaking goroutine (#6944) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-02 15:25:24 +08:00
neza2017
5adb69161f
Set CollectionInfo.CreateTime to the timestamp when save the metadata into etcd, (#6763) 
not the timestamp when RootCoord receive the CreateCollection Request

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-23 14:36:12 +08:00
cai.zhang
a3c662c7bf
Add watchWithVersion interface for etcdKV (#6663) 
* Add watchWithVersion interface for etcdKV

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Add unittest

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Add LoadWithVersion interface

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-21 18:20:11 +08:00
godchen
b9f5949680
Add vector chunk manager (#6613) 
* add file manager

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* add file manager

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* add vector file manager

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* rename

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix ut error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix action error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix memory error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-07-20 15:06:09 +08:00
cai.zhang
f3a5b46288
Fix bug for repeatedly create bucket in minio (#6477) 
* Fix bug for repeatedly create bucket in minio

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Simplify code

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>

* Add log

Signed-off-by: xiaocai2333 <cai.zhang@zilliz.com>
 2021-07-14 09:55:46 +08:00
godchen
346e9cba4a
Add minio FGet method (#6386) 
* Add minio FGet method

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change el append

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-07-09 11:44:40 +08:00
quicksilver
7d920e9c9c
Fix compile error on CentOS (#6359) 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-07-08 15:43:45 +08:00
godchen
99be4c09a5
change retry (#5996) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 09:24:10 +08:00
Cai Yudong
0f4bd50ce3 Support ETCD endpoints array (#5755) 2021-06-15 16:36:36 +08:00
congqixia
7beab6eddc Fix new miniokv retry logic (#5749) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-15 16:36:36 +08:00
godchen
0610ceb3dc
Fix ut error (#5573) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-03 18:44:33 +08:00
Xiangyu Wang
ca0993c274 Update OWNERS 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-05-30 18:58:47 +08:00
cai.zhang
a606ab9c67
Add power-off restart logic for IndexService and IndexNode (#5395) 
Add power-off restart logic for IndexService and IndexNode


Signed-off-by: <xiaocai2333> <cai.zhang@zilliz.com>
 2021-05-27 14:24:29 +00:00
neza2017
c0daf8e41d
set timestamp on dd requests (#5298) 
- set dd request's time tick on master
- send time tick into dd channel

See also: #5291

Signed-off-by: yefu.chen yefu.chen@zilliz.com
 2021-05-20 06:14:14 +00:00
godchen
ccc0130bb4
Add exclusive parameter (#5278) 
Add exclusive parameter.
Issue #5174 

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-18 11:07:27 +00:00
neza2017
49f6542b1d
query master service's with timestamp (#5275) 
let meta support snapshot
so collection could query meta with timestamp

Resolves: #5219

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-05-18 06:18:02 +00:00
godchen
cca75583a6
Add session util (#5269) 
Add session util.
Issue #5174 

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-18 03:39:21 +00:00
godchen
b74afd7a0e
Add service registration (#5189) 
Add service registration.
Part of Issue #5174.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-05-14 02:05:18 +00:00
Xiangyu Wang
82ccd4cec0
Rename module (#4988) 
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-04-22 14:45:57 +08:00
godchen
139b334732
Add kv etcd unittest and remove useless code (#4974) 
* Add kv etcd unittest and remove useless code

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-04-21 18:45:35 +08:00
yukun
89c4bf82a0 Add copyright in kv module 
Signed-off-by: kun yu <kun.yu@zilliz.com>
 2021-04-19 11:13:52 +08:00
godchen
deba964590 Change name of kvBase 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-04-12 18:09:28 +08:00
sunby
751c9d4e81 Refactor meta.go 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-04-09 09:55:04 +08:00
sunby
1d7195e036 Add minio and etcd stats watcher 
Our system needs to watch the performance of etcd and minio. For now I just add the creation stats.

Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-04-08 14:14:43 +08:00
zhenshan.cao
9c574b7c7b Update sdk version to 0.0.55 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-03-23 18:40:08 +08:00
紫晴
3be6dde459 Add smoke tag 
Signed-off-by: 紫晴 <ting.wang@zilliz.com>
 2021-03-23 14:35:30 +08:00
zhenshan.cao
c2734fa55f Fix bug and enchance system 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-03-22 16:36:10 +08:00
sunby
6287ffa1b4 Replace log with zap 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-03-11 14:15:18 +08:00
neza2017
efa7306ef6 Remove with prefix 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-03-06 16:00:41 +08:00