Commit Graph

7805 Commits

Author SHA1 Message Date
Xiangyu Wang
a0faf3d0d1
[skip ci]Add yanliang567 into pr-inspection (#7097)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-13 17:56:08 +08:00
binbin
5e9110c841
Disable test cases (#7087)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2021-08-13 15:52:09 +08:00
XuanYang-cn
86ca96a02e
Fix master branch unittest error (#7083)
Resolves: #7080

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-13 14:00:14 +08:00
XuanYang-cn
6c5be83ea1
Refactor NewEtcdKV API (#7075)
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-13 11:04:09 +08:00
congqixia
e1b3273d1c
Add Datanode watch etcd channel (#6965)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-13 10:50:09 +08:00
sunby
5c383d1d02
Add a checker to listen for the timetick. (#7061)
issue: #7060
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-12 19:58:08 +08:00
Xiangyu Wang
5e78fd6a97
[skip ci]Update approvers (#7063)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-12 19:36:09 +08:00
binbin
3c6a807fd2
Add, enable and xfail test cases (#7071)
* Add, enable and xfail test cases

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

* Modify the test case label

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2021-08-12 18:12:10 +08:00
groot
d9a5ca645a
[skip ci] Fix bootcamp link error (#7072)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-08-12 18:10:10 +08:00
Cai Yudong
6c75301c70
optimize search reduce logic (#7066)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-12 18:00:11 +08:00
dragondriver
b3f10ae5cc
Fix 6990, enhance the log when parsing grpc recv/send parameters (#6993)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-12 16:16:09 +08:00
congqixia
3f21e3d062
Fix querynode tt producer leak (#7059)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-12 14:16:08 +08:00
bigsheeper
b9d3897deb
Return error when any failed detected in loadSegment (#7005)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-12 14:14:08 +08:00
Cai Yudong
85ea051ddc
change growing segment default value to -1 (#7054)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-12 12:32:07 +08:00
sunby
31182e52a9
Fix expire allocation bug (#7053)
issue: #7052
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-12 10:48:08 +08:00
ThreadDao
8bf4524f6f
[skip ci] Add part chaos experment pod failure and container kill (#7024)
* fix chaos checker

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* add chaos queryNode pod failure

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

* add datanode pod failure chaos experiment

add export pods logs func

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-08-12 10:22:08 +08:00
quicksilver
ecfebff801
Bumped milvus verison to 2.0.0-rc.4 (#7057)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-11 20:20:10 +08:00
godchen
7fc7623b92
Add vector data memroy existence check (#7044)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-11 19:50:09 +08:00
Cai Yudong
71d7f407d8
Design detail on meta snapshot (#7047)
* design detail on meta snapshot

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* rename milvus_flush_collections_en.md to milvus_meta_snapshot_en.md

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-08-11 16:28:09 +08:00
quicksilver
1fac193ef7
Fix etcd deployments bug with Docker compose (#7045)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-11 16:22:09 +08:00
quicksilver
e880e99cdc
Bumped milvus verison to 2.0.0-rc.3 (#7042)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-11 15:02:10 +08:00
XuanYang-cn
9d81a90402
Fix mem leak of flush cache in DataNode (#6862)
Resolves: #6858

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-11 14:24:09 +08:00
quicksilver
76b92c3b69
Upgrade ETCD version to 3.5.0 (#7041)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-11 11:50:11 +08:00
neza2017
351c9161c2
design detail of flush collection (#6821)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-08-11 11:49:55 +08:00
neza2017
0d55065193
design detail of create index (#6816)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-08-11 11:49:42 +08:00
neza2017
78dca398cb
update design detail of drop collection (#6802)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-08-11 11:49:29 +08:00
neza2017
a0b39cc08a
update design detail of "create collection" (#6795)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-08-11 11:49:15 +08:00
neza2017
67b3e6e2a1
timesync doc (#6783)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-08-11 11:48:48 +08:00
quicksilver
936c7e6b03
Update Milvus offline installation README (#7034)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-10 16:59:27 +08:00
yanliang567
51529a2638
[skip ci]Add levels for pymilvus tests (#7031)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-08-10 15:59:27 +08:00
quicksilver
17ac9ca07e
Update Milvus offline installation README (#7028)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-10 13:57:27 +08:00
groot
bdb8396e74
Fix CalcDistance wrong result when fetting vectors from collection (#6976)
* Fix CalcDistance wrong result when fetting vectors from collection

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* Fix CalcDistance wrong result when fetting vectors from collection

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* preset capacity

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* error check

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* code lint

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-08-10 11:59:28 +08:00
quicksilver
3c3975b5ef
Add Milvus offline installation README (#7026)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-10 11:41:27 +08:00
godchen
7557616fea
Change client timeout (#6982)
* Change client timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix conflicts

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-06 14:09:26 +08:00
congqixia
9eb35996b5
Fix pulsar consumer goroutine leakage (#7004)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-06 09:45:24 +08:00
quicksilver
2f5d78a596
Set KinD pod anti-affinity to requiredDuringSchedulingIgnoredDuringExecution (#7008)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-04 19:43:24 +08:00
sunby
454620dfaa
Add unit test in datacoord (#6985)
issue: #6984
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-04 16:59:25 +08:00
dragondriver
ad77a6e0d4
Fix #6859, increase the MaxCallRecvMsgSize and MaxCallSendMsgSize of grpc client (#6861)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-04 13:03:24 +08:00
quicksilver
0f76c23a8c
[skip ci] List all env properties within jenkins pipeline job (#6983)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-04 11:11:24 +08:00
bigsheeper
07cc449fbf
Fix data race in flow graph (#6946)
* Fix data race in flow graph

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* add cancel func to flowgraph

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-03 22:43:25 +08:00
xige-16
c8a1f780c1
Use proto marshal instead of MarshalTextString in querycoord (#6958)
* use proto marshal instead of marshalToText

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* log error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* don't retry after init meta/cluster/scheduler failed

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix return err

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* log inconsistent task info

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-03 22:03:25 +08:00
bigsheeper
4123deef9e
Return error message in grpc.LoadSegment in query node (#6908)
* return load error

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* init streaming meta in loadSegment

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* fix excluded init

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

* improve impl

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-03 22:01:27 +08:00
quicksilver
64bdfa7481
Set etcd log level to debug in e2e test (#6974)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-03 21:57:24 +08:00
xige-16
09199170a4
sync call querycoord releaseXXXX (#6978)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-03 21:47:24 +08:00
zhuwenxing
5260160679
Change flush way (#6972)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2021-08-03 17:09:25 +08:00
LocoRichard
80528f53e2
[skip ci] Fix img link (#6970)
* [skip ci] update img link

Signed-off-by: LocoRichard <lichen.wang@zilliz.com>

* [skip ci] update img link

Signed-off-by: LocoRichard <lichen.wang@zilliz.com>
2021-08-03 15:19:24 +08:00
quicksilver
4e27571451
[skip ci] Wipe any etcd data when Jenkins CI cleanup stage (#6968)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-03 15:13:24 +08:00
quicksilver
27726e921d
[skip ci] Jenkins badge down in README.md and README_CN.md (#6966)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-08-03 15:05:24 +08:00
yanliang567
a07b05710d
Add timeout to 20s by default in ci test wrapper (#6961)
* Init num_entities before loop

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>

* [skip ci] Add new tests for L3

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>

* [skip ci]Add timeout to 20s in base wrapper

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2021-08-03 11:01:25 +08:00
ThreadDao
ae1f977b5c
fix cases for query output support binary (#6945)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-08-03 10:59:24 +08:00