Commit Graph

14612 Commits

Author SHA1 Message Date
Xiaofan
337ad53613
Support config small index nprobe and nlist (#16731)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-05 09:49:50 +08:00
cai.zhang
2be46a01c0
Reduce the number of retries and add error log (#16754)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-05-05 09:31:51 +08:00
jaime
c25b337c36
Remove AddTenant from meta table (#16717)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-05-05 09:23:51 +08:00
sre-ci-robot
0b5a593d69 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-05-04 12:01:02 +00:00
Chenglong.li
a3fc596fb3
[skip e2e]Change insight to Attu in Readme (#16766)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2022-05-04 19:13:51 +08:00
Eng Zer Jun
5375161777
test: use T.TempDir to create temporary test directory (#16758)
This commit replaces `ioutil.TempDir` with `t.TempDir` in tests. The
directory created by `t.TempDir` is automatically removed when the test
and all its subtests complete.

Prior to this commit, temporary directory created using `ioutil.TempDir`
needs to be removed manually by calling `os.RemoveAll`, which is omitted
in some tests. The error handling boilerplate e.g.
	defer func() {
		if err := os.RemoveAll(dir); err != nil {
			t.Fatal(err)
		}
	}
is also tedious, but `t.TempDir` handles this for us nicely.

Fixes: #16759
Reference: https://pkg.go.dev/testing#T.TempDir
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2022-05-04 11:35:50 +08:00
Cai Yudong
21a1311f66
Merge utils/Utils.h into common/Utils.h (#16762)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-05-03 12:05:50 +08:00
Cai Yudong
6a62ff18bf
Support easylogging config for segcore and knowhere (#16751)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-05-03 08:39:49 +08:00
Cai Yudong
d5db4ae463
Merge utils/Types.h with common/Types.h (#16445)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-05-02 22:21:51 +08:00
sre-ci-robot
16f8539ee1 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-04-29 12:00:46 +00:00
bigsheeper
1a29337e6b
Print unflushed segmentIDs instead of whole SegmentInfo (#16301)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-04-29 19:13:47 +08:00
bigsheeper
f18b3c44ee
Print msgID instead of msg (#16268)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-04-29 19:11:47 +08:00
cai.zhang
6440c0dd98
Add log for getting IndexNode's mertrics (#16747)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-04-29 19:07:47 +08:00
ThreadDao
38280698ff
[test] Update load multi replicas cases (#16727)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-04-29 18:57:47 +08:00
congqixia
9e09434a4b
Remove not used QueryService in querynode (#16735)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-29 18:15:48 +08:00
Jiquan Long
2fe8677cbf
Enable dimension check in Proxy when create index request received (#16718)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-04-29 18:01:49 +08:00
jaime
bb9ccbb7e2
Use a singleton kafka producer (#16739)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-04-29 17:29:47 +08:00
Letian Jiang
5b2b917987
Benchmark go/cgo parquet payload readers (#16736)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-29 15:59:47 +08:00
yah01
7dfab0aa13
Add unit test for case of failed to sync segments to shard leader (#16712)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-29 15:51:49 +08:00
zhenshan.cao
97757405de
Fix bug: wrong metrics name and forget to register metrics (#16714)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-04-29 15:35:47 +08:00
yah01
93416d5524
Fix LoadBalance loads the same segment multiple times (#16734)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-29 15:19:47 +08:00
shaoyue
2f49db9d3c
Implements remaining rest APIs (#16387)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-04-29 15:15:47 +08:00
yah01
415a0e5978
Fix miss segments/DmChannel when query by nodeID (#16719)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-29 14:11:47 +08:00
Letian Jiang
a38c84e7e7
Lock meta-replica during search/query (#16703)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-29 13:37:47 +08:00
xige-16
515d0369de
Support string type in segcore (#16546)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
2022-04-29 13:35:49 +08:00
Jade Flute
9537394971
Add Milvus Log to issue template (#16425) (#16676)
Signed-off-by: zhangdiandian <1635468471@qq.com>
2022-04-29 11:34:32 +08:00
zhuwenxing
61f50122ca
[skip e2e]Add tasks to check compatibility (#16710)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-04-29 09:17:48 +08:00
binbin
222112d98a
Enable and modify test cases after code fix (#16720)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-04-29 09:11:47 +08:00
jaime
68b1b82faf
Remove DataKV interface (#16692)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-04-28 21:03:47 +08:00
groot
21b5973253
Refine list import task api (#16690)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-04-28 17:21:47 +08:00
jaime
2205b878b1
Refine log in query_shard.go (#16693)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-04-28 17:13:48 +08:00
jingkl
f07e0eb8da
[test]Modify the search testcase (#16709)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-04-28 17:09:48 +08:00
yah01
206b554d49
Sync the distribution of segments to shard leaders (#16685)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-28 16:01:48 +08:00
Xiaofan
ed51ffd50f
Fix Compact Entity ttl param (#16665)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-28 11:51:47 +08:00
jaime
c0a73dbe98
Using a temporary dir instead of a specified dir within embed etcd test (#16694)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-04-28 11:17:47 +08:00
yah01
7017756601
Validate the number of replicas for load collection/partitions request (#16697)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-28 10:54:00 +08:00
zhenshan.cao
0a953948af
Simplify monitoring metrics (#16687)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-04-27 23:03:47 +08:00
congqixia
3a6db2faeb
Fix handling segment change logic (#16695)
Dispatch segmentChangeInfo to ShardCluster leader
Hold segment remove before search is done

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-27 22:23:46 +08:00
yah01
bb6cd4b484
Disable the unit test for the case of filter out unavailable leaders of GetShardLeaders (#16688)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-27 22:15:47 +08:00
Xiaofan
be5d1f1243
Fix Datacoord ut when etcd is slow (#16689)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-27 21:49:47 +08:00
ThreadDao
aed819d06d
[test] Update load multi replicas cases (#16681)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-04-27 21:23:46 +08:00
xiyichan
056fd9aa17
Correct wrong words (#16490)
Signed-off-by: chenlifeng <chenlifeng0995@wezhuiyi.com>

Co-authored-by: chenlifeng <chenlifeng0995@wezhuiyi.com>
2022-04-27 19:51:46 +08:00
Letian Jiang
2879796b42
Validate partitionIDs & segmentIDs in query request (#16684)
* check partitions if they are released or unloaded
    * check segments if their collection/partition(s) are released or unloaded

Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-27 19:23:48 +08:00
XuanYang-cn
35b7267edb
Add ut for task_policies (#16663)
See also: #16652

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-04-27 16:55:46 +08:00
yah01
68ef720d6b
Filter out the unavailable shard leaders (#16677)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-27 16:27:46 +08:00
congqixia
0bf176a7e1
Add SyncReplicaSegments interface for QueryNode (#16672)
Add SyncReplicaSegments for LoadCollection/LoadPartition child task
This API notifies related ShardCluster to record segment Loaded
Preventing the Etcd events is delayed, which will cause some segment not search

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-27 10:41:46 +08:00
Xiaofan
b657b10eb5
Remove useless log (#16624)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-27 10:01:47 +08:00
zhuwenxing
337338685a
[test]Add test case for multi replicase (#16668)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-04-26 18:35:45 +08:00
yah01
60f7fef3b3
Remove offline nodes from replica info after LoadBalanceTask done (#16653)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-26 18:23:46 +08:00
zhenshan.cao
a3f7bb5f2d
Remove the collectionID label from metrics (#16571)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-04-26 17:29:45 +08:00