Commit Graph

14459 Commits

Author SHA1 Message Date
Jiquan Long
3219b4e392
Skip dimension check for scalar index (#16257)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-29 15:35:27 +08:00
Cai Yudong
1160693e4c
Fix centos build error (#16251)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-29 15:13:30 +08:00
aakejiang
de70dfe0c3
refine log (#16256)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-03-29 15:05:27 +08:00
congqixia
91d5436807
Improve log level and param function in QueryCollection (#16254)
Use debug level for all debug information
Use specific parameter function for appliable ones

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-29 12:31:27 +08:00
sre-ci-robot
1edc8970fd
Update Builder image changes (#16250)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-03-29 10:39:27 +08:00
zhenshan.cao
11cea5aad0
Refine proxy log (#16246)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-29 02:29:27 +08:00
Cai Yudong
2ac53c89e9
Revert #16242 (#16247)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-29 00:53:27 +08:00
XuanYang-cn
23b3a9ed8a
Log state in datanode handleWatchInfo (#16231)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-29 00:15:28 +08:00
Cai Yudong
9a6b2b8806
Fix centos build error (#16242)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-28 23:23:27 +08:00
bigsheeper
9d673006e0
Improve primary keys print (#16232)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-28 23:15:27 +08:00
xige-16
d2424fc50a
Print msgID instead of loadInfo when load segment (#16238)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-03-28 23:13:27 +08:00
congqixia
2c03287e79
Improve log level in proxy QueryTask (#16234)
Use warn instead of debug in error case

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-28 23:11:26 +08:00
XuanYang-cn
a77dd1034c
Adopt the extended state in DataCoord (#16200)
ChannelWatchInfo with ToWatch, ToRelease will trigger a timer.
ChannelManager now reacts to different ChannelWatch states.

- WatchSuccess > log this info

- WatchFailure/WatchTimeout > ToRelease

- ReleaseSuccess > Delete, reassign if not from DropCollection

- ReleaseFailure/ReleaseTimeout > Cleanup subscription and Delete,
  reassgin if not from DropCollection.

Some Notes:
1. Reassignment will add this channel to buffer if there's only one node.

See also: #15846

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-28 22:33:27 +08:00
Jenny Li
3936637e2e
[skip e2e]Fix robot fight (#16239)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-03-28 22:14:18 +08:00
Jiquan Long
973ea406ca
Improve log of show collections (#16233)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-28 21:47:27 +08:00
Jiquan Long
3353da7c94
Add m4 and autoconf to builder image (#16228)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-28 21:29:27 +08:00
cai.zhang
c8688a6275
Organize log for GetIndexFilePaths (#16230)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-28 21:27:27 +08:00
Jenny Li
6ac1415eac
[skip e2e]Add url for issue also (#16215)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-03-28 21:25:31 +08:00
sre-ci-robot
a5cd2970fc
Update Builder image changes (#16207)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-03-28 18:09:26 +08:00
Ji Bin
4f08f6d8c6
Workaround for knowhere under windows (#16214)
issue #16205

Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-28 17:41:27 +08:00
sre-ci-robot
1cebf13b5f
Update Pytest image changes (#16223)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-03-28 17:31:27 +08:00
yah01
178eb8cce1
Modify proto to support replicas (#16218)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-28 16:43:27 +08:00
Ten Thousand Leaves
40c703dacd
Support check index state in root coord, for bulk load feature. (#16198)
issue: #15604

/kind feature

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-28 16:41:28 +08:00
zhuwenxing
974371c06c
[test]Add performance monitor for ApiCollectionWrapper (#16221)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-03-28 16:25:27 +08:00
Bingyi Sun
e0ffe54547
Add interface to get replications by collection ID (#16213)
issue: #16158
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-03-28 14:35:27 +08:00
Cai Yudong
3e3756d3dc
Upgrade to knowhere v1.1.1 to support Mac M1 build (#16210)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-28 14:33:26 +08:00
zhuwenxing
4ad89df014
[skip e2e]Fix deploy config (#16206)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-03-28 10:17:26 +08:00
Jiquan Long
9cf96abbd3
Add libtool to builder image (#16194)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-28 10:11:26 +08:00
godchen
478f6ca11e
Add cache for vector chunk (#15912)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-03-26 22:05:26 +08:00
zhuwenxing
25ac724d55
[skip e2e]Add more check step in jenkins pipline (#16188)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-03-25 14:35:25 +08:00
sre-ci-robot
54bae78130
Update Pytest image changes (#16187)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-03-25 14:33:29 +08:00
Xiaofan
f434e99c0a
Update README.md 2022-03-25 14:28:04 +08:00
xige-16
205c92e54b
Support insert string data (#15993)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-03-25 14:27:25 +08:00
yah01
227889b0d0
Add replica interfaces for Meta and Cluster (#16190)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-25 14:03:25 +08:00
Cai Yudong
f4ebd3a9ce
Upgrade to knowhere v1.1.0 (#16186)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-25 13:49:25 +08:00
XuanYang-cn
a00968fdfe
Fix unregister in datacoord cluster (#16182)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-25 12:09:25 +08:00
yah01
0d16ecf0dd
Add protobuf messages to support multi memory replica (#16153)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-25 11:13:25 +08:00
Ten Thousand Leaves
a23ca745bb
Add Etcd support for Import Tasks. (#16164)
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-25 11:03:25 +08:00
jingkl
ed9d3c32ff
[test]Modify the testcase with collection (#16184)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-03-25 09:23:25 +08:00
zhuwenxing
0524802648
[skip e2e]Fix deploy config (#16185)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-03-24 21:19:25 +08:00
bigsheeper
2fcf7b9760
Fix GetMemoryCount, get min as total memory (#15931)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-24 20:41:25 +08:00
yah01
9deb245d77
Fix data race in unittest (#16165)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-24 20:19:25 +08:00
bigsheeper
7fee4743f5
Improve log print in OOM error info (#16170)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-24 20:17:25 +08:00
sre-ci-robot
92b5436bbd Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-03-24 12:01:02 +00:00
Jiquan Long
48706f416f
Migrate scalar index from knowhere (#16174)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-24 14:57:26 +08:00
congqixia
661469445c
Copy index file content to c memory (#16162)
Might be the root cause of #15896
The index content bytes were passed via unsafe.Pointer,
which shall be copy to cpp managed memory inmediately

This solution might cause a lot of memory consumption.
Maybe we need to store the index bytes in cpp memory in the first place.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-24 14:55:25 +08:00
yah01
63a71e247a
Loading segments concurrency level fallbacks to the value that won't cause OOM (#16172)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-24 13:39:25 +08:00
xiyichan
ca129d4308
Support configurable msgstream (#16131)
Signed-off-by: xiyichan <2863768433@qq.com>
2022-03-24 10:15:25 +08:00
groot
478890a700
modify import proto (#16155)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-23 19:29:25 +08:00
Letian Jiang
321105cc01
Add column-based insert interface in segcore (#16100)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-23 19:05:25 +08:00