Letian Jiang
09b90fd8bf
Fix QueryCollection retrieve unit test ( #16376 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-04 21:07:30 +08:00
Ten Thousand Leaves
2bd0a9526a
Implement task expiring logic and make all deadlines configurable. ( #16355 )
...
/kind feature
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-03 11:37:29 +08:00
groot
be8d9a8b6b
Support import numpy file ( #16348 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-04-03 11:27:29 +08:00
sre-ci-robot
6682d1b635
Update all contributors
...
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-04-02 12:00:51 +00:00
xige-16
99984b88e1
Support delete varChar value ( #16229 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-04-02 17:43:29 +08:00
congqixia
aa1c26de77
Add ShardCluster implementation ( #16360 )
...
ShardCluster maintains shard replica meta information
It watches node & segment change events
Provides shard replica search/query services
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-02 17:35:29 +08:00
edward.zeng
573eed5bd3
Bump milvus version to v2.0.2 ( #16358 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-04-02 16:00:31 +08:00
Letian Jiang
028c5cb882
Modify grpc interface for replica Search/Query in QueryNode ( #16326 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-02 14:15:31 +08:00
Xiaofan
7f7379d55f
Fix DML channel AsProducer after Close ( #16352 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-02 13:09:29 +08:00
XuanYang-cn
5494f3c318
Remove offLineNodes from watch states check ( #16347 )
...
This PR also
- adds more information in log
- makes Session able to logged by zap.Any/zap.String
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-04-01 22:33:29 +08:00
Jenny Li
7303036c19
[skip e2e]Update issue example into #<xyx> ( #16350 )
...
Use real issue example will combine too many pr metioned make the pr author annoying
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-04-01 21:33:29 +08:00
congqixia
6111dcde52
Fix ticker leakage in datanode flowgraph ( #16346 )
...
Using in case ticker need to be closed may cause leakage
Use time.NewTicker with deferred Stop instead
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-01 19:35:29 +08:00
XuanYang-cn
e9090a62ab
Rearrange search/queryTask for readability ( #16325 )
...
`searchTask` has 683 lines of code, `queryTask` has 485 lines of code.
`task.go` contains 4k+ codes including `searchTask` and `queryTask`.
It was so much pain navigating codes of searchTask and queryTask though task.go,
task.go and task_test.go are literaly unreadable.
This PR moves
1. 650+ lines of code of `searchTask` from `task.go` to `task_search.go`.
2. 1.4k+ lines of test code of `searchTask` from `task_test.go` to
`task_search_test.go`.
3. 450+ lines of code of `queryTask` from `task.go` to `task_query.go`.
4. 200+ lines of test code of `queryTask from `task_test.go to
`task_query_test.go`.
This PR also rearrange methods positions of `searchTask` and
`queryTask`:
- Putting the most important methods `PreExecute`, `Execute`, and
`PosExecute` at the beginning of the file.
- Moves interface methods `ID`, `SetID`, `Type`, `BeginTs`, etc.
that nobody cares about to the bottom of the file.
See also: #16298
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-04-01 18:59:29 +08:00
congqixia
7a44fff8cd
Use fmt.Errorf instead of string concat in tsafe_replica ( #16344 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-01 18:37:28 +08:00
yah01
c005f07ccc
Modify proto to add GetReplicas() interface ( #16328 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-04-01 16:15:29 +08:00
Jiquan Long
fd589baca7
Integrates marisa trie index ( #16192 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-04-01 15:31:29 +08:00
Jenny Li
8b0f260b05
[skip e2e] Add commit-id after date ( #16316 )
...
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-04-01 14:25:29 +08:00
Letian Jiang
cb65860e22
Add implementation for QueryShardService ( #16317 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-01 14:19:29 +08:00
zhuwenxing
0c2fc2721e
[skip e2e]Update deploy test github action ( #16340 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-04-01 14:09:29 +08:00
Ten Thousand Leaves
45be3deb3f
Implement RC, DC, DN calling path for import. ( #16321 )
...
/kind feature
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-01 11:33:28 +08:00
congqixia
376a7f6567
Fix Datacoord unsubAttempt using pchannel ( #16337 )
...
Fix the channel name used when Datacoord unsub for DataNode
This channel shall always be pChannel instead of vChannel
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-01 11:25:28 +08:00
groot
bd241cd28b
Add performance test case for import ( #16296 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-04-01 10:07:28 +08:00
zhenshan.cao
b03da87df5
Accelerate query speed in sealed segment ( #16287 )
...
Fix delete duplicate key
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-31 17:33:28 +08:00
XuanYang-cn
58addbf9f4
Add GetShardLeaders rpc in querycoord proto ( #16299 )
...
See also: #16298
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-31 16:39:29 +08:00
Jenny Li
e20385c817
[skip e2e] Update mergify rule for adding centos7 ( #16319 )
...
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-03-31 15:19:28 +08:00
congqixia
f529f8c1fc
Use fmt.Errorf instead of str concat in func.go ( #16315 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-31 15:03:28 +08:00
Jenny Li
56c0ea9b1d
[skip e2e] Add centos build ( #16264 )
...
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-03-31 14:49:28 +08:00
Letian Jiang
ad9a2217ae
Add interface for QueryShardService and QueryShard ( #16309 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-31 14:05:28 +08:00
Ten Thousand Leaves
0d54697d42
Implement ReportImport related logic. ( #16312 )
...
/kind feature
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-31 13:51:28 +08:00
Bingyi Sun
baa745b83e
Improve log ( #16307 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-03-31 11:33:28 +08:00
aakejiang
30be20e357
correct DEVELOPMENT.md ( #16302 )
...
Signed-off-by: kejiang <ke.jiang@zilliz.com>
Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-03-31 09:21:28 +08:00
zhuwenxing
fd3ef9b11b
[skip e2e]Update deploy test script ( #16280 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-03-31 09:19:32 +08:00
Bingyi Sun
40fab91448
improve log ( #16236 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-03-30 23:05:28 +08:00
XuanYang-cn
a0bb758be5
Refine log in proxy searchTask ( #16263 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-30 22:09:28 +08:00
congqixia
899638810a
Add error log when tsafe register watcher more than once ( #16294 )
...
Add some test case to cover the error case
Add log in error branch
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-30 22:07:28 +08:00
Jiquan Long
ba37531456
Add support for loading multiple indexes ( #16138 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-30 21:11:28 +08:00
yah01
0f53989f17
Modify proto to support replicas ( #16289 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-30 17:57:28 +08:00
Cai Yudong
5a9e1af3bb
Update create plan CGO interface ( #16271 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-30 17:13:27 +08:00
groot
ffa06c77b6
Import util functions ( #16237 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-30 16:25:30 +08:00
Xiaofan
801eeffbcc
Replace cgo parquet reader to go parquet reader ( #16199 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-30 15:21:28 +08:00
congqixia
18a3e9f265
Add grpc interface for replica Search/Query in QueryNode ( #16197 )
...
Resolves #16195
Add Search and Query grpc interface in query proto and types/types.go
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-30 12:03:27 +08:00
Xiaofan
b6b3c9863c
Fix incompatibility of stats log ( #16277 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-30 10:15:28 +08:00
Cai Yudong
0baa8c60a5
Fix MinGW build error ( #16267 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-30 00:15:27 +08:00
Jiquan Long
cd0f3cbcd3
Refine log ( #16269 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-29 22:43:28 +08:00
cai.zhang
e2e345079f
Add indexMeta version for IndexCoord log ( #16266 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-29 21:03:27 +08:00
sre-ci-robot
a887d81136
Update all contributors
...
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-03-29 12:13:27 +00:00
Jiquan Long
70c10d4a16
Add automake to builder image ( #16260 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-29 20:07:29 +08:00
jaime
d5d6e115bd
Refine delete segment data log ( #16241 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-29 18:41:27 +08:00
zhuwenxing
d96508892d
[skip e2e]Add deploy test jenkins file ( #16261 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-03-29 18:23:30 +08:00
Jenny Li
4d1fee87a2
[skip e2e]Add CMakeLists.txt as code changed ( #16249 )
...
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-03-29 17:05:27 +08:00