Xiaofan
89b4a34892
Fix Data race in NodeID ( #16603 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-24 22:03:44 +08:00
congqixia
bd29518b6e
Remove debug log with no meaning ( #16583 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-22 13:11:42 +08:00
congqixia
6de1d223a6
Remove debug log in querynode segment/node detector ( #16572 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-22 11:07:42 +08:00
congqixia
69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord ( #16470 )
...
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-20 16:15:41 +08:00
codeman
4e12271d79
Support login with username and password ( #15656 ) ( #16341 )
...
Signed-off-by: kejiang <ke.jiang@zilliz.com>
Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-04-11 19:49:34 +08:00
Cai Yudong
71cd7ba67a
Add configuration common.indexSliceSize ( #16438 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-04-08 20:29:33 +08:00
xige-16
27b4cbc098
Cherry pick remove translateHits commit to mater ( #16436 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-04-08 20:27:31 +08:00
godchen
bb7a0766fe
Add dependency factory ( #16204 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-04-07 22:05:32 +08:00
congqixia
4cb7c28bfa
Fix ReplicaInfo package name ( #16400 )
...
Fix #16399
PR 16373 breaks the build after ReplicaInfo moved from querypb to milvuspb
Also fix problem in Makefile
Limit action/setup-go version to ~1.17.1(>=1.17.1 <1.18.0)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-06 19:47:31 +08:00
congqixia
18d76261a0
Add ShardNodeDetector implementation ( #16373 )
...
Use etcd as a ShardNodeDetector
Unit tests is based on embedded etcd
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-06 15:43:31 +08:00
bigsheeper
2b27fa4609
Print numTimestamps instead of Timestamps ( #16369 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-04-06 14:47:31 +08:00
bigsheeper
4f4a417c8f
Unify in log print ( #16368 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-04-06 14:09:35 +08:00
Letian Jiang
09b90fd8bf
Fix QueryCollection retrieve unit test ( #16376 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-04 21:07:30 +08:00
xige-16
99984b88e1
Support delete varChar value ( #16229 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-04-02 17:43:29 +08:00
congqixia
aa1c26de77
Add ShardCluster implementation ( #16360 )
...
ShardCluster maintains shard replica meta information
It watches node & segment change events
Provides shard replica search/query services
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-02 17:35:29 +08:00
Letian Jiang
028c5cb882
Modify grpc interface for replica Search/Query in QueryNode ( #16326 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-02 14:15:31 +08:00
congqixia
7a44fff8cd
Use fmt.Errorf instead of string concat in tsafe_replica ( #16344 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-01 18:37:28 +08:00
Letian Jiang
cb65860e22
Add implementation for QueryShardService ( #16317 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-04-01 14:19:29 +08:00
Letian Jiang
ad9a2217ae
Add interface for QueryShardService and QueryShard ( #16309 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-31 14:05:28 +08:00
congqixia
899638810a
Add error log when tsafe register watcher more than once ( #16294 )
...
Add some test case to cover the error case
Add log in error branch
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-30 22:07:28 +08:00
Jiquan Long
ba37531456
Add support for loading multiple indexes ( #16138 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-30 21:11:28 +08:00
Cai Yudong
5a9e1af3bb
Update create plan CGO interface ( #16271 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-30 17:13:27 +08:00
congqixia
18a3e9f265
Add grpc interface for replica Search/Query in QueryNode ( #16197 )
...
Resolves #16195
Add Search and Query grpc interface in query proto and types/types.go
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-30 12:03:27 +08:00
jaime
d5d6e115bd
Refine delete segment data log ( #16241 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-29 18:41:27 +08:00
congqixia
91d5436807
Improve log level and param function in QueryCollection ( #16254 )
...
Use debug level for all debug information
Use specific parameter function for appliable ones
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-29 12:31:27 +08:00
bigsheeper
9d673006e0
Improve primary keys print ( #16232 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-28 23:15:27 +08:00
xige-16
d2424fc50a
Print msgID instead of loadInfo when load segment ( #16238 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-03-28 23:13:27 +08:00
godchen
478f6ca11e
Add cache for vector chunk ( #15912 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-03-26 22:05:26 +08:00
xige-16
205c92e54b
Support insert string data ( #15993 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-03-25 14:27:25 +08:00
bigsheeper
7fee4743f5
Improve log print in OOM error info ( #16170 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-24 20:17:25 +08:00
yah01
63a71e247a
Loading segments concurrency level fallbacks to the value that won't cause OOM ( #16172 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-24 13:39:25 +08:00
xiyichan
ca129d4308
Support configurable msgstream ( #16131 )
...
Signed-off-by: xiyichan <2863768433@qq.com>
2022-03-24 10:15:25 +08:00
Jiquan Long
f8d9bc919d
Unify interface of vector index & scalar index. ( #15959 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-21 14:23:24 +08:00
yah01
31c5b286da
Fix wrong unittest, check whether loading collection will cause OOM ( #16068 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-18 13:17:22 +08:00
godchen
78557ca6d7
Replace minio kv with minio chunk manager ( #15936 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-03-17 18:03:23 +08:00
Ji Bin
3cd28420f1
Support compile under windows ( #15786 )
...
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
* using gofrs/flock instead of syscall.Flock
* using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`
issue #7706
Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
Jiquan Long
ffdad82b9c
Set load info in reschedule tasks ( #16065 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-16 11:43:21 +08:00
zhenshan.cao
f3eeecf146
Reduce the number of metrics ( #16030 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-15 21:51:21 +08:00
congqixia
b61e8201e7
Refactor querynode historical replica ( #15992 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-15 19:15:20 +08:00
jaime
97b1ed7bca
Remove reader API from Mqstream and replace it with consumer API ( #15971 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-15 14:45:22 +08:00
bigsheeper
caf9cbfcd4
Fix load failure and remove parition release related code ( #16038 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-14 23:18:02 +08:00
congqixia
6a66faa2fb
Explictly specify Load operation meta ( #16027 )
...
Fix #15996
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-14 09:50:01 +08:00
jaime
29975a7a26
Remove Consume() API from mqstream interface ( #15886 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-11 20:09:59 +08:00
yah01
4f3d5fb6eb
Make load operation parallel improve performance ( #15928 )
...
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-11 14:28:01 +08:00
bigsheeper
9ad5c14a4a
Return error when create message stream failed in QueryNode ( #15317 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-09 15:17:59 +08:00
顾炎
4f8c08f912
fix checkSegmentSize overflows int64 ( #15858 )
...
Signed-off-by: guyan <632722781@qq.com>
2022-03-09 13:29:58 +08:00
zhenshan.cao
dff08dbf47
Refactor querynode unittest ( #15929 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-08 17:39:58 +08:00
bigsheeper
6fec7ed6fb
Add search benchmark in QueryNode ( #15854 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-08 10:15:59 +08:00
Jiquan Long
f71651e294
Support column-based insert data in message stream ( #15802 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-04 15:09:56 +08:00
Cai Yudong
3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig ( #15843 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-04 11:17:56 +08:00