Commit Graph

101 Commits

Author SHA1 Message Date
yah01
20936f78da
Fix LoadBalance failed to sync segments to shard leader when the leader is offline (#16770)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-05 16:25:50 +08:00
Xiaofan
c1ff0cec8f
Change QueryCoord Log level (#16590)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-26 11:29:54 +08:00
Ten Thousand Leaves
4ef2df8cb9
Fix an issue where query coord calls MinioChunkManager during init (#16629)
It causes Milvus not runnable with local storage.

issue: #15604

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-25 11:11:46 +08:00
Xiaofan
89b4a34892
Fix Data race in NodeID (#16603)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-24 22:03:44 +08:00
congqixia
69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord (#16470)
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-20 16:15:41 +08:00
jaime
ed3c29eae7
Support Kafka (#16149)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-04-12 19:47:33 +08:00
godchen
bb7a0766fe
Add dependency factory (#16204)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-04-07 22:05:32 +08:00
Bingyi Sun
baa745b83e
Improve log (#16307)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-03-31 11:33:28 +08:00
Bingyi Sun
40fab91448
improve log (#16236)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-03-30 23:05:28 +08:00
xiyichan
ca129d4308
Support configurable msgstream (#16131)
Signed-off-by: xiyichan <2863768433@qq.com>
2022-03-24 10:15:25 +08:00
XuanYang-cn
ad41e2a082
Tidy getQueryChannel for readability (#16096)
- Remove useless codes in query_coord.go
- Tidy slice initialization in LoadCollection task
- Add ut for getQueryChannel

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-21 11:25:24 +08:00
XuanYang-cn
15a3fe41c5
[skip e2e]Fix comments of exposed functions in QC (#16094)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-21 11:17:24 +08:00
godchen
78557ca6d7
Replace minio kv with minio chunk manager (#15936)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-03-17 18:03:23 +08:00
Ji Bin
3cd28420f1
Support compile under windows (#15786)
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
Cai Yudong
3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig (#15843)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-04 11:17:56 +08:00
jaime
7a3a721380
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
congqixia
c7f55c2e34
Make SessionWatch keep watch even no Rewatch func when find ErrCompacted (#15497)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-15 15:07:48 +08:00
xige-16
55cdc5aa35
Get indexInfo and segment size by queryCoord (#14207)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-02-08 21:57:46 +08:00
Cai Yudong
1f337891e1
Rename base_param to service_param, rename global_param to component_param (#15463)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-08 20:57:47 +08:00
Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
Cai Yudong
4bccc85534
Use MsgChannelConfig in GlobalParams for all components (#15163)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-02 00:35:43 +08:00
xige-16
6336e2326c
Set triggerCondition when queryCoord reload loadbalanceTask meta (#15380)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-25 17:26:13 +08:00
xige-16
dfc6670f0f
Unsubscribe channel after query node down (#15230)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-17 17:37:37 +08:00
Cai Yudong
7efb02a4c5
Use PulsarConfig in GlobalParams for all components (#15046)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-09 23:45:33 +08:00
Cai Yudong
f8f61fb116
Use BaseParams etcd configuration for all components (#15012)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
shaoyue
545ff88f9d
[skip e2e] Add comment for querycoord param (#14989)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-01-07 13:31:22 +08:00
guoxiangzhou
4403429705
[skip e2e] Modify log text according to the naming conventions (#14971)
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
2022-01-07 13:11:28 +08:00
xige-16
b063bfda8f
Add index info in loadSegmentRequest (#14524)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-30 19:09:33 +08:00
Xiaofan
69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
Jiquan Long
73c5653c76
Fix close querycoord panic (#14239)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-25 17:52:17 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
jaime
2524fbd1e8
[skip e2e] Fix grammar mistake in query_coord (#13918)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-21 21:55:12 +08:00
xige-16
11c8461c11
Refactor dmChannelWatchInfo to queryCoord meta (#13543)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-21 11:57:39 +08:00
xige-16
7e0c772d64
[skip e2e]Fix golint for log QueryNode (#13672)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-17 22:30:46 +08:00
xige-16
a965bdf325
[skip e2e]Fix golint for log QueryNode (#13671)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-17 22:26:50 +08:00
Xiaofan
b8d3808052
Fix Query Coord UT and cleanup logic (#13618)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-17 21:30:42 +08:00
xige-16
5864e5ea47
[skip ci] Fix golint for querycoord init (#13549)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-16 22:39:15 +08:00
xige-16
8259f81ae6
[skip ci] Fix golint for loadBalanceSegmentLoop (#13548)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-16 22:37:34 +08:00
xige-16
8f0b3ccd08
[skip ci] Fix golint for QueryNode (#13547)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-16 22:35:38 +08:00
xige-16
cf82a248d5
[skip ci]Fix golint for QueryNode (#13468)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-16 19:57:14 +08:00
xige-16
b404138ba7
[skip ci]Fix golint for chooseSegmentToBalance (#13303)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 22:19:10 +08:00
xige-16
7c18be6e08
[skip ci]Fix golint for loadBalanceSegmentLoop (#13302)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 21:01:10 +08:00
xige-16
97d5231a0a
Reorganize querycoord proto (#13181)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 16:53:12 +08:00
cai.zhang
9f23fc7f2a
Register the service when the component state is healthy (#13248)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
xige-16
c68bae236e
[skip ci]Fix golint for watchHandoffSegmentLoop (#13301)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 07:01:09 +08:00
Xiangyu Wang
405b3cd932
Use the same lint rules with golint in revive (#13324)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
xige-16
9ccbffc4b1
[skip ci]Fix golint for watchNodeLoop (#13199)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-10 21:55:48 +08:00
xige-16
f85c1e8f1e
[skip ci]Fix golint for SetIndexCoord (#13198)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-10 21:54:01 +08:00
xige-16
63ead50544
[skip ci]fix golint for SetDataCoord (#13121)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-09 22:25:08 +08:00
xige-16
60d70e82fd
[skip ci]fix golint for SetRootCoord (#13120)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-09 22:23:22 +08:00